Data Conversion¶

Target competencyCan use and teach a scripting language to do data conversion and cleanup.

Why it matters¶

Many times Language Technologists need to assist language workers to clean up their data to make it consistent or to convert their data from one format to another.

Progression¶

Each rung is a level a learner is at; its activities are what carries them to the next one. How to read these levels

General¶

0No Competency

Learn how to do advanced search and replace in text.

Carries a learner to 1 — Has Knowledge
1Has Knowledge

Learn to use a scripting language to replace strings according to context.

Carries a learner to 2 — With Assistance
2With Assistance

Use a scripting language environment to clean up or convert data.

Carries a learner to 3 — Independent
3Independent

Teach and mentor others in the use of a scripting language environment to clean up or convert data.

Carries a learner to 4 — Expert
4Expert

Use a programming language (e.g., Perl or Python) to write more complex data conversion or cleanup routines.

Top of the ladder

Description¶

Knowledge of a scripting language to do data conversion.

Further Information¶

Regular Expressions.info (Jan Goyvaerts)Guide · regular-expressions.infoComprehensive tutorial and reference on regular expression syntax across many tools and languages.
Regex Golf (Game)Site · alf.nuRegex Golf, a puzzle game for practising writing regular expressions.
RegexOne tutorialGuide · regexone.comInteractive step-by-step lessons that teach regular expressions from the basics.
Notepad++ - Regular ExpressionsGuide · npp-user-manual.orgNotepad++ manual section on regular expression syntax for advanced search and replace.
Python DocumentationSite · docs.python.orgOfficial Python documentation hub with the tutorial, library reference and language guides.
Beginner's Guide to PythonGuide · wiki.python.orgPython wiki beginners' guide covering installation, tutorials and learning paths for new programmers.
SIL ConvertersSite · software.sil.orgHome of SIL Converters, tools that change the encoding, font or script of text in Word and other documents.
SIL Converters 4.0Site · scripts.sil.orgArchived page on SIL Converters 4.0, a toolkit for converting text encoding, fonts and scripts in documents.
Learn Python the Hard WaySite · learnpythonthehardway.orgContents and purchase page for Learn Python the Hard Way, a paid exercise-based Python course.
Consistent Changes ProgramSite · software.sil.orgHome of Consistent Changes, a program for finding and changing text consistently across one or many files.