All presentations

Building a Phonics Engine for Automated Text Guidance

Slide 1: Building a Phonics Engine for Automated Text Guidance

Building a Phonics Engine for Automated Text Guidance

The iLearnRW project logo: the word “ilearn” in blue with “RW” in red above a curved line of stars.

Dominik Lukeš

Dyslexia Action

Chris Litsas

NTUA

www.ilearnrw.eu

Original slide 1 (image)

Slide 2: Outline

Outline

  • Struggling readers needs
  • Linguistic background
  • Phonics engine need
  • Phonics engine specification
  • Phonics engine implementation
  • Phonics engine applications
  • Next steps

Original slide 2 (image)

Slide 3: Needs of dyslexic people

Needs of dyslexic people

  • Identifying the syllables in a word
  • Recognising the structure of words (stem, prefix, suffix)
  • Highlighting typical or repeated patterns of English orthography
  • Identifying phoneme/grapheme correspondence
  • Learning the pronunciation of a word
  • Learning the meaning of a word

Original slide 3 (image)

Slide 4: Linguistic background

Linguistic background

Dearest creature in creation
Studying English pronunciation,
I will teach you in my verse
Sounds like corpse, corps, horse and worse.

Though the difference seems little,
We say actual, but victual,
Seat, sweat, chaste, caste, Leigh, eight, height,
Put, nut, granite, and unite.

Gerard Nolst Trenité - The Chaos (1922)

Original slide 4 (image)

Slide 5: Linguistic background

Linguistic background

  • tough, though, through, bough, thought, cough, hiccough
  • hosp.i.tal vs. hos.pit.al
  • kitt.en vs. kit.ten
  • walked, stopped, faked, tried
  • exgirlfriend vs. exigent vs. exit
  • English vs. Greek

Original slide 5 (image)

Slide 6: Phonics engine need

Phonics engine need

  • Finding all examples of ‘a’ spelled to rhyme with ‘hay’ in a text or a corpus.
  • Sorting words by their phoneme/grapheme ratio.
  • Identifying appropriate syllable boundaries in the written form of a multi-syllable word based on knowledge of the syllable boundaries in pronunciation

Original slide 6 (image)

Slide 7: Phonics engine specification

Phonics engine specification

  • provide automated guidance to students and teachers reading texts (using highlighting as well as explicit information)
  • generate more extensive word lists for practice activities within the serious games
  • provide information about word structure to the game engine

Original slide 7 (image)

Slide 8: Phonics engine implementation

Phonics engine implementation

  • Profile of phonic difficulties
  • Annotated phonic dictionary
  • Look up routines

Original slide 8 (image)

Slide 9: Phonics profile - categories

Phonics profile - categories

Based on a modified and expanded version of Dyslexia Action Literacy Programme

  • Consonants (49)
  • Vowels (71)
  • Blends and letter patterns (131)
  • Syllables (13)
  • Suffixes (92)
  • Prefixes (42)
  • Confusing letters (15)

Original slide 9 (image)

Slide 10: Phonics profile (JSON)

Phonics profile (JSON)

{"descriptions":["a-æ"],

"problemType":"LETTER_EQUALS_PHONEME",

"humanReadableDescription":"a=æ (at) <> Pronounce a as æ. For example: at, as, and",

"cluster":3,

"character":"Short vowel"}

Original slide 10 (image)

Slide 11: Phonic dictionary

Phonic dictionary

Word form:feelings
Related stem:feeling
Pronunciation:ˈfiː.lɪŋz
Phoneme/Grapheme Mapping:f-f,ee-iː,l-l,i-ɪ,ng-ŋ,s-z
Orthographic syllabification:fee.lings
Number of letters:8
Number of phonemes:6
Number of syllables:2
Frequency band:4
Suffix type:SUFFIX_ADD
Suffix form:s
Prefix type:PREFIX_NONE
Prefix form:NULL

Original slide 11 (image)

Slide 12: Building the phonic dictionary

Building the phonic dictionary

  • 5,000 most frequent words based on COCA
  • Generated derived forms by reversing hunspell
  • Used online tool to generate pronunciation
  • Create rules for matching pronunciation with spelling patterns
  • Create rules for displaying
  • Mark suffixes and prefixes and types
  • Adjust frequencies
  • Manual fine tuning (lots of regex)

Original slide 12 (image)

Slide 13: Phonics engine applications

Phonics engine applications

  • Phonics aware reader
  • Game support – generating word lists
  • Game support – provide word structure
  • Game support – link word structures to profile
  • Text classification tool
  • Online text annotation tool

Original slide 13 (image)

Slide 14: Phonics aware reader

Phonics aware reader

A word information card for “insects” showing its stem, its syllables “in-sects”, its sounds, and details of its suffix, syllables and vowels, with an OK button.

Original slide 14 (image)

Slide 15: Phonics aware reader

Phonics aware reader

A Highlight Settings panel with a Text Rules list of vowel spellings such as a=æ (at) and e=e (get), each with an ON switch.

Sample text in a large spaced typeface, “time. Fossils tell us that they were alive at the time of the mammoths.”, with some letters in lighter colours.

Original slide 15 (image)

Slide 16: Game support

Game support

A game screen in which the word “unless” is split into the coloured parts “un” and “less” above a scientist character, a clock and a percentage score.

Original slide 16 (image)

Slide 17: Online text tools

Online text tools

A web tool with a profile menu showing “english_profile”, a box of pasted news text, and a Generic Metrics table: for example 186 words, 8 sentences and 5 paragraphs, with an average word length of 5.02 and a Flesch-Kincaid score of 12.76.

Original slide 17 (image)

Slide 18: Online text tools

Online text tools

A web tool showing counts of difficulties under Consonants, Vowels and Blends and Letter Patterns as numbered red circles, and a table of words such as financing, international, analysts, bank and and, with their syllables and phonetic spellings.

Original slide 18 (image)

Slide 19: Online text tools

Online text tools

An iLearnRW web page headed “english_profile, Difficulties List” listing vowel rules such as “iCe=aɪC (time)”, with an Active Rules panel showing the rule “a=æ (at)” and a Paint Problematic Word Parts menu.

Original slide 19 (image)

Slide 20: Online text tools

Online text tools

Two paragraphs of news text about Greece and its creditors in which some letters a are shown in red.

Original slide 20 (image)

Slide 21: Next steps

Next steps

  • Bigger dictionary with more information on words
  • Finetuning of look up routines
  • More sophisticated highlighting routines
  • More sophisticated NLP
    • PoS
    • Sentence structure
    • Semantics
      • WordNet, Framenet
      • Named Entities
      • Collocations

Original slide 21 (image)

Slide 22: www.ilearnrw.eu

www.ilearnrw.eu

Original slide 22 (image)