MGMLaboratory
Back

Menu

01Home
02About Us
03Projects
04Publications
05Member
06Articles
07Contact

Let's Talk

Open in Mail app

Socials

Malang (ID) --:--Privacy PolicyTerms of Service

January 1, 20182 min read

A Phone That Listens While You Learn to SpeakA Phone That Listens While You Learn to Speak

Treating the microphone as an input changes what a language app can ask of a learner, and what it must get right.

  • Conference
  • Publications

Written by

  • SRShirasaka RenIT & Infrastructure · Student Member

In this article

  1. 01What speaking input changes
  2. 02The engineering questions it opens
  3. 03Where the idea points

Learning to speak a language alone is awkward. There is nobody to answer, and nobody to tell you that your pronunciation drifted three sentences ago. A microphone changes that arrangement, because the phone can play both roles.

Self study asks the learner to be their own critic. Photo: Rexdanato, CC BY-SA 4.0, via Wikimedia Commons.
Fig. 01Self study asks the learner to be their own critic. Photo: Rexdanato, CC BY-SA 4.0, via Wikimedia Commons.

01/03

What speaking input changes

Reading and writing give immediate feedback on the screen. Speaking gives none unless the app listens, so learners quietly avoid it and spend their practice time on the skills that already respond. Adding a microphone rebalances the app toward the skill that needs the most repetition.

  • Repeating a phrase becomes a two way exchange instead of a silent exercise.
  • A learner can compare their own attempt against a native model.
  • Speaking practice moves into the spare minutes of a commute, not only into class.
Course materials for a first year Japanese class. Image: Yoko Sato, CC BY 4.0, via Wikimedia Commons.
Fig. 02Course materials for a first year Japanese class. Image: Yoko Sato, CC BY 4.0, via Wikimedia Commons.

02/03

The engineering questions it opens

The authors framed the work as a feasibility study, which is an honest description of how much remains. Speech recognition has to run well on a mid range Android phone, in a noisy room, for a learner who is still making mistakes. That is a harder speech problem than dictating for someone who is already fluent.

Then comes the feedback loop. Recognising words is not the same as judging pronunciation, and a learner told they are wrong without being told why will simply switch the feature off. The usability result in the paper, 81.0, says the shell works. The hard part is what happens inside it.

Headphones that turn a phone into a listening lab. Photo: Akb48akb, CC BY-SA 3.0, via Wikimedia Commons.
Fig. 03Headphones that turn a phone into a listening lab. Photo: Akb48akb, CC BY-SA 3.0, via Wikimedia Commons.

03/03

Where the idea points

The direction reaches past Japanese. Any skill a phone can hear, whether it is a language, a musical instrument or a physiotherapy routine, can become an interactive drill once the device is allowed to listen. What this paper shows is that the interaction design, not the feature list, is what makes that work.

Source

  1. Brata, K. C., & Brata, A. H. (2018). An Idea of Interactive Japanese Language M-Learning Application to Support Listening and Speaking Exercise. 2018 International Conference on Sustainable Information Engineering and Technology.

    DOI10.1109/SIET.2018.8693149 (opens in a new tab)

Next articleWhy Japanese Learning Apps Skip Speaking(Keep scrolling)(Read it next)(Loading)