MGMLaboratory
Back

Menu

01Home
02About Us
03Projects
04Publications
05Member
06Articles
07Contact

Let's Talk

Open in Mail app

Socials

Malang (ID) --:--Privacy PolicyTerms of Service

January 1, 20202 min read

Two Quality Scores That Rarely Move TogetherTwo Quality Scores That Rarely Move Together

A Japanese learning experiment shows why a usable app can still feel cold, and what a design team can do about it.

  • Journal
  • Publications

Written by

  • SRShirasaka RenIT & Infrastructure · Student Member

In this article

  1. 01Pragmatic quality is about finishing the task
  2. 02Hedonic quality is about wanting to come back
  3. 03The caution worth repeating

An app can be easy to use and still leave people flat. Usability research separates that feeling into two measurements: pragmatic quality, which covers getting a task done, and hedonic quality, which covers stimulation, novelty, and how the product makes someone feel. The two do not have to agree.

01/03

Pragmatic quality is about finishing the task

In the Japanese m-learning study, both apps let students complete every learning scenario. On perspicuity, efficiency, and dependability the existing app scored 2.23 and the newly designed one scored 2.15. That difference is small enough to call a tie. Whatever the new design changed, it did not make the app harder to operate.

02/03

Hedonic quality is about wanting to come back

Here the gap was wide. The proposed app scored 1.45 while the existing app dropped to -0.44. Participants described the new version as conversational and natural, which traces back to a single design decision: building speaking and listening into the core learning loop instead of treating them as extras.

A kana chart, the starting point for most self study. Image: W-dcem, CC BY-SA 4.0, via Wikimedia Commons.
Fig. 01A kana chart, the starting point for most self study. Image: W-dcem, CC BY-SA 4.0, via Wikimedia Commons.

The team reached that decision by studying how learners picture the task in their heads, then writing user stories from that picture rather than from a feature list.

  • Collect the mental model first, with a diary study rather than a survey.
  • Turn the notes into personas and a user journey, then into user stories.
  • Test the redesign against the real competitor, not against an older version of the same app.

03/03

The caution worth repeating

A better experience score is not the same as better learning. The authors are explicit that this study measured user experience only, with 20 students from similar backgrounds, and did not test whether the participants actually learned Japanese faster.

The transferable lesson holds anyway. When two apps are equally usable, the one that helps people practise the skill they came for is the one they will describe with enthusiasm.

Source

  1. Komang Candra Brata and Adam Hendra Brata (2020). User experience improvement of japanese language mobile learning application through mental model and A/B testing. International Journal of Electrical and Computer Engineering.

    DOI10.11591/ijece.v10i3.pp2659-2667 (opens in a new tab)

Next articleMeasuring Your Own Eyeglass Prescription With a Phone Camera(Keep scrolling)(Read it next)(Loading)
Learners in a Japanese language class. Image: Sweeper tamonten, public domain.
Fig. 02Learners in a Japanese language class. Image: Sweeper tamonten, public domain.