MGMLaboratory
Back

Menu

01Home
02About Us
03Projects
04Publications
05Member
06Articles
07Contact

Let's Talk

Open in Mail app

Socials

Malang (ID) --:--Privacy PolicyTerms of Service

January 1, 20212 min read

Testing a Learning Tool Against the Technology Acceptance ModelTesting a Learning Tool Against the Technology Acceptance Model

The Kit-Build study is a template for evaluating a study tool before you try to prove it improves learning.

  • Conference
  • Publications

Written by

  • SRShirasaka RenIT & Infrastructure · Student Member

In this article

  1. 01Build the sample deliberately
  2. 02Separate the core from the additions
  3. 03Read the result as a design brief

When a team finishes a learning tool, the first question is often whether students learned more. That is the hardest question to answer, and it is not the first one worth asking.

A study of a Kit-Build concept map authoring tool for English reading comprehension took the step before that one, asking whether students accept the tool at all. The method is worth copying, because it costs far less than a learning outcome study.

01/03

Build the sample deliberately

The authors screened participants instead of taking whoever was available. Seventy three third year undergraduates took part, all with a minimum TOEFL score of 450 and existing familiarity with web applications. Both conditions matter for an English reading task that runs in a browser. One sets a language floor, and the other removes basic usability as a source of noise.

02/03

Separate the core from the additions

The questionnaire used a seven point scale, split into two groups. Fifteen items measured the four standard TAM variables: perceived usefulness, perceived ease of use, attitude towards using, and behavioral intention. Eleven further items measured compatibility, habit, and enjoyment.

Keeping the groups apart is what makes the result readable. You can see whether the standard model still holds, and whether the extra variables earn their place. Here the core was consistent with the original TAM, and compatibility and enjoyment proved significant.

A digital concept map built from linked nodes. Image: F22raptor editor, CC0, via Wikimedia Commons.
Fig. 01A digital concept map built from linked nodes. Image: F22raptor editor, CC0, via Wikimedia Commons.

03/03

Read the result as a design brief

Compatibility and enjoyment are not abstract findings. They translate into concrete work: match the tool to the study habits students already have, and make the act of using it pleasant rather than merely functional.

The authors are careful about scope. They measured adoption, not learning gain, among a screened group at one university. That is a fair limit for this kind of study, and it sets up the obvious next experiment.

Students reading a book together in class. Image: FramaKa, CC BY-SA 4.0, via Wikimedia Commons.
Fig. 02Students reading a book together in class. Image: FramaKa, CC BY-SA 4.0, via Wikimedia Commons.

Source

  1. Pinandito et al. (2021). Students' Acceptance towards Kit-Build Concept Map Authoring Tool in Supporting Learning of English Reading Comprehension. Proceedings of the 5th International Conference on Sustainable Information Engineering and Technology.

    DOI10.1145/3427423.3427464 (opens in a new tab)

Next articleA Smartwatch Interface Cut Transit Travel Time by Six Minutes(Keep scrolling)(Read it next)(Loading)