MGMLaboratory
Back

Menu

01Home
02About Us
03Projects
04Publications
05Member
06Articles
07Contact

Let's Talk

Open in Mail app

Socials

Malang (ID) --:--Privacy PolicyTerms of Service

October 15, 20162 min read

Typing With Your Head When Your Hands Are BusyTyping With Your Head When Your Hands Are Busy

A team built a phone keyboard driven entirely by head movement and tested three layouts for it.

  • Conference
  • Publications

Written by

  • SRShirasaka RenIT & Infrastructure · Student Member

In this article

  1. 01How the input works
  2. 02Three layouts, two control styles

A phone keyboard assumes two free hands. That assumption breaks for a driver, for a welder, and completely for anyone who cannot use their hands at all. A research group at Universitas Brawijaya designed an interface for that situation, where the only input is the movement of the user's head.

A simple headset turns a phone into a head tracked screen. Image: Pinguinguy, CC0, via Wikimedia Commons.
Fig. 01A simple headset turns a phone into a head tracked screen. Image: Pinguinguy, CC0, via Wikimedia Commons.

01/02

How the input works

The system is called HEMOCS, short for Head Movement Control System. A phone sits inside a dummy head mounted display of the cardboard kind, and its accelerometer, gyroscope, and magnetometer report how the head is oriented. That orientation is described with three angles: pitch, roll, and yaw.

Those angles turn into six gestures. The head can rotate left or right, tilt forward or back, and bend sideways in either direction. Each gesture can be bound to an action on screen.

Headset interfaces are awkward to test without help. Image: Subhashish Panigrahi, CC BY-SA 4.0, via Wikimedia Commons.
Fig. 02Headset interfaces are awkward to test without help. Image: Subhashish Panigrahi, CC BY-SA 4.0, via Wikimedia Commons.

02/02

Three layouts, two control styles

The prototype keyboard was built three times over, with letters arranged by English frequency, in plain alphabetical order, and in the familiar QWERTY order. Two control styles were tried as well. In free movement the head drives a pointer like a mouse, and a key is selected by holding still for three seconds. In linear movement, gestures step the pointer around and fire actions directly.

  • Frequency layout: 99 head movements on average
  • Alphabetical layout: 106 movements
  • QWERTY layout: 119 movements

Other settings were tuned by experiment. A head angle threshold of 12 degrees gave the highest accuracy, at 87 percent, and the best key size came out at 0.3 cm. A small usability session with five respondents followed the measurements.

Head control is hands free, but it is not effortless. Image: Skydeas, CC BY-SA 4.0, via Wikimedia Commons.
Fig. 03Head control is hands free, but it is not effortless. Image: Skydeas, CC BY-SA 4.0, via Wikimedia Commons.

The closing result is a tradeoff the authors report plainly. The frequency layout saved the most movement, yet users still felt more comfortable with QWERTY because it was familiar, while the frequency arrangement was judged easier to use. Linear movement was preferred over free movement, and respondents mentioned some mental and physical strain. The authors note their layouts and controls can help builders pick the right combination for hands free interaction, with the next step being a real HEMOCS application.

Source

  1. Herman Tolle et al. (2016). Design of keyboard input control for mobile application using Head Movement Control (HEMOCS). 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

    DOI10.1109/ICACSIS.2016.7872792 (opens in a new tab)

Next articleEfficiency and Familiarity Pull in Different Directions(Keep scrolling)(Read it next)(Loading)