MGMLaboratory
Back

Menu

01Home
02About Us
03Projects
04Publications
05Member
06Articles
07Contact

Let's Talk

Open in Mail app

Socials

Malang (ID) --:--Privacy PolicyTerms of Service

February 9, 20242 min read

How Visual SLAM and Street View Pull Outdoor AR Anchors Into PlaceHow Visual SLAM and Street View Pull Outdoor AR Anchors Into Place

A team cut the average anchor error from about 7 metres to under 1 metre.

  • Journal
  • Publications

Written by

  • SRShirasaka RenIT & Infrastructure · Student Member

In this article

  1. 01How the prototype works
  2. 02What the team found
  3. 03The catch

Outdoor location based augmented reality puts digital labels on real places. Point a phone at a building and a floating card explains what it is. The hard part is getting that card to sit on the right spot. Most Android apps lean on GPS and a compass, and both drift. Labels land metres away from the door they should mark.

A team from Okayama University and Universitas Brawijaya tested a way to close the gap. They added visual SLAM and cloud based matching against Google Street View on top of the usual sensor fusion. The prototype runs as a native Android app through ARCore.

01/03

How the prototype works

Visual SLAM tracks features across the camera feed and maps the surroundings as the user walks. When the tracker loses its grip, during a quick turn or on featureless pavement, the app sends a frame to a cloud service. That service matches it against Street View panoramas and pulls the device pose back to a known coordinate. GPS and inertial data keep the result steady between matches.

Street View cars collect the reference panoramas. Credit: 姒姓賢寧, CC BY-SA 4.0, Wikimedia Commons.
Fig. 01Street View cars collect the reference panoramas. Credit: 姒姓賢寧, CC BY-SA 4.0, Wikimedia Commons.

The evaluation used 10 points of interest around the Universitas Brawijaya campus in Malang. Each was measured several times and compared with the true coordinate using the Haversine distance.

02/03

What the team found

  • Overall mean error fell from 7.328 metres with the conventional approach to 0.796 metres with the proposal.
  • Overall root mean square error dropped from 7.379 metres to 0.806 metres.
  • Resource use rose: average CPU load from 13 percent to 29 percent, and memory from 152 MB to 294 MB.
AR content placed through a phone camera. Credit: Fmalka, CC BY-SA 3.0, Wikimedia Commons.
Fig. 02AR content placed through a phone camera. Credit: Fmalka, CC BY-SA 3.0, Wikimedia Commons.

03/03

The catch

The method needs Street View coverage. Where Google has not driven, the matching step has nothing to work with and the app falls back to sensor fusion alone. The extra accuracy is not free either: more threads stay busy and more memory is held, which matters on budget devices.

Next comes testing under different lighting conditions, and folding the approach into a full outdoor navigation build rather than a point of interest prototype.

Source

  1. Brata et al. (2024). An enhancement of outdoor location-based augmented reality anchor precision through VSLAM and Google Street View. Sensors, 24(4), 1161.

    DOI10.3390/s24041161 (opens in a new tab)

Next articleThe Real Cost of Putting AR Labels in the Right Place(Keep scrolling)(Read it next)(Loading)