Reality Check: The marvel of computer vision technology in today’s camera-based AR systems

British science fiction writer, Sir Arther C. Clark, when mentioned, “Any sufficiently advanced technology is indistinguishable from magic.”

Augmented reality has the possible to instill awe and wonder in us just as magic would. For the extremely initially time in the history of computing, we now have the capability to blur the line amongst the physical planet and the virtual planet. AR promises to bring forth the dawn of a new inventive economy, exactly where digital media can be brought to life and offered the capability to interact with the actual planet.

Web Hosting

AR experiences can look magical but what specifically is taking place behind the curtain? To answer this, we should appear at the 3 simple foundations of a camera-primarily based AR method like our smartphone.

  1. How do computer systems know exactly where it is in the planet? (Localization + Mapping)
  2. How do computer systems recognize what the planet appears like? (Geometry)
  3. How do computer systems recognize the planet as we do? (Semantics)

Portion 1: How do computer systems know exactly where it is in the planet? (Localization)

Mars Rover Curiosity taking a selfie on Mars. Supply: https://www.nasa.gov/jpl/msl/pia19808/searching-up-at-mars-rover-curiosity-in-buckskin-selfie/

When NASA scientists place the rover onto Mars, they necessary a way for the robot to navigate itself on a distinctive planet without having the use of a worldwide positioning method (GPS). They came up with a approach referred to as Visual Inertial Odometry (VIO) to track the rover’s movement more than time without having GPS. This is the very same approach that our smartphones use to track their spatial position and orientation.

A VIO method is produced out of two components.