Skip to main content

The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

Join now

Blippar’s New Augmented Reality App Is Supposed to Recognize Any Object You Point It At (Video)

Taking AR into the everyday world in real time.

Blippar

Augmented reality app Blippar has been around since 2011, but until recently it focused mostly on advertising and content for brands: Point your Blippar smartphone app at a bold “B” embossed on the pages of a magazine or a bottle of ketchup and more information would pop out on your phone’s display.

But it’s safe to say that augmented reality is coming into a new phase: The contextual information being supplied is getting smarter, and people are gradually becoming more aware of the capabilities of AR and virtual reality (some are even excited to wear headsets, if you can believe it). So Blippar, in an effort to evolve along with the rest of the AR world, has just launched a new version of its smartphone app that is supposed to recognize literally any object you point at it — whether it has been “tagged” with an AR code or not.

Blippar co-founder and CEO Ambarish Mitra showed off the new version of the mobile app today at the Code/Media conference at The Ritz-Carlton, Laguna Niguel in Dana Point, Calif. He pointed the app at a variety of random objects — a magazine, a salad and an apple — to demonstrate how the app’s image recognition capabilities work.

“This is a really big change in our business model,” Mitra had said in an interview before the conference kicked off. “Initially, AR was about very static image recognition. You store images of Starbucks or Coca-Cola or General Mills in our database, and the images match. But now you’re able to analyze any environment in the world in real time, over a 3G connection.”

Mitra said over the past year and a half he has moved his technology team from the U.K. to Mountain View, Calif., to focus on machine learning, which is all the rage in Silicon Valley right now, with everyone from small upstarts to behemoths like Google trying to crack the code on how to make accurate predictions from large sets of data. (Google, actually, has an app that works similarly called Google Goggles, but it works when you point the app at a QR code or a famous landmark or something else recognizable — not necessarily everyday objects.)

In short, this is not an easy thing to do. In fact, ahead of the event, one of our staffers tried it out by pointing the app at his dog, and it thought the pup was a goat.

Mitra has said that, right now, the technology has elementary capabilities, like the brain of a six-year-old; it can recognize “car,” but not “Prius,” or it can recognize an item of clothing, but not the label. However, with machine learning, the app should be able to get to the level of an 18-year-old pretty quickly, Mitra said, in terms of its recognition abilities. And during the onstage demo, it did properly identify a pug named Milton as a dog. (No dogs were harmed in the making of Code Media.)

This article originally appeared on Recode.net.

More in Technology

Technology
The case for AI realismThe case for AI realism
Technology

AI isn’t going to be the end of the world — no matter what this documentary sometimes argues.

By Shayna Korol
Politics
OpenAI’s oddly socialist, wildly hypocritical new economic agendaOpenAI’s oddly socialist, wildly hypocritical new economic agenda
Politics

The AI company released a set of highly progressive policy ideas. There’s just one small problem.

By Eric Levitz
Future Perfect
Human bodies aren’t ready to travel to Mars. Space medicine can help.Human bodies aren’t ready to travel to Mars. Space medicine can help.
Future Perfect

Protecting astronauts in space — and maybe even Mars — will help transform health on Earth.

By Shayna Korol
Podcasts
The importance of space toilets, explainedThe importance of space toilets, explained
Podcast
Podcasts

Houston, we have a plumbing problem.

By Peter Balonon-Rosen and Sean Rameswaram
Technology
What happened when they installed ChatGPT on a nuclear supercomputerWhat happened when they installed ChatGPT on a nuclear supercomputer
Technology

How they’re using AI at the lab that created the atom bomb.

By Joshua Keating
Future Perfect
Humanity’s return to the moon is a deeply religious missionHumanity’s return to the moon is a deeply religious mission
Future Perfect

Space barons like Jeff Bezos and Elon Musk don’t seem religious. But their quest to colonize outer space is.

By Sigal Samuel