Mark Zuckerberg’s Project Cambria demo shows off its full-color passthrough

Mark Zuckerberg just shared a short demo video showcasing some of the capabilities of Meta’s upcoming high-end VR headset, Project Cambria. While keeping the device itself hidden, Meta highlights the upcoming headset’s ability to deliver high-resolution, full-color transmission so wearers can interact with virtual objects superimposed on their real environments.

The mixed reality experience is built using Meta’s presence platform, which was introduced last fall. Current Quest headsets are only capable of displaying passthrough content in grayscale, but Project Cambria will have much higher resolution image sensors to make the real world look better inside the headset.

Meta also posted this two and a half minute video highlighting its presence platform, which shows the huge difference in experience between the Quest and Cambria headsets. Meta CTO Andrew Bosworth wrote on Twitter that an SDK update next week will include “the full set of Presence Platform tools powered by machine perception and AI – Passthrough, Spatial Anchors, Scene, Interaction and Voice SDK, and our hands recently updated”.

The demo reel mostly shows Zuckerberg gesturing towards this video’s cartoon character Oppy and appearing to paint his surroundings over the real world. It also includes clips from other Meta AR projects, again teasing the possibility of you wearing one to tour a virtual desktop environment and work on your cloud workstation using augmented reality.

We haven’t gotten any new details on the hardware itself. However, Janko Roettgers at Protocol was able to briefly try out the device by running the same demo, saying the video quality produced by Cambria’s sensors is still not photorealistic but closer to “decent quality home video”. Zuckerberg also told him that another benefit of upgrading the sensors to include color is that they’re better at distinguishing between different real-world objects so he knows where to place virtual objects.

The demo, which was shown off at the Facebook Connect event last year, is called The World Beyond, and Meta says it will soon be available in the App Lab for developers to try out. Project Cambria is just one of many virtual reality headsets Meta plans to introduce over the next few years, and using its technology to help developers create augmented reality experiences that more people will want. visiting is just one step in Meta’s plan for consumer AR devices. . Cambria is supposed to be released “later this year”.

Updated May 12, 12:07 p.m. ET: Added a preview video of Meta Project Cambria and a note on tweets from Facebook CTO Andrew Bosworth.

Leave a Comment