Jul 17

New Apple Patent: Light Field Cameras for more Immersive Video Calls with Augmented Reality

Apple’s latest light field patent describes the use of a camera array for immersive augmented reality (AR), live display walls, head mounted displays, video conferencing, and similar applications based on a user’s point of view. The patent application, simply titled “Light field capture”, talks about AR video conferencing where the user’s background can be replaced with other information (e.g. their own view of a scene, or live sports).

New Apple Patent: Light Field Cameras for more Immersive Video Calls and Augmented Reality (Picture: Motta et al. 2016)

The invention also includes concepts including pixel culling (i.e. following the user’s movements and cropping to the interesting parts of the entire camera view), conversion of 3D data to 2D views for the left and right eyes of the second party,
Interestingly, the authors also mention the possibility for a hybrid display/camera-array that would integrate both devices into a single, light-field sensing screen.

New Apple Patent: Light Field Cameras for more Immersive Video Calls and Augmented Reality (Picture: Motta et al. 2016)

For more information, check out Patently Apple and Patent US9681096 – Light field capture on Google Patents.

Apr 04

Magic Leap: Promo Video Teases AR Headset

Rony Abovitz, CEO of the secretive startup Magic Leap, was expected to reveal the company’s rumoured Augmented Reality headset recently at a TED talk in Vancouver, but canceled a few days before. Instead, the company released a 90 second promo video teasing an AR game that it says is “currently being played at the office”, and it looks pretty awesome.

Video description: Unfortunately, we couldn’t make it to TED, but we wanted to share one of the things that we’d planned to share at the talk. This is a game we’re playing around the office right now (no robots were harmed in the making of this video).

Continue reading