Apple image capture app11/25/2023 ![]() So if you have a picture of a white cup with a black spot in front of a white wall, stereoscopic analysis might fail to tell whether the spot is on the wall or the cup for short distances and unknown curvature of the cup, meaning if you look at that picture in VR, moving your head sideways may show the spot sticking to the wall, while a spatial image would contain the actual depth of the spot, and it would therefore vanish if you look behind the cup in VR. This can be used for example to change the focus length in post processing, keeping all objects at the appropriated distance, and helps with reconstructing actual spatial data. ![]() ![]() Though there is no guarantee that Apple uses the term this way, they have had 3D depth sensors on the high end phones for some time, and these can utilize and store depth information in addition to regular pixels. This usually requires an extra depth sensor, of which there are several types, which work/fail in different situations. Spatial video actually includes 3D depth information encoded in the data. with video, but fails in situations lacking visual differences, for example a white cup in front of a white wall, or anything involving mirrors. Software can (try to) extract depth information by comparing the two 2D images, which works decently well, esp. They don’t contain any actual 3D informations which could be used later, e.g. Stereoscopic video is what most people assume 3D video is and what could be done with two old iPhones, basically two 2D images recorded in parallel and played back to two eyes. ![]() While the first 3D movies actually used two slightly shifted cameras (stereoscopy), most 3D movies today are conversions from 2D, with software “guessing” the depth information from other cues like shadows, which works sufficiently well at much lower costs. Spatial video includes true depth data, stereoscopic video includes none, but software can try to reconstruct it from the parallax.ģD video is a very broad term that mostly means “not just 2D”, but can mean anything from adding a second, slightly moved perspective in post-processing to full holographic video that shows a different perspective depending on the view direction even for multiple users, with all the information actually being encoded in the medium. TL DR: Spatial Video ≠ Stereoscopic Video ≠ 3D Video. While users will be able to watch their immersive videos on Vision Pro, Apple also said they’ll be able to share the footage with others who can watch on their own headset. Curiously, Apple didn’t mention spatial photo capture, but ostensibly this should be possible as well. Image courtesy Apple proĪpple didn’t specifically say whether the phone’s depth-sensor was involved, but considering the phone uses it for other camera functions, we wouldn’t be surprised to find that it has some role to play. Given that the iPhone 15 Pro cameras are so close together-not offering enough distance between the two views for straightforward stereo capture-it seems that some kind of depth projection or scene reconstruction will be necessary. But it isn’t clear if “three-dimensional” means stereoscopic footage with a fixed viewpoint, or some kind of depth projection with a bit of 6DOF wiggle room. “We use the ultrawide and main cameras together to create a three-dimensional video,” the company said during its announcement. The base versions of the phone, the iPhone 15 and iPhone 15 Plus, won’t have the spatial capture capability.ĭetails on exactly how this function works are slim for the time being. Today during the company’s iPhone 15 announcement, it was revealed that the new iPhone 15 Pro will be capable of capturing spatial video which can be viewed immersively on the company’s upcoming Vision Pro headset. Image courtesy AppleĪpple seems to feel the same way. While Apple Vision Pro itself works as a spatial camera, allowing users to capture immersive photos and videos, I think we can all agree that wearing a camera on your head isn’t the most convenient way to capture content. Apple today announced its iPhone 15 lineup of smartphones, including the iPhone 15 Pro which will be the company’s first phone to capture spatial video for immersive viewing on Vision Pro.
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |