Optica’s Post

One of the most interesting things that I've seen at AWE has been Ultraleap's hand gesture tracking using "event cameras". This may make hand tracking possible on lightweight AR glasses that have a battery that lasts for very long. I explain everything about it in my latest blog article! #VirtualReality #AugmentedReality #SpatialComputing #technology #innovation

Apple Vision Pro: Unveiling the Magic of Mixed Reality Through Camera Tech Apple Vision Pro promises a leap forward in #mixed #reality (#MR), and its camera system is the key that unlocks this immersive world. 1. TrueDepth Camera: This front-facing camera plays a crucial role in: Precise Face Tracking: The TrueDepth camera with its depth-sensing capabilities will meticulously track your facial movements. This allows your digital avatar in the MR space to mimic your expressions in real-time, fostering a more natural and engaging experience. 2. Main Camera(s): The high-resolution main camera(s) will likely be used for: Capturing the Real World: The cameras capture the physical environment you're interacting with in the MR space. This allows for seamless overlay of virtual elements onto the real world, creating a cohesive mixed reality experience. 3. LiDAR Scanner: This essential sensor excels at: Environmental Depth Mapping: The LiDAR scanner creates a precise 3D map of your surroundings, allowing the Apple Vision Pro to understand the dimensions and spatial relationships within your environment. This is crucial for accurate placement and interaction with virtual objects. 4. Side Cameras: While details are scarce, the presence of side cameras could offer: Expanded Field of View: Ultrawide side cameras might capture a wider portion of the real world, allowing for a more expansive MR experience. 5. Downward-facing Camera: A downward-facing camera could potentially be used for: Surface Detection: This camera might help the Vision Pro recognize surfaces like floors and tables, enabling more precise placement of virtual objects within your environment. Each component plays a vital role in accurately capturing the real world and integrating virtual elements, blurring the lines between the physical and digital realms. Reference : Apple's “camera system” patent (number US 20230185093 A1) https://lnkd.in/g8mj2pFR #RealMatter

Congrats to Alexandre Chapiro and collaborators on the award for this upcoming SIGGRAPH 2024 research: "In this work we explored several perceptual algorithms (PEAs) for power optimization of displays (PODs). Different methods may introduce alterations of different types, and save more or less power depending on the display technology. We compare like-to-like in a user study, obtaining interpretable results for perceptually subtle breakpoints on how much display power can be saved across a wide range of technologies: LCD, OLED, with or without eye tracking, and more." #siggraph2024 #DisplayPower #VisualPerception #XR #DisplayTech

The individual pixels on Vision Pro displays will be invisible to most people, unless you have extremely impressive visual acuity, like 20/10. A pair of micro-OLED displays no larger than a postage stamp that pack 4K resolution into a screen just 1.3 inches square. Each display contains more than 11 million pixels spaced only 6.3 micrometers apart—less than the diameter of a human red blood cell. #AugmentedReality #VirtualReality #Optics

// Perceptual Quality Measurement and Optimization of Displays // Perceptual models have been leveraged to optimize the quality of XR displays, including improved rendering speed, reduced data volumes, or reduced target-searching times. This award-winning paper examines this type of optimization in the context of saving display power.

Congrats to TCL and Applied Materials for the RayNeo X2 Lite, it seems we are finally at the beginning of a very promising market segment primed for new user adoption. Waveguide-based optics, relatively wide FOV, bright MicroLED engine, and a Qualcomm processor along with a full suite of apps and features supported by TCL's own LLM seem to check all the boxes. The only thing missing from all the articles I've seen so far is the real world usage battery life. The RayNeo X2 Lite reportedly weighs only 60 grams, and when considering that Meta's latest Quest 3 VR headset's battery with ~5000mAh/19Wh weighs in a 64 grams (just under 300 Wh/kg) and has the ability to run heavy load gaming for up to 2 hours, I do wonder how long the battery life is on the RayNeo X2 Lite if multiple applications (camera, RF, AI, etc.) were running at the same time. When every 0.1 gram of weight matters, and battery size is limited by the industrial design of a pair of normal-looking glasses, Ion Storage Systems can solve the problems faced by #ARVR device makers by providing higher energy density by weight and by volume to offer unparalleled device runtime, not to mention the inherent safe cell design and raw materials used will never endanger the AR glasses wearer the way lithium-ion batteries could. #solidstatebatteries #batterytechnology #ces2024 #augmentedreality

Human-computer interaction's next technology! We shall be able to interact with digital objects in a seamless and natural way utilizing gestures and voice commands thanks to the future mixed reality headsets. We will be able to view and interact with 3D simulations of things before we buy them, making spatial shopping a snap. #mixedreality #XR #augmentedreality #AR #ecommerce #headsets #hci #humancomputerinteraction #mixedrealityheadsets #interact #digitalinteraction #gestures #sensors #gesturesensor #voicecontrol

Title: Mapping Real-World Environments into the Metaverse with iPhone 15 Pro Max and Polycam VTATV TIP AND TRICKS EP1 @decentraland Check out our Polycam scanned world in dcl worlds keep in mind we decided to use worlds because of the bigger triangle and file size availability. Check out Vtatv.dcl.eth READ BELOW TO LEARN MORE AND WATCH THE TUTORIAL VIDEO BELOW 👇 TO WATCH FIRST HAND ON HOW TO MAKE YOUR NEXT BUILD TODAY IN #DECENTRALAND #METAVERSE BROUGHT TO YOU BY #VTATV In today's digital age, the fusion of real-world environments with virtual platforms has opened a myriad of possibilities. One exciting application is transforming physical spaces into detailed 3D models for use in the metaverse. This post will guide you through using the Polycam app on the iPhone 15 Pro Max, which is equipped with advanced LiDAR technology, to create and export 3D models suitable for virtual reality (VR) environments and metaverse applications. **Step 1: Setting Up Your Device** Ensure your iPhone 15 Pro Max is updated to the latest iOS version to maximize the performance of the LiDAR scanner. Download and install the Polycam app from the App Store. **Step 2: Capturing the Environment** Open Polycam and select the LiDAR capture mode. Slowly walk around the area you want to map, allowing the LiDAR scanner to capture detailed spatial data. The app will display a real-time mesh overlay on your screen, showing you the areas that have been successfully scanned. **Step 3: Processing the Scan** Once the scan is complete, the app processes the data to create a cohesive 3D model. You can edit the model within Polycam to improve accuracy, remove unwanted objects, or enhance textures. **Step 4: Exporting Your Model** Polycam allows you to export your 3D model in several file formats including GLB, GLTF, and OBJ, which are compatible with most 3D modeling software and VR platforms. Choose the format that best suits your needs for further refinement or direct implementation into your metaverse project. **Step 5: Using Your 3D Model in the Metaverse** Import your exported file into a metaverse platform like Unity or Unreal Engine. Here, you can further refine the model, add interactive elements, or integrate it into larger virtual environments. **Examples and References:** 1. **Case Study: Historical Site Mapping** - A team used Polycam to scan and digitize a historical site. The detailed model was then used in a virtual museum tour, allowing users from around the globe to explore the site in 3D from their VR devices. 2. **Tutorial Video:** - For a detailed visual guide on using Polycam with LiDAR on the iPhone 15 Pro Max, check out this tutorial on YouTube: "How to 3D Scan with iPhone 15 Pro Max and Polycam."

A good article by Alan Truly in Digital Trends Media Group who has tested several smart AR glasses: "Simplicity and reliability are a winning combination, and with the current technology available, are the safest way into the world of AR glasses". https://lnkd.in/eQWftd7B #AR #smartglasses #digitaltrends