A number of high-end iPhone and iPad models use LiDAR sensors in their camera module. This sensor provides interesting features for 3D scanning of the environment that you can use to do various things. Here are 7 interesting things you can do with this sensor.
What does the LiDAR sensor do?
LiDAR abbreviation Li ght D etection A nd R anging ( Light detection and navigation) and is also referred to as a 3D scanner and other such terms. The basis of this technology is based on irradiating light waves to different levels and measuring the reflection time of these waves, which is used to determine their shape and distance.
In general, its performance is similar to radar technology, but LiDAR can provide more accurate and sharp scans with smaller equipment. The LiDAR sensor has a nanometer accuracy, but the radar uses antennas that generate much higher frequencies due to the use of radio waves.
LiDAR sensor can capture 3D images of objects around you using apps available for iPhone or iPad. Some key iPhone apps, such as the Camera app, use this technology for other tasks.
Currently only iPhone 12 Pro and Pro Max, iPhone 13 Pro and Pro Max, 11-inch iPad Pro (generation Second and third) and the 12.9-inch iPad Pro (fourth and fifth generation) use the LiDAR sensor. If you look closely at the camera module of these gadgets, you can see a small black dot, which is the same LiDAR sensor.
1. Three-dimensional scan of places you like
Most people keep all kinds of photos to capture memories. But suppose you can record a three-dimensional scan of these places instead of old photos of your childhood home or places you have fond memories of. Thanks to an iPhone or iPad equipped with a LiDAR sensor, you can easily do that. Capturing a 3D scan that you can look around is far more appealing than a number of 2D images and videos.
Using apps like Polycam, RoomScan LiDAR, and Canvas: Pocket 3D Room Scanner It becomes possible. Many of these apps are free, but they usually offer more features for a fee, and various restrictions can be removed. You can watch the 3D scanning process by the Polycam app below.
2. Do you want to buy a house or change the decoration? Scan first
Record a 3D scan of a room or house for a variety of tasks. If you are currently looking to buy or rent a home, 3D scanning of this environment can make your decision easier. This process is similar to filming or photographing different parts of the home, which is very common in the real estate world. Reconstruction becomes easier. If you want to make detailed changes to your current home, you can easily try out different ideas for your home space with 3D scanning and then programs like Blender (if you are comfortable with such programs).
Finally, if you are planning to sell your home, you can provide an accurate 3D scan of your home without the need for real estate consultants. And make it available to customers so they can see all the parts and details of the house before visiting.
3. Creating three-dimensional objects
Photogrammetry is the knowledge and technology of extracting information about the earth and its surroundings using recorded images and information from various sensors. Although the 3D images created with this technology are very accurate and full of details, the process of converting hundreds of images into an accurate 3D model can take hundreds of hours.
Instead, with an iPhone or iPad, and using apps like Polycam, you can create a fairly good 3D model in minutes. Scanning 3D objects is somewhat similar to filming, and when this process is complete, you will receive a file that you can use in 3D modeling programs such as Blender. After troubleshooting the scanned model, you can easily insert the object into 3D engines such as Unity and Unreal.
These 3D engines are used to develop games, movies, and interactive content. Conor O'Kane is a video game developer who has posted a comprehensive video on his YouTube channel about 3D scanning of objects and their use in games.
4. Scanning and Sharing Interesting Things
Are you a collector? Everything you collect - from paintings and game consoles to cars - you can easily hold an online exhibition of these products in 3D. The Polycam app is ideal for this because it uses a social network to share 3D models called polyworld.
In this environment you can see all kinds of 3D models. For example, some users have even scanned their ice cream or shoes in 3D and placed them in this environment. Even if you do not have a LiDAR sensor on your iPhone or iPad, it is best to install this app to see what different people around the world are doing 3D scanning and sharing. This social network is simply like Instagram for 3D models.
5. Take better photos in dark environments
Your iPhone and iPad take advantage of this feature by default, so you don't have to do anything special to use it. All in all, if you are postponing shooting in the dark because you do not trust the autofocus of your gadget, it is better to reconsider your decision if you use the LiDAR sensor.
Since the LiDAR sensor can calculate its distance from the subject based on the reciprocation of light waves, in this case the autofocus is performed more accurately. Phones without these sensors, on the other hand, can only use ambient contrast and phase detection for autofocus, which does not work well in low light environments. On the other hand, although many phones use ToF sensors, LiDARs usually perform better than them.
6. More accurate measurements
iOS app called There is a measure that you can use to measure objects or your surroundings. This application can do this using augmented reality technology and it is very easy to use. If your iPhone or iPad has a LiDAR sensor, then the accuracy of this application will increase significantly. During the studies, its error rate is only about 1 cm, which indicates its very high accuracy.
7. Increasing the attractiveness of augmented reality applications
Almost all augmented reality applications can be more accurate and attractive thanks to the LiDAR sensor. Using apps like World Brush, SketchAR and Assemblr, you can create interesting artwork using augmented reality.Download
Using IKEA Place, you can place different IKEA appliances in your home to see which ones are more attractive to your home environment. LEGO Hidden Side can also bring Lego sets to life on your phone, which you can see in the video above how this application works. If you are looking for an augmented reality training app, you should definitely try Playground AR. Although you can install all of these apps on almost all iPhones and iPads, they offer a much more immersive experience when using the LiDAR sensor. Apple's most advanced camera
Source: How To Geek