Intel RealSense Smartphone Developer Kit: Details

Published on April 06, 2016

Intel RealSense Smartphone Developer Kit: Details

Original author: Miao Wei
  • Transfer
We already reported that at CES 2016 in Las Vegas, an Android smartphone for Intel RealSense Smartphone Developer Kit (SDK) was introduced. It is notable for the integrated Intel RealSense Camera ZR300 and support for Google Project Tango. Today we’ll talk about it in more detail.


Specifications


For starters - a little technical specifications. The hardware base of the device is a 4-core Intel Atom x7-Z8700 (Cherry Trail). Graphics processing is carried out by Gen 8 Intel HD Graphics. In the smartphone, in addition to the unique ZR300 camera, which we will touch on, the 8-megapixel rear and 2-megapixel front cameras are quite usual for Android. The picture is complemented by a 6-inch touchscreen QHD-display with a resolution of 2560x1440, 2 GB of RAM and 64 GB of internal flash memory. A powerful platform complements Android 5.1.1.

In front, the smartphone looks quite familiar.


Intel RealSense Smartphone Developer Kit, front side

But if you turn it over, everything changes dramatically.


Intel RealSense Smartphone Developer Kit, back

Intel RealSense Camera ZR300


On the back of the device, from left to right, is located all that is called Intel RealSense Camera ZR300. Namely:

  • Right infrared camera.
  • Color camera.
  • Infrared laser projector.
  • Left infrared camera.
  • A short-focus wide-angle camera that provides motion recognition support.

On the right side you can see the usual camera and its accompanying flash. ZR300, as you can immediately see from the location of its module on the device, is designed to capture the outside world, and not the owner of the phone. Although no one bothers to take selfie with her.

The laser projector is committed to superimposing an infrared grid on the objects it is aimed at. Two infrared cameras capture images. The spatial characteristics of objects are calculated using the pixel shift method when analyzing images obtained from the left and right IR cameras.

The processing speed of depth data is more than 10 million points per second. In addition, the ZR300 includes a wide-angle camera with a VGA resolution and a viewing angle of more than 160 degrees, with which a high-precision combination of an accelerometer and a gyroscope work. Such a complex is called a gyro-stabilizer (Inertial Measurement Unit, IMU). This camera is used in tracking tasks of moving objects and the features of the scene.

High-quality high-density spatial data that a pair of ZR300 infrared cameras can capture can be used for three-dimensional scanning of people, rooms, and things. This feature also helps in gesture recognition and positioning. The obtained data can be used for 3D rendering of various objects, building depth maps and reconstructing captured scenes. A wide-angle camera, a gyro stabilizer and well-adjusted software mechanisms for synchronizing sensors (this is done through time stamps) allow the device to realize the capabilities of Google Project Tango. For example - indoor navigation and space exploration.

Google project tango


Project Tango provides the mobile industry with three core technologies: motion tracking, environmental research, and depth perception.

Motion tracking technology uses a gyrostabilizer to determine the current position of the device relative to where it started to move. A similar approach can be used for indoor navigation without using GPS.

To study the environment, the Simultaneous Localization and Mapping (SLAM) method is used. Its essence lies in combining space scanning data and location tracking. This can be used for “offset correction” in usage scenarios where movement tracking is performed over long periods of time.

Depth-of-space technology uses the ZR300 to create a point cloud that provides information about the depth of space and the location of various objects in front of the camera.

Summary


Intel RealSense enables developers to implement capabilities that enrich user experience scenarios. Such as face tracking, creating a digital representation of the environment, reconstruction of the environment. Here - the possibilities of photography with support for the depth of space. For example, correction of photography errors, separation of image plans, measurements, implementation of the parallax effect, focus adjustment.

Armed with the Intel RealSense Smartphone Developer Kit (SDK), developers can begin work on a new class of applications on a single Android platform that includes support for Google Project Tango and the Intel RealSense Camera ZR300.

If you want to get this thing - look here .