Unlimited XR technology in the era of distributed computing

How transformation Wireless Edge will help in the development of photorealistic augmented reality mobile systems.

Extended Reality (XR) already gives users revolutionary opportunities, but to achieve even more realism and a new level of immersion, given the limitations associated with the performance and cooling of thin portable gadgets, the task is quite non-trivial.

Looking to the future: slim and stylish augmented reality glasses

With the transformation of Wireless Edge systems (wireless systems operating at the junction of the network and the gadget), a new era of distributed computing will begin, in which 5G technologies, information processing on the devices themselves and border cloud computing will be actively used. And it is this transformation that should help find an optimized solution.

Best of both worlds

What if we could take all the benefits of mobile XR devices and combine them with the performance of PC-based XR systems? Mobile gadgets for augmented reality is the future of XR, because they can be used anywhere, anytime, without prior preparation and without wires. The PC-based XR implementation, although it cannot be considered the future of augmented reality, has an important advantage - it is not limited by the power consumption and efficiency of the cooling systems, which, in turn, allows for more extensive calculations. With 5G networks with lower latency and high bandwidth, we plan to take the best from both approaches. The distribution of computing tasks using 5G technology will offer the best of both worlds - unlimited mobile XR experience and photorealistic graphics in thin and affordable XR headsets. As a result, users will get “limitless" opportunities in every sense, because they can connect to augmented reality wherever they want, and the degree of immersion in XR applications will become even higher.


Unlimited Augmented Reality Technologies Offer the Best of Mobile XR Devices and PC-Connected Devices

Enhanced Augmented Reality Data Processing on the Device

Working with graphics in augmented reality systems requires large computing power and is sensitive to response time. For the correct separation of calculations, a systematic approach is needed. Let's look at how the use of cloud-based cloud computing can help more efficiently complement processing on the device, creating systems of unlimited augmented reality with photo-realistic graphics (more detailed information is in our webinar ).

When a user of the XR system turns his head, processing on the device determines the position of the head and sends this data to the cloud of border computing via a 5G channel with a minimum delay and a high quality service indicator. This system uses the obtained head position data to partially render the next image frame, encode the data and send it back to the XR headset. Then the headset decrypts the last packet received and, using regularly updated data on changes in the position of the head, continues to render and fine-tune the image to minimize the indicator of motion-to-photon latency (the delay between changing the position of the user's head and changing the image in the headset). Recall that in accordance with this indicator, all processing should be completed in time, not exceeding 20 milliseconds. Exceeding this threshold leads to the appearance of an unpleasant sensation in the user and a decrease in the level of immersion in augmented reality.


Computations on the device are complemented by cloud edge computing and a 5G channel with low response time.

As you can see, to get a high-quality immersion effect in XR, you need a system solution with low response time and high reliability, so 5G networks with their minimum delay, high bandwidth are a critical element of XR. As 5G networks improve and their coverage grows, users will be able to enjoy photorealistic graphics in XR applications in a large number of places and will be sure that the premium stand-alone XR experience will remain available thanks to efficient computing on the device itself.

And this is a key point, which is worth emphasizing again: data processing on the device remains an extremely important factor in any scenario. In stand-alone mode, on-board computing on the device is responsible for all all computing related to XR. When working together with a cloud-based cloud computing system, on-board processing will provide the XR headset with energy-efficient, high-performance visualization and low latency tracking.

Creating “boundless” augmented reality

Qualcomm Technologies is already creating high-performance stand-alone mobile XR solutions and remains the leader in promoting 5G technology in the world. But we cannot translate our ideas of the “limitless” XR into reality alone. We actively cooperate with the largest representatives of the XR and 5G ecosystems, including OEMs and content creators, service providers and infrastructure, because the architecture of separate rendering is a system solution.


XR and 5G ecosystem members must work together to make “limitless” XR technologies a reality

As a result of synergy, all participants in the XR ecosystem will receive a large overall benefit from its active development, and the name is called “consumer acceptance growth”. For example, telecom operators will receive certain benefits from the transformation of Wireless Edge as a whole, but let's look at the benefits from the development of unlimited XR. Firstly, with the advent of 5G networks, improved broadband access will increase capacity, reduce response time and provide a guaranteed class of service, which will enable the appearance of richer and more interactive XR applications. Secondly, as operators increase their capabilities for cloud-based cloud computing, they will be able to offer the mass user completely new services, for example, XR-applications with photorealistic graphics.

We believe that a revolutionary new user experience will be a great advantage, including collaborative interactive work in real time, multiplayer games with photorealistic graphics, a new generation of video with support for six degrees of freedom, educational applications with immersion and personalized shopping which was not there. These prospects are inspirational, so we look forward to working together fruitfully with other members of the ecosystem - this work will help turn our XR vision into reality.