How does MR work? Understanding the basics
Once the new kid on the block, mixed reality (MR) is today a sought-after tool in tech-forward business environments. Its ability to aid in learning and collaboration means Meta Quest headsets and apps are becoming more commonplace in various industries, including healthcare, manufacturing and education.
To stay ahead of the curve and be at the forefront of innovation, understanding this new technology has become imperative for tech-savvy businesses around the world.
How does MR work?
To answer the question "how does MR work?", we first need to understand what it is. In a nutshell, MR is an immersive 3D environment generated by computers. It relies on software, in the form of apps, and hardware, consisting of head-mounted displays to "replace" the real world as we perceive it.
So how does MR work? When a person puts a headset on, they are essentially stepping into an immersive simulation and are presented with a new reality that they can see, hear and to a degree, touch. Using a combination of LEDs, motion sensors, cameras and screens, the MR headset captures the wearer's response to natural stimuli. It then uses AI software to create virtual objects in a spatially mapped environment, specifically designed to trick the human brain into believing what it perceives is actually there.
AR (augmented reality) and MR (mixed reality), which work on a similar principle. The difference is that AR overlays the real world with digital elements that enhance the user's perception of the environment, creating a composite view that combines both. And MR seamlessly brings together the virtual and physical worlds and, more importantly, allows both to interact with each other.
What's the difference between AR, VR and MR.
How do MR headsets work?
If you're thinking of integrating MR headsets into your office workflow, get familiar with how the technology works so you have an idea of the kind of device you want to invest in.
Some VR and MR headsets must be tethered to a PC to work, while others are cable-free, such as Meta Quest options. These standalone devices offer 360° of freedom of movement and are lightweight for added functionality.
Other hardware aspects to consider in a MR headset are the screens and lenses, sensors, immersive audio and controllers. Let's unpack how each of these work…
MR headsets
MR headsets have a screen per eye so that two different images are shown, creating visual depth and mimicking how the human eye functions in the real world. Lenses are positioned between the screens and the wearer's eyes to distort the image into appearing three-dimensional. These can be either Fresnel or Pancake lenses, the latter being thicker and positioned closer to the screen for an overall slimmer headset look.
Compare the display features of different Meta Quests.
MR headsets come with an array of sensors, including gyroscopes, accelerometers and others, so the visual world on the display continuously adapts to the user's inputs. Some devices also come with a six degrees of freedom (6DoF) system to track the wearer's head movements, as well as eye-tracking sensors for an even more immersive display. In terms of audio, MR headsets use 360-degree or spatial audio technology to mimic real-world sounds, where distance and space can be perceived.
A small but rather significant aspect of MR headsets are the straps. Some devices come with adjustable straps for a custom fit – something to look out for when purchasing for use by multiple people. The Meta Quest 3, for example, has a soft, adjustable strap design, allowing each wearer to make it their own.
MR controllers
Another important part of a MR device is its handheld controllers. Some come with a single joystick-type controller and others come with more advanced options such as haptic-based handhelds that enable pressure-sensitive touch and navigation. The Meta Quests' Tru Haptics controllers provide a new level of interaction and reality, with localised trigger and thumb responses.
Find out which Meta Quest meets all your business's VR needs.
Having a MR headset with all the bells and whistles makes for an enhanced immersive experience. But to bring it all together, the right kind of software needs to be installed.
Discover VR software for your business' needs.
What makes a good MR headset?
Not all MR headsets are created equal – so what separates the good MR headsets from the great MR headsets? Apart from comfort, weight and basic look and feel, here are some of the key aspects that make certain MR devices stand out from the crowd.
MR pass-through
The first is MR pass-through quality. Pass-through is a feature that allows you to see your real-world view of your surroundings while wearing a headset. It works by using headset sensors that approximate what you would see if you were able to look directly through the front of your headset and into the real world around you.
Pass-through can be presented in greyscale or in colour – the latter being available in advanced options such as the Meta Quest 3 and Meta Quest 3S. Depending on your business's needs, full-colour pass-through may prove the superior option. Using mixed reality apps and interacting with colleagues in the same room becomes easier and more natural with a full-colour experience, for example.
Frames per second
Devices offering high frames per second (e.g. 90 FPS) also offer an enhanced user experience. It can be very disruptive for the headset wearer if in-headset motion lags and can even cause them to feel dizzy. Optimal frame rates generate a smoother image quality, so latency issues are prevented, which means your colleagues have a more comfortable MR experience.
Processing power and image resolution
Processing power is also important to consider when choosing a MR headset, as the platform and its graphic rendering capabilities contribute to the resolution of the image seen on the display. Higher resolution means less pixelation, so the virtual world appears more realistic.
How to use your laptop in MR
Meta Quest Remote Desktop lets you pair your laptop to your Meta Quest headset, streaming what is on your computer screen into MR. This is a great tool for business as it creates a seamless flow between your virtual and physical workspaces.
To use your computer in MR in Meta Horizon Workrooms, you'll need to download and install Meta Quest Remote Desktop for macOS (Big Sur, Catalina and Monterey) or Windows (10 and 11).
What are businesses using MR for?
From training programmes to designing 3D models, companies across the globe are using MR to create innovative solutions that propel their businesses into the future. See how Pfizer, Mortensen and Locker Room Talk have used the technology to achieve ambitious business goals.
Training product line operatives at scale
Pfizer manufactured more than 4.5 billion doses of its COVID-19 vaccine because of its innovative approach to training. By implementing MR in just one of their global supply areas, Pfizer was able to reduce training time by 40%.2
Saving money on construction projects
Catching errors early can save the construction industry billions of dollars. Mortensen adopted MR in their 3D modelling so design issues were easier to spot and construction projects more cost-effective to execute.
Promoting gender equality in young athletes
Swedish charity Locker Room Talk developed Coach Journey, a MR-powered emotional intelligence training course for sports coaches. The app aims to prevent misogynistic attitudes from developing in boys' locker rooms.
What's the future for MR technology?
As for the future of MR, the boundary between the real and virtual is becoming increasingly blurred. With full body tracking, greater AI integration and increased adoption across industries setting the scene for the future of business.
We have already seen traditional education models being shattered by MR, with learning and training taking place successfully in virtual classroom and laboratory environments. And corporations are not far behind, with companies in 2024 taking advantage of MR software in areas such as prototyping, design, staff training and customer service.
It's certainly an exciting time for tech-forward businesses with an innovative approach to problem-solving – what will the future hold for such enterprises? With MR as a tool, the possibilities are truly endless.
Get in touch with Meta for Work
Discover how Meta Horizon managed solutions can scale your organisation with virtual and mixed reality. Learn how you can use VR and MR to build the future of work and education with our success stories. Getting started is easy, please
How VR is revolutionising team building
Five benefits of immersive meetings with Microsoft Mesh on Meta Quest
Six innovations shaping the future of work
"Working to make COVID-19 vaccines accessible to everyone, everywhere" Pfizer, accessed 5 June 2024, https://www.pfizer.com/science/coronavirus/vaccine/working-to-reach-everyone-everywhere.
2 "Developing a global vaccine with the help of a digital twin" Meta, accessed 5 June 2024, https://forwork.meta.com/case-studies/how-vr-tech-boosted-pfizers-covid-response/.