Microsoft Mesh, a new mixed-reality platform powered by Azure – that allows people in different physical locations to join and share holographic experiences on many kinds of devices, was launched on Tuesday by Microsoft.
The team of engineers behind the technology mostly worked from Lagos, Nigeria’s most populated commercial city.
Mixed-reality technology allows real and virtual elements to interact with one another and the user to interact with virtual elements like they would in the real world. The new technology essentially changes the experience people would have in a virtual meeting where they can only participate with their voices.
With the Microsoft Mesh launched, participants would not only speak to one another, but they also get to be in the same virtual room and interact with virtual objects like in real life. In that sense, Mesh is more than an app for holding virtual meetings. It is an all-encompassing platform built on top of Azure that Microsoft is hoping developers will tap into.
“Today, the world finally gets to hear about Microsoft Mesh. Our incredible engineering team here in Lagos has been working tirelessly towards this day for a very long time. So proud of what we have accomplished,” Hoop Somuah, engineer manager, Microsoft Mesh, tweeted on Tuesday.
Somuah, who joined Microsoft as a software engineer in June 2003, became the software engineering manager in January 2019. He also heads the mixed-reality team in Nigeria. Microsoft maintains engineering teams in Nigeria and Kenya.
Mesh is likely the future of the Microsoft Team – the company’s virtual meeting app. Microsoft is hoping architects, engineers and designers will all see the promise of Mesh, particularly during a pandemic when it is difficult to work with 3D physical models without all being in the same room.
“This has been the dream for mixed reality, the idea from the very beginning,” said Microsoft technical fellow, Alex Kipman. “You can actually feel like you are in the same place with someone sharing content or you can teleport from different mixed-reality devices and be present with people even when you are not physically together.”
The new platform is the result of years of Microsoft research and development in areas ranging from hand and eye-tracking and HoloLens development to creating persistent holograms and artificial intelligence models that can create expressive avatars.
Microsoft originally demonstrated HoloLens using a collaborative Skype call where a technician could guide you on how to fix some wiring. It felt like the promise of augmented reality, and Microsoft Mesh seems like the natural next step.
Microsoft Mesh will also enable geographically distributed teams to have more collaborative meetings, conduct virtual design sessions, assist others, learn together and host virtual social meet-ups. People will initially be able to express themselves as avatars in these shared virtual experiences and overtime use holoportation (a new type of 3D capture technology that allows high-quality 3D models of people to be reconstructed, compressed, and transmitted anywhere in the world in real-time) to project themselves as their most lifelike, photorealistic selves, the company said.
Experts say the Microsoft Mesh is likely to face its biggest challenge with the high cost of HoloLens devices and virtual reality (VR) headsets. Users however can still use the Microsoft Mesh using a 2D screen like a phone or personal computer (PC), but the experience will not be as immersive as using a headset. The price of one HoloLens goes for about $4,950 (N1.88m).