How can you combine AR with other technologies?

GenAI and AR are a perfect pairing. Use GenAI to generate assets, textures, and even code to help accelerate augmented reality development. You can also incorporate GenAI into your AR experience to give your user greater creative control in experience where they can use text-to-image, for example, to change the texture on a virtual object in world space, the background of an image target, or even change the sky using semantics with a simple prompt.

XR and AI are a match made in heaven, not that we're in any way biased at @XRAI. Augmenting the real world with contextually relative information could be AR's killer feature. We call this Augmented Intelligence. Imagine being part of the conversation and having information and responses dynamically suggested around you, based on previous conversations you've had. That's nirvana.

With the advancements of Artificial Intelligence in these last two or three years, specially on Generative AI, humanity is approaching the next level of technological evolution. Combining AI with Augmented Reality can make this process even faster reliable and more useful. As AR is essentially "programmable vision", we can use it with AI to identify and count objects, to locate ourselves and find a guided way to a specific location, see information about something that is at some distance, generate virtual objects and useful information on-the-fly to help us accomplish some tasks and many other innovations that we can benefit from. AI + AR are the foundation of the new computing era and will lead humanity to a promising future.

In my journey with SeaDeep, a startup that leverages AR to augment undersea data for optimizing human performance, the role of AI has been nothing short of transformative. Utilizing frameworks like TensorFlow and PyTorch, we've elevated our AR experiences. These AI integrations enable real-time object recognition and decision support, critically enhancing the performance and safety of divers and marine researchers. It's not just about making your AR experience smarter; it's about making it indispensable for achieving peak human performance in challenging environments. For anyone in the startup world, the AI-AR combination isn't just a nice-to-have; it's the future of user engagement and operational excellence.

AR as a concept is pretty straightforward. Adding detail to the "real-world" through digital tools. The real power of AI as it relates to AR is not only the efficiencies it brings to the content creation side of things, though that can't be discounted. The power really lies in ability for these LLMs to parse massive amounts of data quickly and relay that knowledge contextually as valuable "detail". Schematics, SOPs, manuals, etc. all condensed into knowledge that can be delivered as needed.

Connecting AR glasses to the cloud provides access to limitless resources to offload compute from the glasses or a tethered phone. Transcribing audio around the user or interfacing with LLMs are great examples of combining AR and the Cloud.

Cloud and Edge computing are essential elements of the future Augmented / Spatial Internet. Networks such as 6G and its successors will allow for devices to be smaller, lighter and more accessible, whilst delivering outstanding experiences thanks to technologies such as Pixel Streaming, which will empower users with rich experiences. Data can be processed and delivered entirely via Cloud, or just partially, for those who will prefer to own more powerful hardware. But ideally the networks of the future will allow both use cases. Cloud could be the key to the amount of processing required for seamless massive AR experiences in our daily lives.

Cloud Storage allows for assets to be loaded in from an external server. This can offer the opportunity of a larger file size and more expansive AR experience.

3D modeling is the first step towards promoting products with AR Shopping experiences such as virtual try on for eyewear, footwear, watches and jewelry in general. The cheaper and easier to create 3D models for this channel, the more penetration we will see for AR shopping tools and usages. The number one reason AR shopping is still not widely adopted is the high cost and complexity of creating these 3D models. At VRee.ai we are dedicated to fix this. Using AI and machine learning we generate 3D models at high quality, saving up to 99% of the cost and time. AR shopping is the future and our 3D modeling solution is here to help.

AR and CAD In the world of design and engineering, the fusion of Augmented Reality (AR) and Computer-Aided Design (CAD) is breaking down barriers and revolutionizing how we create and interact with 3D models. Augmented Reality enriches the CAD experience by overlaying digital designs onto the real world. This integration provides designers, engineers, and architects with a dynamic way to visualize, review, and collaborate on projects.

AI, leveraged properly, can accelerate the 3D modeling process for creating FBX and OBJ files that UNITY can consume. We have automated this creative pipeline bringing weeks down to hours in many cases.

Yes, we can use the 3D representation of an object or a space and add real-time data to the scene from the IoT (IIoT) platform. We will obtain a very useful AR experience suitable for use in any environment, especially in the industrial environment. .

Although 3D is not necessarily essential for an AR experience, it's definitely one of the main characters. When looking at devices such as Meta's Quest, Apple's Vision Pro and others, you can see many of them still adopt many concepts we're familiar with, being Windows the main one. We've always worked in 2D and used windows since the 90s. So 3D is not really needed, however to allow for truly immersive and outstanding experiences, having 3D objects is key: Shopping, Education, Fitness, and more. Having the ability to visualize objects in 3D allows for better, more seamless experiences that recall the real world.

Universal Spatial Anchors are the missing ingredient to realise the full potential of the GenAI+AR revolution. This will allow full deployment of AR overlays in the real world, replacing existing way finding, QR codes and wifi beacons, allowing Municipalities to set rules regarding the safe use of AR in urban environments and opening up a whole new range of services. The spatial anchor ecosystem is converging towards this through various forms of interoperability and translation tools so there is room for optimism

Computer vision when combined with AR is really exciting. Using CV libraries with AR it is possible to detect what is in the scene and then display contextual AR information. Scene understanding allows virtual content to seamlessly blend with the physical world.

Spatial design / building architecture and AR. When thinking of value and digital design i see these elements as some of the “lowest hanging fruits”. Mostly because this is the field i work within every single day. The design process of spatial design and building architecture is almost fully 3d today with focus on digital modelling for both BIM and CAD design that is used for developing blueprints and documentation. Most of this digital material is sketched in 3d for creating renderings or visualisations as a communicative toolset or later a selling point. When adding on the element of costs, there is rarely made physical 1:1 modelling to see the potential space / element. I look forward to follow this field and be apart of the journey.

AR + Blockchain: Blockchain technology enables shared, persistent AR experiences by allowing secure digital ownership of virtual assets. Blockchain also facilitates AR-based transactions, like buying virtual goods tied to a location.

Medical imaging with AR. AR allows medical professionals to overlay real-time or pre-acquired medical images, such as MRI or CT scans, onto a patient's body during surgery or diagnostic procedures. This fusion of data enables surgeons to visualize critical structures, like blood vessels or tumors, with precision, enhancing surgical accuracy and reducing the risk of complications. Moreover, AR-based medical education platforms offer an immersive learning experience for students and practitioners, allowing them to interact with 3D anatomical models and practice complex procedures virtually. This synergy between medical imaging and AR not only improves patient outcomes but also advances medical training and research in profound ways.