Digital Controller for Mobile VR Experiences

INTRODUCTION

The ‘Digital Controller Solution’ manifested from a larger project. We didn't set out to develop the ‘Controller’. It's an outcome of a personal project. Like all personal projects, this one too is inspired by client AR/VR projects developed over last 3 years.

So many times it happens, while researching a client's project you stumble upon nuggets of information. It might have no immediate relevance to the work at hand,but gets stored into your memory for later.

Those initial enquiries & some personal experience, have led us to this dev-blog. 

This POC of the initial idea is for Android mobile VR experiences only. Its a 'Work in Progress' & with this article we hope to get critical feedback .

Not everyone needs or can afford the latest expensive VR devices. People who want to graduate from video to a 360 degree or 3D experience need better controls on their Gear VR not a new device. It's a bottom up low cost approach & is addressed to the lowest denominator in the value chain, the SMARTPHONE.

The 'Digital Controller', is a feature bridge that can enhance the user experience in Mobile VR devices that lack controllers unlike the more expensive VR devices.

We are too early in the project to reveal too many details for now, and will keep the blogs coming as we progress in the right direction.

CONCEPT:

Mobile VR devices lack controllers. This limits the scope of VR experiences on mobile VR.

The 'Digital Controller' solution makes it possible to guide a VR experience with the aid of a second smartphone (Controller device) or a PC/Laptop. The Controller device plays the role of a dedicated VR controller & its features can be further extended as per the needs of the applications.

SOLUTION:

1. Device A - Controller (Mobile or PC/Laptop) in the hands of the ‘Demo Giver’ or Trainer/Presenter .
2. Device B - VR capable device (only mobile) in the hands of the ‘Demo Receiver’ or Student/Staff .
3. The demo receiver (device B) experiences 3D VR on a smartphone. While the controller (device A) guides & controls the VR experience on device B.
4. This system can be devised for VR Box / Google Cardboard / Gear VR class of devices needed for mobile VR.
5. The system follows a client-server model, where the controlling device is the server, and the VR device is a client.
6. There are two key feature of this 'Digital Controller' Solution

• More than one user (Clients) can be added to the same system .
• Single controller ( Server) device can guide more users in the VR experience.

Example view of both the Server & Client ( for demo purpose only)

SERVER-Controller View CLIENT-3D VR View

Benefits of this Solution

1. This system can extend the shelf life of existing or old content developed for mobile VR experiences.
2. Newer content can be generated with better controls for the Smartphone + VR device combine.
3. Controller features can be further modified to address specific needs of any mobile VR applications.

What you can do with this solution

1. To develop guided mobile VR experiences with better features
2. Develop applications that demand portable mobile VR experience for large audiences like a classroom or training sessions.
3. Extend the capabilities of existing mobile VR experiences with a cost effective solution. Older solutions can be re-purposed with better controls giving it a new lease of life without the expense of new content development & hardware purchase.

USE-CASES:

INDUSTRIAL TRAINING- 

1. Exploded view of a 3D car in VR can have enhanced control features.
2. Working of different types of machines can have triggers.
3. Production processes of goods can display animations.

TRAINING

1. Observe the functions of the human body in VR with better controls
2. Learn the principles of Chemistry with triggered content .
3. Experience the formations of tornadoes with animations.

BUSINESS PRESENTATIONS- 

1. Re-purpose existing guided tour of a real estate property or cruise ship.

a) Existing solution has poor user experience.

b) Solution: User getting a better VR experience of the location/property guided by the digital controller solution:

1. 
   
2. Construction site review in an office
3. Evaluation of a design in 3D:

a) Existing Solution: The speaker explains the details of the architectural structure of

the Eiffel Tower, using a power-point presentation.

b) Solution: The speaker guides uses a guided VR experience to

explain the architectural structure.

CLOSING NOTE

This is a WIP & very much in the idea stage for now . We would like to gather feedback on these ideas , anything that can help us develop it further.

--------------------------------------------------------------

Harold & Rohan