Remote Presence Solution

XB Software can implement the remote presence software system on AR glasses, head-mounted wearable computers, smartphones or tablets. In conditions of high humidity, dirt, dust, severe weather conditions, or when manual control of the devices is not possible, special devices like head-mounted wearable computer or AR glasses with voice control can be used. Remote presence is provided by video streaming with WebRTC technology. Additionally, AR technology is used when the customer requires the solution to be implemented on AR glasses.

System Architecture

The solution, as a rule, consists of 3-4 components:

1. a signal server which is responsible for two-way video/audio signal
2. a client application on a device
3. a desktop web interface for an expert
4. a process management system/storage/wiki-systems, etc.

Internet connection takes place via:

• Mobile Internet. If work is carried out in the field, e.g. gas pipes, or at sites under construction, mobile Internet is used for data transfer.
• Wi-Fi. This is used on-site if available.
• Through a chain of repeaters. If works take place in hard-to-reach places such as underground in mines for example, then a network of repeaters is used to provide the connection.

In case of disconnection or network absence, a video stream from the device can be saved in its internal memory for later transfer to storage following reconnection.

The following features can be implemented:

• Digital video recorder (DVR) to monitor the duration and quality of work.
• Real-time consultation with a remote expert (with text chat for noisy environments).
• Access to the knowledge base of case studies, manuals, protocols scripts, schemes, etc.
• Voice control.
• Process/staff administration system or any other web-based systems in the office.

Digital video recorder (DVR) feature

DVR controls the time and quality of work of the specialists. A record of a specific timestamp can be accessed via cloud storage, local servers or hosts in disputed cases or for access to archived notes. DVR feature ensures compliance by workers with working and resting regulations, safety measures, etc.

Real-time consultation with a remote expert (with chat option)

A two-way audio and video communication channel provides access to an office-based expert for remote professional consultation so that skilled personnel can see what a specialist sees and give advice, share the screen, use pointer features, and make marks on screenshots, etc. If AR technology is used, virtual elements or hints such as geotags, addresses, recommendations, and pointers are displayed directly on the smartphone, tablet, or glasses being used.

The specialist can also use chat to communicate with remote experienced personnel if necessary.

Access to the knowledge base

With a remote presence device, a specialist can access a stored knowledge base and use voice control, if required, to navigate, open, copy, send, or move files.

Voice control

If necessary, voice commands will be configured to control the system.

Process/staff administration system or any other web-based systems in the office

It’s essential that the remote presence system can be integrated into any enterprise resource planning system (ERP). Also, features of the process administration system, staff management system, or any other required features can be added to the desktop interface.