Custom Remote Presence System | XB Software

Remote Presence Solution

XB Software developed custom web-based software that embodies the virtual presence of a remote expert for assistance to a specialist who can be located at any place. Remote presence technology is provided by means of a digital device – tablet/ AR-glasses/ head-mounted wearable computer, etc..

2019

Business Challenge

For spheres like manufacturing, oil and mining industries, mechanical engineering and other high-tech sectors, the ability to perform highly skilled work by less qualified personnel, as well as reduction of errors related to the human factor, are very promising areas of development. Remote presence system is one of the opportunities to embody the being of rare experts at locations remote from offices. First of all, such an approach grows the labor efficiency of less qualified personnel and increases the efficiency of a man-hour of expensive employees. It’s done by the reduction of 1) time on business trips, 2) time for performance of the works, and 3) the likelihood of errors due to the prompt intervention of skilled personnel. Furthermore, in case of urgencies and incidents, it provides the most rapid response of the necessary expert or a group through the remote presence at the places. And finally, with this solution, intern training and practice directly during the process under the guidance of an expert can be carried out (Remote Mentor).

Solution

XB Software implements Remote Presence software system on AR-glasses, head-mounted wearable computers, smartphones or tablets. In conditions of high humidity, dirt, dust, severe weather conditions, or when manual control of the devices is not possible special devices like head-mounted wearable computers or AR-glasses with voice control can be used. Remote presence is provided by video streaming with WebRTC technology. Additionally, AR technology will be used in case a customer requires to implement the solution on AR-glasses.

 

System Architecture

The solution, as a rule, consists of 3-4 components:

  1. a signal server which is responsible for two-way video/audio signal
  2. a client application on a device
  3. a desktop web interface for an expert
  4. a process management system/storages/wiki-systems, etc..

Internet connection takes place via:

  • Mobile Internet. If work is carried out in the fields, e.g., gas pipes, or at sites under construction, mobile Internet is used for data transfer.
  • Wi-Fi. If the territory of the plant/enterprise is covered with Wi-Fi, then this net is used.
  • Through a chain of repeaters. If works are introduced in mines, underground city communications, etc., a network of repeaters is used to provide connection in hard-to-reach places.

In case of disconnection or network absence video stream from the device can be saved in the internal memory for further transfer to the storage when reconnecting.

 

The following features can be implemented:

  • Digital video recorder (DVR) controls time and quality of work.
  • Real-time consultation with a remote expert (with a text chat for noisy environments).
  • Access to the knowledge base of case studies, manuals, protocols scripts, schemes, etc..
  • Voice control.
  • Process/staff administration system or any other web-based systems in the office.

 

Digital video recorder (DVR) feature

DVR controls the time and quality of work of the specialists. A record of a specific timestamp can be accessed via the cloud storage, local servers or hosts in disputed cases or for access to archival notes. DVR feature allows ensuring compliance with working and resting regulations, safety measures, etc. by workers.

 

Real-time consultation with a remote expert (with chat option)

Two-way audio and video communication channel provides to an expert in the office with the possibility to consult a professional on the place. The skilled personnel sees what a specialist sees and gives advice, shares the screen, uses pointer features, and makes marks on screenshots, etc. In case AR technology is used virtual elements or hints (e.g. geotags, addresses, recommendations, pointers) are displayed directly on the device that is used – smartphone, tablet, or glasses.

If required, a specialist is able to use a chat to communicate with experienced remote personnel.

 

Access to the knowledge base

From a remote presence device, a specialist has access to a knowledge base in the storage. Through voice control, if required, one can navigate, open, copy, send, or move files.

 

Voice control

If necessary, voice commands will be configured to control the system.

 

Process/staff administration system or any other web-based systems in the office

It’s essential that the Remote Presence System can be integrated into any enterprise resource planning system (ERP). Also, features of the process administration system, staff management system, or any other required features can be added to the desktop interface.

Applied Technologies

nodejs
reactjs
webrtc
Duration

5 months

Estimated Working Hours

2500+

Business Effects

An increase in the efficiency of internal processes can give a significant advantage in the market. Depending on the size of the enterprise, cost savings may count hundreds of thousands of dollars by:

  • increasing the labor efficiency of less qualified personnel
  • increases the efficiency of a man-hour of expensive employees
  • reducing the likelihood of errors by specialists
  • faster and better adaptation of interns.