Virtual interactive presence
Script error: No such module "Draft topics".
Script error: No such module "AfC topic".
Virtual interactive presence or merged reality is the use of technology to combine multiple environments and objects, both real and virtual, into an integrated virtual space for two or more users. Merged reality/virtual interactive presence combines elements of virtual reality and augmented reality, and describe a type of mixed reality or extended reality.
"Merged reality" is sometimes used interchangeably with "augmented reality" and "mixed reality,"[1] but like "virtual interactive presence," it also frequently refers to the merging of two or more sets of virtual and real inputs and outputs, while mixed reality and augmented reality are broader terms which can also describe the one-way overlay of computer-generated data onto sensory modalities.
History[edit]
One of the earliest descriptions of virtual interactive presence in academic literature appeared in a 2005 description of a control system for space station docking. The proposed system conceived virtual interactive presence as a means of enhancing human-robot communication and manually use autonomous systems to carry out tasks beyond the capacity of robotic components.[2]
However, University of Alabama neurosurgeon Barton Guthrie had been investigating the potential use of augmented reality since 2003, and participated in the development of a system utilizing Google Glass. The system was first used in a shoulder replacement surgery conducted in a merged reality environment at the University of Alabama by orthopedic surgeon Brent Ponce in 2013.[3] Guthrie and Ponce developed the prototype into a formal system dubbed Virtual Interactive Presence in Augmented Reality (VIPAAR).[4] In 2015, the technology was used to enable surgeons in Alabama to participate in a surgery in Vietnam.[5]
The first major consumer product to be described as a "merged reality" device was Intel's Project Alloy, announced in 2016. The device contained sensors which mapped real-world objects into virtual environments. Alloy was differentiated from Microsoft's mixed reality HoloLens by its ability to incorporate the user's surroundings into virtual environments, whereas the HoloLens only enabled inside-out tracking.[6] Alloy's capacity to incorporate real-world data into virtual environments was based on Intel's RealSense, a suite of range and depth tracking technologies.[7] Alloy was ultimately discontinued due to lack of partner interest and limited computing power within the headset.[8]
Intel has been credited with coining the term "merged reality" for this application,[9] but usage of "merged reality" in academic literature to describe virtual interactive presence was already widespread at the time.[10]
Applications[edit]
Mixed reality has been used in applications across fields including design, education, entertainment, military training, healthcare, product content management, and human-in-the-loop operation of robots.
Merged reality/virtual interactive presence typically adds interactive layers to a mixed reality visual environment. This often involves a remote expert interacting in real time with an on-site technician or worker via a mobile device or augmented reality headset. The remote user can see the visual field and hands of the on-site user, while the on-site user can see the hands of the remote user.
Merged reality/virtual interactive presence applications may also project additional visual content onto the visual field of the on-site user, such as informational content or visual aids, including virtual tools. These applications require 3D spatial understanding to enable accurate collaboration in merged reality environments.
Medicine[edit]
Medical applications are the most well known application of virtual interactive presence. These applications typically allow a remote surgeon to view the patient and the hands of the operating surgeon. The operating surgeon can see the virtual presence of the remote surgeon's hands and sometimes a tool like a scalpel, while the remote surgeon can see the patient and the operating surgeon's hands from the operating surgeon's perspective. In this way, an expert can remotely guide the hands of a less experienced surgeon with a high degree of precision.[11] Similar applications have been explored in medical education.[12]
Maintenance and Field Service[edit]
Virtual interactive presence can be used to remotely guide and support workers or technicians via video call or live video stream by overlaying real-time annotations and human gestures on video streams.[13] It can enable technicians to access digital manuals and schematics overlaid on physical equipment facilitating real-time diagnosis and repair.
For example, merged reality has been used in repairs of British Columbia's utilities infrastructure, where power lines covering large distances and serving small populations are covered by a small number of technicians. Merged reality applications have enabled technicians to guide customers to perform maintenance and repair procedures themselves rather than dispatching technicians to remote locations.[14]
See also[edit]
References[edit]
- ↑ "Augmented Reality", International Encyclopedia of Ergonomics and Human Factors - 3 Volume Set (2 ed.), CRC Press, 2006, pp. 1077–1080, doi:10.1201/9780849375477-224, ISBN 978-0-429-13484-5, retrieved 2023-07-13
- ↑ Reitsema, Josh; Chun, Wendell; Fong, Terry; Stiles, Randy (2005-08-30). Team-Centered Virtual Interactive Presence for Adjustable Autonomy. American Institute of Aeronautics and Astronautics. doi:10.2514/6.2005-6606. ISBN 978-1-62410-070-3. Search this book on
- ↑ "UAB does virtual surgery with VIPAAR and Google Glass". UAB News. Retrieved 2023-07-13.
- ↑ Underwood, Jerry (26 December 2013). "UAB virtual reality surgery combines Google Glass, VIPAAR technologies | Made in Alabama: Alabama Department of Commerce". Made in Alabama. Retrieved 7 August 2023.
- ↑ Davis, Matthew Christopher; Can, Dang D.; Pindrik, Jonathan; Rocque, Brandon G.; Johnston, James M. (2016-02-01). "Virtual Interactive Presence in Global Surgical Education: International Collaboration Through Augmented Reality". World Neurosurgery. 86: 103–111. doi:10.1016/j.wneu.2015.08.053. PMC 5476961. PMID 26342783.
- ↑ Robertson, Adi (2017-09-22). "Intel is cutting plans for its Project Alloy 'merged reality' headset". The Verge. Retrieved 2023-07-13.
- ↑ Nast, Condé. "Intel's 'merged reality' headset arrives this year". Wired UK. ISSN 1357-0978. Retrieved 2023-07-13.
- ↑ "Hope you weren't waiting for Intel's Project Alloy headset". CNET. Retrieved 2023-07-13.
- ↑ Chand, Mahesh. "What Is Merged Reality". www.c-sharpcorner.com. Retrieved 2023-07-13.
- ↑ Moseley, Ralph (August 2014). "Merged reality systems: Bringing together automation and tracking through immersive geospatial connected environments". 2014 Science and Information Conference. IEEE. pp. 732–735. doi:10.1109/SAI.2014.6918268. ISBN 978-0-9893193-1-7. Unknown parameter
|s2cid=
ignored (help) Search this book on - ↑ Cofano, Fabio; Di Perna, Giuseppe; Bozzaro, Marco; Longo, Alessandro; Marengo, Nicola; Zenga, Francesco; Zullo, Nicola; Cavalieri, Matteo; Damiani, Luca; Boges, Daniya J.; Agus, Marco; Garbossa, Diego; Calì, Corrado (2021). "Augmented Reality in Medical Practice: From Spine Surgery to Remote Assistance". Frontiers in Surgery. 8: 657901. doi:10.3389/fsurg.2021.657901. ISSN 2296-875X. PMC 8042331 Check
|pmc=
value (help). PMID 33859995 Check|pmid=
value (help). - ↑ Davis, Matthew Christopher; Can, Dang D.; Pindrik, Jonathan; Rocque, Brandon G.; Johnston, James M. (February 2016). "Virtual Interactive Presence in Global Surgical Education: International Collaboration Through Augmented Reality". World Neurosurgery. 86: 103–111. doi:10.1016/j.wneu.2015.08.053. PMC 5476961. PMID 26342783.
- ↑ "Field service delivery featuring merged reality". Ricoh USA. Retrieved 2023-07-13.
- ↑ Johnston, Carol (2021-06-29). "Tech Trends for Utilities: Our Reality is Now a Merged Reality". IFS Blog. Retrieved 2023-07-21.
External links[edit]
Media related to Mixed reality at Wikimedia Commons Template:Informatics
This article "Virtual interactive presence" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:Virtual interactive presence. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.