This paper surveys the field of augmented reality AR, in which 3D virtual objects are integrated into a 3D real environment in real time. It describes the medical, manufacturing, visualization, path planning, entertainment, and military applications that have been explored. This paper describes the characteristics of augmented reality systems, including a detailed discussion of the tradeoffs between optical and video blending approaches. Registration and sensing errors are two of the biggest problems in building effective augmented reality systems, so this paper summarizes current efforts to overcome these problems. Future directions and areas requiring further research are discussed. This survey provides a starting point for anyone interested in researching or using augmented reality.

/pdf/a-survey-of-augmented-reality-17irtaxt7z.pdf

A survey of augmented reality

http://ee.sharif.edu/~miap/Files/A%20Survey%20of%20Medical%20Image%20Registration.pdf

A survey of medical image registration.

Minimally invasive surgery represents one of the main evolutions of surgical techniques aimed at providing a greater benefit to the patient. However, minimally invasive surgery increases the operative difficulty since the depth perception is usually dramatically reduced, the field of view is limited and the sense of touch is transmitted by an instrument. However, these drawbacks can currently be reduced by computer technology guiding the surgical gesture. Indeed, from a patient’s medical image (US, CT or MRI), Augmented Reality (AR) can increase the surgeon’s intra-operative vision by providing a virtual transparency of the patient. AR is based on two main processes: the 3D visualization of the anatomical or pathological structures appearing in the medical image, and the registration of this visualization on the real patient. 3D visualization can be performed directly from the medical image without the need for a pre-processing step thanks to volume rendering. But better results are obtained with surface rendering after organ and pathology delineations and 3D modelling. Registration can be performed interactively or automatically. Several interactive systems have been developed and applied to humans, demonstrating the benefit of AR in surgical oncology. It also shows the current limited interactivity due to soft organ movements and interaction between surgeon instruments and organs. If the current automatic AR systems show the feasibility of such system, it is still relying on specific and expensive equipment which is not available in clinical routine. Moreover, they are not robust enough due to the high complexity of developing a real-time registration taking organ deformation and human movement into account. However, the latest results of automatic AR systems are extremely encouraging and show that it will become a standard requirement for future computer-assisted surgical oncology. In this article, we will explain the concept of AR and its principles. Then, we will review the existing interactive and automatic AR systems in digestive surgical oncology, highlighting their benefits and limitations. Finally, we will discuss the future evolutions and the issues that still have to be tackled so that this technology can be seamlessly integrated in the operating room.

Augmented reality in laparoscopic surgical oncology.

We compare two technological approaches to augmented reality for 3-D medical visualization: optical and video see-through devices. We provide a context to discuss the technology by reviewing several medical applications of augmented-reality re search efforts driven by real needs in the medical field, both in the United States and in Europe. We then discuss the issues for each approach, optical versus video, from both a technology and human-factor point of view. Finally, we point to potentially promising future developments of such devices including eye tracking and multifocus planes capabilities, as well as hybrid optical/video technology.

/pdf/optical-versus-video-see-through-head-mounted-displays-in-lvskg46osj.pdf

Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization

The impressive development of medical imaging technology during the last decades provided physicians with an increasing amount of patient specific anatomical and functional data. In addition, the increasing use of non-ionizing real-time imaging, in particular ultrasound and optical imaging, during surgical procedures created the need for design and development of new visualization and display technology allowing physicians to take full advantage of rich sources of heterogeneous preoperative and intraoperative data. During 90's, medical augmented reality was proposed as a paradigm bringing new visualization and interaction solutions into perspective. This paper not only reviews the related literature but also establishes the relationship between subsets of this body of work in medical augmented reality. It finally discusses the remaining challenges for this young and active multidisciplinary research community.

Advanced Medical Displays: A Literature Review of Augmented Reality

The operating microscope is an integral part of many neurosurgery and otolaryngology procedures; the surgeon often uses the microscopic view for a large portion of the operation. Information from preoperative radiological images is often viewed only on X-ray films. The surgeon then has the difficult task of relating this information to the appearance of the surgical view. Image guidance techniques attempt to relate these two sets of information by registering the patient in the operating room to preoperative images using locating devices. Conventionally, image data are presented on a computer monitor, which requires the surgeon to look away from the operative scene. We describe a guidance system, for procedures in which the operating microscope is used, which super-imposes image-derived data upon the operative scene. We create a model of relevant structures (e.g., tumor volume, blood vessels, and nerves) from multimodality preoperative images. By calibrating microscope optics, registering the patient to image coordinates, and tracking the microscope and patient intraoperatively, we can generate stereo projections of the three-dimensional model and project them into the microscope eyepieces, allowing critical structures to be overlaid on the operative scene in the correct position. Measurements with a head phantom gave a root mean square (RMS) error of 1.08 mm, and the estimated error for a human volunteer is between 2 and 3 mm. Initial evaluation in the operating room was very promising.

https://www.tandfonline.com/doi/pdf/10.3109/10929089509105692

Augmentation of Reality Using an Operating Microscope for Otolaryngology and Neurosurgical Guidance

Many neuro- and ENT surgical procedures are performed using the operating microscope. Conventionally, the surgeon cannot accurately relate information from preoperative radiological images to the appearance of the surgical field. We propose that the best way do this is to superimpose image derived data upon the operative scene. We create a model of relevant structures (e.g. tumor volume, blood vessels and nerves) from multimodality preoperative images. By calibrating microscope optics, registering the patient in-theatre to image coordinates, and tracking the microscope intra-operatively, we can generate stereo projections of the 3D model and project them into the microscope eyepieces, allowing critical structures to be overlayed on the operative scene in the correct position. We have completed initial evaluation with a head phantom, and are about to start clinical evaluation on patients. With the head phantom a theoretical accuracy of 4.6mm was calculated and the observed accuracy ranged from 2mm to 5mm.

Neurosurgical Guidance Using the Stereo Microscope

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

R. Spink

Author Tools

Chat about Author

Papers

Augmentation of Reality Using an Operating Microscope for Otolaryngology and Neurosurgical Guidance

Neurosurgical Guidance Using the Stereo Microscope