A Survey of auditory display in image-guided interventions <s> Results <s> Current medical visualization technology intended for positional guidance in surgical applications may only ever have limited utility in the operating room due to the preexisting visual requirements of surgical practice. Additionally, visual systems impose limits as a result of their high latency, poor image resolution, problems with stereopsis and physical strain upon the user. Audio technology is relatively unexamined in the broad range of available methodologies for medical devices. The potential to translate surgical instrument position into audio feedback presents a novel solution to the human factors and engineering problems faced by visual display technology because audio technology employs a rich and as yet unburdened sensory modality. We describe an experimental system we have developed for investigating this new interface design approach using commercially available hardware. <s> BIB001 </s> A Survey of auditory display in image-guided interventions <s> Results <s> OBJECTIVES ::: Direct haptic (force or tactile) feedback is not yet available in commercial robotic surgical systems. Previous work by our group and others suggests that haptic feedback might significantly enhance the execution of surgical tasks requiring fine suture manipulation, specifically those encountered in cardiothoracic surgery. We studied the effects of substituting direct haptic feedback with visual and auditory cues to provide the operating surgeon with a representation of the forces he or she is applying with robotic telemanipulators. ::: ::: ::: METHODS ::: Using the robotic da Vinci surgical system (Intuitive Surgical, Inc, Sunnyvale, Calif), we compared applied forces during a standardized surgical knot-tying task under 4 different sensory-substitution scenarios: no feedback, auditory feedback, visual feedback, and combined auditory-visual feedback. ::: ::: ::: RESULTS ::: The forces applied with these sensory-substitution modes more closely approximate suture tensions achieved under ideal haptic conditions (ie, hand ties) than forces applied without such sensory feedback. The consistency of applied forces during robot-assisted suture tying aided by visual feedback or combined auditory-visual feedback sensory substitution is superior to that achieved with hand ties. Robot-assisted ties aided with auditory feedback revealed levels of consistency that were generally equivalent or superior to those attained with hand ties. Visual feedback and auditory feedback improve the consistency of robotically applied forces. ::: ::: ::: CONCLUSIONS ::: Sensory substitution, in the form of visual feedback, auditory feedback, or both, confers quantifiable advantages in applied force accuracy and consistency during the performance of a simple surgical task. <s> BIB002 </s> A Survey of auditory display in image-guided interventions <s> Results <s> In this study the authors measured the effect of auditory feedback during image-guided surgery (IGS) in a phantom model and in a clinical setting. In the phantom setup, advanced IGS with complementary auditory feedback was compared with results obtained with 2 routine forms of IGS, either with an on-screen image display or with image injection via a microscope. The effect was measured by means of volumetric resection assessments. The authors also present their first clinical data concerning the effects of complementary auditory feedback on instrument handling during image-guided neurosurgery. When using image-injection through the microscope for navigation, however, resection quality was significantly worse. In the clinical portion of the study, the authors performed resections of cerebral mass lesions in 6 patients with the aid of auditory feedback. Instrument tip speeds were slightly (although significantly) influenced by this feedback during resection. Overall, the participating neurosurgeons reported that the auditory feedback helped in decision-making during resection without negatively influencing instrument use. Postoperative volumetric imaging studies revealed resection rates of > or = 95% when IGS with auditory feedback was used. There was only a minor amount of brain shift, and postoperative resection volumes corresponded well with the preoperative intentions of the neurosurgeon. Although the results of phantom surgery with auditory feedback revealed no significant effect on resection quality or extent, auditory cues may help prevent damage to eloquent brain structures. <s> BIB003 </s> A Survey of auditory display in image-guided interventions <s> Results <s> Purpose We developed a surgical navigation system that warns the surgeon with auditory and visual feedback to protect the facial nerve with real-time monitoring of the safe region during drilling. <s> BIB004 </s> A Survey of auditory display in image-guided interventions <s> Results <s> BACKGROUND ::: A neuronavigation interface with extended function as compared with current systems was developed to aid during temporal bone surgery. The interface, named EVADE, updates the prior anatomical image and visualizes the bone drilling process virtually in real-time without need for intra-operative imaging. Furthermore, EVADE continuously calculates the distance from the drill tip to segmented temporal bone critical structures (e.g. the sigmoid sinus and facial nerve) and produces audiovisual warnings if the surgeon drills in too close vicinity. The aim of this study was to evaluate the accuracy and surgical utility of EVADE in physical phantoms. ::: ::: ::: METHODOLOGY/PRINCIPAL FINDINGS ::: We performed 228 measurements assessing the position accuracy of tracking a navigated drill in the operating theatre. A mean target registration error of 1.33±0.61 mm with a maximum error of 3.04 mm was found. Five neurosurgeons each drilled two temporal bone phantoms, once using EVADE, and once using a standard neuronavigation interface. While using standard neuronavigation the surgeons damaged three modeled temporal bone critical structures. No structure was hit by surgeons utilizing EVADE. Surgeons felt better orientated and thought they had improved tumor exposure with EVADE. Furthermore, we compared the distances between surface meshes of the virtual drill cavities created by EVADE to actual drill cavities: average maximum errors of 2.54±0.49 mm and -2.70±0.48 mm were found. ::: ::: ::: CONCLUSIONS/SIGNIFICANCE ::: These results demonstrate that EVADE gives accurate feedback which reduces risks of harming modeled critical structures compared to a standard neuronavigation interface during temporal bone phantom drilling. <s> BIB005 </s> A Survey of auditory display in image-guided interventions <s> Results <s> Background ::: ::: An alternative mode of interaction with navigation systems for open liver surgery was requested. Surgeons who use such systems are impeded by having to constantly switch between viewing the navigation system screen and the patient during an operation. ::: ::: ::: ::: Methods ::: ::: To this end, an auditory display system for open liver surgery is introduced with support for guiding the tracked instrument towards and remaining on a predefined resection line. To evaluate the method, a clinically orientated user study with 12 surgeons was conducted. ::: ::: ::: ::: Results ::: ::: It is shown in qualitative results from the user study that the proposed auditory display is recognized as a useful addition to the current visual mode of interaction. It was revealed in a statistical analysis that participants spent less time looking on the screen (10% vs. 96%). Accuracy for resection guidance was significantly improved when using auditory display as an additional information channel (0.6 vs. 1.4 mm); however, the overall time for the resection task was shorter without auditory display (47 vs. 24 s). ::: ::: ::: ::: Conclusions ::: ::: By reducing dependence on the visual modality during resection guidance, the auditory display is well suited to become integrated in navigation systems for liver surgery. Copyright © 2012 John Wiley & Sons, Ltd. <s> BIB006 </s> A Survey of auditory display in image-guided interventions <s> Results <s> Radiofrequency ablation is applied to treat a lesion using a needle inserted into the patient, which delivers local radiofrequency energy. Guided surgical methods allow surgeons to view the placement of the needle in relation to the patient to aid in guiding the tip of the needle to the target point. Unfortunately, such methods require that surgeons remove attention from the patient in order to receive guidance information from a screen. We introduce a novel method to align and insert an ablation needle using auditory display, allowing the surgeon to retain attention on the patient. First evaluation results show that novice users can successfully guide a needle towards a target point using primarily auditory display. We hypothesize that successful auditory display will lead to increased attention on the patient and reduce unnecessary operator head and neck movements. <s> BIB007 </s> A Survey of auditory display in image-guided interventions <s> Results <s> In cochlear implantation (CI), the insertion of the electrode array into the appropriate compartment of the cochlea, the scala tympani, is important for an optimal hearing outcome. The current surgical technique for CI depends primarily on the surgeon's skills and experience level to achieve the correct placement of the electrode array, and the surgeon needs to confirm that the exact placement is achieved prior to completing the procedure. Thus, a surgical navigation system can help the surgeon to access the scala tympani without injuring important organs in the complex structure of the temporal bone. However, the use of a surgical microscope has restricted the effectiveness of the surgical navigation because it has been difficult to deliver the navigational information to the surgeon from outside of the surgeon's visual attention. We herein present a clinical feasibility study of an auditory feedback function developed as a computer-surgeon interface that can guide the surgeon to the preset cochleostomy location. As a result, the surgeon could confirm that the drilling point was correct, while keeping his or her eyes focused on the microscope. The proposed interface reduced the common frustration that surgeons experience when using surgical navigation during otologic surgeries. <s> BIB008 </s> A Survey of auditory display in image-guided interventions <s> Results <s> OBJECTIVES/HYPOTHESIS ::: Image-guided surgery (IGS) systems are frequently utilized during cranial base surgery to aid in orientation and facilitate targeted surgery. We wished to assess the performance of our recently developed localized intraoperative virtual endoscopy (LIVE)-IGS prototype in a preclinical setting prior to deployment in the operating room. This system combines real-time ablative instrument tracking, critical structure proximity alerts, three-dimensional virtual endoscopic views, and intraoperative cone-beam computed tomographic image updates. ::: ::: ::: STUDY DESIGN ::: Randomized-controlled trial plus qualitative analysis. ::: ::: ::: METHODS ::: Skull base procedures were performed on 14 cadaver specimens by seven fellowship-trained skull base surgeons. Each subject performed two endoscopic transclival approaches; one with LIVE-IGS and one using a conventional IGS system in random order. National Aeronautics and Space Administration Task Load Index (NASA-TLX) scores were documented for each dissection, and a semistructured interview was recorded for qualitative assessment. ::: ::: ::: RESULTS ::: The NASA-TLX scores for mental demand, effort, and frustration were significantly reduced with the LIVE-IGS system in comparison to conventional navigation (P < .05). The system interface was judged to be intuitive and most useful when there was a combination of high spatial demand, reduced or absent surface landmarks, and proximity to critical structures. The development of auditory icons for proximity alerts during the trial better informed the surgeon while limiting distraction. ::: ::: ::: CONCLUSIONS ::: The LIVE-IGS system provided accurate, intuitive, and dynamic feedback to the operating surgeon. Further refinements to proximity alerts and visualization settings will enhance orientation while limiting distraction. The system is currently being deployed in a prospective clinical trial in skull base surgery. <s> BIB009 </s> A Survey of auditory display in image-guided interventions <s> Results <s> Image-guided medical interventions more frequently rely on Augmented Reality (AR) visualization to enable surgical navigation. Current systems use 2-D monitors to present the view from external cameras, which does not provide an ideal perception of the 3-D position of the region of interest. Despite this problem, most research targets the direct overlay of diagnostic imaging data, and only few studies attempt to improve the perception of occluded structures in external camera views. The focus of this paper lies on improving the 3-D perception of an augmented external camera view by combining both auditory and visual stimuli in a dynamic multi-sensory AR environment for medical applications. Our approach is based on Temporal Distance Coding (TDC) and an active surgical tool to interact with occluded virtual objects of interest in the scene in order to gain an improved perception of their 3-D location. Users performed a simulated needle biopsy by targeting virtual lesions rendered inside a patient phantom. Experimental results demonstrate that our TDC-based visualization technique significantly improves the localization accuracy, while the addition of auditory feedback results in increased intuitiveness and faster completion of the task. <s> BIB010 </s> A Survey of auditory display in image-guided interventions <s> Results <s> Image-guided navigation (IGN) systems provide automation support of intra-operative information analysis and decision-making for surgeons. Previous research showed that navigated-control (NC) systems which represent high levels of decision-support and directly intervene in surgeons' workflow provide benefits with respect to patient safety and surgeons' physiological stress but also involve several cost effects (e.g. prolonged surgery duration, reduced secondary-task performance). It was hypothesised that less automated distance-control (DC) systems would provide a better solution in terms of human performance consequences. N = 18 surgeons performed a simulated mastoidectomy with NC, DC and without IGN assistance. Effects on surgical performance, physiological effort, workload and situation awareness (SA) were compared. As expected, DC technology had the same benefits as the NC system but also led to less unwanted side effects on surgery duration, subjective workload and SA. This suggests that IGN systems ... <s> BIB011 </s> A Survey of auditory display in image-guided interventions <s> Results <s> Purpose ::: During medical needle placement using image-guided navigation systems, the clinician must concentrate on a screen. To reduce the clinician’s visual reliance on the screen, this work proposes an auditory feedback method as a stand-alone method or to support visual feedback for placing the navigated medical instrument, in this case a needle. <s> BIB012
The results of the search yielded 15 articles, BIB006  BIB010 BIB007 BIB012 BIB004 BIB008 BIB009 BIB002  BIB005 BIB001  BIB003 BIB011 that met the eligibility criteria. The eligible articles cover a wide range of interventional tasks, implemented auditory display methods, evaluation styles and environments, and findings.