Using Mixed Reality with Haptic Feedback for Training Medical Personnel in Catheter Insertion, 07-9224

Principal Investigators
J. Brian Fisher
Julie M. Pickard
Susan M. Porter
Brian L. Robey
Malachi J. Wurpts
Aaron J. Roberts

Inclusive Dates: 10/01/00 - 12/31/01

Background - In the medical industry, a significant amount of medical training is currently performed using actual patients, which can be costly to both patients and hospitals. Medical simulations provide a low-cost, low-risk, readily available option. Improving on current medical simulation techniques will improve the quality of healthcare and reduce the chances for error, potentially saving hospitals and patients thousands of dollars from unnecessary follow-up treatments.

Approach - The purpose of this project was to design, develop, and demonstrate a prototype medical training simulation. This project focused on demonstrating the use of mixed reality technologies integrated with current medical simulation techniques to improve the realism and quality of medical training. As shown in the illustrations below, the device allows a simulated procedure to be performed in a natural manner by allowing the user to work in their normal workspace. Haptic and force feedback are provided in the workspace through the use of a mannequin and force feedback device. A Charge Couple Device (CCD) camera is mounted in the workspace to capture images of the user's hand. Chromakeying techniques are applied to combine these real images with computer-generated images representing a simulated patient, which are displayed on a Liquid Crystal Display (LCD) monitor.

Accomplishments - The project team successfully completed the development of a prototype system that provides visual, haptic, and force feedback during the simulation of a catheter introducer insertion. Software was developed to simulate different patient types by allowing the user to interactively set physical properties associated with skin, bones, and veins. An evaluation of the prototype was conducted at the Janey Briscoe Children's Center at University Hospital in San Antonio, during which physicians, nurses, and medical technicians provided feedback regarding the usefulness and possible application areas for the device and approach. The results of the evaluation were promising, with a large majority expressing interest in the system and identifying potential use in training numerous procedures.

The display device uses chromakey technologies and force and haptic feedback to allow a user to practice a simulated procedure in a natural manner.

2002 Program SwRI Home