The Johns Hopkins-Coulter Translational Partnership Oversight Committee has selected our project, “Augmented Reality for Orthopedic and Trauma Surgeries,” for the full funding requested. The OC stated it was very impressed with the high level of presentations. For our project, the technical development, market potential and potential benefit to patients, as well as the chance of commercialization success were considered exceptionally strong and justified full project funding.
The most difficult procedures during orthopedic and trauma surgeries is the placement of screws to repair complex fractures. Using a vast amount of X-ray images (we have observed surgeries with up to 246 images) the surgeon needs to drill a guide wire through the bone fragments. The difficulty is further increased by muscle and other tissue covering the bones (e.g. for pelvis).
Our system comprises a traditional X-ray machine (C-arm), a 3D camera mounted on this X-ray machine, and generally available 3D Computed Tomography (CT) images to guide the surgeon. Rather than seeing simple 2D X-ray images, our system shows the surgeon a 3D view of the bones, the drill, the patient surface and even the surgeon’s hands in real-time. This “Superman”- view, referred to Interventional 3D Augmented Reality, was shown to reduce duration, radiation dose, number of X-ray images, and complications in our pre-clinical experiments. In summary, our system increases patient safety and represents the future of interventional X-ray imaging.
Our joint effort on the first SPECT imaging using a miniaturized drop-in gamma detector and the da Vinci surgical system has not just been accepted for publication in the IEEE Transactions on Medical Imaging, but is one of the currently featured articles. Find the announcement and access to the paper here. Special thanks to the authors Bernhard Fuerst, Francisco Pinto, Julian Sprung, Benjamin Frisch, Thomas Wendler, Herve Simon, Laurent Mengus, Nynke S. van den Berg, Henk G. van der Poel, Fijs W.B. van Leeuwen, and Nassir Navab.
Neither snow nor rain nor cold nor darkness* kept the interested group of PhD applications from visiting JHU CS and LCSR on Friday and Saturday (15 cm snow at 263 Kelvin). We were happy to present our research, and discuss details individually. We want thank our visitors the great time and fighting the bad weather!
Camera Augmented Mobile C-arm (CamC) is the newest addition to LCSR which was initially invented by Prof. Nassir Navab in 1998 at Siemens Corporate Research. It allows the fusion of X-ray and the optical camera, and it is the only practically accepted intra-operative augmented reality system.