MIT researchers have developed an augmented reality ultrasound platform that generates a real-time 3D view of scanned anatomy, a technology that could reduce the expertise required to interpret conventional ultrasound images.

The system, described in Nature Communications Engineering, combines real-time 3D ultrasound imaging with augmented reality visualization. Users wearing an AR/VR headset can view a three-dimensional digital representation of structures beneath the surface of the object being scanned, aligned with its physical location.

Traditional ultrasound typically produces 2D images that clinicians must mentally reconstruct into a 3D understanding of anatomy. According to the researchers, this process can be difficult to learn and may contribute to interpretation errors.
The new platform, called AR-VIU (augmented real-time volumetric imaging in ultrasound), uses a compact ultrasound probe connected to a chirped data acquisition system. The probe incorporates an ultrasound array configured to capture volumetric images while requiring fewer elements than many conventional 3D ultrasound systems, reducing power and hardware requirements.

Imaging data are streamed into Unreal Engine software, which converts the ultrasound information into a 3D rendering that can be viewed through an AR headset. Users can examine the anatomy from different angles by moving around the image.

Researchers evaluated the system with 18 participants, including nine ultrasound experts such as sonographers and physicians and nine individuals with no prior ultrasound experience. Participants completed object-identification and localization tasks using four imaging approaches: standard 2D ultrasound, conventional 3D ultrasound displayed on a screen, augmented reality 2D imaging and the AR-VIU system.

The study found that AR-VIU improved participants' ability to identify and locate targets. The gains were most pronounced among novice users, whose performance approached that of experienced operators when using the augmented reality system.

Researchers said the technology could have applications in ultrasound-guided procedures, including needle placement for biopsies, and may help accelerate ultrasound training. Future work will focus on improving image resolution and conducting additional validation studies.

Ultrasound Homepage