Multi-Modality imaging to support 3D Brain Visualization - HIGH PROFILE Project

Logo of Crystal projectMulti-modality imaging combines imaging techniques in synergistic ways which facilitate the improved interpretation of data. Combining multiple structural techniques, technologies such as computed tomography (CT) and MRI, can show the best of each modality while the weakness of a specific modality is overcome and shown by a second modality.  As such anatomical images can be combined, or a combination of anatomical and functional imaging, such as electroencephalographic  (EEG), can be created to facilitate the medical professional with aligned structural and functional information.  

Within High Profile PS-tech worked on the multi-modality imaging to support 3D brain visualization by creating one 3D brain map. Three modalities were combined in Vesalius3D. The electrical diagram of the EEG provides split-second timing, the MRI provides high levels of spatial accuracy and thirdly the Electrocorticography (ECoG) provides the record of electrical activity from the cerebral cortex. The combination of these three modalities provided a unique 3D functional and structural brainmap.

PS-Tech continues to develop the aligning and visualization tools in Vesalius3D to create a hybrid imaging platform in which synergism in the imaging capabilities can be achieved.

The High Profile project description

HIGH PROFILE [HIGH-throughput PROduction of FunctIonaL 3D images of the brain (2011-2014)], combines industrial and clinical driven R&D activities dealing with image diagnostic platforms for the central nervous system. 

HIGH PROFILE aims to develop multi-scale, adaptive algorithms to merge information about the actual behavior of the brain, originating from (f)MRI, MRS, and EEG. These algorithms allow a physician to follow the status of the patient during his/her evolution, and be supported by a suitable content management platform and a data infrastructure capable of handling  the massive quantities of data produced by these technologies, delivering them to their point of use. 

Better imaging of the central nervous system and the head/neck area will improve diagnosis treatment of neurological diseases like insomnia, depression, multiple sclerosis and epilepsy, as well as brain and head/neck cancer. The approach developed by HIGH PROFILE for these conditions should also be extendable to the whole field of advanced medical imaging.

Multi-modality, registration and interaction with 3D and 4D medical data

PS-Tech 3D visualization software as well as its 3D workstations changed dramatically during the High Profile project. Results from the project have been implemented.

PS-Tech’s focus in High Profile:Multi-modality imaging

  • Combined rendering of (overlapping) multi-modal 3D/4D data 
  • Registration of data sets of different modalities
  • Interaction with 3D and 4D medical data sets

PS-Tech developed visualization software to allow for needed functionality. This functionality has been implemented into PS-Tech’s application Vesalius3D showcasing PS-Tech's ability to add custom functionality to its 3D visualization platform.  

Volumetric rendering of 3D images with Vesalius3D

The Vesalius3D platform is PS-Tech’s medical image data visualization and processing software package, dedicated to 3D/4D image data produced by imaging equipment (CT, MRI, PET, PET-CT, SPECT-CT, Ultrasound, etc). Vesalius3D features advanced and high quality volumetric rendering techniques and can render to both conventional and stereoscopic displays. Vesalius3D is a toolkit for efficient and effective analysis and presentation of 3D medical volumetric data.

Multi-modality rendering of 3D images

The results of High Profile were used to enhance Vesalius3D with functionality for rendering of multiple (overlapping) 3D or 4D datasets simultaneously at interactive rates. The number of data sets that can be visualized simultaneously are limited only by GPU memory.

For the High profile project Vesalius3D was loaded with:

  • an MRI, (Magnetic resonance imaging)
  • an EEG (Electroencephalography) 
  • an ECoG (Electrocorticography) 

Registration in Vesalius3D

Overlapping MRIRegistration in Vesalius3D was done by using 3D interaction for the initial alignment and combined with an algorithm for further automatic alignment.