Hybrid Visualization for White Matter Tracts using Triangle Strips and Point Sprites
|
Diffusion tensor imaging is of high value in neurosurgery, providing information about the location of white matter tracts in the human brain. For their reconstruction, streamline techniques commonly referred to as fiber tracking model the underlying fiber structures and have therefore gained interest. To meet the requirements of surgical planning and to overcome the visual limitations of line representations, a new real-time visualization approach of high visual quality is introduced. For this purpose, textured triangle strips and point sprites are combined in a hybrid strategy employing GPU programming. The triangle strips follow the fiber streamlines and are textured to obtain a tube-like appearance. A vertex program is used to orient the triangle strips towards the camera. In order to avoid triangle flipping in case of fiber segments where the viewing and segment direction are parallel, a correct visual representation is achieved in these areas by chains of point sprites. As a result, a high quality visualization similar to tubes is provided allowing for interactive multimodal inspection. Overall, the presented approach is faster than existing techniques of similar visualization quality and at the same time allows for real-time rendering of dense bundles encompassing a high number of fibers, which is of high importance for diagnosis and surgical planning.
[1] 1181 OpenGL(R) Shading Language. Addison Wesley Longman, 2004.
[2] D. Akers, A. Sherbondy, R. Mackenzie, R. Dougherty, and B. Wandell, Exploration of the Brain's White Matter Pathways with Dynamic Queries. In IEEE Visualization, pages 377–384, 2004.
[3] P. Basser, J. Mattiello, and D. LeBihan, Mr diffusion tensor spectroscopy and imaging. Biophys J, 66 (1): 259–267, 1994.
[4] P. Basser, S. Pajevic, C. Pierpaoli, J. Duda, and A. Aldroubi, In vivo fiber tractography using DT-MRI data. Magnet Reson Med, 44: 625–632, 2000.
[5] P. Basser and C. Pierpaoli, Microstructural and physiological features of tissues elucidated by quantitative-diffusion-tensor MRI. J Magn Reson, Series B, 111 (3): 209–219, 1996.
[6] T. Behrens, H. Johansen-Berg, M. Woolrich, S. Smith, C. Wheeler-Kingshott, P. Boulby, G. Barker, E. Sillery, K. Sheehan, O. Ciccarelli, A. Thompson, J. Brady, and P. Matthews, Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging. Nat Neurosci, 6 (7): 750–757, 2003.
[7] J. Berman, M. Berger, P. Mukherjee, and R. Henry, Diffusion-tensor imaging-guided tracking of fibers of the pyramidal tract combined with intraoperative cortical stimulation mapping in patients with gliomas. Neurosurgery, 101 (1): 66–72, 2004.
[8] M. Björnemo, A. Brun, R. Kikinis, and C.-F. Westin, Regularized Stochastic White Matter Tractography Using Diffusion Tensor MRI. In MICCAI, pages 435–442, 2002.
[9] J. Blaas, C. Botha, F. Vos, and F. Post, Fast and Reproducible Fibre Bundle Selection in DTI Visualization. In IEEE Visualization, pages 59–64, 2005.
[10] A. Brun, H. Knutsson, H.-J. Park, M. Shenton, and C.-F. Westin, Clustering Fiber Tracts Using Normalized Cuts. In MICCAI, LNCS, pages 368–375. Springer, 2004.
[11] J. Coremans, R. Luypaert, F. Verhelle, T. Stadnik, and M. Osteaux, A Method for Myelin Fiber Orientation Mapping Using Diffusion-Weighted MR Images. Magn Reson Imaging, pages 443–454, 1994.
[12] T. Delmarcelle and L. Hesselink, Visualizing Second-Order Tensor Fields with Hyperstreamlines. IEEE Comput Graph, 13 (4): 25–33, 1993.
[13] A. Einstein, Über die von der molekularkinetischen Theorie der Wärme geforderte Bewegung von in ruhenden Fluessigkeiten suspendierten Teilchen. Annalen der Physik und Chemie, IV. Folge, 17: 549–560, 1905.
[14] F. Enders, S. Iserhardt-Bauer, P. Hastreiter, C. Nimsky, and T. Ertl, Hardware-Accelerated Glyph Based Visualization of Major White Matter Tracts for Analysis of Brain Tumors. In Medical Imaging. SPIE, 2005.
[15] M. Hlawitschka and G. Scheuermann, HOT Lines: Tracking Lines in Higher Order Tensor Fields. In IEEE Visualization, pages 27–34, 2005.
[16] M. Jackowski, C. Kao, M. Qiu, R. Constable, and L. Staib, White matter tractography by anisotropic wavefront evolution and diffusion tensor imaging. Med Image Anal, 9: 427–440, 2005.
[17] D. Jones, S. Williams, and M. Horsfield, Full Representation of White-Matter Fibre Direction in One Map via Diffusion Tensor Analysis. In Proc Int Soc Mag Res in Med, page 1743, 1997.
[18] K. Kamada, T. Todo, Y. Masutani, S. Aoki, K. Ino, T. Takano, T. Kirino, N. Kawahara, and A. Morita, Combined use of tractography-integrated functional neuronavigation and direct fiber stimulation. Neurosurgery, 102 (4): 664–627, 2005.
[19] G. Kindlmann, Superquadric Tensor Glyphs. In EG/IEEE TCVG VisSym, pages 147–154, 2004.
[20] G. Kindlmann, D. Weinstein, and D. Hart, Strategies for Direct Volume Rendering of Diffusion Tensor Fields. IEEE T Vis Comput Gr, 6 (2): 1247–138, 2000.
[21] M. Lazar, D. Weinstein, J. Tsuruda, K. Hasan, K. Arfanakis, M. Meyerand, B. Badie, H. Rowley, V. Haughton, A. Field, and A. Alexander, White Matter Tractography Using Diffusion Tensor Deflection. Hum Brain Mapp, 18 (4): 306–321, 2003.
[22] C. A.-L. M. Martin-Fernandez, C.-F. Westin, 3D Bayesian Regularization of Diffusion Tensor MRI using Multivariate Gaussian Markov Random Fields. In MICCAI, LNCS, pages 351–359. Springer, 2004.
[23] O. Mallo, R. Peikert, C. Sigg, and F. Sadlo, Illuminated Lines Revisited. In IEEE Visualization, pages 19–25, 2005.
[24] O. Mattausch, T. Theußl, H. Hauser, and E. Gröller, Strategies for interactive exploration of 3D flow using evenly-spaced illuminated streamlines. Spring Conference on Computer Graphics (SCCG), pages 213–222, 2003.
[25] D. Merhof, M. Sonntag, F. Enders, C. Nimsky, P. Hastreiter, and G. Greiner, Streamline visualization of diffusion tensor data based on triangle strips. In Bildverarbeitung für die Medizin (BVM), Informatik Aktuell, pages 271–275. Springer, 2006.
[26] B. Moberts, A. Vilanova, and J. van Wijk, Evaluation of Fiber Clustering Methods for Diffusion Tensor Imaging. In IEEE Visualization, pages 65–72, 2005.
[27] S. Mori, B. Crain, V. Chacko, and P. van Zijl, Three Dimensional Tracking of Axonal Projections in the Brain by Magnetic Resonance Imaging. Ann Neurol, 45 (2): 265–269, 1999.
[28] S. Mori and P. van Zijl, Fiber tracking: principles and strategies — a technical review. NMR Biomed, 15: 468–480, 2002.
[29] C. Nimsky, O. Ganslandt, P. Hastreiter, R. Wang, T. Benner, A. Sorensen, and R. Fahlbusch, Preoperative and intraoperative diffusion tensor imaging-based fiber tracking in glioma surgery. Neurosurgery, 56 (1): 130–138, 2005.
[30] S. Pajevic and C. Pierpaoli, Color schemes to represent the orientation of anisotropic tissues from diffusion tensor data: Application to white matter fiber tract mapping in the human brain. Magn Reson Imaging, 42 (3): 526–540, 1999.
[31] M. Schirski, T. Kuhlen, M. Hopp, P. Adomeit, S. Pischinger, and C. Bischof, Virtual Tubelets — efficiently visualizing large amounts of particle trajectories. Computers & Graphics, 29 (1): 17–27, 2005.
[32] P. Staempfli, T. Jaermann, G. Crelier, S. Kollias, A. Valavanis, and P. Boesiger, Resolving fiber crossing using advanced fast marching tractography based on diffusion tensor imaging. Neuroimage, 30 (1): 110–120, 2006.
[33] C. Stoll, S. Gumhold, and H.-P. Seidel, Visualization with stylized line primitives. In IEEE Visualization, pages 695–702, 2005.
[34] A. Vilanova, G. Berenschot, and C. van Pul, DTI Visualization with Streamsurfaces and Evenly-Spaced Volume Seeding. In EG/IEEE TCVG VisSym, pages 173–182, 2004.
[35] C.-F. Westin, S. E. Maier, H. Mamata, A. Nabavi, F. A. Jolesz, and R. Kikinis, Processing and Visualization of Diffusion Tensor MRI. Med Image Anal, 6 (2): 93–108, 2002.
[36] B. Wünsche and R. Lobb, The Visualization of Diffusion Tensor Fields in the Brain. In Int. Conf. on Mathematics and Engineering Techniques in Medicine and Biological Science, METMBS, pages 498–504, 2001.
[37] W. Zhan, E. Stein, and Y. Yang, Mapping the orientation of intravoxel crossing fibers based on the phase information of diffusion circular spectram. Neuroimage, 23 (4): 1358–1369, 2004.
[38] S. Zhang, C. Demiralp, and D. Laidlaw, Visualizing Diffusion Tensor MR Images Using Streamtubes and Streamsurfaces. IEEE T Vis Comput Gr, 9 (4): 454–462, 2003.
[39] L. Zhukov and A. Barr, Oriented Tensor Reconstruction: Tracing Neural Pathways from Diffusion Tensor MRI. In IEEE Visualization, 2002.
[40] M. Zöckler, D. Stalling, and H.-C. Hege, Interactive visualization of 3D-vector fields using illuminated stream lines. In IEEE Visualization, pages 107–113, 1996.
Index Terms:
Diffusion tensor data, fiber tracking, streamline visualization
Citation:
Dorit Merhof, Markus Sonntag, Frank Enders, Christopher Nimsky, Peter Hastreiter, Guenther Greiner, "Hybrid Visualization for White Matter Tracts using Triangle Strips and Point Sprites," IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 5, pp. 1181-1188, Sept. 2006, doi:10.1109/TVCG.2006.151
PURCHASE ARTICLE: $19
IEEE Xplore Subscribers
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb