Concurrent Visualization in a Production Supercomputing Environment
|
We describe a concurrent visualization pipeline designed for operation in a production supercomputing environment. The facility was initially developed on the NASA Ames "Columbia" supercomputer for a massively parallel forecast model (GEOS4). During the 2005 Atlantic hurricane season, GEOS4 was run 4 times a day under tight time constraints so that its output could be included in an ensemble prediction that was made available to forecasters at the National Hurricane Center. Given this time-critical context, we designed a configurable concurrent pipeline to visualize multiple global fields without significantly affecting the runtime model performance or reliability. We use MPEG compression of the accruing images to facilitate live low-bandwidth distribution of multiple visualization streams to remote sites. We also describe the use of our concurrent visualization framework with a global ocean circulation model, which provides a 864-fold increase in the temporal resolution of practically achievable animations. In both the atmospheric and oceanic circulation models, the application scientists gained new insights into their model dynamics, due to the high temporal resolution animations attainable.
[1] 997 G. Allen, W. Benger, T. Dramlitsch, T. Goodale, H.-C. Hege, G. Lanfermann, A. Merzky, T. Radke, and E. Seidel, Cactus grid computing: Review of current development. In R. Sakellariou, J. Keane, J. Gurd, and L. Freeman, editors, Lecture Notes In computer Science; Vol. 2150, Euro-Par 2001: Parallel Processing, Proceedings of 7th International Euro-Par conference Manchester, Aug. 2001.
[2] G. B. Bonan, The NCAR land surface model (LSM version 1.0) coupled to the NCAR Community Climate Model. Technical Report NCAR/TN-429+STR, National Center for Atmospheric Research, Boulder, Colorado, 1996.
[3] A. Cedilnik, B. Geveci, K. Moreland, J. Ahrens, and J. Favre, Remote large data visualization in the paraview framework. In Eurographics Symposium on Parallel Graphics and Visualization, pages 163–170, 2006.
[4] G. Cheng, Y. Lu, G. Fox, K. Mills, and T. Haupt, An interactive remote visualization environment for an electromagnetic scattering simulation on a high performance computing system. In Proceedings of the 1993 ACM/IEEE Conference on Supercomputing, pages 317–326, 1993.
[5] H. Childs, E. Brugger, K. Bonnell, J. Meredith, M. Miller, B. Witlock, and N. Max, A contract based system for large data visualization. In Visualization 2005, pages 191–198, 2005.
[6] J. A. Clarke, C. E. Schmitt, and J. J. Hare, The distributed interactive computing environment. In Proc. High-Performance Computing Workshop, July 1998.
[7] S. Doi, T. Takei, and K. Matsumoto, Experiences in large-scale volume data visualization with RVSLIB. Computer Graphics, 35 (2): 10–13, May 2001.
[8] ECCO. http://www.ecco-group.org.
[9] FSU "superensemble" approach to predicting hurricanes' path, http://www.research.fsu.edu/scicol/3teest.html.
[10] G. A. Geist, II, J. A. Kohl, and P. M. Papadopoulos, CUMULVS: Providing fault-tolerance, visualization and steering of parallel applications. International Journal of Supercomputer Applications and High Performance Computing, 11 (3): 224–235, 1997.
[11] Growler. http://www.nas.nasa.gov/~bgreengrowler.html.
[12] R. Haimes and D. E. Edwards, Visualization in a parallel processing environment. In AIAA Paper 97–0348, Proceedings of the 35th AIAA Aerospace Sciences Meeting, Jan. 1997.
[13] W. Hibbard, C. Rueden, S. Emmerson, T. Rink, D. Glowacki, T. Whittaker, D. Murray, D. Fulker, and J. Anderson, Java distributed components for numerical visualization in VisAD. Commun. ACM, 48 (3): 98–104, 2005.
[14] C. Johnson, S. G. Parker, C. Hansen, G. L. Kindlmann, and Y. Livnat, Interactive simulation and visualization. IEEE Computer, 32 (12): 59–65, Dec. 1999.
[15] J. T. Kiehl, J. J. Hack, G. B. Bonan, B. A. Boville, B. P. Briegleb, D. L. Williamson, and P. J. Rasch, Description of the NCAR Community Climate Model (CCM3). Technical Report NCAR/TN—420+STR, National Center for Atmospheric Research, Boulder, Colorado, 1996.
[16] J. C. Lakey and R. J. Moorhead, II, Concurrent visualization of time varying CFD simulations. In Proc. SPIE Vol. 2178 Visual Data Exploration and Analysis, pages 123–126, Feb. 1994.
[17] S.-J. Lin, A vertically Lagrangian finite-volume dynamical core for global models. Monthly Weather Review, 132: 2293–2307, 2004.
[18] MAP05. http://map05.gsfc.nasa.gov.
[19] B. H. McCormick, T. A. DeFanti, and M. D. Brown, Visualization in scientific computing. Computer Graphics, 21 (6): 1–14, Nov. 1987.
[20] H. Okuda, K. Nakajima, M. Iizuka, L. Chen, and H. Nakamura, Parallel finite element analysis platform for the Earth Simulator: GeoFEM. In Proc. 3rd ACES Working Group Meeting, June 2003.
[21] T. A. Sandstrom, C. Henze, and C. Levit, The hyperwall. In Proc. Conference on Coordinated and Multiple Views in Exploratory Visualization, pages 124–133, July 2003.
[22] A. Vaziri, M. Kremenetsky, M. Fitzgibbon, and C. Levit, Experiences with CM/AVS to visualize and compute simulation data on the CM-5. In 1994 AVS Users Conference Proceedings, May 1994. Also available as NASA Technical Report RNR-94–005.
Index Terms:
Supercomputing, concurrent visualization, interactive visual computing, time-varying data, high temporal resolution visualization, GEOS4 global climate model, hurricane visualization, ECCO, ocean modeling.
Citation:
David Ellsworth, Bryan Green, Chris Henze, Patrick Moran, Timothy Sandstrom, "Concurrent Visualization in a Production Supercomputing Environment," IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 5, pp. 997-1004, Sept. 2006, doi:10.1109/TVCG.2006.128
PURCHASE ARTICLE: $19
IEEE Xplore Subscribers
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb