Comparing 2D Vector Field Visualization Methods: A User Study
|
We present results from a user study that compared six visualization methods for two-dimensional vector data. Users performed three simple but representative tasks using visualizations from each method: 1) locating all critical points in an image, 2) identifying critical point types, and 3) advecting a particle. Visualization methods included two that used different spatial distributions of short arrow icons, two that used different distributions of integral curves, one that used wedges located to suggest flow lines, and line-integral convolution (LIC). Results show different strengths and weaknesses for each method. We found that users performed these tasks better with methods that: 1) showed the sign of vectors within the vector field, 2) visually represented integral curves, and 3) visually represented the locations of critical points. Expert user performance was not statistically different from nonexpert user performance. We used several methods to analyze the data including omnibus analysis of variance, pairwise t-tests, and graphical analysis using inferential confidence intervals. We concluded that using the inferential confidence intervals for displaying the overall pattern of results for each task measure and for performing subsequent pairwise comparisons of the condition means was the best method for analyzing the data in this study. These results provide quantitative support for some of the anecdotal evidence concerning visualization methods. The tasks and testing framework also provide a basis for comparing other visualization methods, for creating more effective methods and for defining additional tasks to further understand the tradeoffs among the methods. In the future, we also envision extending this work to more ambitious comparisons, such as evaluating two-dimensional vectors on two-dimensional surfaces embedded in three-dimensional space and defining analogous tasks for three-dimensional visualization methods.
[1] 59 E. Tufte, The Visual Display of Quantitative Information. Graphics Press, 1983.
[2] C. Ware, Information Visualization: Perception for Design. Morgan Kaufmann, 2000.
[3] W.S. Cleveland, The Elements of Graphing Data. Wadsworth, 1985.
[4] R. Kosara, C.G. Healey, V. Interrante, D.H. Laidlaw, and C. Ware, “Thoughts on User Studies: Why, How, and When,” Computer Graphics and Applications, vol. 23, no. 4, pp. 20-25, July/Aug. 2003.
[5] V. Interrante, H. Fuchs, and S.M. Pizer, “Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture,” IEEE Trans. Visualization and Computer Graphics, vol. 3, no. 2, Apr.-June 1997.
[6] R. Kosara, S. Miksch, H. Hauser, J. Schrammel, V. Giller, and M. Tscheligi, “Useful Properties of Semantic Depth of Field for Better f+c Visualization,” Proc. Joint Eurographics-IEEE TCVG Symp. Visualization 2002 (VisSym '02), pp. 205-210, 2002.
[7] J.E. Swan II, J.L. Gabbard, D. Hix, R.S. Schulman, and K.P. Kim, “A Comparative Study of User Performance in a Map-Based Virtual Environment,” IEEE Virtual Reality 2003, p. 259, Mar. 2003.
[8] D.H. Laidlaw, R.M. Kirby, T.S. Miller, M. da Silva, J.S. Davidson, W.H. Warren, and M. Tarr, “Evaluating 2D Vector Visualization Methods,” Proc. Visualization '01, 2001.
[9] M.A.Z. Dippé and E.H. Wold, “Antialiasing through Stochastic Sampling,” Computer Graphics (SIGGRAPH '85 Proc.), B.A. Barsky, ed., vol. 19, pp. 69-78, July 1985.
[10] R.M. Kirby, H. Marmanis, D.H. Laidlaw, “Visualizing Multivalued Data from 2D Incompressible Flows Using Concepts from Painting,” Proc. Visualization '99, 1999.
[11] B. Cabral and L.C. Leedom, “Imaging Vector Fields Using Line Integral Convolution,” Computer Graphics (SIGGRAPH '93 Proc.), J.T. Kajiya, ed., vol. 27, pp. 263-272, Aug. 1993.
[12] G. Turk and D. Banks, “Image-Guided Streamline Placement,” Proc. SIGGRAPH 96, pp. 453-460, 1996.
[13] Mathworks, Matlab. Natick, Mass.: Mathworks, Inc., 1999.
[14] A. Globus, C. Levit, and T. Lasinski, “A Tool for Visualizing the Topology of Three-Dimensional Vector Fields,” Proc. Visualization '91, pp. 33-40, 1991.
[15] S.E. Maxwell and H.D. Delaney, Designing Experiments and Analyzing Data: A Model Comparison Perspective, Belmont, Calif.: Wadsworth, 1990.
[16] D.H. Krantz, “The Null Hypothesis Testing Controversy in Psychology,” Am. Statistical Assoc., vol. 44, pp. 1372-1381, 1999.
[17] R.S. Nickerson, “Null Hypothesis Significance Testing: A Review of an Old and Continuing Controversy,” Psychological Methods, vol. 5, pp. 241-301, 2000.
[18] R.P. Abelson, “On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test,” Psychological Science, vol. 8, pp. 12-15, 1997.
[19] R.L. Hagen, “In Praise of the Null Hypothesis Statistical Test,” Am. Psychologist, vol. 52, pp. 15-24, 1997.
[20] W.W. Tryon, “Evaluating Statistical Difference, Equivalence, and Indeterminacy Using Inferential Confidence Intervals: An Integrated Alternative Method of Conducting Null Hypothesis Statistical Tests,” Psychological Methods, vol. 6, no. 4, pp. 371-386, 2001.
[21] J.W. Tukey, Exploratory Data Analysis. Addison-Wesley, 1977.
[22] H. Wainer and D. Thissen, A Handbook for Data Analysis in the Behavioral Sciences: Statistical Issues, Graphical Data Analysis, pp. 391-458, 1993.
[23] M.E.J. Masson and G.R. Loftus, “Using Confidence Intervals for Graphically Based Data Interpretation,” Canadian Experimental Psychology, vol. 57, no. 3, pp. 203-220, 2003.
[24] G.R. Loftus and M.E.J. Masson, “Using Confidence Intervals in Within-Subject Designs,” Psychonomic Bulletin and Rev., vol. 1, pp. 476-490, 1994.
[25] E. Batschelet, Circular Statistics in Biology. Academic Press, 1981.
[26] C. Jackson, D. Acevedo, D.H. Laidlaw, F. Drury, E. Vote, and D. Keefe, “Designer-Critiqued Comparison of 2D Vector Visualization Methods: A Pilot Study,” Proc. SIGGRAPH 2003 Sketches and Applications, 2003.
Index Terms:
User study, vector visualization, fluid flow visualization.
Citation:
David H. Laidlaw, Robert M. Kirby, Cullen D. Jackson, J. Scott Davidson, Timothy S. Miller, Marco da Silva, William H. Warren, Michael J. Tarr, "Comparing 2D Vector Field Visualization Methods: A User Study," IEEE Transactions on Visualization and Computer Graphics, vol. 11, no. 1, pp. 59-70, Jan./Feb. 2005, doi:10.1109/TVCG.2005.4
PURCHASE ARTICLE: $19
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb