June 11-13, 2003    
San Diego, USA


Sponsored by:
ACM SIGCHI, SIGGRAPH, SIGPLAN and SIGSOFT, and in cooperation with ACM SIGCSE.

TUTORIAL:
Empirically Evaluating Software Visualization Technology

Presenters: Chris Hundhausen and Eileen Kraemer

OVERVIEW

This tutorial aims to motivate and prepare participants to conduct their own empirical studies of software visualization effectiveness. In Part I of the tutorial, we will review the legacy of experimental studies designed to substantiate the educational effectiveness of algorithm visualization technology. We will then present a meta-analysis of these studies that provides insight into five key questions:
  • Is algorithm visualization technology effective?
  • What theories of effectiveness have had the most predictive success?
  • What factors have had the most impact on effectiveness?
  • What measures have been most sensitive to effectiveness?
  • What directions for future empirical research appear most fruitful?
In Part II of the tutorial, we will survey prior work in perception and cognition as it applies to the design and evaluation of program visualizations. Finally, Part III of the tutorial aims to encourage participants to think about the design of their own studies. We will first present some example study designs, and ask participants to discuss and critique them. We will then do some group brainstorming to identify research questions of interest to the group as a whole. A group breakout session will enable participants with similar interests to discuss and create preliminary study designs. Finally, the breakout groups will be invited to present their study designs to the entire group for feedback and discussion.

INTENDED AUDIENCE AND ASSUMED BACKGROUND

This tutorial is intended for any software visualization researcher who is interested in learning more about the state-of-the-art in empirical evaluation, or who would like to learn more about how to design studies. While researchers who have already performed some form of empirical evaluation are certainly invited, no prior background in empirical evaluation will be assumed.

TUTORIAL:
Introduction to Software Visualization

Presenters: Stephan Diehl and Carsten Görg

OVERVIEW

Researchers in software visualization devolop and investigate methods and use of computer graphical representations of different aspects of software, e.g. its static structure, its concrete and abstract execution, and its evolution. In this tutorial we give a broad overview of basic visualization techniques, as well as seminal and current research in the field. This will include static program visualization, algorithm animation, visual debugging, as well as the visualization of the evolution of software.

INTENDED AUDIENCE AND ASSUMED BACKGROUND

The tutorial is aimed at students and researchers who are new to the field of software visualization. No prior knowledge of software visualization will be assumed. Programming experience and some basic knowledge of software engineering terminology will be assumed.