RIVET: Rapid Interactive Visualization for Extensible Training

NASA NRA -3-0BPR-01 Rapid Technology Development Team

The new NASA mandate calls for missions of unprecedented remoteness and duration. Challenges include high system complexity, and low training time and tolerance for error. Human capabilities remain relatively fixed and current training and instruction tools are inadequate. OUR MANDATE: To provide computer based integrated training and instruction tools that are visually intuitive and adaptable to user skill level and context.

 

Personnel:

Norman I. Badler , Univ. of Pennsylvania
Jan Allbeck , Univ. of Pennsylvania
Durell Bouchard , Univ. of Pennsylvania
Peggy Choi , Univ. of Pennsylvania
Steve Crowe, Univ. of Pennsylvania
Mike Lang , Univ. of Pennsylvania
Ghulam Lashari , Univ. of Pennsylvania
Luke Zarko, Univ. of Pennsylvania
Mihriban Whitmore, NASA JSC
Abe Megahed, Orbitec, Inc.
Barbara Woolford, NASA JSC (COTR)

Documentation:

N. Badler, J. Allbeck, A. Megahed, M. Whitmore. RIVET: Rapid Interactive Visualization for Extensible Training . Habitation 2006. Orlando, FL. Feb. 5-8, 2006.

General information ( pdf ).

NASA Taskbook entry .

This project consists of three connected components. The first we developed RIVET-0, an instruction delivery tool with embedded training that is visually intuitive and adaptable to user skill level. Next we developed RIVET-1. RIVET-1 is a multi-media segmentation and coordination interface. It allows instruction authors to easily segment different forms of media (video, audio, diagrams, and motion capture) and coordinate them with instruction steps. The last part of our RIVET toolkit, RIVET-2, takes the media segmentation data and supplies an interface for the user to sequence instruction steps and finalize text.  Its graph interface allows users to easily visualize the ordering of the instruction steps.  The underlying parameterized representation of actions and objects provides error checking to ensure that preparatory conditions for actions have been met and maintained by previous actions. More information about the toolkit components can be found below.

RIVET-0: Supporting documents
Story boards ( pdf ). Grasp type recognition
Automated action segmentation
RIVET-1:
Slide show FINAL REPORT
Walk through
RIVET-2:
Walk through