Brandon Hall Research
    Sign up for "Brandon Hall News" and get free research downloads. Your privacy is assured.
    Your Email:

Home > Community > Shootouts > 2001 Software Simulation Shootout

Simulation Shootout
 
The Sponsors
Training Magazine
Brandon Hall Research

The event took place October 1, 2, and 3, in 2001, at the Online Learning Conference in Los Angeles, California.


Gallery

Event hall
More than 200 people attended each day of the event, watching as 12 teams created e-learning simulations on large screens.

Analyst Bryan Chapman
Bryan Chapman, e-learning analyst at Brandon Hall Research, "refereed" the Shootout.

Conference hall
There was standing room only for the event.

Audience watches screens
A digital clock ran on the center screen as each of the four teams built their simulation. This shot was taken during Round 2.

 
The Participants
Product Company Home Page
Authorware Macromedia www.macromedia.com
CBIQuick AMT Learning Solutions www.amtcorp.com
DazzlerMax MaxIT www.maxit.com
Info Pak Simulator RWD Technologies www.rwd.com
IST Author EDT Learning www.edtlearning.com
Jupiter Avaltus www.avaltus.com
Knowledge Mechanics Knowledge Mechanics www.knowledgemechanics.com
OnDemand Global Knowledge www.ondemandgk.com
RapidBuilder XStream Software www.xstreamsoftware.com
ToolBook Click2learn www.click2learn.com
ViewletBuilder Qarbon www.qarbon.com
X.HLP Designer X.HLP www.xhlp-usa.com

Average development time = 11:23. This involved amazingly fast development times for all participants given the assignment.


Background

As part of the Online Learning Conference, we invited 12 teams to compete against each other to create a guided-practice, e-learning simulation with multiple interactions and feedback. All teams had the same task – teaching a learner how to add someone’s name to an Outlook contact list (requiring both clicking and typing). Each vendor team used its own simulation product to build the tutorial according to a storyboard given to them all before the competition.

We ran the event in three rounds, with four new teams competing in each round. All teams built their simulations from scratch, simultaneously, with more than 200 attendees watching as they went through the entire development process from start to finish. Each team’s efforts were displayed on large screens on the Expo floor of the Los Angeles Convention Center. As each team finished its simulation, team members were allowed to make a five-minute presentation to the audience demonstrating the robustness of the simulation.

The audience then rated each simulation development tool in the following four areas:

  • Ease of use
  • Speed of development
  • Robustness of simulation (feedback, guidance, etc.)
  • Overall rating

Beyond the top three finishers (listed below), this page contains more statistical information and links for the companies that participated in the shootout event.


Highest Overall Score

Product Company Score
1st Place IST Author EDT Learning 8.39
2nd Place Info Pak Simulator RWD Technologies 8.32
3rd Place RapidBuilder XStream Software 8.07

Scores were based on a 10-point scale (with 10 being the highest rating). Audience members rated each product in the following categories: (1) ease of use, (2) speed of development, (3) robustness of the simulation, and (4) overall rating. The score represents a composite rating for all four categories.


Ease of Use

Product Company
1st Place Info Pak Simulator RWD Technologies
2nd Place IST Author EDT Learning
3rd Place RapidBuilder XStream Software

Robustness of Simulation

Product Company
1st Place IST Author EDT Learning
2nd Place Authorware Macromedia
3rd Place OnDemand Global Knowledge
 
© 2008 Brandon Hall Research