Brandon Hall Research
    Sign up for "Brandon Hall News" and get free research downloads. Your privacy is assured.
    Your Email:

Home > Community > Shootouts > 2002 Legacy Content Converion Shootout

Brandon Hall Research Shootout
 
The Sponsors
Training magazine
Brandon Hall Research

Hundreds watched May 14th and 15th, 2002, at the Expo Center in Singapore as e-learning vendors converted Word, PowerPoint, Flash, Dreamweaver, and unformatted test questions into e-learning courseware in record time.


Gallery

Stage set for competitions
Birds eye view of the competition.

RefereeBryan Chapman, e-learning analyst at Brandon Hall Research, "refereed" the Shootout.

Competitor at workThe team from Aculearn (based in Singapore) set up a complete video studio and recorded an on-screen narrator (streaming video) during the competition.

Teams compete in real timeAlthough sometimes stressful, the teams worked fast to convert the legacy content.

Audience watchesThe audience were active participants, serving as judges for the event.

 

 
The Participants (fastest finish time first)
Product Company Home Page
RADAuthor Global Competency Systems www.radauthor.com
ROCKET KM Eedo Knowledgeware www.eedo.com
PSS 2000 Aculearn www.aculearn.com
Knowledge Pathways Global Knowledge www.ondemandgk.com
Techniq Vitalect www.vitalect.com
Evolution OutStart www.outstart.com

Average development time = 13:17.


Background

The Legacy Content Conversion Shootout was not designed as an exercise in instructional design. Rather, the intent was to see how well systems handled or converted miscellaneous content items that were created using standard content creation tools like Word, PowerPoint, Flash, and Dreamweaver (the most commonly used tools in training). The goal of the Shootout was simply to convert the legacy content into an e-learning course as quickly as possible. The audience could see a digital clock running throughout the event. The finish time was posted for each team at the end of each round.

The systems were judged in each of the following categories:

  • Ease of use
  • Speed of development (only 1/2 of the score in this category counts toward the final score)
  • Robustness of the learner interface (navigation, menus, learner control, etc.)
  • Content conversion capabilities

The winners were determined by the vote of the audience judges. Beyond the top three finishers, this page contains more statistical information and links for the companies that participated in the Shootout event.

Each team was given a CD-ROM containing 10 folders, each containing a piece of legacy content, as follows:

Folder/Type Content
#1 Flash Title screen

#2 Word document
List of objectives for the e-learning course (words and graphics only)
#3 PowerPoint PowerPoint slide (with text and graphics only)
#4 Word document Comparison page (document includes a table to see how systems handle formatted Word documents)
#5 PowerPoint and audio Block diagram (created from PowerPoint drawing objects) and narration (embedded in the PowerPoint in .wav format)
#6 Dreamweaver (CourseBuilder template) Click-and-label exercise (used to determine how well the system addresses a complex interaction requiring multiple files beyond a simple HTML file)
# 7 Word document Unformatted multiple-choice question (was cut and pasted from an instructor-led lesson plan)
#8 Word document Unformatted short answer question
#9 Word document Unformatted matching question
#10 Flash Conclusion screen

Top Finishers by Audience Vote

Product Company Score
1st Place Evolution OutStart 28.19
2nd Place Knowledge Pathways Global Knowledge 27.93
3rd Place ROCKET KM Eedo Knowledgeware 27.23

Scores are based on a 10-point scale (with 10 being the highest rating). Audience members rated each product. The score was derived by adding the average rating in each category, while weighting the speed of development category by adding one-half of the score for this category.

Ease of Use

Product Company Score
1st Place Evolution OutStart 7.98
2nd Place Knowledge Pathways Global Knowledge 7.85
3rd Place Techniq Vitalect 7.60

This category is based on audience score. Top score would be 10 points.


Speed of Development

Product Company Score
1st Place Knowledge Pathways Global Knowledge 8.67
2nd Place RAD Author Global Competency Systems 8.25
3rd Place Techniq Vitalect 8.45

This category is based on audience score. Top score would be 10 points.


Robustness of Learner Interface

Product Company Score
1st Place Evolution OutStart 8.36
2nd Place ROCKET KM Eedo Knowledgeware 7.84
3rd Place Knowledge Pathways Global Knowledge 7.67

This category is based on audience score. Top score would be 10 points.


Content Conversion Capability

Product Company Score
1st Place Evolution OutStart 8.40
2nd Place Knowledge Pathways Global Knowledge 8.07
3rd Place ROCKET KM Eedo Knowledgeware 8.02

This category is based on audience score. Top score would be 10 points.

 
© 2008 Brandon Hall Research