About the original simulation
A few years ago, we created a rule-based simulation to assess teamwork skills for use in education and research. Participants interacted with chatbot teammates in a text-based group chat while a scoring algorithm analyzed their responses and evaluated their teamwork skills. The tool was actively used between 2019 and 2023.
Here’s our introductory video from 2019, which shows the simulation in action:
How it was used
The full simulation took about 40 minutes to complete and was typically administered as part of a course activity or research study. For participants, the experience felt like joining an ordinary online team discussion with three other team members — each one a chatbot. The assessment happened unobtrusively in the background as they collaborated.
Why this simulation is now archived
Rapid advances in large language models from 2023 onward made rule-based dialogue systems outdated as a technology. Rather than continue developing the original version, we retired it in 2024 and began rethinking our approach around generative AI. While the tool itself is no longer available, the assessment framework and research findings behind it remain foundational to our current work and publications.
What we’re working on now
Building on the insights from our earlier simulation, we are now developing new LLM-powered simulations for use in teaching and research.