A few years ago, we created a rule-based assessment simulation to evaluate teamwork skills in undergraduate courses and research studies. Participants interacted with virtual teammates in a text-based group chat while a scoring algorithm analyzed their behaviour and evaluated their teamwork skills. The tool was actively used between 2019 and 2023 to help students diagnose their skills and conduct research.

Here’s our introductory video from 2019.


What the simulation looked like

The simulation recreated common team dynamics through the use of chatbot teammates and a computer-based scoring mechanism that analyzed students’ text-based responses. The experience felt like participating in an online team discussion while the system assessed student’s teamwork skills as they worked with their virtual teammates. The full simulation typically took about 40 minutes to complete and was usually administered as part of a course activity or research study.


Why this simulation is now archived

The introduction of ChatGPT, a large language model, essentially made our rule-based tool obsolete. With the quick progress in LLMs starting in 2023, we stopped developing our rule-based version and started rethinking our approach to include newer AI features. In 2024, we removed the original rule-based teamwork simulation, but it still influences our current work and publications.


What we’re working on now

Building on the insights from this rule-based simulation, we are now developing new LLM-powered simulations for use in teaching and research.