Perceived usability of collaborative modeling tools

Online collaborative creation of models is becoming commonplace. Collaborative modeling using chatbots and natural language may lower the barriers to modeling for users from different domains. We compare the perceived usability of two similarly online collaborative modeling tools, the SOCIO chatbot and the Creately web-based tool. We conducted a crossover experiment with 66 participants. The evaluation instrument was based on the System Usability Scale (SUS). We performed a quantitative and qualitative exploration, employing inferential statistics and thematic analysis. The results indicate that chatbots enabling natural language communication enhance communication and collaboration efficiency and improve the user experience. Chatbots need to improve guidance and help for novices, but they appear beneficial for enhancing user experience. •Compare the perceived usability of two similarly online collaboration modeling tools.•Apply the System Usability Scale to quantify user satisfaction.•Apply thematic analysis to analyze user opinions qualitatively.•Insights into chatbots achieving higher perceived usability than traditional tools).•Lessons learned: aspects that can be improved in SOCIO chatbot.