Curriculum analytics adoption in higher education: A multiple case study engaging stakeholders in different phases of design

Several studies have indicated that stakeholder engagement could ensure the successful adoption of learning analytics (LA). Considering that researchers and tech developers may not be aware of how LA tools can derive meaningful and actionable information for everyday use, these studies suggest that...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:British journal of educational technology 2024-05, Vol.55 (3), p.785-801
Hauptverfasser: Hilliger, Isabel, Miranda, Constanza, Celis, Sergio, Pérez-Sanagustin, Mar
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 801
container_issue 3
container_start_page 785
container_title British journal of educational technology
container_volume 55
creator Hilliger, Isabel
Miranda, Constanza
Celis, Sergio
Pérez-Sanagustin, Mar
description Several studies have indicated that stakeholder engagement could ensure the successful adoption of learning analytics (LA). Considering that researchers and tech developers may not be aware of how LA tools can derive meaningful and actionable information for everyday use, these studies suggest that participatory approaches based on human‐centred design can provide stakeholders with the opportunity to influence decision‐making during tool development. So far, there is a growing consensus about the importance of identifying stakeholders' needs and expectations in early stages, so researchers and developers can design systems that resonate with their users. However, human‐centred LA is a growing sub‐field, so further empirical work is needed to understand how stakeholders can contribute effectively to the design process and the adoption strategy of analytical tools. To illustrate mechanisms to engage various stakeholders throughout different phases of a design process, this paper presents a multiple case study conducted in different Latin American universities. A series of studies inform the development of an analytical tool to support continuous curriculum improvement, aiming to improve student learning and programme quality. Yet, these studies differ in scope and design stage, so they use different mechanisms to engage students, course instructors and institutional administrators. By cross analysing the findings of these three cases, three conclusions emerged for each design phase of a CA tool, presenting mechanisms to ensure stakeholder adoption after tool development. Further implications of this multiple case study are discussed from a theoretical and methodological perspective. Practitioner notes What is already known about this topic? Human‐centred learning analytics (LA) has accommodated different configurations of stakeholder engagement, including co‐design and participatory design. Participatory design provides developers with a wide variety of techniques to engage a particular group in a mutual learning process. Most studies mainly focus on engaging stakeholders to identify needs in the early stages of the design process. More empirical works are needed to unveil the effectiveness of human centredness during LA design and after tool development. What this paper adds? Provides a multiple case study to illustrate mechanisms to engage various stakeholders in different design phases of a curriculum analytics (CA) tool. Summarises different assertions b
doi_str_mv 10.1111/bjet.13374
format Article
fullrecord <record><control><sourceid>hal</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_04550161v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>oai_HAL_hal_04550161v1</sourcerecordid><originalsourceid>FETCH-hal_primary_oai_HAL_hal_04550161v13</originalsourceid><addsrcrecordid>eNqVjM1KxDAUhYMoWH82PsHduuiYkGYq7oZBmYVL9-Xa3LZ3TNOSH6Hgw9uCL-DZHM7HxxHiQcmdWvP0eaa0U1rX1YUoVLWvy2ejzaUopJR1qaTS1-ImxvM6pTZVIX6OOQRus8sjoEe3JG4joJ3mxJMH9jBwP1AAsrnFjb3AAcbsEs-OoMVIEFO2C5DvsWffrxO_aJicpRC3A8tdR4F8gnlY9QhTB5Yi9_5OXHXoIt3_9a14fHv9OJ7KAV0zBx4xLM2E3JwO783GZGWMVHv1rfR_3F8ys1lw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Curriculum analytics adoption in higher education: A multiple case study engaging stakeholders in different phases of design</title><source>Access via Wiley Online Library</source><creator>Hilliger, Isabel ; Miranda, Constanza ; Celis, Sergio ; Pérez-Sanagustin, Mar</creator><creatorcontrib>Hilliger, Isabel ; Miranda, Constanza ; Celis, Sergio ; Pérez-Sanagustin, Mar</creatorcontrib><description>Several studies have indicated that stakeholder engagement could ensure the successful adoption of learning analytics (LA). Considering that researchers and tech developers may not be aware of how LA tools can derive meaningful and actionable information for everyday use, these studies suggest that participatory approaches based on human‐centred design can provide stakeholders with the opportunity to influence decision‐making during tool development. So far, there is a growing consensus about the importance of identifying stakeholders' needs and expectations in early stages, so researchers and developers can design systems that resonate with their users. However, human‐centred LA is a growing sub‐field, so further empirical work is needed to understand how stakeholders can contribute effectively to the design process and the adoption strategy of analytical tools. To illustrate mechanisms to engage various stakeholders throughout different phases of a design process, this paper presents a multiple case study conducted in different Latin American universities. A series of studies inform the development of an analytical tool to support continuous curriculum improvement, aiming to improve student learning and programme quality. Yet, these studies differ in scope and design stage, so they use different mechanisms to engage students, course instructors and institutional administrators. By cross analysing the findings of these three cases, three conclusions emerged for each design phase of a CA tool, presenting mechanisms to ensure stakeholder adoption after tool development. Further implications of this multiple case study are discussed from a theoretical and methodological perspective. Practitioner notes What is already known about this topic? Human‐centred learning analytics (LA) has accommodated different configurations of stakeholder engagement, including co‐design and participatory design. Participatory design provides developers with a wide variety of techniques to engage a particular group in a mutual learning process. Most studies mainly focus on engaging stakeholders to identify needs in the early stages of the design process. More empirical works are needed to unveil the effectiveness of human centredness during LA design and after tool development. What this paper adds? Provides a multiple case study to illustrate mechanisms to engage various stakeholders in different design phases of a curriculum analytics (CA) tool. Summarises different assertions based on case study findings regarding needs for analytical tool, its early evaluation and its potential use after development. Provides empirical evidence on how to promote stakeholder engagement at a specific design stage and for a specific purpose. The implications for practitioners LA researchers and developers can use assertions based on evidence as a starting point to drive the design process of CA solutions. Researchers and practitioners will have a set of protocols to implement participatory techniques in different design phases of a CA tool.</description><identifier>ISSN: 0007-1013</identifier><identifier>EISSN: 1467-8535</identifier><identifier>DOI: 10.1111/bjet.13374</identifier><language>eng</language><publisher>Wiley</publisher><subject>Computer Science ; Education ; Humanities and Social Sciences ; Technology for Human Learning</subject><ispartof>British journal of educational technology, 2024-05, Vol.55 (3), p.785-801</ispartof><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0000-0002-9110-2832 ; 0000-0001-5270-7655 ; 0000-0001-9854-9963 ; 0000-0002-0502-5608 ; 0000-0001-5270-7655 ; 0000-0002-0502-5608 ; 0000-0001-9854-9963 ; 0000-0002-9110-2832</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,780,784,885,27924,27925</link.rule.ids><backlink>$$Uhttps://hal.science/hal-04550161$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Hilliger, Isabel</creatorcontrib><creatorcontrib>Miranda, Constanza</creatorcontrib><creatorcontrib>Celis, Sergio</creatorcontrib><creatorcontrib>Pérez-Sanagustin, Mar</creatorcontrib><title>Curriculum analytics adoption in higher education: A multiple case study engaging stakeholders in different phases of design</title><title>British journal of educational technology</title><description>Several studies have indicated that stakeholder engagement could ensure the successful adoption of learning analytics (LA). Considering that researchers and tech developers may not be aware of how LA tools can derive meaningful and actionable information for everyday use, these studies suggest that participatory approaches based on human‐centred design can provide stakeholders with the opportunity to influence decision‐making during tool development. So far, there is a growing consensus about the importance of identifying stakeholders' needs and expectations in early stages, so researchers and developers can design systems that resonate with their users. However, human‐centred LA is a growing sub‐field, so further empirical work is needed to understand how stakeholders can contribute effectively to the design process and the adoption strategy of analytical tools. To illustrate mechanisms to engage various stakeholders throughout different phases of a design process, this paper presents a multiple case study conducted in different Latin American universities. A series of studies inform the development of an analytical tool to support continuous curriculum improvement, aiming to improve student learning and programme quality. Yet, these studies differ in scope and design stage, so they use different mechanisms to engage students, course instructors and institutional administrators. By cross analysing the findings of these three cases, three conclusions emerged for each design phase of a CA tool, presenting mechanisms to ensure stakeholder adoption after tool development. Further implications of this multiple case study are discussed from a theoretical and methodological perspective. Practitioner notes What is already known about this topic? Human‐centred learning analytics (LA) has accommodated different configurations of stakeholder engagement, including co‐design and participatory design. Participatory design provides developers with a wide variety of techniques to engage a particular group in a mutual learning process. Most studies mainly focus on engaging stakeholders to identify needs in the early stages of the design process. More empirical works are needed to unveil the effectiveness of human centredness during LA design and after tool development. What this paper adds? Provides a multiple case study to illustrate mechanisms to engage various stakeholders in different design phases of a curriculum analytics (CA) tool. Summarises different assertions based on case study findings regarding needs for analytical tool, its early evaluation and its potential use after development. Provides empirical evidence on how to promote stakeholder engagement at a specific design stage and for a specific purpose. The implications for practitioners LA researchers and developers can use assertions based on evidence as a starting point to drive the design process of CA solutions. Researchers and practitioners will have a set of protocols to implement participatory techniques in different design phases of a CA tool.</description><subject>Computer Science</subject><subject>Education</subject><subject>Humanities and Social Sciences</subject><subject>Technology for Human Learning</subject><issn>0007-1013</issn><issn>1467-8535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNqVjM1KxDAUhYMoWH82PsHduuiYkGYq7oZBmYVL9-Xa3LZ3TNOSH6Hgw9uCL-DZHM7HxxHiQcmdWvP0eaa0U1rX1YUoVLWvy2ejzaUopJR1qaTS1-ImxvM6pTZVIX6OOQRus8sjoEe3JG4joJ3mxJMH9jBwP1AAsrnFjb3AAcbsEs-OoMVIEFO2C5DvsWffrxO_aJicpRC3A8tdR4F8gnlY9QhTB5Yi9_5OXHXoIt3_9a14fHv9OJ7KAV0zBx4xLM2E3JwO783GZGWMVHv1rfR_3F8ys1lw</recordid><startdate>202405</startdate><enddate>202405</enddate><creator>Hilliger, Isabel</creator><creator>Miranda, Constanza</creator><creator>Celis, Sergio</creator><creator>Pérez-Sanagustin, Mar</creator><general>Wiley</general><scope>1XC</scope><scope>BXJBU</scope><orcidid>https://orcid.org/0000-0002-9110-2832</orcidid><orcidid>https://orcid.org/0000-0001-5270-7655</orcidid><orcidid>https://orcid.org/0000-0001-9854-9963</orcidid><orcidid>https://orcid.org/0000-0002-0502-5608</orcidid><orcidid>https://orcid.org/0000-0001-5270-7655</orcidid><orcidid>https://orcid.org/0000-0002-0502-5608</orcidid><orcidid>https://orcid.org/0000-0001-9854-9963</orcidid><orcidid>https://orcid.org/0000-0002-9110-2832</orcidid></search><sort><creationdate>202405</creationdate><title>Curriculum analytics adoption in higher education: A multiple case study engaging stakeholders in different phases of design</title><author>Hilliger, Isabel ; Miranda, Constanza ; Celis, Sergio ; Pérez-Sanagustin, Mar</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-hal_primary_oai_HAL_hal_04550161v13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science</topic><topic>Education</topic><topic>Humanities and Social Sciences</topic><topic>Technology for Human Learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hilliger, Isabel</creatorcontrib><creatorcontrib>Miranda, Constanza</creatorcontrib><creatorcontrib>Celis, Sergio</creatorcontrib><creatorcontrib>Pérez-Sanagustin, Mar</creatorcontrib><collection>Hyper Article en Ligne (HAL)</collection><collection>HAL-SHS: Archive ouverte en Sciences de l'Homme et de la Société</collection><jtitle>British journal of educational technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hilliger, Isabel</au><au>Miranda, Constanza</au><au>Celis, Sergio</au><au>Pérez-Sanagustin, Mar</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Curriculum analytics adoption in higher education: A multiple case study engaging stakeholders in different phases of design</atitle><jtitle>British journal of educational technology</jtitle><date>2024-05</date><risdate>2024</risdate><volume>55</volume><issue>3</issue><spage>785</spage><epage>801</epage><pages>785-801</pages><issn>0007-1013</issn><eissn>1467-8535</eissn><abstract>Several studies have indicated that stakeholder engagement could ensure the successful adoption of learning analytics (LA). Considering that researchers and tech developers may not be aware of how LA tools can derive meaningful and actionable information for everyday use, these studies suggest that participatory approaches based on human‐centred design can provide stakeholders with the opportunity to influence decision‐making during tool development. So far, there is a growing consensus about the importance of identifying stakeholders' needs and expectations in early stages, so researchers and developers can design systems that resonate with their users. However, human‐centred LA is a growing sub‐field, so further empirical work is needed to understand how stakeholders can contribute effectively to the design process and the adoption strategy of analytical tools. To illustrate mechanisms to engage various stakeholders throughout different phases of a design process, this paper presents a multiple case study conducted in different Latin American universities. A series of studies inform the development of an analytical tool to support continuous curriculum improvement, aiming to improve student learning and programme quality. Yet, these studies differ in scope and design stage, so they use different mechanisms to engage students, course instructors and institutional administrators. By cross analysing the findings of these three cases, three conclusions emerged for each design phase of a CA tool, presenting mechanisms to ensure stakeholder adoption after tool development. Further implications of this multiple case study are discussed from a theoretical and methodological perspective. Practitioner notes What is already known about this topic? Human‐centred learning analytics (LA) has accommodated different configurations of stakeholder engagement, including co‐design and participatory design. Participatory design provides developers with a wide variety of techniques to engage a particular group in a mutual learning process. Most studies mainly focus on engaging stakeholders to identify needs in the early stages of the design process. More empirical works are needed to unveil the effectiveness of human centredness during LA design and after tool development. What this paper adds? Provides a multiple case study to illustrate mechanisms to engage various stakeholders in different design phases of a curriculum analytics (CA) tool. Summarises different assertions based on case study findings regarding needs for analytical tool, its early evaluation and its potential use after development. Provides empirical evidence on how to promote stakeholder engagement at a specific design stage and for a specific purpose. The implications for practitioners LA researchers and developers can use assertions based on evidence as a starting point to drive the design process of CA solutions. Researchers and practitioners will have a set of protocols to implement participatory techniques in different design phases of a CA tool.</abstract><pub>Wiley</pub><doi>10.1111/bjet.13374</doi><orcidid>https://orcid.org/0000-0002-9110-2832</orcidid><orcidid>https://orcid.org/0000-0001-5270-7655</orcidid><orcidid>https://orcid.org/0000-0001-9854-9963</orcidid><orcidid>https://orcid.org/0000-0002-0502-5608</orcidid><orcidid>https://orcid.org/0000-0001-5270-7655</orcidid><orcidid>https://orcid.org/0000-0002-0502-5608</orcidid><orcidid>https://orcid.org/0000-0001-9854-9963</orcidid><orcidid>https://orcid.org/0000-0002-9110-2832</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0007-1013
ispartof British journal of educational technology, 2024-05, Vol.55 (3), p.785-801
issn 0007-1013
1467-8535
language eng
recordid cdi_hal_primary_oai_HAL_hal_04550161v1
source Access via Wiley Online Library
subjects Computer Science
Education
Humanities and Social Sciences
Technology for Human Learning
title Curriculum analytics adoption in higher education: A multiple case study engaging stakeholders in different phases of design
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T03%3A11%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-hal&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Curriculum%20analytics%20adoption%20in%20higher%20education:%20A%20multiple%20case%20study%20engaging%20stakeholders%20in%20different%20phases%20of%20design&rft.jtitle=British%20journal%20of%20educational%20technology&rft.au=Hilliger,%20Isabel&rft.date=2024-05&rft.volume=55&rft.issue=3&rft.spage=785&rft.epage=801&rft.pages=785-801&rft.issn=0007-1013&rft.eissn=1467-8535&rft_id=info:doi/10.1111/bjet.13374&rft_dat=%3Chal%3Eoai_HAL_hal_04550161v1%3C/hal%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true