undefined

Measuring digital intervention user experience with a novel ecological momentary assessment (EMA) method, CORTO

Publiceringsår

2024

Upphovspersoner

Lukka, Lauri; Karhulahti, Veli Matti; Bergman, Vilma Reetta; Palva, J. Matias

Abstrakt

Digital interventions often suffer from low usage, which may reflect insufficient attention to user experience. Moreover, the existing evaluation methods have limited applicability in the remote study of user experience of complex interventions that have expansive content and that are used over an extensive period of time. To alleviate these challenges, we describe here a novel qualitative Ecological Momentary Assessment (EMA) method: the CORTO method (Contextual, One-item, Repeated, Timely, Open-ended). We used it to gather digital intervention user experience data from Finnish adults (n = 184) who lived with interview-confirmed major depressive disorder (MDD) and took part in a randomized controlled trial (RCT) that studied the efficacy of a novel 12-week game-based digital intervention for depression. A second dataset on user experience was gathered with retrospective interviews (n = 22). We inductively coded the CORTO method and retrospective interview data, which led to four user experience categories: (1) contextual use, (2) interaction-elicited emotional experience, (3) usability, and (4) technical issues. Then, we used the created user experience categories and Template Analysis to analyze both datasets together, and reported the results qualitatively. Finally, we compared the two datasets with each other. We found that the data generated with the CORTO method offered more insights into usability and technical categories than the interview data that particularly illustrated the contextual use. The emotional valence of the interview data was more positive compared with the CORTO data. Both the CORTO and interview data detected 55 % of the micro-level categories; 20 % of micro-level categories were only detected by the CORTO data and 25 % only by the interview data. We found that the during-intervention user experience measurement with the CORTO method can provide intervention-specific insights, and thereby further the iterative user-centered intervention development. Overall, these findings highlight the impact of evaluation methods on the categories and qualities of insights acquired in intervention research.
Visa mer

Organisationer och upphovspersoner

Jyväskylä universitet

Karhulahti Veli-Matti Orcid -palvelun logo

Helsingfors universitet

Palva J. Matias

Aalto-universitetet

Lukka Lauri Orcid -palvelun logo

Palva Matias Orcid -palvelun logo

Bergman Vilma-Reetta

Publikationstyp

Publikationsform

Artikel

Moderpublikationens typ

Tidning

Artikelstyp

En originalartikel

Målgrupp

Vetenskaplig

Kollegialt utvärderad

Kollegialt utvärderad

UKM:s publikationstyp

A1 Originalartikel i en vetenskaplig tidskrift

Publikationskanalens uppgifter

Moderpublikationens namn

Internet Interventions

Förläggare

Elsevier

Volym

35

Artikelnummer

100706

Publikationsforum

86837

Publikationsforumsnivå

1

Öppen tillgång

Öppen tillgänglighet i förläggarens tjänst

Ja

Öppen tillgång till publikationskanalen

Helt öppen publikationskanal

Parallellsparad

Ja

Parallellagringens licens

CC BY NC ND

Publiceringsavgift för öppen tillgång €

1988

Betalningsår för den öppen tillgång publiceringsavgiften

2024

Övriga uppgifter

Vetenskapsområden

Data- och informationsvetenskap; Fysik; Medicinsk teknik; Psykologi

Nyckelord

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Publiceringsland

Nederländerna

Förlagets internationalitet

Internationell

Språk

engelska

Internationell sampublikation

Ja

Sampublikation med ett företag

Nej

DOI

10.1016/j.invent.2023.100706

Publikationen ingår i undervisnings- och kulturministeriets datainsamling

Ja