Assessment of learning in child–computer interaction research: A semi-systematic literature review

Abstract

In this paper, we investigate and map out how learning is assessed in Child–computer interaction (CCI) research. We have conducted a semi-systematic literature review in the CCI community's leading venues: the Interaction Design and Children (IDC) conference and the International Journal of Child–Computer Interaction (IJCCI). This eventually led to 30 publications that use the word stem ‘learn*’ in title, abstract and keywords being included in the corpus. Based on our analysis of these publications, the results demonstrate that there are three main strands of research approaches, namely quantitative, qualitative and mixed-methods, some of which are design-based. The case studies taking a qualitative approach dominate the field whereas the mixed-methods approach remains low in number. Furthermore, the findings showed that basic characteristics of research design and approaches to the assessment of learning are rarely defined, and that assessment of learning is scarcely operationalized. This affects the methodological rigor and possibility of understanding causality of technology interaction in children's learning. It was also found that only a limited number of works include assessment of learning regarding transfer of learning and controlled groups. The main findings from this review describe the current state-of-the art and address the gaps in CCI research in presenting evidence for learning in children as a desired impact. We conclude with suggestions for future avenues for the assessment of learning in CCI.