Multimodal AI and learning analytics

Understanding learner engagement

What can visual signals and learner feedback tell us about engagement?

The research

This research connects artificial intelligence with questions about participation and learning processes in educational settings.

Related publications examine multimodal engagement profiles and classroom activity detection. Together, they illustrate different ways of investigating learning processes with image-based and language-based methods.

Approaches

  • Computer vision
  • Text and sentiment analysis
  • Multimodal learning analytics

Reading the evidence

Model classification performance is not equivalent to an improvement in educational outcomes. Each paper sets out its evaluation context.