Use of Learning Analytics Data in Health Care-Related Educational Disciplines: Systematic Review

Background: While the application of learning analytics in tertiary education has received increasing attention in recent years, a much smaller number have explored its use in health care-related educational studies.

Objective: This systematic review aims to examine the use of e-learning analytics data in health care studies with regards to how the analytics is reported and if there is a relationship between e-learning analytics and learning outcomes.

Methods: We performed comprehensive searches of papers from 4 electronic databases (MEDLINE, EBSCOhost, Web of Science, and ERIC) to identify relevant papers. Qualitative studies were excluded from this review. Papers were screened by 2 independent reviewers. We selected qualified studies for further investigation.

Results: A total of 537 papers were screened, and 19 papers were identified. With regards to analytics undertaken, 11 studies reported the number of connections and time spent on e-learning. Learning outcome measures were defined by summative final assessment marks or grades. In addition, significant statistical results of the relationships between e-learning usage and learning outcomes were reported in 12 of the identified papers. In general, students who engaged more in e-learning resources would get better academic attainments. However, 2 papers reported otherwise with better performing students consuming less e-learning videos. A total of 14 papers utilized satisfaction questionnaires for students, and all were positive in their attitude toward e-learning. Furthermore, 6 of 19 papers reported descriptive statistics only, with no statistical analysis.

Conclusions: The nature of e-learning activities reported in this review was varied and not detailed well. In addition, there appeared to be inadequate reporting of learning analytics data observed in over half of the selected papers with regards to definitions and lack of detailed information of what the analytic was recording. Although learning analytics data capture is popular, a lack of detail is apparent with regards to the capturing of meaningful and comparable data. In particular, most analytics record access to a management system or particular e-learning materials, which may not necessarily detail meaningful learning time or interaction. Hence, learning analytics data should be designed to record the time spent on learning and focus on key learning activities. Finally, recommendations are made for future studies.