Perceived MOOC satisfaction: A review mining approach using machine learning and fine-tuned BERTs
Article
Chen, Xieling, Xie, Haoran, Zou, Di, Cheng, Gary, Tao, Xiaohui and Wang, Fu Lee. 2025. "Perceived MOOC satisfaction: A review mining approach using machine learning and fine-tuned BERTs." Computers and Education: Artificial Intelligence. 8. https://doi.org/10.1016/j.caeai.2025.100366
| Article Title | Perceived MOOC satisfaction: A review mining approach using machine learning and fine-tuned BERTs |
|---|---|
| ERA Journal ID | 212149 |
| Article Category | Article |
| Authors | Chen, Xieling, Xie, Haoran, Zou, Di, Cheng, Gary, Tao, Xiaohui and Wang, Fu Lee |
| Journal Title | Computers and Education: Artificial Intelligence |
| Journal Citation | 8 |
| Article Number | 100366 |
| Number of Pages | 17 |
| Year | 2025 |
| Publisher | Elsevier |
| ISSN | 2666-920X |
| Digital Object Identifier (DOI) | https://doi.org/10.1016/j.caeai.2025.100366 |
| Web Address (URL) | https://www.sciencedirect.com/science/article/pii/S2666920X25000062 |
| Abstract | This study investigates the application of machine learning and BERT models to identify topic categories in helpful online course reviews and uncover factors that influence the overall satisfaction of learners in massive open online courses (MOOCs). The research has three main objectives: (1) to assess the effectiveness of machine learning models in classifying review helpfulness, (2) to evaluate the performance of fine-tuned BERT models in identifying review topics, and (3) to explore the factors that influence learner satisfaction across various disciplines. The study uses a MOOC corpus containing 102,184 course reviews from 401 courses across 13 disciplines. The methodology involves three approaches: (1) machine learning for automatic classification of review helpfulness, (2) BERT models for automatic classification of review topics, and (3) multiple linear regression analysis to explore the factors influencing learner satisfaction. The results show that most machine learning models achieve precision, recall, and F1 scores above 80%, 99%, and 89%, respectively, in identifying review helpfulness. The fine-tuned BERT model outperforms baseline models with precision, recall, and F1 scores of 78.4%, 74.4%, and 75.9%, respectively, in classifying review topics. Additionally, the regression analysis identifies key factors affecting learner satisfaction, such as the positive influence of “Instructor” frequency and the negative impact of “Platforms and tools” and “Process”. These insights offer valuable guidance for educators, course designers, and platform developers, contributing to the optimization of MOOC offerings to better meet the evolving needs of learners. |
| Keywords | BERT models; MOOCs; Learner satisfaction; Machine learning; Multiple linear regression |
| Contains Sensitive Content | Does not contain sensitive content |
| ANZSRC Field of Research 2020 | 4611. Machine learning |
| Byline Affiliations | Guangzhou University, China |
| Lingnan University of Hong Kong, China | |
| Hong Kong Polytechnic University, China | |
| Education University of Hong Kong, China | |
| School of Mathematics, Physics and Computing | |
| Hong Kong Metropolitan University, China |
Permalink -
https://research.usq.edu.au/item/zx104/perceived-mooc-satisfaction-a-review-mining-approach-using-machine-learning-and-fine-tuned-berts
Download files
10
total views3
total downloads10
views this month3
downloads this month