Learner’s attention detection in connected smart classroom using internet of things and convolutional neural networks

Mustapha Riad, Mohammed Qbadou, Es-Saâdia Aoula


Detecting learner attention is an essential part of learning assessment. Consequently, it becomes an essential requirement for adaptive intelligent teaching systems, to identify specific needs and anticipate orientations. In this article, we propose a new model of a connected smart classroom, based on the internet of things, artificial intelligence and machine learning to detect in real time learners' attention and marking their presence during the execution of a teacher-assisted pedagogical activity, as well as to adapt the most suitable learning objects to these learners. The proposed model is based on head position, gaze direction, yawning and eye-state analysis as facial landmarks detected by cameras connected via the Bluetooth low energy network and transmitted to a developed convolutional neural network. In addition, a series of experiments have been conducted to evaluate the performance and efficiency of the model developed. The findings demonstrate that the model developed can be used to precisely capture the status of learners in the classroom in terms of attention and identification. In this way, these interesting findings can be used to adapt teaching activities to the individual needs of learners, and to identify areas where they have difficulties and needs extra help.


Adapting learning paths; Bluetooth low energy; Camera-based detection; Connected smart classroom; Convolutional neural networks; Internet of things; Landmarks

Full Text:


DOI: http://doi.org/10.11591/ijece.v14i3.pp3455-3466

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

International Journal of Electrical and Computer Engineering (IJECE)
p-ISSN 2088-8708, e-ISSN 2722-2578

This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).