Sensemo: An Affective Learning System based on Real TimeEmotion Recognition with Smartwatch

Background

In educational settings, both online and offline, monitoring and responding to students' emotional states can significantly enhance learning outcomes. Traditional approaches rely heavily on subjective observations by teachers, which can be inconsistent and limited by human perception and attention. In online environments, the challenge is even greater due to the physical separation between students and instructors, making it difficult to gauge engagement and emotional responses accurately. Existing methods often lack real-time adaptability and fail to provide personalized interventions, thereby affecting the overall efficacy of the learning experience. Additionally, the need for specially designed teaching materials and prerecorded content to accommodate emotional responses adds complexity and resource demands. These limitations highlight the necessity for more sophisticated, real-time emotion-sensing technologies that can seamlessly integrate into both online and offline educational frameworks.

Technology

Sensemo is designed for both online and offline learning environments, utilizing smartwatches to collect real-time physiological signal data from students. This data is transmitted to a server via an Android app for further processing. In online learning, the system adapts the learning experience by adjusting the speed or content based on the student's emotional responses, either automatically or through teacher intervention. Teachers can monitor and override the system's actions as needed, using specially designed teaching materials and prerecorded lecture segments. In classroom settings, lecturers use the emotional feedback to engage in interactive learning, aiming to maintain positive emotional responses among the majority while addressing individual needs.

Advantages

Real-time Emotion Monitoring - Adaptation of Learning Material - Teacher Override Capability - Interactive Classroom Learning - Unified Online and Offline Application - Physiological Data Utilization - Enhanced Student Engagement

Application

The system monitors individual students' emotional responses in real-time and adjusts the speed or content of the lesson to enhance engagement and learning outcomes. Lecturers can use real-time emotional feedback from students to tailor their teaching methods, ensuring a positive emotional response from the majority and addressing the needs of less engaged individuals.