Remote Facial Emotion Recognition System

Результат исследования: Публикации в книгах, отчётах, сборниках, трудах конференцийстатья в сборнике материалов конференциинаучнаярецензирование

Аннотация

This paper describes a method for collecting information of user's emotional state based on its facial expressions and linking the data acquired to the user's actions in a time. Methods and Algorithms: At client side, we use reactive programming model implemented by RxJS library to manage data streams. Our client library includes logic to combining events from different sources such as MediaStream APIs, classic DOM event API. We have developed our own neural network architecture that allows us to map the facial expressions of people into a continuous space of arousal/valence. The same architecture for classification of emotions was used. We used inception and residual blocks and batch normalization layers to achieve higher accuracy. In addition, we augment train data by adding pose variations using 3D face reconstruction. Results: We have developed a system that allows us to collect various data such as video stream and events of user interaction with the webpage. We also trained a neural network that shows high accuracy. One part of the system is a client library that does not require the user to install any special software and can be easily integrated into the website. The other part is a server application that enables the site owner to analyze the data collected.
Язык оригиналаанглийский
Название основной публикацииSIBIRCON 2019 - International Multi-Conference on Engineering, Computer and Information Sciences, Proceedings
ИздательIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Страницы975-979
Число страниц5
ISBN (электронное издание)978-1-7281-4401-6
ISBN (печатное издание)978-1-7281-4402-3
DOI
СостояниеОпубликовано - окт 2019
Событие2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON) - Academpark, Dom Uchyonykh—TUSUR, Ural Hi-Tech Park, Novosibirsk, Tomsk, Yekaterinburg, Российская Федерация
Продолжительность: 21 окт 201927 окт 2019
Номер конференции: V
https://ieeexplore.ieee.org/xpl/conhome/1002416/all-proceedings

Серия публикаций

НазваниеSIBIRCON 2019 - International Multi-Conference on Engineering, Computer and Information Sciences, Proceedings

Конференция

Конференция2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON)
Сокращенный заголовок2019 SIBIRCON
СтранаРоссийская Федерация
ГородNovosibirsk, Tomsk, Yekaterinburg
Период21.10.201927.10.2019
Адрес в сети Интернет

    Fingerprint

Цитировать

Хазанкин, Г. Р., Шмаков, И. С., & Малинин, А. Н. (2019). Remote Facial Emotion Recognition System. В SIBIRCON 2019 - International Multi-Conference on Engineering, Computer and Information Sciences, Proceedings (стр. 975-979). [8958047] (SIBIRCON 2019 - International Multi-Conference on Engineering, Computer and Information Sciences, Proceedings). IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC. https://doi.org/10.1109/SIBIRCON48586.2019.8958047