Аннотация
This paper describes a method for collecting information of user's emotional state based on its facial expressions and linking the data acquired to the user's actions in a time. Methods and Algorithms: At client side, we use reactive programming model implemented by RxJS library to manage data streams. Our client library includes logic to combining events from different sources such as MediaStream APIs, classic DOM event API. We have developed our own neural network architecture that allows us to map the facial expressions of people into a continuous space of arousal/valence. The same architecture for classification of emotions was used. We used inception and residual blocks and batch normalization layers to achieve higher accuracy. In addition, we augment train data by adding pose variations using 3D face reconstruction. Results: We have developed a system that allows us to collect various data such as video stream and events of user interaction with the webpage. We also trained a neural network that shows high accuracy. One part of the system is a client library that does not require the user to install any special software and can be easily integrated into the website. The other part is a server application that enables the site owner to analyze the data collected.
Язык оригинала | английский |
---|---|
Название основной публикации | SIBIRCON 2019 - International Multi-Conference on Engineering, Computer and Information Sciences, Proceedings |
Издатель | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
Страницы | 975-979 |
Число страниц | 5 |
ISBN (электронное издание) | 978-1-7281-4401-6 |
ISBN (печатное издание) | 978-1-7281-4402-3 |
DOI | |
Состояние | Опубликовано - окт 2019 |
Событие | 2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON) - Academpark, Dom Uchyonykh—TUSUR, Ural Hi-Tech Park, Novosibirsk, Tomsk, Yekaterinburg, Российская Федерация Продолжительность: 21 окт 2019 → 27 окт 2019 Номер конференции: V https://ieeexplore.ieee.org/xpl/conhome/1002416/all-proceedings |
Серия публикаций
Название | SIBIRCON 2019 - International Multi-Conference on Engineering, Computer and Information Sciences, Proceedings |
---|
Конференция
Конференция | 2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON) |
---|---|
Сокращенный заголовок | 2019 SIBIRCON |
Страна | Российская Федерация |
Город | Novosibirsk, Tomsk, Yekaterinburg |
Период | 21.10.2019 → 27.10.2019 |
Адрес в сети Интернет |