Biosignal and image processing system for emotion recognition applications

Students Name: Shereha Viktor Ivanovych
Qualification Level: magister
Speciality: Artificial Intelligence
Institute: Institute of Computer Science and Information Technologies
Mode of Study: full
Academic Year: 2020-2021 н.р.
Language of Defence: англійська
Abstract: Purpose and motivation Not so long ago the idea for a machine to understand the human thoughts could be comprehended as total nonsense. Computer-brain interfaces, BrainNet, deep interactive gaming are fields that are thought to be fictional but at the same time could benefit and move human society to the next level of development. Digital advertising, marketing, one-on-one interviews are the technologies we are already using though they could be greatly improved by applying the described idea. After thoroughly researching the computer-brain interfaces, its versions, the labs and scientists are developing in the moment of writing this thesis the glimpses of new technologies such as EEG-to-speech, EEG-to-devices (mental typing) are already on the horizon. By leveraging a couple of brain-wave detectors and complex algorithms, it’s gradually becoming possible to analyze brain signals and extract reasonable brain patterns. Brain activity, such as neurons and synapses cooperation, can then be recorded by a non-invasive device, so that no surgical intervention is needed. In fact, most of the developed prototypes and mainstream BCIs are non-invasive. Generally they are contained inside the wearable headbands and earbuds. Regarding the invasive approach, over the last years a specific type of BCI gained attention - a model that utilizes a grid of electrodes implanted directly into the motor cortex and neighbouring areas. In this context, motor imagery is used as an intuitive and natural strategy to elicit brain activity changes and subsequently to control movements of a robotic arm in real-time. With the technologies on the horizon that gives the opportunity for much more accurate brain-data extraction the research can be moved to the following stage - emotions and its understanding. The emotions are considered the vital states of the human being and play a dramatic role in its lifecycle, commonly being emphasized in theoretical research as a mechanism of consciousness. The questions about cognition, conscience, philosophy, human nature rise more frequently making the research of emotions a first step of understanding how to answer them. Besides making a contribution to global topics, the research of emotions can influence people’s lives on the baseline level. As it is known emotions affect organisms not only on the psychical level but on the physiological as well. An abundance of positive emotions improves a person’s health and work efficiency. On the other hand, negative emotions are one of the main reasons of depression which is the widely spread cause of suicide if being neglected. For emotion recognition, the emotions should be defined and evaluated quantitatively. The sole definition of initial emotions was first proposed decades ago. However, the precise definition has never been widely acknowledged by psychologists. They tend to assess emotions with two different approaches. One is to split the emotions into separate groups or classes. Another one is to use multi-dimensional labels. For emotion elicitation, subjects are given a series of emotionally-evocative materials to induce a certain emotion. For the past few years, entertainment stimulations are the most common product. Besides, some new methods called situational stimulation are rising in recent years.