Jéssica Sena de Souza

Aluno de doutorado

Jessica Sena é doutoranda em Ciência da Computação na Universidade Federal de Minas Gerais (UFMG), onde também recebeu seus títulos de bacharela em Sistemas de Informação e mestra em Ciência da Computação. Atualmente, trabalha como pesquisadora no Laboratório Smart Sense (SENSE/UFMG). Seus interesses de pesquisa incluem visão computacional, vigilância inteligente e aplicações de aprendizado de máquina, com foco no reconhecimento de padrões visuais e sensoriais.

Dissertação

Jessica Sena: Human Activity Recognition based on Wearable Sensors using Multiscale DCNN Ensemble. Federal University of Minas Gerais, 2018.

Resumo

Sensor-based Human Activity Recognition (sensor-based HAR) provides valuable knowledge to many areas, such as medical, military and security. Recently, wearable devices have gained space as a relevant source of data due to the facility of data capture, the massive number of people who use these devices and the comfort and convenience of the device. In addition, the large number of sensors present in these devices provides complementary data as each sensor provides different information. However, there are two issues: heterogeneity between the data from multiple sensors and the temporal nature of the sensor data. We believe that mitigating these issues might provide valuable information if we handle the data correctly. To handle the first issue, we propose to processes each sensor separately, learning the features of each sensor and performing the classification before fusing with the other sensors. To exploit the second issue, we use an approach to extract patterns in multiple temporal scales of the data. This is convenient since the data are already a temporal sequence and the multiple scales extracted provide meaningful information regarding the activities performed by the users. We extract multiple temporal scales using an ensemble of Deep Convolution Neural Networks (DCNN). In this ensemble, we use a convolutional kernel with different height for each DCNN. Considering that the number of rows in the sensor data reflects the data captured over time, each kernel height reflects a temporal scale from which we can extract patterns. Consequently, our approach is able to extract both simple movement patterns such as a wrist twist when picking up a spoon and complex movements such as the human gait. This multimodal and multi-temporal approach outperforms previous state-of-the-art works in seven important datasets using two different protocols. We also demonstrate that the use of our proposed set of kernels improves sensor-based HAR in another multi-kernel approach, the widely employed inception network.

    Publicações

    Sena, Jessica

    Human Activity Recognition based on Wearable Sensors using Multiscale DCNN Ensemble Masters Thesis

    Federal University of Minas Gerais, 2018.

    Resumo | BibTeX

    de Melo, Victor Hugo Cunha; Santos, Jesimon Barreto; Junior, Carlos Antonio Caetano; Sena, Jessica; Penatti, Otavio A B; Schwartz, William Robson

    Object-based Temporal Segment Relational Network for Activity Recognition Inproceedings

    Conference on Graphic, Patterns and Images (SIBGRAPI), pp. 1-8, 2018.

    BibTeX

    Sena, Jessica; Santos, Jesimon Barreto; Schwartz, William Robson

    Multiscale DCNN Ensemble Applied to Human Activity Recognition Based on Wearable Sensors Inproceedings

    26th European Signal Processing Conference (EUSIPCO 2018), pp. 1-5, 2018.

    Links | BibTeX

    Jordao, Artur; Junior, Antonio Carlos Nazare; Sena, Jessica; Schwartz, William Robson

    Human Activity Recognition based on Wearable Sensor Data: A Benchmark Journal Article

    arXiv, pp. 1-12, 2018.

    Links | BibTeX

    Jordao, Artur; Sena, Jessica; Schwartz, William Robson

    A Late Fusion Approach to Combine Multiple Pedestrian Detectors Inproceedings

    IAPR International Conference on Pattern Recognition (ICPR), pp. 1-6, 2016.

    Links | BibTeX

    Sena, Jessica; Ferreira, Cesar Augusto Moura; dos Junior, Cassio Elias Santos; de Melo, Victor Hugo Cunha; Schwartz, William Robson

    Self-Organizing Traffic Lights: A Pedestrian Oriented Approach Miscellaneous

    Workshop of Undergraduate Works (WUW) in SIBGRAPI - Conference on Graphics, Patterns and Images, 2014, (1st place award).

    Links | BibTeX

    Sena, Jessica; Ferreira, Cesar Augusto Moura; dos Junior, Cassio Elias Santos; de Melo, Victor Hugo Cunha; Schwartz, William Robson

    Self-Organizing Traffic Lights: A Pedestrian Oriented Approach Inproceedings

    X Workshop de Visão Computacional, pp. 1-6, 2014.

    Links | BibTeX