Jéssica Sena de Souza

Ph.D. Student

Jessica Sena is a PhD student in Computer Science at Universidade Federal de Minas Gerais (UFMG), where she also received her B.Sc. and M.Sc. degrees in Information Systems and Computer Science, respectively.  She is currently at UFMG as researcher at Smart Sense Laboratory (SENSE/UFMG). Her research interests include computer vision, smart surveillance and machine learning applications, with focus on visual and sensorial pattern recognition.

Master Thesis

Jessica Sena: Human Activity Recognition based on Wearable Sensors using Multiscale DCNN Ensemble. Federal University of Minas Gerais, 2018.

Abstract

Sensor-based Human Activity Recognition (sensor-based HAR) provides valuable knowledge to many areas, such as medical, military and security. Recently, wearable devices have gained space as a relevant source of data due to the facility of data capture, the massive number of people who use these devices and the comfort and convenience of the device. In addition, the large number of sensors present in these devices provides complementary data as each sensor provides different information. However, there are two issues: heterogeneity between the data from multiple sensors and the temporal nature of the sensor data. We believe that mitigating these issues might provide valuable information if we handle the data correctly. To handle the first issue, we propose to processes each sensor separately, learning the features of each sensor and performing the classification before fusing with the other sensors. To exploit the second issue, we use an approach to extract patterns in multiple temporal scales of the data. This is convenient since the data are already a temporal sequence and the multiple scales extracted provide meaningful information regarding the activities performed by the users. We extract multiple temporal scales using an ensemble of Deep Convolution Neural Networks (DCNN). In this ensemble, we use a convolutional kernel with different height for each DCNN. Considering that the number of rows in the sensor data reflects the data captured over time, each kernel height reflects a temporal scale from which we can extract patterns. Consequently, our approach is able to extract both simple movement patterns such as a wrist twist when picking up a spoon and complex movements such as the human gait. This multimodal and multi-temporal approach outperforms previous state-of-the-art works in seven important datasets using two different protocols. We also demonstrate that the use of our proposed set of kernels improves sensor-based HAR in another multi-kernel approach, the widely employed inception network.

    Publications

    Sena, Jessica

    Human Activity Recognition based on Wearable Sensors using Multiscale DCNN Ensemble Masters Thesis

    Federal University of Minas Gerais, 2018.

    Abstract | BibTeX

    de Melo, Victor Hugo Cunha; Santos, Jesimon Barreto; Junior, Carlos Antonio Caetano; Sena, Jessica; Penatti, Otavio A B; Schwartz, William Robson

    Object-based Temporal Segment Relational Network for Activity Recognition Inproceedings

    Conference on Graphic, Patterns and Images (SIBGRAPI), pp. 1-8, 2018.

    BibTeX

    Sena, Jessica; Santos, Jesimon Barreto; Schwartz, William Robson

    Multiscale DCNN Ensemble Applied to Human Activity Recognition Based on Wearable Sensors Inproceedings

    26th European Signal Processing Conference (EUSIPCO 2018), pp. 1-5, 2018.

    Links | BibTeX

    Jordao, Artur; Junior, Antonio Carlos Nazare; Sena, Jessica; Schwartz, William Robson

    Human Activity Recognition based on Wearable Sensor Data: A Benchmark Journal Article

    arXiv, pp. 1-12, 2018.

    Links | BibTeX

    Jordao, Artur; Sena, Jessica; Schwartz, William Robson

    A Late Fusion Approach to Combine Multiple Pedestrian Detectors Inproceedings

    IAPR International Conference on Pattern Recognition (ICPR), pp. 1-6, 2016.

    Links | BibTeX

    Sena, Jessica; Ferreira, Cesar Augusto Moura; dos Junior, Cassio Elias Santos; de Melo, Victor Hugo Cunha; Schwartz, William Robson

    Self-Organizing Traffic Lights: A Pedestrian Oriented Approach Miscellaneous

    Workshop of Undergraduate Works (WUW) in SIBGRAPI - Conference on Graphics, Patterns and Images, 2014, (1st place award).

    Links | BibTeX

    Sena, Jessica; Ferreira, Cesar Augusto Moura; dos Junior, Cassio Elias Santos; de Melo, Victor Hugo Cunha; Schwartz, William Robson

    Self-Organizing Traffic Lights: A Pedestrian Oriented Approach Inproceedings

    X Workshop de Visão Computacional, pp. 1-6, 2014.

    Links | BibTeX