DeepEyes: Visual Computing Solutions and Machine Intelligence for Computer Forensics and Electronic Surveillance

Agency:
capes

Criminal activities vary in scope and complexity but exist in all sectors of society. With technological development, crimes have become more sophisticated, migrating from the physical world and reaching the virtual world as well. Faced with the many forms that illegal activities can take, the approach for modern society lies in investing in improved and scientifically grounded investigative techniques. With demands so sophisticated and increasingly complex, there is an obligation to strengthen more and more the foundations on which Forensic Science develops. More than ever, we need objective and scientifically based criteria to identify characteristics at crime and accident sites, or even to prevent the occurrence of crimes, taking effective preventive actions of electronic surveillance. We need innovative approaches that are consistent with the current challenges to help us solve the three basic questions about an illegal activity or a large-scale accident: Who?, Under what circumstances?, and Why? Faced with so many challenges, this project aimed at the development of algorithmic solutions of visual computation and machine intelligence for problems related to computer forensics, digital security and electronic surveillance. The problems of interest are: (P1) detection of falsifications in digital images and videos; (P2) allocation of data capture sources, such as cameras, scanners, printers; (P3) detection of clandestine plantations of e.g., Cannabis sativa from remote sensing images; (P4) development of human identification techniques from faces; (P5) recognition of vehicle license plates from digital videos; and (P6) analysis of activities in digital videos. The research will be carried out jointly with several partners in universities in Brazil and the world, and with the Federal Police of Brazil more specifically with the Service of Expertise in Audiovisual and Electronic (SEPAEL) of the National Institute of Criminalistics (INC).

Surveillance

Contributions generated from this research…

  • Publications

Victor Hugo Cunha de Melo; Jesimon Barreto Santos; Carlos Antonio Caetano Junior; Jessica Sena; Otavio A B Penatti; William Robson Schwartz

Object-based Temporal Segment Relational Network for Activity Recognition Inproceedings

In: Conference on Graphic, Patterns and Images (SIBGRAPI), pp. 1-8, 2018.

BibTeX

Jessica Sena; Jesimon Barreto Santos; William Robson Schwartz

Multiscale DCNN Ensemble Applied to Human Activity Recognition Based on Wearable Sensors Inproceedings

In: 26th European Signal Processing Conference (EUSIPCO 2018), pp. 1-5, 2018.

Links | BibTeX

Gabriel Resende Gonçalves; Matheus Alves Diniz; Rayson Laroca; David Menotti; William Robson Schwartz

Real-time Automatic License Plate Recognition Through Deep Multi-Task Networks Inproceedings

In: Conference on Graphic, Patterns and Images (SIBGRAPI), pp. 1-8, 2018.

Links | BibTeX

Carlos Antonio Caetano Junior; Jefersson A dos Santos; William Robson Schwartz

Statistical Measures from Co-occurrence of Codewords for Action Recognition Inproceedings

In: VISAPP 2018 - International Conference on Computer Vision Theory and Applications, pp. 1-8, 2018.

Links | BibTeX

Artur Jordao; Ricardo Barbosa Kloss; William Robson Schwartz

Latent hypernet: Exploring all Layers from Convolutional Neural Networks Inproceedings

In: IEEE International Joint Conference on Neural Networks (IJCNN), pp. 1-7, 2018.

Links | BibTeX

Rensso Victor Hugo Mora Colque; Carlos Antonio Caetano Junior; Victor Hugo Cunha de Melo; Guillermo Camara Chavez; William Robson Schwartz

Novel Anomalous Event Detection based on Human-object Interactions Inproceedings

In: VISAPP 2018 - International Conference on Computer Vision Theory and Applications, pp. 1-8, 2018.

Links | BibTeX

Igor Leonardo Oliveira Bastos; Victor Hugo Cunha de Melo; Gabriel Resende Gonçalves; William Robson Schwartz

MORA: A Generative Approach to Extract Spatiotemporal Information Applied to Gesture Recognition Inproceedings

In: 15th International Conference on Advanced Video and Signal-based Surveillance (AVSS), pp. 1-6, 2018.

Links | BibTeX

Ricardo Barbosa Kloss; Artur Jordao; William Robson Schwartz

Boosted Projection An Ensemble of Transformation Models Inproceedings

In: 22nd Iberoamerican Congress on Pattern Recognition (CIARP), pp. 331-338, 2018.

Links | BibTeX

Renan Oliveira Reis; Igor Henrique Dias; William Robson Schwartz

Neural network control for active cameras using master-slave setup Inproceedings

In: International Conference on Advanced Video and Signal-based Surveillance (AVSS), pp. 1-6, 2018.

Links | BibTeX

Antonio Carlos Nazare Junior; Filipe Oliveira de Costa; William Robson Schwartz

Content-Based Multi-Camera Video Alignment using Accelerometer Data Inproceedings

In: Advanced Video and Signal Based Surveillance (AVSS), 2018 15th IEEE International Conference on, pp. 1-6, 2018.

Links | BibTeX

Artur Jordao; Ricardo Kloss; Fernando Yamada; William Robson Schwartz

Pruning Deep Neural Networks using Partial Least Squares Journal Article

In: ArXiv e-prints, 2018.

Links | BibTeX

Igor Leonardo Oliveira Bastos; Larissa Rocha Soares; William Robson Schwartz

Pyramidal Zernike Over Time: A spatiotemporal feature descriptor based on Zernike Moments Inproceedings

In: Iberoamerican Congress on Pattern Recognition (CIARP 2017), pp. 77-85, 2017.

Links | BibTeX

Rensso Victor Hugo Mora Colque; Carlos Antonio Caetano Junior; Matheus Toledo Lustosa de Andrade; William Robson Schwartz

Histograms of Optical Flow Orientation and Magnitude and Entropy to Detect Anomalous Events in Videos Journal Article

In: IEEE Transactions on Circuits and Systems for Video Technology, 27 (3), pp. 673-682, 2017.

Links | BibTeX

Artur Jordao; Jessica Sena; William Robson Schwartz

A Late Fusion Approach to Combine Multiple Pedestrian Detectors Inproceedings

In: IAPR International Conference on Pattern Recognition (ICPR), pp. 1-6, 2016.

Links | BibTeX

Gabriel Resende Gonçalves; David Menotti; William Robson Schwartz

License Plate Recognition based on Temporal Redundancy Inproceedings

In: IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 1-5, 2016.

Links | BibTeX

Gabriel Resende Gonçalves; Sirlene Pio Gomes da Silva; David Menotti; William Robson Schwartz

Benchmark for License Plate Character Segmentation Journal Article

In: Journal of Electronic Imaging, 25 (5), pp. 1-5, 2016, ISBN: 1017-9909.

Links | BibTeX

Rafael Henrique Vareto; Filipe Oliveira de Costa; William Robson Schwartz

Face Identification in Large Galleries Inproceedings

In: Workshop on Face Processing Applications, pp. 1-4, 2016.

Links | BibTeX

Raphael Felipe Carvalho de Prates; Marina Santos Oliveira; William Robson Schwartz

Kernel Partial Least Squares for Person Re-Identification Inproceedings

In: IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS), 2016.

Abstract | Links | BibTeX

Artur Jordao; William Robson Schwartz

Oblique Random Forest based on Partial Least Squares Applied to Pedestrian Detection Inproceedings

In: IEEE International Conference on Image Processing (ICIP), pp. 2931-2935, 2016.

Links | BibTeX

Gabriel Resende Goncalves

License Plate Recognition based on Temporal Redundancy Masters Thesis

Federal University of Minas Gerais, 2016.

Abstract | Links | BibTeX

Artur Jordao

The Good, the Fast and the Better Pedestrian Detector Masters Thesis

Federal University of Minas Gerais, 2016.

Abstract | Links | BibTeX

Cristianne Rodrigues Santos Dutra

Técnicas Otimizadas para Reidentificaçâo de Pessoas Masters Thesis

Federal University of Minas Gerais, 2016.

Links | BibTeX

Cassio Elias Santos dos Junior

Partial Least Squares for Face Hashing Masters Thesis

Federal University of Minas Gerais, 2015.

Abstract | Links | BibTeX

D Menotti; G Chiachia; A Pinto; William Robson Schwartz; H Pedrini; Xavier A Falcao; A Rocha

Deep Representations for Iris, Face, and Fingerprint Spoofing Detection Journal Article

In: Information Forensics and Security, IEEE Transactions on, 10 (4), pp. 864-879, 2015, ISSN: 1556-6013.

Links | BibTeX

A Pinto; William Robson Schwartz; H Pedrini; De Rezende A Rocha

Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks Journal Article

In: Information Forensics and Security, IEEE Transactions on, 10 (5), pp. 1025-1038, 2015, ISSN: 1556-6013.

Links | BibTeX