Evaluation Of The Neural Network Object Detection In Multi-Modal Images

Abstract

This paper studies the information gain of various data domains that are commonly usedin the modern Advanced Driving Assistant Systems (ADAS) to develop robust systems that wouldincrease traffic safety. We could see a fast growth of many Deep Convolutional Neural Networks(DCNN) based solutions during the last several years. These methods are state-of-the-art in objectdetection and semantic scene segmentation. We created a small annotated dataset of synchronizedRGB, grayscale, thermal, and depth map images and used the modern DCNN framework tool toevaluate the object detection robustness of different data domains and their information gain processunderstanding the surrounding environment of the semi-autonomous driving agent.