Comparative Study of Out-of-the-Box Technology for Automatic Target Detection and Recognition
초록
Automatic Target Detection and Recognition (ATD/R) is critical for military decision support and (semi-)autonomous operations. Recent advances in object detection and artificial intelligence (AI) significantly boosted the potential performance of ATD/R. However, the scarcity of publicly available military datasets limits the application of these systems. As a solution, this paper explores the use of publicly available models and civilian datasets to achieve reasonable performance in military contexts. We benchmark several state-of-the-art models, including six iterations of the YOLO series and two variations on the DETR framework, on a newly acquired military relevant dataset. This dataset features military vehicles and challenging circumstances, including various degrees of occlusions and small targets. The out-of-the-box version of each model is validated alongside a version finetuned on the VisDrone dataset. This dataset features small objects, an Air-to-Ground (A2G) perspective and relevant classes, potentially generalizing to our military ATD/R task. We compare the performance of the models using mAP@0.5 and mAP@0.5:0.95, across A2G and Ground-to-Ground (G2G) perspective, target size and model size, giving insight into the real-time capabilities of models. Our main findings are: (1) bigger models outperform smaller models, (2) DETR-based models show promising results compared to the YOLO series,(3) fine-tuning models on an out-of-domain A2G dataset, improves their A2G performance and slightly improves their performance on small objects, but (4) all models still struggle with detecting small objects in an A2G scenario. We conclude that, despite recent advances in object detection, in-domain training is still crucial for creating capable ATD/R systems.
저자 (15명)
- Alma M. Liezenga — LinkedIn 검색
- Lotte Nijskens — LinkedIn 검색
- Henrik R. Baumann — LinkedIn 검색
- Stefan Becker — LinkedIn 검색
- Simon Bensberg — LinkedIn 검색
- Niccolò Camarlinghi — LinkedIn 검색
- Håvard R. Eiring — LinkedIn 검색
- Alexander W. Johnsgaard — LinkedIn 검색
- Tanel Liiv — LinkedIn 검색
- Giuseppe Martino — LinkedIn 검색
- Matteo Marturini — LinkedIn 검색
- Matthias Rapp — LinkedIn 검색
- Jan Erik van Woerden — LinkedIn 검색
- Alexander Wolpert — LinkedIn 검색
- Hugo J. Kuijf — LinkedIn 검색
저자 LinkedIn 변경 추적은 추후 자동화 예정입니다. 현재는 검색 링크를 제공합니다.