Synthehicle is a massive CARLA-based synthehic multi-vehicle multi-camera tracking dataset and includes ground truth for 2D detection and tracking, 3D detection and tracking, depth estimation, and semantic, instance and panoptic segmentation.
- Synthehicle has been accepted to WACV Workshops 2023
- We have added the CARLA and evaluation scripts
- The evaluation server is ready!
The 17 hour Synthehicle dataset consists of 64 scenes in four different weather conditions, 16 different camera setups, and 340 camera videos. It is freely available via the following download links provided here.
To evaluate on Synthehicle please refer to our wiki.
To generate your own data similar to Synthehicle please refer to our wiki.
We provide pretrained weights for 2D detection and vehicle re-identification:
We have used the YOLOX-x model from mmdetection.
| Model | Trained on | Weights | Config | AP |
|---|---|---|---|---|
| YOLOX-x | All | download | download | 59.7% |
| YOLOX-x | Day | download | download | 58.7% |
| YOLOX-x | Dawn | download | download | 60.8% |
| YOLOX-x | Rain | download | download | 56.8% |
| YOLOX-x | Night | download | download | 50.6% |
The specialized models (day, dawn, rain, night) are provided for completeness. Results from our paper indicate that the model trained on all subsets performs best for all environmental setups.
We have used the fastreid ResNet-50 Model with IBN:
| Model | Trained on | Weights | Config | mAP |
|---|---|---|---|---|
| fastreid | All | download | 47.8% | |
| fastreid | Day | download | 59.8% | |
| fastreid | Dawn | download | 47.57% | |
| fastreid | Rain | download | 39.08% | |
| fastreid | Night | download | 27.04% |
The specialized models (day, dawn, rain, night) are provided for completeness. Results from our paper indicate that the model trained on all subsets performs best for all environmental setups. We will provide a fast-reid config soon alongside a model class. The weights can be read into any fast-reid ResNet-50 model.
In our paper, single-camera tracking has been performed using DeepSORT with the models above. Multi-camera tracking has been performed using ELECTRICITY.
If you use Synthehicle for your work, please cite:
@InProceedings{Herzog_2023_WACV,
author = {Herzog, Fabian and Chen, Junpeng and Teepe, Torben and Gilg, Johannes and H\"ormann, Stefan and Rigoll, Gerhard},
title = {Synthehicle: Multi-Vehicle Multi-Camera Tracking in Virtual Cities},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops},
month = {January},
year = {2023},
pages = {1-11}
}