The Driver Monitoring Dataset (DMD) is a comprehensive visual dataset designed for real-world driving action recognition. It features synchronized footage from multiple camera angles to support the development of Deep Learning models for Driver Monitoring Systems (DMS).
Important
Dataset Revision (2026): Due to license updates and hosting constraints, the dataset has been streamlined. Simulator recordings, IR, and Depth streams have been removed. Only RGB material from the real-car scenario is currently available.
To comply with revised privacy and licensing agreements, only material from the following subjects is unrestricted for use:
The DMD provides rich annotations for distraction, fatigue, and gaze-head pose estimation.
| Feature | Description |
|---|---|
| Scenarios | Real-car driving (Simulator data deprecated) |
| Streams | RGB (Body, Face, and Hands views) |
| Format | OpenLABEL / VCD (Video Content Description) |
| Labels | Distraction actions, fatigue levels, gaze, and head pose |
This repository provides the essential ecosystem for interacting with DMD data:
- TaTo (Temporal Annotation Tool): A specialized tool for annotating temporal actions and events.
- DEx (Dataset Explorer): A tool to inspect annotated data and export customized training sets.
To ensure consistency across annotators, we follow strict criteria:
- Distraction-related Action Criteria: Detailed definitions for consistent labeling.
- OpenLABEL Compatibility: The tools and annotation files now use VCD >= 5.0. Make sure you download the latest annotation files and update the tools.
- Video Formats: All video assets are now in
.mp4format. If you have older.aviversions of IR videos, please replace them with the current versions.
If you use DMD in your research, please refer to the Official Website for the preferred citation format.
The following projects and research works utilize the DMD:
- dmd-to-3pdd-builder: A tool for building the 3 Perspective Driver Dataset (3PDD) from the Driver Monitoring Dataset (DMD). (Please, take into consideration tha data availability update from 2026.)
DMD was funded by the European Commission (EC) Horizon 2020 programme via the VI-DAS project (Grant 690772).
Developed with 💙 by:
- Paola Cañas (pncanas@vicomtech.org)
- Juan Diego Ortega (jdortega@vicomtech.org)
- Contributors: Marcos Nieto, Mikel Garcia, Gonzalo Pierola, Itziar Sagastiberri, Itziar Urbieta, Eneritz Etxaniz, Orti Senderos.
Copyright © 2026 Vicomtech. Distributed under the MIT License.
View Full License Text
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.