How Does the Application Work?
This mixed reality application is designed to teach and reinforce essential first aid skills (PSC1). It is structured in three main phases, progressively guiding the user from learning to practicing and finally testing their knowledge.
Developed as a final year project at ESILV (Ecole Supérieure d'Ingénieurs Léonard de Vinci), DVBio won the "Best Immersive Project" prize at the 2025 Engineering Showroom.
This project was made with Teanie Miosotis & Minseok Kim
Watch the Demo: https://www.youtube.com/watch?v=bq56TWKqQ_g
- Users are introduced to essential first aid content through interactive panels.
- Instructions cover core scenarios such as CPR, Recovery Position (PLS), Injury treatment, and Choking response.
- Information is presented step by step with clear visuals, audio narration, and demonstration panels to ensure understanding.
A virtual mannequin appears, allowing users to practice their first aid skills in a realistic environment. The system responds dynamically to the user’s actions, providing real-time feedback and validating whether the techniques are performed correctly.
🫀 CPR Training
- Users place their hands on the chest target of the mannequin.
- The system tracks hand placement and compression depth.
- A progress bar fills only when compressions are executed correctly, ensuring proper learning.
🛠 Injury Training
- Users apply a virtual compress to stop bleeding on the mannequin.
- The app checks correct placement and pressure.
- Visual feedback shows progress as the bleeding decreases, reinforcing correct technique.
🫁 Choking Training
- The training consists of two parts: back blows and abdominal thrusts.
- Users perform each step on the mannequin.
- The application provides feedback to confirm whether the maneuvers are executed correctly.
- After practicing, users can test their knowledge in a quiz mode.
- The quiz evaluates recognition of emergency scenarios.
- Example: identifying the correct action when someone is choking or when CPR is required.
- This phase reinforces learning and ensures that users retain the correct responses.
- Mixed Reality Environment: immersive and interactive training with a 3D mannequin.
- Real-Time Feedback: dynamic system verifies correct actions (hand placement, pressure, depth, sequence).
- Audio Integration: instructional voice guidance and success/failure sound effects.
- Interactive UI Panels: panels allow navigation through learning, practice, and quiz phases.
- Add more PSC1 scenarios (burns, fractures, etc.).
- Introduce multiplayer collaborative training.
- Expand the environment with more interactive medical tools.