Skip to content
BranchesTags

Latest commit

 

History

7 Commits

Folders and files

NameName
Last commit message
Last commit date
.gitignore
.gitignore
 
 
NeuraDem.html
NeuraDem.html
 
 
README.md
README.md
 
 
index.html
index.html
 
 
package.json
package.json
 
 
server.js
server.js
 
 
vercel.json
vercel.json
 
 

Repository files navigation

🧠 NeuraDem — AI Cognitive Gaming & Memory Assistance

Smart India Hackathon (SIH) 2026 — Problem Statement ID: 26003

Offline-First, Multilingual Cognitive Rehabilitation & Caregiver Ecosystem for North East India

SIH 2026 Problem Statement ID Category Stack License: MIT

📌 Problem Statement

SIH Problem Statement ID: 26003
Domain: Healthcare, MedTech, Geriatric Care & Assistive Technology
Target Region: North East India (Assam, Meghalaya, Manipur, Mizoram, Nagaland, Arunachal Pradesh, Tripura, Sikkim)

Over 8.8 million Indians aged 60+ live with dementia and Mild Cognitive Impairment (MCI). In North East India, this challenge is acutely compounded by:

  1. Severe Geographic & Specialist Shortages: Minimal tertiary geriatric neurology centres outside major cities like Guwahati.
  2. Linguistic Diversity: Mainstream digital health apps support only English or standard Hindi, alienating indigenous populations speaking Assamese, Bengali, Meiteilon, Mizo, Khasi, Garo, and Bodo.
  3. Intermittent Connectivity: Rural hilly terrains face erratic cellular coverage, rendering cloud-dependent applications unreliable.
  4. Cultural Alienation: Existing brain training platforms use Western cultural paradigms that fail to trigger emotional resonance or reminiscence in rural elders.
  5. Caregiver Burnout & Invisibility: Family caregivers lack continuous, non-invasive telemetry to track cognitive decline, medication adherence, and wandering tendencies.

👥 Team Information

  • Team Name: Mind Mates
  • Institution: Ramdeobaba university
  • Team Leader: Abhi Dutta
  • Team Members:
    • Member 1: Abhi Dutta
    • Member 2: Jemuel Francis
    • Member 3: Shweta Mishra
    • Member 4: Samraddhi Agrawal
    • Member 5: Dhanshri Verma
    • Member 6: Shayan Roy
  • Mentor(s): Dr. Lalit Agrawal , Emmanuel Francis

🌟 Project Overview

NeuraDem is an offline-first, culturally anchored cognitive stimulation and memory assistance platform engineered specifically for dementia patients and their caregivers in North East India.

Built as a lightweight, zero-dependency progressive application, NeuraDem features a dual-device synchronized ecosystem:

  • Patient Terminal: A high-accessibility, voice-guided interface with high-contrast UI, gentle micro-rewards ("Xorai Points"), daily routine coaching, and culturally grounded cognitive exercises.
  • Caregiver & Clinician Terminal: A comprehensive surveillance and analytics cockpit featuring geofenced wandering detection, cognitive domain radar tracking (Memory, Attention, Recognition, Problem Solving), medication adherence tracking, and downloadable clinical summaries for ASHA community health workers and Primary Health Centres (PHCs).
                      ┌────────────────────────────────────────────────┐
                      │             NeuraDem Core Engine               │
                      │  (Offline-First P2P Sync & Reactive State)    │
                      └───────┬────────────────────────────────┬───────┘
                              │                                │
            ┌─────────────────▼─────────┐            ┌─────────▼─────────────────┐
            │   Elderly Patient Terminal│            │Caregiver/Clinician Terminal│
            ├───────────────────────────┤            ├───────────────────────────┤
            │ • Culturally Grounded Games│            │ • Real-Time Domain Radar   │
            │ • Voice AI Grounding & Cues│◄─────────►│ • Geofence Wander Alerts  │
            │ • Visual Daily Schedule    │ Peer Sync │ • Medication Adherence Logs│
            │ • Digital Reminiscence Hub│            │ • Clinical PHC PDF Report │
            │ • Hydration & SOS Dispatch │            │ • Remote Reminder Setup   │
            └───────────────────────────┘            └───────────────────────────┘

✨ Key Features

1. Culturally Localized Cognitive Interventions (9 Specialized Games)

Standard cognitive tools use abstract shapes. NeuraDem leverages emotionally and culturally resonant motifs from North East India:

  • 🃏 Memory Match (match): Card-matching with indigenous symbols (Rhino, Great Indian Hornbill, Bamboo, Japi, Dhol drum, Lotus).
  • 🍵 Name This Thing (object): Recognition exercises using tea garden artifacts, bamboo craft, and indigenous household objects.
  • 🔢 Pattern Game (pattern): Logic sequence completion designed with gentle visual steps.
  • 🧩 Everyday Puzzles (problem): Practical life problems (e.g. village bus schedules, market arithmetic).
  • 📅 My Day Recall (routine): Temporal orientation questions validating morning breakfast, medication times, and personal care.
  • ❤️ How Do They Feel? (emotion): Facial affect recognition for social-emotional grounding.
  • 📖 Story Order (story): Procedural sequence reconstruction (e.g., preparing Assam morning tea, dressing in Gamosa & Japi for Rongali Bihu, harvesting paddy).
  • 🥁 Sound & Music (sound): Synthetic acoustic generator playing authentic folk timbres via Web Audio API (Dhol drum rhythm, Bamboo flute, hornbill calls, temple bell, monsoon rain, Brahmaputra river).
  • 👥 Who Is This? (faces): Personalized digital reminiscence therapy populated with photos and relationships of family members (e.g., daughter Ananya, grandson Bikash).

2. Multilingual Accessibility (7 Languages)

Complete native voice and textual translation for:

  • English (en)
  • Assamese / অসমীয়া (as)
  • Bengali / বাংলা (bn)
  • Hindi / हिन्दी (hi)
  • Meiteilon / Manipuri / মৈতৈলোন্ (mni)
  • Mizo / Mizo ṭawng (lus)
  • Khasi / Ka Ktien Khasi (kha)

3. Dual-Device Interactive Simulator

  • Enables simultaneous simulation of Phone A (Patient) and Phone B (Caregiver) within a single unified workspace.
  • Changes made on the patient terminal (e.g., taking medicine, completing games, hydration intake, moving out of range) instantly synchronize across to the caregiver screen.

4. Safety, Geofencing & Wandering Mitigation

  • Visual home anchor with an adjustable 500-meter safety radius.
  • Proactive perimeter breach alerts with real-time distance and breadcrumb movement timeline.
  • Rapid SOS emergency dispatch directly to primary emergency contacts.

5. Caregiver Analytics & Clinical Summaries

  • 4-Domain Cognitive Metrics: Independent longitudinal scoring across Memory, Attention, Recognition, and Executive Problem Solving.
  • ASHA / PHC Clinical Export: Generates standardized clinical progress summaries ready for review by village ASHA health workers (Rekha Bora) or PHC Medical Officers (Dr. P. Saikia, PHC Titabor).

6. AI Adaptive Progression

  • Dynamic 3-tier difficulty engine (Levels 1, 2, and 3).
  • Dynamically adjusts card grid density, distractors, and response timeouts based on trailing 3-day accuracy thresholds, preventing cognitive frustration.

7. Xorai Incentive System

  • Gamified positive reinforcement named after the revered Assamese brass emblem Xorai.
  • Points accumulated through adherence and cognitive workouts, redeemable for subsidies at local Jan Aushadhi generic medicine outlets and cooperative weavers.

🛠 Technology Stack

Layer Technology Rationale
Core UI Framework React 19.3.0 (Production bundle) High-performance reactive state management and seamless reconciliation
Styling & Layout Modern Vanilla CSS3 / CSS Grid / Flexbox Custom typography, accessibility contrast ratios, fluid mobile simulator shells
Typography Google Fonts (Nunito / UI Rounded) High-legibility sans-serif optimized for elderly low-vision users
Sound Synthesis Web Audio API (Synthesizers & Oscillators) 100% offline procedural synthesis of traditional instruments (Dhol, Flute, Bell) without heavy MP3 assets
Speech AI Web Speech API (SpeechSynthesis & SpeechRecognition) Hands-free voice prompts and conversational orientation queries
Sync & State Engine Reactive P2P State Machine & Local Storage Zero-latency local storage persistence and mock P2P/QR synchronization
Form Factor Self-Contained Executable SPA Zero build steps required; runs on any standard webview, low-cost Android tablet, or desktop

🏗 System Architecture

flowchart TD
    subgraph Client["NeuraDem Client Architecture"]
        subgraph Views["Dual Terminal View Engine"]
            PA["Patient Terminal (Accessible UI)"]
            CB["Caregiver Cockpit & Dashboard"]
        end

        subgraph Core["Core Subsystems"]
            CE["Cognitive Engine\n(9 Indigenous Games)"]
            AI["Adaptive AI Engine\n(Difficulty Calibration)"]
            RM["Reminiscence Module\n(Family & Heritage Album)"]
            GF["Geofence & Safety\n(500m Perimeter Monitor)"]
            DL["Daily Living & Adherence\n(Tasks & Hydration)"]
        end

        subgraph HardwareAPIs["Browser Hardware Layer"]
            WA["Web Audio API\n(Procedural Folk Acoustic Engine)"]
            WS["Web Speech API\n(Text-to-Speech & Voice Queries)"]
            LS["LocalStorage / Cache API\n(Offline Persistence)"]
        end

        subgraph Sync["Synchronization Pipeline"]
            SE["P2P Sync Engine\n(QR Pairing & Conflict Resolution)"]
        end
    end

    PA <--> CE
    PA <--> RM
    PA <--> DL
    PA <--> WS
    CE <--> AI
    CE <--> WA
    PA <--> GF

    PA <===>|Real-Time P2P Events| SE
    CB <===>|State Mirroring & Control| SE
    SE <--> LS
Loading

🔄 Workflow

sequenceDiagram
    autonumber
    actor Patient as 👴 Patient (Arun)
    participant App as 📱 NeuraDem App
    actor Caregiver as 👩 Caregiver (Ananya)
    actor Doctor as 🩺 PHC Doctor / ASHA

    Caregiver->>App: Configures patient profile, medicine schedule (Donepezil) & geofence
    App->>Patient: Displays simplified morning schedule & speaks reminder
    Patient->>App: Completes "Morning Tea" sequencing game & drinks water
    App->>App: Calculates cognitive score (+40 Xorai points) & logs hydration
    App-->>Caregiver: Real-time sync: Task completed, cognitive domain radar updated
    Note over Patient,App: Patient wanders beyond 500m perimeter
    App->>Caregiver: ⚠️ Perimeter Alert: Arun at Village Shop (300m away)
    Caregiver->>App: Acknowledges alert & triggers voice orientation call
    App->>Doctor: Exports Clinical Progress Summary for PHC Titabor checkup
Loading

📁 Folder Structure

sam1/
├── NeuraDem.html          # Self-contained production application & dual simulator
├── README.md              # Comprehensive Smart India Hackathon documentation
├── .gitignore             # Tech stack exclusion rules & workflow protection
└── commit.md              # Granular, context-aware commit message strategy (ignored)

🚀 Installation & Getting Started

Because NeuraDem is architected as an offline-first, standalone web application, no external compilation or package manager installation is strictly mandatory.

Prerequisites

  • Any modern web browser (Google Chrome 110+, Microsoft Edge, Mozilla Firefox, or Safari).
  • Python 3 / Node.js (optional, for local development server).

Option 1: Direct Execution (Zero Setup)

Simply open the file directly in your browser:

  • Double-click NeuraDem.html, or
  • Right-click NeuraDem.html → Open with → Google Chrome / Microsoft Edge.

Option 2: Local HTTP Server (Recommended)

Running via a local HTTP server enables all Web Audio, Web Speech, and Service Worker APIs without browser origin restrictions:

Using Node.js (npx):

# Serve current directory on port 3000
npx serve .

Using Python:

# Python 3
python -m http.server 8080

Visit: http://localhost:3000/NeuraDem.html or http://localhost:8080/NeuraDem.html.

📖 Usage Instructions

  1. Launch the Application:

    • Open NeuraDem.html in your browser.
    • You will observe two simulated smartphone interfaces: Phone A (left) and Phone B (right).

  2. Setup Dual Roles:

    • On Phone A, select "I am the Patient" (Arun Kumar).
    • On Phone B, select "I am the Caregiver" (Ananya Kumar).

  3. Explore Patient Functionalities:

    • Language Selection: Tap the globe icon to switch between Assamese, Bengali, Meiteilon, Mizo, Khasi, Hindi, or English.
    • Cognitive Games: Navigate to the "Games" tab. Test Memory Match, Name This Thing, or Sound & Music (listen to synthesized Dhol beats).
    • Daily Routine: Tap on "Mark Done" for morning medication or water intake.
    • AI Voice Assistant: Tap "Ask AI" for voice-based orientation ("Where do I live?").

  4. Observe Real-Time Caregiver Mirroring:

    • Notice that completing a game or task on Phone A immediately updates Phone B's cognitive domain score radar and task checklist.
    • Navigate to the "Safety" tab on the caregiver phone to inspect the geofence perimeter and simulate patient movement.
    • Click "Doctor Summary" to inspect the clinical record prepared for medical officers.

📸 Interface Previews & Mockups

Patient Interface (High Contrast & Big Targets) Caregiver Analytics & Geofence Cockpit
[📱 Visual Routine, Voice Prompts & Daily Games] [📊 Cognitive Domain Radar, Geofence & PHC Summary]
High-accessibility view with Assamese / English support Real-time telemetry tracking cognitive progression
Culturally Grounded Cognitive Games Acoustic & Folk Heritage Module
[🃏 Memory Match with Japi, Rhino, Tea & Dhol] [🥁 Procedural Web Audio Folk Instruments & Songs]
Non-stigmatizing, failure-tolerant game engine Authentic auditory stimulation for memory recall

🔮 Future Scope & Scalability

  1. IoT & Wearable Telemetry Integration:
    • BLE (Bluetooth Low Energy) integration with low-cost fitness bands (e.g. Noise, Boat) to capture passive heart rate variability (HRV), sleep disruption, and real-time fall detection.
  2. Ayushman Bharat Digital Mission (ABDM) Integration:
    • Linking patient cognitive trend records directly with their ABHA (Ayushman Bharat Health Account) ID for seamless continuity of care at government PHCs and District Hospitals.
  3. On-Device Edge ML for Vocal Biomarkers:
    • Deploying lightweight quantized acoustic models (TensorFlow Lite / ONNX) to detect speech hesitation, semantic paraphasia, and acoustic tremor as early digital biomarkers of cognitive decline.
  4. Community ASHA Tele-Supervision:
    • Multi-patient dashboard enabling a single ASHA worker or village health volunteer to track up to 30 elderly patients across a rural cluster.

🌍 Societal Impact & Alignment with SDGs

  • UN Sustainable Development Goal 3 (Good Health and Well-Being): Promotes cognitive longevity, mental well-being, and structured non-pharmacological therapy for elderly populations.
  • UN Sustainable Development Goal 10 (Reduced Inequalities): Delivers state-of-the-art neuro-rehabilitative support in native indigenous languages to geographically remote and underserved tribal populations.
  • Caregiver Empowerment: Reduces psychological stress and burnout by automating medication monitoring, wander alerting, and doctor reporting.

🤝 Contributors

Developed with dedication for the Smart India Hackathon 2026.

Contributor Role / Contribution
[Developer Name 1] System Architecture, React 19 Frontend & State Engine
[Developer Name 2] Multilingual Localization & Regional Acoustic Engineering
[Developer Name 3] Cognitive Domain Assessment Logic & Clinical Workflows
[Developer Name 4] Offline P2P Synchronization Engine & Geofencing Module

📄 License

This project is licensed under the MIT License — see the LICENSE file for details.
Open-source under Smart India Hackathon guidelines.

About

NeuraDem — Zero-dependency, offline-first assistive platform delivering culturally anchored cognitive exercises, wandering mitigation, and clinical PHC reporting for elderly dementia care in North East India.

neuradem.vercel.app

Topics

assistive-technologycognitive-rehabilitationdementia-caregeriatric-healthhealthcarenorth-east-indiaoffline-firstreact19sih2026smart-india-hackathonsmart-india-hackathon-2026

Resources

Readme
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

Packages

Contributors

Languages