Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
86 changes: 70 additions & 16 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,41 +1,95 @@
[![arXiv](https://img.shields.io/badge/arXiv-1234.56789-b31b1b.svg)](https://arxiv.org/abs/2512.01234v2)
![License](https://img.shields.io/github/license/foloup/foloup)
[![Demo](https://img.shields.io/badge/demo-drawdash-blue)](https://x.com/SuveenE/status/1979942916572561527?s=20)
<p align="center">
<img src="assets/cover.png" width="600" />
</p>

# DrawDash ✏️
<h1 align="center">DrawDash</h1>

**Proactive Agentic Whiteboards: Enhancing Diagrammatic Learning**
<p align="center">
<b>Proactive Agentic Whiteboards: Enhancing Diagrammatic Learning</b>
</p>

An AI-powered whiteboard assistant that proactively completes and refines educational diagrams through multimodal understanding.
<p align="center">
An AI-powered whiteboard assistant that proactively completes and refines educational diagrams through multimodal understanding. DrawDash listens to spoken explanations, detects intent, and dynamically suggests diagram refinements that can be accepted with a single keystroke.
</p>

## Paper 📜
<p align="center">
<a href="https://arxiv.org/abs/2512.01234v2">Paper</a> · <a href="#overview">Overview</a> · <a href="#setup">Setup</a> · <a href="https://x.com/SuveenE/status/1979942916572561527?s=20">Demo</a>
</p>

<p align="center">
<a href="https://arxiv.org/abs/2512.01234v2"><img src="https://img.shields.io/badge/arXiv-2512.01234-b31b1b.svg" alt="arXiv" /></a>
<img src="https://img.shields.io/github/license/foloup/foloup" alt="License" />
<a href="https://x.com/SuveenE/status/1979942916572561527?s=20"><img src="https://img.shields.io/badge/demo-drawdash-blue" alt="Demo" /></a>
</p>

---

Educators frequently rely on diagrams to explain complex concepts during lectures, yet creating clear and complete visual representations in real time while simultaneously speaking can be cognitively demanding. DrawDash adopts a TAB-completion interaction model: it listens to spoken explanations, detects intent, and dynamically suggests refinements that can be accepted with a single keystroke.

## Overview

| Component | Description |
|-----------|-------------|
| **Speech Recognition** | Listens to spoken explanations while you draw |
| **Visual Understanding** | Interprets incomplete diagrams in real time |
| **Generative AI** | Suggests improved and completed diagrams |
| **TAB Completion** | Accept suggestions with a single keystroke |

## Why DrawDash?

| Challenge | How DrawDash Helps |
|-----------|-------------|
| Cognitive Load | Reduces the burden of drawing and speaking simultaneously |
| Incomplete Diagrams | Proactively completes missing visual elements |
| Real-Time Feedback | Provides instant suggestions based on speech context |
| Diagram Quality | Refines rough sketches into clear educational visuals |

## Paper

**Title:** Proactive Agentic Whiteboards: Enhancing Diagrammatic Learning

**Authors:** Suveen Ellawela, Sashenka Gamage, Dinithi Dissanayake

**Link:** [https://arxiv.org/html/2512.01234v2](https://arxiv.org/html/2512.01234v2)

<img width="500" height="400" alt="Image" src="https://github.com/user-attachments/assets/33cd330d-f674-4c74-8991-a9972d6601e0" />

### Abstract

Educators frequently rely on diagrams to explain complex concepts during lectures, yet creating clear and complete visual representations in real time while simultaneously speaking can be cognitively demanding. Incomplete or unclear diagrams may hinder student comprehension, as learners must mentally reconstruct missing information while following the verbal explanation. Inspired by advances in code completion tools, we introduce DrawDash, an AI-powered whiteboard assistant that proactively completes and refines educational diagrams through multimodal understanding. DrawDash adopts a TAB-completion interaction model: it listens to spoken explanations, detects intent, and dynamically suggests refinements that can be accepted with a single keystroke. We demonstrate DrawDash across four diverse teaching scenarios—spanning topics from computer science and web development to biology. This work represents an early exploration into reducing instructors' cognitive load and improving diagram-based pedagogy through real-time, speech-driven visual assistance, and concludes with a discussion of current limitations and directions for formal classroom evaluation.

## Overview
## Setup

DrawDash listens to your spoken explanations while you draw, then suggests improved and completed diagrams that you can accept with a single keystroke (TAB). The system combines speech recognition, visual understanding, and generative AI to enhance diagram-based teaching and learning.
DrawDash consists of two main components: a backend API and a frontend web application.

## Setup
```bash
# Clone the repository
git clone https://github.com/foloup/drawdash.git
cd drawdash
```

| Component | Instructions |
|-----------|-------------|
| **Backend** | See [backend/README.md](backend/README.md) |
| **Frontend** | See [frontend/README.md](frontend/README.md) |

## Citation

DrawDash consists of two main components: a backend API and a frontend web application. For detailed setup instructions, please refer to:
If you use this work in your research, please cite:

- **Backend Setup:** See [backend/README.md](backend/README.md)
- **Frontend Setup:** See [frontend/README.md](frontend/README.md)
```bibtex
@misc{ellawela2025drawdash,
title={Proactive Agentic Whiteboards: Enhancing Diagrammatic Learning},
author={Suveen Ellawela and Sashenka Gamage and Dinithi Dissanayake},
year={2025},
eprint={2512.01234},
archivePrefix={arXiv},
primaryClass={cs.HC},
url={https://arxiv.org/abs/2512.01234v2},
}
```

## Contact

If you have any questions or feedback, please feel free to reach out to us at [suveen.te1[at]gmail.com](mailto:suveen.te1@gmail.com).
If you have any questions or feedback, please feel free to reach out at [suveen.te1[at]gmail.com](mailto:suveen.te1@gmail.com).

## License

Expand Down
Binary file added assets/cover.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading