Proposal: GPT-Live as a Voice Bridge for OpenAB

[chaodu-agent]

Summary

Propose using GPT-Live (OpenAI Advanced Voice Mode) as a voice bridge between human operators and the OAB bot fleet. GPT-Live acts as a voice-powered Discord client — translating speech to text commands, posting them to Discord, collecting bot responses, and summarizing results back via voice.

Core Concept

GPT-Live is not a new bot or part of OAB. It is a voice bridge — an interface layer that lets humans interact with the entire bot fleet hands-free.

Human (voice) <-> GPT-Live (Voice Bridge) <-> Discord API <-> OAB Bots

Without GPT-Live	With GPT-Live
Eyes on Discord, type commands	Speak naturally to GPT-Live
Read bot replies manually	GPT-Live summarizes & reads back
Requires screen + keyboard	Fully hands-free (driving, flying, beach)

Architecture

+---------------------------------------------------------------------+
|                         HUMAN (Voice)                                |
|                      Mic Input / Speaker Output                     |
+---------------------+-------------------------------+---------------+
                      | Speech                         ^ Voice Summary
                      v                               |
+---------------------------------------------------------------------+
|              GPT-Live - Voice Bridge (Custom GPT + Actions)          |
|                                                                      |
|  Role:                                                               |
|  - Translate: voice <-> text                                         |
|  - Route: decide which bot to mention, which channel to post to      |
|  - Summarize: compress bot replies into listenable voice output      |
|  - Wait: handle async "ask now, check later" pattern                 |
|                                                                      |
|  Custom Actions (OpenAPI):                                           |
|    - POST /discord/send   (post message to channel/thread)           |
|    - GET  /discord/read   (poll replies from thread)                 |
|    - GET  /discord/bots   (list available bots & capabilities)       |
+------------------------------------------------------+--------------+
                                                       | HTTPS
                                                       v
+---------------------------------------------------------------------+
|              Proxy / Middleware (Lambda + API Gateway)                |
|                                                                      |
|  - Holds Discord Bot Token (secure)                                  |
|  - Routes messages to correct channel/thread                         |
|  - Handles bot mention mapping (B0~B15)                              |
|  - Auth: API key or OAuth from GPT-Live                              |
+------------------------------------------------------+--------------+
                                                       | Discord REST API
                                                       v
+---------------------------------------------------------------------+
|                    Discord Channels / Threads                         |
|                                                                      |
|  [B0] [B1] [B2] [B4] [B5] [B6] ... [B15]                           |
|                                                                      |
|              OAB Bot Fleet (ZERO changes required)                    |
+---------------------------------------------------------------------+

Scenarios

Driving with FSD

You: "Review the latest PR and summarize today's tech news"

GPT-Live:
  -> POST to Discord: "@B0 review latest PR"
  -> POST to Discord: "@B5 generate today tech news summary"
  -> "Got it. I'll check back in a moment."

(30 seconds later)

You: "Any updates?"

GPT-Live:
  -> GET replies from thread
  -> "B0 says the PR looks good, LGTM. B5 is still working on the news summary."

On a Flight

You: "Get the release notes ready before we land, and prepare my meeting summary for today"

GPT-Live:
  -> Routes to appropriate bots
  -> Checks back periodically
  -> Summarizes results before landing

Beach Vacation

You: "Merge yesterday's bug fix and run CI"

GPT-Live:
  -> "@B0 merge the bug fix PR and run CI"
  -> Reports back results via voice

Components Needed

Component	Tech	Notes
Custom GPT	OpenAI GPT Builder	System prompt + OpenAPI actions
Proxy API	AWS Lambda + API Gateway (CDK)	Holds Discord token, routes messages
OpenAPI Schema	YAML	Defines send/read/bots endpoints
Bot routing config	JSON/env	Maps intents to channels + bot mentions

Key Design Principles

1. GPT-Live = Voice Bridge only — it is not part of OAB, just a voice frontend
2. OAB side: zero changes — bots continue operating as-is in Discord
3. Proxy layer required — keeps Discord token secure, adds routing logic
4. Async-friendly — human can ask "any update?" rather than blocking on response
5. OAB bots cannot tell the difference — whether a human typed it or GPT-Live posted it, same Discord message

Open Questions

• GPT-Live Advanced Voice Mode action reliability (still evolving)
• Polling interval vs webhook push for real-time notification
• Auth mechanism for proxy (API key vs OAuth)
• Rate limiting considerations
• Multi-language support (e.g. Mandarin voice input to English GitHub commands)

[github-actions]

⚠️ This issue is missing the following required information and will not be processed until completed:

• Use Case

Please edit this issue to fill in the missing fields. Thank you!

Tip: Use headings like ## Description or ### Description — common synonyms (e.g. ## Problem, ## Reproduction, ## Motivation) are also accepted.