Skip to content

Sync cageyoko release/public_v4: Qwen3TTS dialogue demo - #8

Merged
cageyoko merged 50 commits into
mainfrom
sync/public-v4-qwen3tts
Sep 7, 2026
Merged

cageyoko merged 50 commits into
mainfrom
sync/public-v4-qwen3tts

Conversation

@cageyoko

@cageyoko cageyoko commented Sep 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Sync cageyoko/X2-Turn@release/public_v4 (01af067) onto X-Square-Robot/X2-Turn main.
  • main is a direct ancestor of this tip, so the PR is a clean fast-forward of the public_v4 dialogue work.
  • Full-duplex demo switches from CosyVoice/Edge-TTS to local Qwen3TTS-Streaming, with reproducible live pause-handling defaults and regression tests.

Key changes

  • Replace CosyVoice / Edge-TTS paths with qwen3_tts_client + scripts/start_qwen3tts_engine.sh
  • Update .env.example, Docker Compose, CI, and docs for the Qwen3TTS stack
  • Commit live-mic pause defaults (silence_end_frames=10, FDB-style tails) in voxtral-realtime
  • Safer barge-in history: do not commit unfinished TTS text; enforce 24 kHz TTS
  • README News: updated dialogue demo (faster, better UX, pause handling)

Test plan

  • Review the file diff against main
  • Confirm CI on this branch is green
  • Fresh checkout: install dialogue env, start local Qwen3TTS engine, run full-duplex-demo/start_demo.sh
  • Smoke barge-in / pause handling on a live mic
  • After review, merge (fast-forward) into main

Note: Draft PR for review only — please check before merging / publishing.

Made with Cursor

kaiqifu and others added 30 commits August 12, 2026 08:17
Package the reusable realtime core, sanitized full-duplex demo, and model metadata together so the release can be reviewed without publishing gated model weights.

Co-authored-by: Cursor <cursoragent@cursor.com>
Remove stale full-dialogue evaluation artifacts, organize component documentation, and add a production-policy WAV replay example so ASR and turn behavior can be validated independently.

Co-authored-by: Cursor <cursoragent@cursor.com>
Publish the shared-backbone ASR/turn wrapper and reconstruction contract so the canonical checkpoint can be inspected and tested without relying on private training code.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep executable model and inference contracts versioned together while limiting the model repository to release artifacts and metadata.

Co-authored-by: Cursor <cursoragent@cursor.com>
Expose a repository-owned two-pass inference helper so users can inspect transcripts and aligned turn frames without modifying Transformers.

Co-authored-by: Cursor <cursoragent@cursor.com>
Lead with the model purpose, a minimal ASR plus turn example, and clear ownership of the model, inference, and demo directories.

Co-authored-by: Cursor <cursoragent@cursor.com>
Make the focused ASR and turn-policy UI publishable without training-repository paths, datasets, LLM, or TTS dependencies.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep the unauthenticated development UI local by default and document safe handling for remote exposure and speech data.

Co-authored-by: Cursor <cursoragent@cursor.com>
Lead with a runnable example, plain-language turn labels, intended use, and concise results while retaining technical, safety, and release details below.

Co-authored-by: Cursor <cursoragent@cursor.com>
Align published model defaults and close install, CI, demo security, and documentation gaps found during the release audit.

Co-authored-by: Cursor <cursoragent@cursor.com>
Separate Transformers, patched vLLM, and dialogue dependencies so users can set up each runtime without cross-stack CUDA conflicts.

Co-authored-by: Cursor <cursoragent@cursor.com>
Fix realtime ASR, interruption, and waveform behavior while adding structured traces and simplifying Turn Demo to expose raw frame predictions without product policy.

Co-authored-by: Cursor <cursoragent@cursor.com>
Bundle a reproducible synthetic audio fixture with playback so newcomers can exercise the raw ASR and Turn UI without supplying their own recording.

Co-authored-by: Cursor <cursoragent@cursor.com>
Standardize public documentation, UI copy, and code prose in English while keeping the root README bilingual and enforcing that release boundary in CI.

Co-authored-by: Cursor <cursoragent@cursor.com>
Present X2 Turn with accurate project branding and direct model links so the repository purpose is immediately clear to new users.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep the default landing page concise and English-only while providing a parallel Chinese README with matching branding and navigation.

Co-authored-by: Cursor <cursoragent@cursor.com>
Center the project title and place the X Square logo alongside it consistently across both language landing pages.

Co-authored-by: Cursor <cursoragent@cursor.com>
Use the conventional heading layout for predictable rendering across GitLab and other Markdown hosts.

Co-authored-by: Cursor <cursoragent@cursor.com>
Help newcomers choose the right demo and document the upstream projects that make the release possible.

Co-authored-by: Cursor <cursoragent@cursor.com>
Use Hugging Face as the single source for weights and model metadata while keeping this repository focused on inference and demos.

Co-authored-by: Cursor <cursoragent@cursor.com>
Consolidate release validation and repository governance so the monorepo has one clear CI and maintenance surface.

Co-authored-by: Cursor <cursoragent@cursor.com>
Link the arXiv publication and provide a ready-to-use citation in both language guides.

Co-authored-by: Cursor <cursoragent@cursor.com>
Allow direct TLS serving for secure microphone access and refine the release citation guidance.

Co-authored-by: Cursor <cursoragent@cursor.com>
Provide lightweight README previews while decoupling the vLLM path from local model dependencies and making microphone startup reliable.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep the release documentation lightweight by removing redundant preview images.

Co-authored-by: Cursor <cursoragent@cursor.com>
Updated video links in README for Turn and Full-Duplex Dialogue Demos.
Use the uploaded GitHub attachments consistently so both language versions render the two demo players correctly.

Co-authored-by: Cursor <cursoragent@cursor.com>
README now embeds GitHub user-attachments video links, so the checked-in
dialogue_demo_web.mp4 and turn_demo_web.mp4 are no longer referenced.
Use the same GitHub user-attachments URLs for the Turn Demo and
full-duplex dialogue demo videos.
cageyoko and others added 20 commits August 17, 2026 07:36
Document a ~5 minute Turn Demo-only setup in the root READMEs so reviewers
can skip CosyVoice, LLM, and patched vLLM. Replace leftover
x2_turn_opensource references with X2-Turn.
Point private vulnerability reports to kaiqifu@x2robot.com.
Make working directories, sample audio paths, and the two offline
inference scripts explicit, require the exported vLLM directory, and
bind local demo services to 127.0.0.1 unless remote access is requested.

Co-authored-by: Cursor <cursoragent@cursor.com>
Drop the standalone paper and contributing sections, keep the arXiv
badge and citation, and mirror the same outline in README_zh.md.

Co-authored-by: Cursor <cursoragent@cursor.com>
Keep vLLM, full-duplex, and the Python API behind a successful built-in run, and document VRAM, first-load delay, and a Hub download fallback.

Co-authored-by: Cursor <cursoragent@cursor.com>
…folder.

Turn Demo and full-duplex READMEs now assume the beginner path already worked; architecture, state-machine, and brand notes live in those READMEs instead of full-duplex-demo/docs.

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Updated asset link in README.md.
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@cageyoko
cageyoko marked this pull request as ready for review September 7, 2026 11:31
@cageyoko
cageyoko merged commit 5d55633 into main Sep 7, 2026
2 checks passed
@cageyoko
cageyoko deleted the sync/public-v4-qwen3tts branch September 7, 2026 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant