Skip to content

feat: Carry audio level and VAD flag in mediajson media events - #237

Merged
bgrozev merged 1 commit into
masterfrom
export-audio-level
Jul 14, 2026
Merged

feat: Carry audio level and VAD flag in mediajson media events#237
bgrozev merged 1 commit into
masterfrom
export-audio-level

Conversation

@bgrozev

@bgrozev bgrozev commented Jul 14, 2026

Copy link
Copy Markdown
Member

Adds two optional fields to the mediajson Media:

  • audioLevel — RFC 6464 audio level (0-127, i.e. -dBov: 0 loudest, 127 silence), as reported by the sender in the ssrc-audio-level RTP header extension.
  • vad — RFC 6464 Voice Activity Detection flag.

Both are optional and omitted from the wire when absent (sender didn't include the extension), so this is backward compatible. Encoded as natural JSON number/boolean, not string-encoded like the VoxImplant-derived chunk/timestamp.

This lets JVB forward per-frame speech information to the transcription/translation peer (opus-transcriber-proxy), which can use it to gate audio and avoid sending silence to paid STT backends.

Consumer side: jitsi/jitsi-videobridge#2430 (same branch name, built together by CI).

Adds optional audioLevel (RFC 6464, 0-127 -dBov) and vad fields to the
mediajson Media, so a sender's per-frame ssrc-audio-level information can be
forwarded to the transcription/translation peer. Both are omitted when absent.
@codecov

codecov Bot commented Jul 14, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 34.65%. Comparing base (1e2216b) to head (cec3eb9).

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff              @@
##             master     #237      +/-   ##
============================================
+ Coverage     34.56%   34.65%   +0.09%     
  Complexity      162      162              
============================================
  Files            36       36              
  Lines          1380     1382       +2     
  Branches        140      140              
============================================
+ Hits            477      479       +2     
  Misses          870      870              
  Partials         33       33              
Files with missing lines Coverage Δ
...n/src/main/kotlin/org/jitsi/mediajson/MediaJson.kt 98.50% <100.00%> (+0.04%) ⬆️

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1e2216b...cec3eb9. Read the comment docs.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

jitsi-ci Bot pushed a commit to jitsi/jitsi-pr-tests-pages that referenced this pull request Jul 14, 2026
@bgrozev
bgrozev merged commit 4b9e48e into master Jul 14, 2026
7 checks passed
@bgrozev
bgrozev deleted the export-audio-level branch July 14, 2026 19:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants