DOA Policy - #37

Merged

mgaido91 merged 159 commits into

mainfrom

Jul 9, 2026

Commits on Mar 24, 2026

DOA Policy first implementation
sarapapi
committed
cafb609
Improve Phi4-Multimodal DOA description
sarapapi
committed
4f9dbd1
Rename DOA Phi config
sarapapi
committed
99282e2
Rename DOA Phi config
sarapapi
committed
9dd7668
Correct audio subsampling factor
sarapapi
committed
f841ce2
Fix load_model to class method
sarapapi
committed
73fed6b
Fix lang init
sarapapi
committed
c456013
Fix newer transformers compatibility
sarapapi
committed
54752a9
Debug
sarapapi
committed
48ab026
Remove end of sentence
sarapapi
committed
03091ac
Disable eos
sarapapi
committed
aa990ee
Revert
sarapapi
committed
6dc2e4d
Try different EOS
sarapapi
committed
042e682
Debug
sarapapi
committed
2dcfdcd
Debug
sarapapi
committed
46ad7f8
Debug
sarapapi
committed
bc37b8d
Partial fix
sarapapi
committed
b8a5e33
Increase stability
sarapapi
committed
aa41e41
Add cross attention normalization
sarapapi
committed
5d08e7d
revert speech chunk
sarapapi
committed
d9def94
debug
sarapapi
committed
87ee050
debug
sarapapi
committed
69eb48f
debug
sarapapi
committed
e6f936f
reduce hallucinations
sarapapi
committed
616fcaa
reduce hallucinations
sarapapi
committed
c629a76
Try fix
sarapapi
committed
af083b7
Debug
sarapapi
committed
54d137f
Remove unnecessary parameters
sarapapi
committed
4d889e3
Fix stripping with alternative tokenizer and add debug
sarapapi
committed
8fc0ee4
Choose a simple prompt for Phi4Multimodal
sarapapi
committed
6a40aed
More stable outputs
sarapapi
committed
b215ba3

Commits on Mar 27, 2026

Remove debugs
sarapapi
committed
2c88831

Commits on Apr 3, 2026

Commits on Apr 8, 2026

Update language maps
sarapapi
committed
5876552
Update qwen2.5omni implementation
sarapapi
committed
e3e41c2

Commits on Apr 9, 2026

Correct trust_remote_code typo in detokenizers
sarapapi
committed
1f7f80b
Update config
sarapapi
committed
9a4314b
Update Qwen name
sarapapi
committed
5e8c6e3
Update Qwen code
sarapapi
committed
bdd3253
Update Qwen code
sarapapi
committed
cef90d6
Disable flash attention for testing
sarapapi
committed
4010d6e
Revert to standard system prompt
sarapapi
committed
4ff9dae
Add average across layers
sarapapi
committed
faf060a
Update config
sarapapi
committed
1f7c34f
Add Phi4Multimodal configs
sarapapi
committed
53e3338
Add Phi4Multimodal configs
sarapapi
committed
a7b6982
Fix detokenizer for Qwen2.5-Omni
sarapapi
committed
f3d6713
Discourage Qwen2.5 Omni to repeat
sarapapi
committed
d9e0ac5
Adjust repetition
sarapapi
committed
4705733
Add history param
sarapapi
committed
3dae1a5

Commits on Apr 10, 2026

Add deterministic params
sarapapi
committed
b384d24

Commits on Apr 12, 2026

Revert partially deterministic params for Qwen2.5Omni
sarapapi
committed
cf799b1
Revert partially deterministic params for Phi4Multimodal
sarapapi
committed
414bf32

Commits on Apr 13, 2026

Disable strip
sarapapi
committed
012b5ca
Correct prefix handling
sarapapi
committed
743233b

Commits on Apr 14, 2026

Add summary policy
sarapapi
committed
d1a32d5
Revert to original implementation of the prefix for Qwen
sarapapi
committed
6fdde36

Commits on Apr 15, 2026

Try the fix
sarapapi
committed
69ddeef
Revert "Try the fix"
sarapapi
committed
f964e47

Commits on Apr 16, 2026

Add Qwen2.5omni 7b config
sarapapi
committed
f117590
reduce audio max len
sarapapi
committed
b9830a9
Move summary
sarapapi
committed
fbb5517

Commits on May 5, 2026

Try change for summary
sarapapi
committed
e44980a
Try change for summary
sarapapi
committed
dfcd53e
Revert
sarapapi
committed
3989154
Try fix
sarapapi
committed
5a82371
Revert "Try fix"
sarapapi
committed
abefe05

Commits on May 6, 2026

Switch from summary to reference memory
sarapapi
committed
73eda2a

Commits on May 7, 2026

Revert to simple implementation
sarapapi
committed
5dcddbc

Commits on May 8, 2026

Add head analysis
sarapapi
committed
acbc5e1

Commits on May 15, 2026

Try different prompt
sarapapi
committed
67dfd73
Try different sys prompt
sarapapi
committed
0506a9b
debug
sarapapi
committed
d8133a9
debug
sarapapi
committed
9448e0d
debug
sarapapi
committed
9904d4b
debug
sarapapi
committed
7e976f7
debug
sarapapi
committed
41cb279

Commits on May 16, 2026

Commits on May 17, 2026

Revert "debug"
sarapapi
committed
8ff9bd1
Revert "debug"
sarapapi
committed
ed17179
Revert "debug"
sarapapi
committed
421a2f8
Revert "debug"
sarapapi
committed
6f3f6f4
Revert "debug"
sarapapi
committed
b94cb83
Revert "debug"
sarapapi
committed
4a7414b
Revert "debug"
sarapapi
committed
deec3a8
Revert "debug"
sarapapi
committed
525f20b
debug
sarapapi
committed
bb047fb
Revert "debug"
sarapapi
committed
8247ecc
debug
sarapapi
committed
fc40392
Revert "Try different sys prompt"
sarapapi
committed
c150348
revert
sarapapi
committed
f6ff53d

Commits on May 18, 2026

Try new Qwen3Omni
sarapapi
committed
a81af66
Try new Qwen3Omni
sarapapi
committed
0aefbf9
Try new Qwen3Omni
sarapapi
committed
f1772d8
Try new Qwen3Omni
sarapapi
committed
1658514
Try new Qwen3Omni
sarapapi
committed
d5d1807
Try new Qwen3Omni
sarapapi
committed
13bd2e3
Try new Qwen3Omni
sarapapi
committed
c5981e6
Trim max input length of Qwen3Omni
sarapapi
committed
c4297e2
Add Gemma4
sarapapi
committed
c798537

Commits on May 20, 2026

Add Gemma4 global layers for the average
sarapapi
committed
52c8b59
Add Qwen2Audio
sarapapi
committed
c0dcf25
Fix wrong path
sarapapi
committed
44d8e1e
Fix Qwen2Audio inference
sarapapi
committed
80b9bd3
Fix Qwen2Audio inference
sarapapi
committed
3ba31fe

Commits on May 21, 2026

Fix Qwen2Audio inference
sarapapi
committed
2e2b62d
seed
sarapapi
committed
96128c3
Revert "Fix Qwen2Audio inference"
sarapapi
committed
9a2755f
Revert "Fix Qwen2Audio inference"
sarapapi
committed
eefe133
Fix Qwen2Audio
sarapapi
committed
f71fed9
Remove Gemma4 as it performs very bad
sarapapi
committed
b5eabf5
Revert "seed"
sarapapi
committed
5a437db
Add UltraVox
sarapapi
committed
a9dcd6b
Add UltraVox
sarapapi
committed
af80da4
Add UltraVox
sarapapi
committed
d89741c

Commits on May 23, 2026

Comment attn implementation
sarapapi
committed
6c1cead
Revert "Comment attn implementation"
sarapapi
committed
db80ada
Change Qwen2Audio prompt
sarapapi
committed
41ba86f
Add Voxtral
sarapapi
committed
d5020a0
Add Voxtral
sarapapi
committed
e89a3f5

Commits on May 24, 2026

Add Voxtral
sarapapi
committed
a709c74
Fix tokenizer
sarapapi
committed
ffcf1c4
Fix voxtral tokenizer
sarapapi
committed
c0f4995
Fix voxtral tokenizer
sarapapi
committed
7b34fe5
Fix voxtral tokenizer
sarapapi
committed
a2d00da
Fix voxtral tokenizer
sarapapi
committed
5386881
Fix voxtral prompt
sarapapi
committed
278786f

Commits on May 28, 2026

Clean for release
sarapapi
committed
d124275
Revert voxtral detokenizer
sarapapi
committed
c6ab757
Fix Phi4-Multimodal linting
sarapapi
committed
35e5809
Fix Qwen3-Omni linting and remove useless comments
sarapapi
committed
d908dd8
Clean from useless comments
sarapapi
committed
5fa2b29
Fix uts
sarapapi
committed
e40fa38

Commits on Jun 9, 2026

Commits on Jun 11, 2026

Address comment about pycountry
sarapapi
committed
cd5ecc4
Fix linting
sarapapi
committed
26e06ae

Commits on Jun 12, 2026

refactor code to avoid duplicated code
mgaido91
committed
76ba013

Commits on Jun 18, 2026

Fix logging
sarapapi
committed
dae38d8
Partially revert the change
sarapapi
committed
a7ac4d4
Fix the description to go new line after 100 chars
sarapapi
committed
1fad0d7
Address comments
sarapapi
committed
909d36d
Fix Lint
sarapapi
committed
987637b
Remove unused import
sarapapi
committed
39d6d7b

Commits on Jul 3, 2026

Address comment
sarapapi
committed
fcafb30

Commits on Jul 8, 2026

Address comment
sarapapi
committed
ca8678a
Remove comment from yaml
sarapapi
committed
a933ab2
Add default parameter for the bow_prefix
sarapapi
committed
4671fe2
Merge branch 'main' into doa_policy
sarapapi
committed
4e62547
fix bow_prefix leftovers
sarapapi
committed
52bafd2
Address comment
sarapapi
committed
80fe712