Skip to content

Update incontext to latest#48

Open
cfunk1210 wants to merge 678 commits intodev/incontextfrom
main
Open

Update incontext to latest#48
cfunk1210 wants to merge 678 commits intodev/incontextfrom
main

Conversation

@cfunk1210
Copy link

@cfunk1210 cfunk1210 commented Apr 24, 2024

No description provided.

jadie1 and others added 24 commits December 18, 2024 18:02
@jadie1
Removing sampling from relevance prediction
d6c8d95
@jadie1
Merge pull request #156 from ITM-Kitware/dev/relevance
a2e9000 
Relevance
@eveenhuis @dmjoy
Log true relevance for comp reg
f74cdba
@jadie1 @dmjoy
Adding cumulative KDE alignment with or without relevance for hybrid …
b78595c 
…kaleido ADM
@jadie1 @dmjoy
Fixing relevance keys
85589ca
@jadie1 @dmjoy
Update CHANGELOG.md
74caeea
@jadie1 @dmjoy
Fix relevance to be float rather than list
637ed15
@dmjoy
Change choice_history default arg to None
f78d005
@jadie1 @dmjoy
Adding mulit-kdma configs
b750b53
@jadie1 @dmjoy
Fixing name typo for consistency
48479fc
@eveenhuis @dmjoy
Single heuristic treatment bugfix
9630071
@dmjoy
Add initial integration test driver script
1401e4f
@dmjoy
Fix exit status of integration test driver script; misc cleanup
3a0d22b
@dmjoy
Add comp reg ICL soartech integration test
30b456c
@dmjoy
Add exemption logic to integration test diffs
6fa2b5d
@dmjoy
Add integration test for adept comp reg adm
81d26ee
@dmjoy
Add random adm to integration tests (good quick smoketest)
f439451
@dmjoy
Add documentation for integration tests, update changelog
9e06dfe
@dmjoy
Add more integration tests; fix issue with markup tags in test diffs
00c7bd2
@dmjoy
Add hybrid kaleido ADM to integration tests
177bb74
@dmjoy
Add multi kdma configs for ADEPT eval_as_train
beb5daa
@dmjoy
Remove MJ4 eval scenario from ingroup bias configs as no IB probes
de8609b
@dmjoy
Add eval-as-train configs for SoarTech for multi-kdma relevance exp
bff99da
@dmjoy
Update Phase1 SoarTech group targets to their server convention
1fe808e
dmjoy and others added 30 commits December 15, 2025 15:13
@dmjoy
Add caching to BertRelevance component
c9c0d77
@dmjoy
Quickfix for multi attribute alignment "alignment_info"
cfafbb0
@eveenhuis
Add random effects model alignment function and tests
e5dc298
@eveenhuis
Merge pull request #259 from ITM-Kitware/dev/new-align-fn
5fb3c3f 
Add random effects model alignment function and tests
@barry-ravichandran @dmjoy
DecisionFlow: Added fine-grained value prompts for Attribute and Math…
ec1678b 
…Reason stages
@barry-ravichandran @dmjoy
DecisionFlow: Refactor outlines prompts to a dedicated script
ec021d0
@barry-ravichandran @dmjoy
Fix attribute filtering stage to pass correct information to objectiv…
1f28acf 
…e function
@barry-ravichandran @dmjoy
Remove inference call from Objective Stage to match original implemen…
42641fb 
…tation
@barry-ravichandran @dmjoy
Refine fine-grained prompts for KDMA-specific examples and improve in…
b552be4 
…ference speed
@barry-ravichandran @dmjoy
Refine Express stage prompt for faster inference and reduced JSON errors
3ca8337
@barry-ravichandran @dmjoy
Add TA3 eval server info to experiment config
952b9d4
@barry-ravichandran @dmjoy
Refine math_reason prompt to match closer to the source implementation
0ae89dc
@barry-ravichandran @dmjoy
Refine math_reason prompt and add in-context KDMA examples
5d47c1a
@barry-ravichandran @dmjoy
Constrain attribute stage output for high/low pipeline
bac54d9
@barry-ravichandran @dmjoy
Update Express Stage to use positive-negative alignment info
c234732
@barry-ravichandran @dmjoy
Fix redundant system prompt definitions in experiment config
ff9e637
@eveenhuis @dmjoy
Add choice index X ADM
fcc4551
@eveenhuis @dmjoy
Fix variable scope in phase 1 driver
eabb200
@dmjoy
Add initial configs for Feb evaluation
7f396c9
@dmjoy
Update TA3 client version; update ICL databases
140a2f9
@dmjoy
Update choose_a and choose_b experiments to point at AWS TA3 server
fd27b7c
@eveenhuis @dmjoy
Add spectrum-tuned configs
7b5cd65
@eveenhuis @dmjoy
Add observation configs
47e24fe
@dmjoy
Quickfix for direct regression PS scenarios
8042e4a
@dmjoy
Upgrade TA3 client version dep
cd0e578
@dmjoy
Multi-attribute run tweaks and experiment configs
6238c6a
@dmjoy
Set up caching for ICL step
849088b
@dmjoy
Add live eval configs for multi-target
34ce70d
@dmjoy
Add direct reg multi configs with different backbones
e6d9754
@dmjoy
MF z-score values updated (2026-01-21)
09dfc29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@cfunk1210 @jadie1 @eveenhuis @dmjoy @barry-ravichandran @PaulHax @DennisMelamedKitware