Skip to content

chore: Publish python via trusted publishing and unify release process#183

Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit intomainfrom
abhi-python-publish
Apr 2, 2026
Merged

chore: Publish python via trusted publishing and unify release process#183
Abhijeet Prasad (AbhiPrasad) merged 1 commit intomainfrom
abhi-python-publish

Conversation

@AbhiPrasad
Copy link
Copy Markdown
Member

Part 2 for #180

adds pypi trusted publishing, and then unifies the release process to publish both python and javascript libraries at once. Also bumps versions, so can test cutting a release after this.

@@ -1,6 +1,6 @@
{
"name": "autoevals",
"version": "0.0.132",
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems like an odd version jump 🤔

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we are going to publish a changelog, so I figured we might as well just use a minor version.

changing the default model as per #169 also feels like a change worthy of a minor.

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) merged commit a5854ee into main Apr 2, 2026
10 checks passed
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 2, 2026

Braintrust eval report

Autoevals (main-1775145460)

Score Average Improvements Regressions
NumericDiff 78.7% (0pp) 6 🟢 11 🔴
Time_to_first_token 8.8tok (+0.19tok) 54 🟢 63 🔴
Llm_calls 1.09 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 316.55tok (0tok) 1 🟢 1 🔴
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Completion_tokens 256.11tok (+10.01tok) 39 🟢 64 🔴
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 572.66tok (+10.01tok) 39 🟢 64 🔴
Estimated_cost 0$ (+0$) 37 🟢 60 🔴
Duration 8.94s (+0.08s) 104 🟢 113 🔴
Llm_duration 10.29s (+0.31s) 55 🟢 62 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants