-
Notifications
You must be signed in to change notification settings - Fork 49
Add Cairo release check workflow #1501
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Benchmark results Main vs HEAD.Base
Head
Base
Head
Base
Head
Base
Head
Base
Head
Base
Head
|
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1501 +/- ##
=======================================
Coverage 72.88% 72.88%
=======================================
Files 110 110
Lines 27137 27137
=======================================
+ Hits 19779 19780 +1
+ Misses 7358 7357 -1 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Benchmarking resultsBenchmark for program
|
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
11.429 ± 0.063 | 11.348 | 11.553 | 5.52 ± 0.10 |
cairo-native (embedded AOT) |
2.070 ± 0.034 | 2.019 | 2.144 | 1.00 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
2.130 ± 0.037 | 2.073 | 2.198 | 1.03 ± 0.02 |
Benchmark for program dict_snapshot
Open benchmarks
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
610.5 ± 13.1 | 593.4 | 637.2 | 1.00 |
cairo-native (embedded AOT) |
1794.3 ± 35.2 | 1746.0 | 1874.3 | 2.94 ± 0.09 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
1904.4 ± 18.7 | 1873.0 | 1941.5 | 3.12 ± 0.07 |
Benchmark for program factorial_2M
Open benchmarks
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
5.139 ± 0.017 | 5.118 | 5.171 | 2.34 ± 0.02 |
cairo-native (embedded AOT) |
2.199 ± 0.016 | 2.175 | 2.221 | 1.00 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
2.232 ± 0.018 | 2.198 | 2.264 | 1.02 ± 0.01 |
Benchmark for program fib_2M
Open benchmarks
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
4.990 ± 0.016 | 4.963 | 5.020 | 2.77 ± 0.04 |
cairo-native (embedded AOT) |
1.802 ± 0.028 | 1.761 | 1.854 | 1.00 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
1.810 ± 0.022 | 1.775 | 1.840 | 1.00 ± 0.02 |
Benchmark for program linear_search
Open benchmarks
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
634.0 ± 6.8 | 623.6 | 642.8 | 1.00 |
cairo-native (embedded AOT) |
1746.3 ± 16.9 | 1719.8 | 1774.3 | 2.75 ± 0.04 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
1877.9 ± 13.5 | 1861.6 | 1901.3 | 2.96 ± 0.04 |
Benchmark for program logistic_map
Open benchmarks
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
532.8 ± 7.1 | 523.3 | 545.7 | 1.00 |
cairo-native (embedded AOT) |
1900.9 ± 21.8 | 1867.5 | 1938.2 | 3.57 ± 0.06 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
2060.7 ± 24.1 | 2027.1 | 2094.5 | 3.87 ± 0.07 |
…airo_native into add-release-check-workflow
099b239 to
ef367b8
Compare
|
It would be nice if we can have a way to test this workflow so that we don't have to wait until Monday to test it (Maybe adding a manual trigger?). |
…airo_native into add-release-check-workflow
I did a test in commit ef367b8. The results can be seen here. Since cairo's last release is 2.14.1-dev.3 and it is greater the one currently being used (2.14.1-dev.1) it made to end of the workflow. I added I manual trigger though, just in case. It can be checked here: f422616. |
…airo_native into add-release-check-workflow
- Fix CAIRO_LAST_RELEASE -> CAIRO_LATEST_RELEASE in issue template - Fix undefined REPO_URL by using github.server_url and github.repository
Add Cairo release check workflow
Closes #1500
Introduces Breaking Changes?
No.
starknet-blocks.ymlworkflow to use these PRs.These PRs should be merged after this one right away, in that order.
Checklist