Skip to content

Bench: Disable ASLR on x86_64 to stabilize cycle counts#1091

Draft
mkannwischer wants to merge 1 commit into
mainfrom
experiment/main-with-setarch
Draft

Bench: Disable ASLR on x86_64 to stabilize cycle counts#1091
mkannwischer wants to merge 1 commit into
mainfrom
experiment/main-with-setarch

Conversation

@mkannwischer
Copy link
Copy Markdown
Contributor

Wraps bench binaries on x86_64 EC2 runners in setarch --addr-no-randomize to work around benchmarking instability.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 46538 cycles 46487 cycles 1.00
ML-DSA-44 sign 131060 cycles 131051 cycles 1.00
ML-DSA-44 verify 47347 cycles 47309 cycles 1.00
ML-DSA-65 keypair 81694 cycles 81708 cycles 1.00
ML-DSA-65 sign 215382 cycles 215407 cycles 1.00
ML-DSA-65 verify 79304 cycles 79322 cycles 1.00
ML-DSA-87 keypair 132496 cycles 132418 cycles 1.00
ML-DSA-87 sign 277520 cycles 277418 cycles 1.00
ML-DSA-87 verify 134239 cycles 134237 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 112825 cycles 112745 cycles 1.00
ML-DSA-44 sign 401151 cycles 400892 cycles 1.00
ML-DSA-44 verify 120183 cycles 120100 cycles 1.00
ML-DSA-65 keypair 192913 cycles 192891 cycles 1.00
ML-DSA-65 sign 650086 cycles 649931 cycles 1.00
ML-DSA-65 verify 192967 cycles 192957 cycles 1.00
ML-DSA-87 keypair 318766 cycles 318769 cycles 1.00
ML-DSA-87 sign 828863 cycles 828749 cycles 1.00
ML-DSA-87 verify 326673 cycles 326650 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 112361 cycles 112506 cycles 1.00
ML-DSA-44 sign 354280 cycles 354778 cycles 1.00
ML-DSA-44 verify 117087 cycles 117070 cycles 1.00
ML-DSA-65 keypair 194658 cycles 194535 cycles 1.00
ML-DSA-65 sign 584377 cycles 584268 cycles 1.00
ML-DSA-65 verify 193000 cycles 193228 cycles 1.00
ML-DSA-87 keypair 321268 cycles 320659 cycles 1.00
ML-DSA-87 sign 749900 cycles 748892 cycles 1.00
ML-DSA-87 verify 318657 cycles 317906 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 212308 cycles 212281 cycles 1.00
ML-DSA-44 sign 756599 cycles 756677 cycles 1.00
ML-DSA-44 verify 229193 cycles 229156 cycles 1.00
ML-DSA-65 keypair 378617 cycles 378671 cycles 1.00
ML-DSA-65 sign 1240292 cycles 1240241 cycles 1.00
ML-DSA-65 verify 372100 cycles 371834 cycles 1.00
ML-DSA-87 keypair 602591 cycles 602830 cycles 1.00
ML-DSA-87 sign 1580398 cycles 1580525 cycles 1.00
ML-DSA-87 verify 618819 cycles 619530 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 227115 cycles 232162 cycles 0.98
ML-DSA-44 sign 628390 cycles 631016 cycles 1.00
ML-DSA-44 verify 237407 cycles 227773 cycles 1.04
ML-DSA-65 keypair 386213 cycles 395842 cycles 0.98
ML-DSA-65 sign 1007278 cycles 1023934 cycles 0.98
ML-DSA-65 verify 379956 cycles 374329 cycles 1.02
ML-DSA-87 keypair 654190 cycles 672194 cycles 0.97
ML-DSA-87 sign 1347400 cycles 1388591 cycles 0.97
ML-DSA-87 verify 635751 cycles 639020 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 43803 cycles 43752 cycles 1.00
ML-DSA-44 sign 133199 cycles 133474 cycles 1.00
ML-DSA-44 verify 45749 cycles 45758 cycles 1.00
ML-DSA-65 keypair 76076 cycles 75991 cycles 1.00
ML-DSA-65 sign 218320 cycles 218042 cycles 1.00
ML-DSA-65 verify 75691 cycles 75709 cycles 1.00
ML-DSA-87 keypair 123707 cycles 124572 cycles 0.99
ML-DSA-87 sign 276054 cycles 276549 cycles 1.00
ML-DSA-87 verify 122605 cycles 121738 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i) (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 94096 cycles 94220 cycles 1.00
ML-DSA-44 sign 329856 cycles 329551 cycles 1.00
ML-DSA-44 verify 98806 cycles 98744 cycles 1.00
ML-DSA-65 keypair 161815 cycles 161791 cycles 1.00
ML-DSA-65 sign 538921 cycles 538752 cycles 1.00
ML-DSA-65 verify 160576 cycles 160741 cycles 1.00
ML-DSA-87 keypair 264044 cycles 264407 cycles 1.00
ML-DSA-87 sign 695322 cycles 695217 cycles 1.00
ML-DSA-87 verify 265812 cycles 266076 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 55418 cycles 55536 cycles 1.00
ML-DSA-44 sign 165184 cycles 165510 cycles 1.00
ML-DSA-44 verify 57984 cycles 58085 cycles 1.00
ML-DSA-65 keypair 96127 cycles 95989 cycles 1.00
ML-DSA-65 sign 267583 cycles 268680 cycles 1.00
ML-DSA-65 verify 96376 cycles 96882 cycles 0.99
ML-DSA-87 keypair 154387 cycles 155832 cycles 0.99
ML-DSA-87 sign 327696 cycles 328267 cycles 1.00
ML-DSA-87 verify 151724 cycles 151971 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 478e7c6 Previous: 339782e Ratio
ML-DSA-44 verify 67737 cycles 65332 cycles 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a) (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 135388 cycles 133876 cycles 1.01
ML-DSA-44 sign 529062 cycles 522571 cycles 1.01
ML-DSA-44 verify 148544 cycles 146946 cycles 1.01
ML-DSA-65 keypair 226172 cycles 223601 cycles 1.01
ML-DSA-65 sign 859582 cycles 850538 cycles 1.01
ML-DSA-65 verify 235572 cycles 232912 cycles 1.01
ML-DSA-87 keypair 381589 cycles 372804 cycles 1.02
ML-DSA-87 sign 1092160 cycles 1075896 cycles 1.02
ML-DSA-87 verify 393010 cycles 384101 cycles 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 47070 cycles 47034 cycles 1.00
ML-DSA-44 sign 144080 cycles 144520 cycles 1.00
ML-DSA-44 verify 50010 cycles 49948 cycles 1.00
ML-DSA-65 keypair 82785 cycles 83477 cycles 0.99
ML-DSA-65 sign 229303 cycles 230006 cycles 1.00
ML-DSA-65 verify 82763 cycles 83313 cycles 0.99
ML-DSA-87 keypair 130310 cycles 130262 cycles 1.00
ML-DSA-87 sign 281779 cycles 281243 cycles 1.00
ML-DSA-87 verify 129082 cycles 129599 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 67351 cycles 67493 cycles 1.00
ML-DSA-44 sign 201244 cycles 201188 cycles 1.00
ML-DSA-44 verify 70213 cycles 70224 cycles 1.00
ML-DSA-65 keypair 119526 cycles 119397 cycles 1.00
ML-DSA-65 sign 328451 cycles 328227 cycles 1.00
ML-DSA-65 verify 116896 cycles 116800 cycles 1.00
ML-DSA-87 keypair 196788 cycles 196677 cycles 1.00
ML-DSA-87 sign 424371 cycles 425034 cycles 1.00
ML-DSA-87 verify 192927 cycles 193222 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 478e7c6 Previous: 339782e Ratio
ML-DSA-44 verify 55178 cycles 52842 cycles 1.04
ML-DSA-87 keypair 147972 cycles 140729 cycles 1.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 62061 cycles 61936 cycles 1.00
ML-DSA-44 sign 190815 cycles 191043 cycles 1.00
ML-DSA-44 verify 66356 cycles 66126 cycles 1.00
ML-DSA-65 keypair 110436 cycles 108392 cycles 1.02
ML-DSA-65 sign 319073 cycles 314788 cycles 1.01
ML-DSA-65 verify 110111 cycles 108959 cycles 1.01
ML-DSA-87 keypair 176169 cycles 171889 cycles 1.02
ML-DSA-87 sign 388494 cycles 382461 cycles 1.02
ML-DSA-87 verify 180461 cycles 172648 cycles 1.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-87 verify 180461 cycles 172648 cycles 1.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 299914 cycles 300737 cycles 1.00
ML-DSA-44 sign 1139477 cycles 1174829 cycles 0.97
ML-DSA-44 verify 333965 cycles 337343 cycles 0.99
ML-DSA-65 keypair 560559 cycles 560306 cycles 1.00
ML-DSA-65 sign 1911182 cycles 1893632 cycles 1.01
ML-DSA-65 verify 541069 cycles 539843 cycles 1.00
ML-DSA-87 keypair 857284 cycles 857474 cycles 1.00
ML-DSA-87 sign 2396180 cycles 2416187 cycles 0.99
ML-DSA-87 verify 897755 cycles 888630 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4 (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 128633 cycles 128403 cycles 1.00
ML-DSA-44 sign 444840 cycles 445364 cycles 1.00
ML-DSA-44 verify 136566 cycles 136669 cycles 1.00
ML-DSA-65 keypair 220163 cycles 220556 cycles 1.00
ML-DSA-65 sign 718660 cycles 718235 cycles 1.00
ML-DSA-65 verify 221060 cycles 220870 cycles 1.00
ML-DSA-87 keypair 365571 cycles 365470 cycles 1.00
ML-DSA-87 sign 917869 cycles 919110 cycles 1.00
ML-DSA-87 verify 371519 cycles 371043 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a) (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 119341 cycles 119050 cycles 1.00
ML-DSA-44 sign 446640 cycles 446279 cycles 1.00
ML-DSA-44 verify 129051 cycles 128711 cycles 1.00
ML-DSA-65 keypair 202372 cycles 201699 cycles 1.00
ML-DSA-65 sign 717980 cycles 718938 cycles 1.00
ML-DSA-65 verify 207399 cycles 207407 cycles 1.00
ML-DSA-87 keypair 335167 cycles 334972 cycles 1.00
ML-DSA-87 sign 918484 cycles 914589 cycles 1.00
ML-DSA-87 verify 342567 cycles 341996 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i) (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 151569 cycles 151054 cycles 1.00
ML-DSA-44 sign 549245 cycles 549603 cycles 1.00
ML-DSA-44 verify 164730 cycles 163499 cycles 1.01
ML-DSA-65 keypair 257952 cycles 255396 cycles 1.01
ML-DSA-65 sign 898392 cycles 885386 cycles 1.01
ML-DSA-65 verify 264256 cycles 262296 cycles 1.01
ML-DSA-87 keypair 426031 cycles 425949 cycles 1.00
ML-DSA-87 sign 1143940 cycles 1141022 cycles 1.00
ML-DSA-87 verify 439080 cycles 439485 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 71485 cycles 71571 cycles 1.00
ML-DSA-44 sign 211365 cycles 211564 cycles 1.00
ML-DSA-44 verify 74930 cycles 74835 cycles 1.00
ML-DSA-65 keypair 125877 cycles 125944 cycles 1.00
ML-DSA-65 sign 348023 cycles 347491 cycles 1.00
ML-DSA-65 verify 124036 cycles 123844 cycles 1.00
ML-DSA-87 keypair 206659 cycles 206284 cycles 1.00
ML-DSA-87 sign 447124 cycles 443149 cycles 1.01
ML-DSA-87 verify 204036 cycles 204484 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3 (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 138037 cycles 137899 cycles 1.00
ML-DSA-44 sign 481614 cycles 482179 cycles 1.00
ML-DSA-44 verify 148675 cycles 148821 cycles 1.00
ML-DSA-65 keypair 240452 cycles 241085 cycles 1.00
ML-DSA-65 sign 785163 cycles 784964 cycles 1.00
ML-DSA-65 verify 241043 cycles 240575 cycles 1.00
ML-DSA-87 keypair 395120 cycles 395071 cycles 1.00
ML-DSA-87 sign 1005311 cycles 1006137 cycles 1.00
ML-DSA-87 verify 403178 cycles 402652 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 112581 cycles 112619 cycles 1.00
ML-DSA-44 sign 355008 cycles 355293 cycles 1.00
ML-DSA-44 verify 117458 cycles 117618 cycles 1.00
ML-DSA-65 keypair 194596 cycles 194592 cycles 1.00
ML-DSA-65 sign 585087 cycles 585677 cycles 1.00
ML-DSA-65 verify 193240 cycles 193472 cycles 1.00
ML-DSA-87 keypair 321420 cycles 321217 cycles 1.00
ML-DSA-87 sign 750058 cycles 749559 cycles 1.00
ML-DSA-87 verify 318474 cycles 318397 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown
Contributor

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2 (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 213154 cycles 213821 cycles 1.00
ML-DSA-44 sign 758222 cycles 758249 cycles 1.00
ML-DSA-44 verify 230003 cycles 230198 cycles 1.00
ML-DSA-65 keypair 378694 cycles 378496 cycles 1.00
ML-DSA-65 sign 1241332 cycles 1241167 cycles 1.00
ML-DSA-65 verify 372827 cycles 372998 cycles 1.00
ML-DSA-87 keypair 603780 cycles 604231 cycles 1.00
ML-DSA-87 sign 1581866 cycles 1582789 cycles 1.00
ML-DSA-87 verify 618269 cycles 618559 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 820171 cycles 820237 cycles 1.00
ML-DSA-44 sign 3223209 cycles 3223193 cycles 1.00
ML-DSA-44 verify 916992 cycles 917028 cycles 1.00
ML-DSA-65 keypair 1391007 cycles 1390135 cycles 1.00
ML-DSA-65 sign 5242587 cycles 5238883 cycles 1.00
ML-DSA-65 verify 1467211 cycles 1466168 cycles 1.00
ML-DSA-87 keypair 2299063 cycles 2299889 cycles 1.00
ML-DSA-87 sign 6620561 cycles 6609795 cycles 1.00
ML-DSA-87 verify 2407332 cycles 2408604 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 266721 cycles 267270 cycles 1.00
ML-DSA-44 sign 799633 cycles 801949 cycles 1.00
ML-DSA-44 verify 268728 cycles 269574 cycles 1.00
ML-DSA-65 keypair 461003 cycles 460278 cycles 1.00
ML-DSA-65 sign 1311456 cycles 1308045 cycles 1.00
ML-DSA-65 verify 445813 cycles 445886 cycles 1.00
ML-DSA-87 keypair 790539 cycles 787308 cycles 1.00
ML-DSA-87 sign 1788045 cycles 1788644 cycles 1.00
ML-DSA-87 verify 771262 cycles 767345 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)

Details
Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 keypair 455950 cycles 455980 cycles 1.00
ML-DSA-44 sign 2117413 cycles 2117562 cycles 1.00
ML-DSA-44 verify 548538 cycles 548769 cycles 1.00
ML-DSA-65 keypair 766527 cycles 767753 cycles 1.00
ML-DSA-65 sign 3451201 cycles 3460763 cycles 1.00
ML-DSA-65 verify 852031 cycles 853656 cycles 1.00
ML-DSA-87 keypair 1237682 cycles 1238514 cycles 1.00
ML-DSA-87 sign 4274485 cycles 4275697 cycles 1.00
ML-DSA-87 verify 1364009 cycles 1362369 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link
Copy Markdown
Contributor

oqs-bot commented May 4, 2026

CBMC Results (ML-DSA-65, REDUCE-RAM)

Full Results (199 proofs)
Proof Status Current Previous Change
**TOTAL** 1659s 1526s +8.7%
poly_pointwise_montgomery_c 200s 172s +16%
polyvec_matrix_pointwise_montgomery_yvec 174s 159s +9%
rej_uniform_native 114s 109s +5%
mld_invntt_layer 109s 107s +2%
mld_ct_memcmp 76s 67s +13%
mld_ntt_layer 47s 43s +9%
mld_attempt_signature_generation 33s 29s +14%
fqmul 31s 27s +15%
sign_verify_internal 27s 26s +4%
keccakf1600x4_permute_native 22s 24s -8%
polyvecl_chknorm 22s 20s +10%
rej_uniform 22s 19s +16%
rej_uniform_c 21s 19s +11%
mld_ntt_butterfly_block 16s 15s +7%
mld_check_pct 15s 17s -12%
polyveck_decompose 15s 15s +0%
poly_chknorm_c 14s 13s +8%
polyt0_unpack 14s 11s +27%
compute_pack_t0_t1 13s 9s +44%
poly_add 12s 11s +9%
poly_uniform_eta_4x 12s 11s +9%
polyvec_matrix_pointwise_montgomery_row 10s 8s +25%
polyz_unpack_c 10s 5s +100%
keccak_absorb_once_x4 9s 10s -10%
poly_invntt_tomont_c 9s 9s +0%
mld_compute_pack_z 8s 6s +33%
poly_power2round 8s 7s +14%
polyveck_caddq 8s 8s +0%
polyveck_reduce 8s 7s +14%
polyvecl_ntt 8s 7s +14%
sign 8s 6s +33%
caddq 7s 3s +133%
keccak_absorb 7s 5s +40%
mld_keccakf1600_permute_c 7s 8s -12%
pointwise_acc_native_aarch64 7s 5s +40%
poly_caddq_c 7s 8s -12%
sign_signature_internal 7s 5s +40%
poly_caddq_native_aarch64 6s 2s +200%
poly_challenge 6s 3s +100%
polyveck_invntt_tomont 6s 5s +20%
polyveck_pack_eta 6s 3s +100%
sign_keypair 6s 5s +20%
unpack_sk_s1hat 6s 3s +100%
yvec_get_poly 6s 2s +200%
decompose 5s 3s +67%
fqscale 5s 3s +67%
intt_native_aarch64 5s 2s +150%
keccakf1600_permute_native 5s 3s +67%
mld_ct_get_optblocker_u32 5s 2s +150%
mld_h 5s 6s -17%
mld_polymat_expand_entry 5s 3s +67%
mld_sample_s1_s2_serial 5s 4s +25%
ntt_native_aarch64 5s 3s +67%
pointwise_acc_native_x86_64 5s 5s +0%
poly_decompose_c 5s 5s +0%
poly_ntt 5s 3s +67%
poly_shiftl 5s 6s -17%
poly_uniform_eta 5s 3s +67%
polyeta_unpack 5s 2s +150%
polyt0_pack 5s 4s +25%
polyveck_chknorm 5s 3s +67%
rej_uniform_native_aarch64 5s 4s +25%
sign_open 5s 4s +25%
sign_pk_from_sk 5s 4s +25%
sign_signature_pre_hash_internal 5s 3s +67%
keccak_squeezeblocks_x4 4s 4s +0%
keccakf1600x4_xor_bytes_native 4s 3s +33%
mld_sample_s1_s2 4s 4s +0%
mld_value_barrier_u32 4s 3s +33%
nttunpack_native_x86_64 4s 2s +100%
pack_sig_c 4s 2s +100%
pointwise_native_aarch64 4s 5s -20%
pointwise_native_x86_64 4s 3s +33%
poly_chknorm_native 4s 3s +33%
poly_decompose_88_native_aarch64 4s 2s +100%
poly_permute_bitrev_to_custom_optional_native 4s 3s +33%
poly_pointwise_montgomery 4s 1s +300%
poly_pointwise_montgomery_native 4s 3s +33%
poly_uniform_4x 4s 3s +33%
polyt1_unpack 4s 5s -20%
polyveck_pack_w1 4s 2s +100%
polyz_unpack 4s 4s +0%
polyz_unpack_17_native_aarch64 4s 3s +33%
shake128_release 4s 4s +0%
shake256 4s 4s +0%
shake256_absorb 4s 2s +100%
shake256_squeeze 4s 3s +33%
shake256x4_squeezeblocks 4s 4s +0%
sig_unpack_hints 4s 4s +0%
sign_keypair_internal 4s 7s -43%
sign_signature 4s 3s +33%
sign_signature_extmu 4s 4s +0%
sign_verify 4s 4s +0%
sign_verify_pre_hash_internal 4s 3s +33%
sk_s1hat_get_poly 4s 3s +33%
unpack_sk_s2hat 4s 3s +33%
unpack_sk_t0hat 4s 3s +33%
use_hint 4s 3s +33%
intt_native_x86_64 3s 4s -25%
keccak_f1600_x1_native_aarch64 3s 1s +200%
keccak_f1600_x4_native_aarch64_v84a 3s 2s +50%
keccak_f1600_x4_native_aarch64_v8a_scalar_hybrid 3s 2s +50%
keccak_f1600_x4_native_avx2 3s 1s +200%
keccak_finalize 3s 1s +200%
keccakf1600_extract_bytes (big endian) 3s 3s +0%
keccakf1600_xor_bytes (big endian) 3s 2s +50%
keccakf1600x4_xor_bytes 3s 1s +200%
make_hint 3s 1s +200%
mld_ct_cmask_nonzero_u32 3s 5s -40%
mld_keccakf1600x4_xor_bytes_c 3s 3s +0%
mld_prepare_domain_separation_prefix 3s 3s +0%
pack_sk_rho_key_tr_s2 3s 4s -25%
pack_sk_s1 3s 3s +0%
poly_caddq 3s 4s -25%
poly_caddq_native 3s 3s +0%
poly_chknorm 3s 3s +0%
poly_chknorm_native_aarch64 3s 4s -25%
poly_decompose_32_native_aarch64 3s 4s -25%
poly_decompose_native 3s 2s +50%
poly_invntt_tomont_native 3s 4s -25%
poly_ntt_native 3s 2s +50%
poly_permute_bitrev_to_custom_optional 3s 3s +0%
poly_reduce 3s 2s +50%
poly_sub 3s 3s +0%
poly_uniform 3s 6s -50%
poly_uniform_gamma1_4x 3s 3s +0%
poly_use_hint 3s 3s +0%
poly_use_hint_c 3s 2s +50%
poly_use_hint_native_aarch64 3s 4s -25%
polyvec_matrix_expand 3s 4s -25%
polyvecl_pointwise_acc_montgomery_c 3s 3s +0%
polyvecl_uniform_gamma1 3s 3s +0%
polyvecl_uniform_gamma1_serial 3s 3s +0%
polyvecl_unpack_eta 3s 2s +50%
polyvecl_unpack_z 3s 2s +50%
polyz_pack 3s 3s +0%
polyz_unpack_native 3s 5s -40%
reduce32 3s 2s +50%
rej_eta 3s 4s -25%
rej_eta_c 3s 2s +50%
rej_eta_native 3s 4s -25%
shake128_absorb 3s 2s +50%
shake256_finalize 3s 3s +0%
shake256_release 3s 4s -25%
sign_signature_pre_hash_shake256 3s 5s -40%
sign_verify_extmu 3s 2s +50%
sk_s2hat_get_poly 3s 3s +0%
sk_t0hat_get_poly 3s 5s -40%
keccak_f1600_x1_native_aarch64_v84a 2s 1s +100%
keccak_f1600_x4_native_aarch64_v8a_v84a_scalar_hybrid 2s 5s -60%
keccak_init 2s 3s -33%
keccak_squeeze 2s 1s +100%
keccakf1600x4_extract_bytes 2s 2s +0%
keccakf1600x4_extract_bytes_native 2s 3s -33%
keccakf1600x4_permute 2s 2s +0%
mld_ct_cmask_neg_i32 2s 1s +100%
mld_ct_get_optblocker_i64 2s 2s +0%
mld_ct_get_optblocker_u8 2s 1s +100%
mld_ct_sel_int32 2s 2s +0%
mld_keccakf1600_extract_bytes 2s 2s +0%
mld_keccakf1600x4_extract_bytes_c 2s 2s +0%
mld_value_barrier_i64 2s 2s +0%
montgomery_reduce 2s 3s -33%
ntt_native_x86_64 2s 3s -33%
pack_sig_h 2s 3s -33%
pack_sig_z 2s 4s -50%
poly_decompose 2s 4s -50%
poly_uniform_gamma1 2s 3s -33%
poly_use_hint_native 2s 4s -50%
polyeta_pack 2s 3s -33%
polyt1_pack 2s 3s -33%
polyveck_ntt 2s 3s -33%
polyveck_unpack_eta 2s 3s -33%
polyvecl_pack_eta 2s 1s +100%
polyvecl_pointwise_acc_montgomery 2s 3s -33%
polyvecl_pointwise_acc_montgomery_native 2s 2s +0%
polyw1_pack 2s 3s -33%
polyz_unpack_19_native_aarch64 2s 3s -33%
power2round 2s 3s -33%
shake128_finalize 2s 3s -33%
shake128_init 2s 4s -50%
shake128_squeeze 2s 5s -60%
shake128x4_absorb_once 2s 2s +0%
shake128x4_squeezeblocks 2s 2s +0%
shake256_init 2s 2s +0%
shake256x4_absorb_once 2s 3s -33%
sign_verify_pre_hash_shake256 2s 5s -60%
sys_check_capability 2s 3s -33%
unpack_pk_t1 2s 3s -33%
yvec_init 2s 1s +100%
keccakf1600_permute 1s 2s -50%
keccakf1600_xor_bytes 1s 2s -50%
mld_ct_abs_i32 1s 2s -50%
mld_ct_cmask_nonzero_u8 1s 3s -67%
mld_value_barrier_u8 1s 4s -75%
poly_invntt_tomont 1s 5s -80%
poly_ntt_c 1s 1s +0%
polyvec_matrix_expand_serial 1s 4s -75%
unpack_sk 1s 4s -75%

@oqs-bot
Copy link
Copy Markdown
Contributor

oqs-bot commented May 4, 2026

CBMC Results (ML-DSA-44, REDUCE-RAM)

Full Results (199 proofs)
Proof Status Current Previous Change
**TOTAL** 1622s 1437s +12.9%
poly_pointwise_montgomery_c 223s 171s +30%
rej_uniform_native 122s 105s +16%
mld_invntt_layer 118s 106s +11%
polyvec_matrix_pointwise_montgomery_yvec 100s 93s +8%
mld_ct_memcmp 81s 67s +21%
mld_ntt_layer 46s 42s +10%
fqmul 33s 29s +14%
mld_attempt_signature_generation 28s 24s +17%
keccakf1600x4_permute_native 27s 24s +12%
sign_verify_internal 26s 22s +18%
rej_uniform 21s 20s +5%
rej_uniform_c 20s 16s +25%
mld_check_pct 19s 16s +19%
mld_ntt_butterfly_block 18s 17s +6%
poly_chknorm_c 16s 12s +33%
polyeta_unpack 16s 17s -6%
polyz_unpack_c 16s 15s +7%
poly_uniform_eta_4x 15s 10s +50%
poly_add 12s 10s +20%
polyt0_unpack 12s 12s +0%
poly_decompose_c 10s 10s +0%
poly_power2round 10s 8s +25%
polyveck_chknorm 10s 9s +11%
keccak_absorb 9s 7s +29%
keccak_absorb_once_x4 9s 10s -10%
poly_caddq_c 9s 10s -10%
poly_invntt_tomont_c 8s 7s +14%
sign 8s 7s +14%
poly_shiftl 7s 6s +17%
caddq 6s 2s +200%
compute_pack_t0_t1 6s 8s -25%
intt_native_aarch64 6s 3s +100%
mld_keccakf1600_permute_c 6s 7s -14%
mld_sample_s1_s2 6s 2s +200%
pointwise_acc_native_x86_64 6s 6s +0%
poly_caddq_native_aarch64 6s 3s +100%
poly_decompose 6s 3s +100%
poly_invntt_tomont 6s 2s +200%
polyvec_matrix_pointwise_montgomery_row 6s 8s -25%
rej_eta_native 6s 5s +20%
sign_pk_from_sk 6s 6s +0%
sign_signature_extmu 6s 4s +50%
sign_signature_pre_hash_shake256 6s 3s +100%
sign_verify_pre_hash_shake256 6s 4s +50%
intt_native_x86_64 5s 7s -29%
keccakf1600x4_extract_bytes_native 5s 2s +150%
ntt_native_aarch64 5s 3s +67%
pack_sk_s1 5s 3s +67%
poly_challenge 5s 4s +25%
poly_use_hint_native 5s 4s +25%
polyeta_pack 5s 3s +67%
polyt1_pack 5s 2s +150%
polyt1_unpack 5s 2s +150%
polyvec_matrix_expand_serial 5s 5s +0%
polyveck_caddq 5s 4s +25%
polyvecl_ntt 5s 4s +25%
polyw1_pack 5s 2s +150%
polyz_unpack_19_native_aarch64 5s 2s +150%
shake256 5s 3s +67%
sign_keypair_internal 5s 3s +67%
sign_open 5s 5s +0%
sign_signature_internal 5s 5s +0%
keccak_f1600_x1_native_aarch64 4s 3s +33%
keccak_f1600_x4_native_aarch64_v8a_scalar_hybrid 4s 3s +33%
keccak_squeezeblocks_x4 4s 5s -20%
mld_compute_pack_z 4s 6s -33%
mld_ct_cmask_nonzero_u8 4s 3s +33%
mld_sample_s1_s2_serial 4s 5s -20%
pack_sig_z 4s 5s -20%
pack_sk_rho_key_tr_s2 4s 3s +33%
pointwise_acc_native_aarch64 4s 5s -20%
pointwise_native_aarch64 4s 2s +100%
pointwise_native_x86_64 4s 2s +100%
poly_caddq 4s 2s +100%
poly_caddq_native 4s 5s -20%
poly_chknorm 4s 3s +33%
poly_chknorm_native 4s 3s +33%
poly_invntt_tomont_native 4s 4s +0%
poly_pointwise_montgomery 4s 2s +100%
poly_pointwise_montgomery_native 4s 5s -20%
poly_sub 4s 2s +100%
poly_uniform_eta 4s 5s -20%
poly_uniform_gamma1 4s 3s +33%
poly_uniform_gamma1_4x 4s 5s -20%
poly_use_hint_c 4s 2s +100%
polyvec_matrix_expand 4s 3s +33%
polyveck_decompose 4s 6s -33%
polyveck_invntt_tomont 4s 3s +33%
polyveck_pack_w1 4s 1s +300%
polyveck_reduce 4s 4s +0%
polyvecl_chknorm 4s 7s -43%
power2round 4s 6s -33%
shake128_squeeze 4s 2s +100%
shake128x4_absorb_once 4s 3s +33%
sign_signature 4s 3s +33%
sign_signature_pre_hash_internal 4s 3s +33%
sign_verify 4s 3s +33%
sk_s1hat_get_poly 4s 3s +33%
sk_s2hat_get_poly 4s 2s +100%
yvec_get_poly 4s 4s +0%
yvec_init 4s 1s +300%
fqscale 3s 4s -25%
keccak_f1600_x1_native_aarch64_v84a 3s 2s +50%
keccak_f1600_x4_native_avx2 3s 2s +50%
keccak_finalize 3s 3s +0%
keccak_init 3s 2s +50%
keccakf1600_permute 3s 3s +0%
keccakf1600_permute_native 3s 3s +0%
keccakf1600_xor_bytes 3s 2s +50%
keccakf1600x4_extract_bytes 3s 2s +50%
make_hint 3s 3s +0%
mld_ct_abs_i32 3s 2s +50%
mld_ct_get_optblocker_i64 3s 1s +200%
mld_ct_get_optblocker_u32 3s 3s +0%
mld_ct_get_optblocker_u8 3s 2s +50%
mld_keccakf1600_extract_bytes 3s 4s -25%
mld_keccakf1600x4_xor_bytes_c 3s 2s +50%
mld_polymat_expand_entry 3s 2s +50%
mld_value_barrier_u32 3s 2s +50%
mld_value_barrier_u8 3s 2s +50%
ntt_native_x86_64 3s 2s +50%
nttunpack_native_x86_64 3s 5s -40%
pack_sig_c 3s 3s +0%
pack_sig_h 3s 3s +0%
poly_chknorm_native_aarch64 3s 2s +50%
poly_decompose_32_native_aarch64 3s 2s +50%
poly_decompose_native 3s 2s +50%
poly_ntt 3s 1s +200%
poly_ntt_c 3s 4s -25%
poly_ntt_native 3s 4s -25%
poly_permute_bitrev_to_custom_optional 3s 3s +0%
poly_permute_bitrev_to_custom_optional_native 3s 3s +0%
poly_reduce 3s 3s +0%
poly_uniform 3s 5s -40%
poly_use_hint 3s 1s +200%
polyt0_pack 3s 3s +0%
polyveck_pack_eta 3s 2s +50%
polyvecl_pointwise_acc_montgomery_c 3s 2s +50%
polyvecl_pointwise_acc_montgomery_native 3s 3s +0%
polyvecl_uniform_gamma1 3s 3s +0%
polyvecl_unpack_z 3s 2s +50%
polyz_pack 3s 2s +50%
polyz_unpack_17_native_aarch64 3s 3s +0%
rej_eta_c 3s 3s +0%
rej_uniform_native_aarch64 3s 5s -40%
shake128_init 3s 2s +50%
sig_unpack_hints 3s 3s +0%
sign_keypair 3s 3s +0%
sign_verify_extmu 3s 5s -40%
sign_verify_pre_hash_internal 3s 2s +50%
unpack_pk_t1 3s 2s +50%
unpack_sk_s2hat 3s 2s +50%
use_hint 3s 3s +0%
decompose 2s 3s -33%
keccak_f1600_x4_native_aarch64_v8a_v84a_scalar_hybrid 2s 1s +100%
keccak_squeeze 2s 4s -50%
keccakf1600_extract_bytes (big endian) 2s 2s +0%
keccakf1600_xor_bytes (big endian) 2s 2s +0%
keccakf1600x4_permute 2s 3s -33%
keccakf1600x4_xor_bytes 2s 3s -33%
keccakf1600x4_xor_bytes_native 2s 4s -50%
mld_ct_cmask_neg_i32 2s 3s -33%
mld_ct_sel_int32 2s 3s -33%
mld_h 2s 3s -33%
mld_prepare_domain_separation_prefix 2s 5s -60%
montgomery_reduce 2s 3s -33%
poly_uniform_4x 2s 3s -33%
poly_use_hint_native_aarch64 2s 3s -33%
polyveck_ntt 2s 2s +0%
polyveck_unpack_eta 2s 2s +0%
polyvecl_pack_eta 2s 4s -50%
polyvecl_pointwise_acc_montgomery 2s 2s +0%
polyvecl_uniform_gamma1_serial 2s 3s -33%
polyvecl_unpack_eta 2s 3s -33%
polyz_unpack_native 2s 3s -33%
reduce32 2s 1s +100%
rej_eta 2s 3s -33%
shake128_absorb 2s 4s -50%
shake128_finalize 2s 2s +0%
shake128x4_squeezeblocks 2s 4s -50%
shake256_finalize 2s 2s +0%
shake256_init 2s 4s -50%
shake256_squeeze 2s 3s -33%
shake256x4_squeezeblocks 2s 2s +0%
sk_t0hat_get_poly 2s 2s +0%
sys_check_capability 2s 4s -50%
unpack_sk 2s 2s +0%
unpack_sk_s1hat 2s 1s +100%
keccak_f1600_x4_native_aarch64_v84a 1s 2s -50%
mld_ct_cmask_nonzero_u32 1s 3s -67%
mld_keccakf1600x4_extract_bytes_c 1s 5s -80%
mld_value_barrier_i64 1s 5s -80%
poly_decompose_88_native_aarch64 1s 3s -67%
polyz_unpack 1s 2s -50%
shake128_release 1s 1s +0%
shake256_absorb 1s 3s -67%
shake256_release 1s 2s -50%
shake256x4_absorb_once 1s 3s -67%
unpack_sk_t0hat 1s 3s -67%

@oqs-bot
Copy link
Copy Markdown
Contributor

oqs-bot commented May 4, 2026

CBMC Results (ML-DSA-87, REDUCE-RAM)

Full Results (199 proofs)
Proof Status Current Previous Change
**TOTAL** 1579s 1648s -4.2%
poly_pointwise_montgomery_c 180s 210s -14%
polyvec_matrix_pointwise_montgomery_yvec 138s 138s +0%
mld_invntt_layer 114s 117s -3%
rej_uniform_native 113s 121s -7%
mld_ct_memcmp 69s 72s -4%
mld_ntt_layer 44s 46s -4%
sign_verify_internal 39s 36s +8%
fqmul 33s 30s +10%
mld_attempt_signature_generation 26s 26s +0%
keccakf1600x4_permute_native 25s 23s +9%
rej_uniform_c 20s 19s +5%
rej_uniform 19s 23s -17%
mld_ntt_butterfly_block 18s 16s +12%
polyeta_unpack 16s 16s +0%
mld_check_pct 15s 14s +7%
poly_chknorm_c 15s 14s +7%
polyveck_decompose 15s 15s +0%
poly_uniform_eta_4x 13s 15s -13%
poly_add 12s 14s -14%
polyt0_unpack 12s 12s +0%
keccak_absorb_once_x4 10s 10s +0%
polyvec_matrix_pointwise_montgomery_row 10s 10s +0%
compute_pack_t0_t1 9s 8s +12%
poly_power2round 9s 9s +0%
pointwise_acc_native_x86_64 8s 8s +0%
polyveck_reduce 8s 8s +0%
polyvecl_ntt 8s 9s -11%
sign 8s 10s -20%
keccak_absorb 7s 7s +0%
mld_keccakf1600_permute_c 7s 7s +0%
mld_sample_s1_s2 7s 7s +0%
pointwise_acc_native_aarch64 7s 7s +0%
pointwise_native_x86_64 7s 4s +75%
poly_caddq_c 7s 9s -22%
poly_invntt_tomont_c 7s 8s -12%
polyz_unpack_c 7s 9s -22%
sign_signature 7s 4s +75%
intt_native_aarch64 6s 3s +100%
mld_prepare_domain_separation_prefix 6s 2s +200%
mld_sample_s1_s2_serial 6s 6s +0%
poly_shiftl 6s 6s +0%
poly_uniform 6s 6s +0%
polyveck_caddq 6s 8s -25%
sign_pk_from_sk 6s 5s +20%
sign_signature_internal 6s 6s +0%
keccak_squeezeblocks_x4 5s 7s -29%
keccakf1600_permute_native 5s 4s +25%
mld_compute_pack_z 5s 6s -17%
mld_ct_cmask_nonzero_u8 5s 2s +150%
poly_chknorm_native 5s 4s +25%
poly_decompose_native 5s 2s +150%
poly_pointwise_montgomery 5s 2s +150%
poly_uniform_eta 5s 3s +67%
polyveck_chknorm 5s 7s -29%
polyveck_invntt_tomont 5s 7s -29%
rej_eta_native 5s 5s +0%
sign_keypair 5s 4s +25%
sign_verify_pre_hash_internal 5s 6s -17%
sign_verify_pre_hash_shake256 5s 4s +25%
intt_native_x86_64 4s 5s -20%
keccakf1600x4_permute 4s 4s +0%
mld_ct_cmask_neg_i32 4s 2s +100%
mld_h 4s 3s +33%
mld_polymat_expand_entry 4s 5s -20%
ntt_native_aarch64 4s 3s +33%
nttunpack_native_x86_64 4s 2s +100%
pack_sk_rho_key_tr_s2 4s 4s +0%
poly_decompose_88_native_aarch64 4s 4s +0%
poly_decompose_c 4s 3s +33%
poly_invntt_tomont 4s 3s +33%
poly_ntt_native 4s 2s +100%
poly_permute_bitrev_to_custom_optional_native 4s 2s +100%
poly_reduce 4s 4s +0%
poly_uniform_gamma1_4x 4s 3s +33%
polyt1_pack 4s 3s +33%
polyvec_matrix_expand 4s 2s +100%
polyveck_unpack_eta 4s 5s -20%
polyvecl_chknorm 4s 6s -33%
polyvecl_pointwise_acc_montgomery 4s 2s +100%
polyvecl_unpack_z 4s 3s +33%
polyz_pack 4s 4s +0%
power2round 4s 5s -20%
reduce32 4s 5s -20%
shake256x4_absorb_once 4s 2s +100%
shake256x4_squeezeblocks 4s 2s +100%
sign_keypair_internal 4s 5s -20%
sign_signature_extmu 4s 3s +33%
sign_verify 4s 6s -33%
sk_s1hat_get_poly 4s 4s +0%
unpack_sk 4s 2s +100%
unpack_sk_s1hat 4s 2s +100%
yvec_get_poly 4s 2s +100%
decompose 3s 3s +0%
fqscale 3s 2s +50%
keccak_f1600_x4_native_avx2 3s 2s +50%
keccakf1600_extract_bytes (big endian) 3s 5s -40%
keccakf1600_xor_bytes 3s 2s +50%
keccakf1600_xor_bytes (big endian) 3s 3s +0%
keccakf1600x4_extract_bytes_native 3s 3s +0%
keccakf1600x4_xor_bytes 3s 3s +0%
keccakf1600x4_xor_bytes_native 3s 3s +0%
make_hint 3s 4s -25%
mld_ct_cmask_nonzero_u32 3s 7s -57%
mld_ct_get_optblocker_u32 3s 2s +50%
mld_ct_sel_int32 3s 4s -25%
mld_keccakf1600_extract_bytes 3s 2s +50%
mld_keccakf1600x4_xor_bytes_c 3s 3s +0%
ntt_native_x86_64 3s 5s -40%
pack_sig_h 3s 3s +0%
pack_sig_z 3s 3s +0%
pack_sk_s1 3s 5s -40%
pointwise_native_aarch64 3s 3s +0%
poly_caddq 3s 4s -25%
poly_caddq_native 3s 4s -25%
poly_challenge 3s 4s -25%
poly_chknorm_native_aarch64 3s 3s +0%
poly_decompose 3s 3s +0%
poly_ntt 3s 3s +0%
poly_sub 3s 5s -40%
poly_uniform_4x 3s 2s +50%
poly_uniform_gamma1 3s 4s -25%
poly_use_hint_c 3s 5s -40%
polyeta_pack 3s 4s -25%
polyvec_matrix_expand_serial 3s 3s +0%
polyveck_ntt 3s 2s +50%
polyveck_pack_eta 3s 3s +0%
polyvecl_pointwise_acc_montgomery_c 3s 2s +50%
polyvecl_pointwise_acc_montgomery_native 3s 2s +50%
polyvecl_uniform_gamma1_serial 3s 1s +200%
polyvecl_unpack_eta 3s 3s +0%
polyw1_pack 3s 2s +50%
polyz_unpack 3s 3s +0%
polyz_unpack_17_native_aarch64 3s 3s +0%
polyz_unpack_native 3s 2s +50%
rej_eta 3s 4s -25%
rej_eta_c 3s 4s -25%
rej_uniform_native_aarch64 3s 3s +0%
shake128_squeeze 3s 2s +50%
shake256_finalize 3s 3s +0%
shake256_release 3s 2s +50%
sig_unpack_hints 3s 4s -25%
sign_open 3s 5s -40%
sign_signature_pre_hash_shake256 3s 4s -25%
sign_verify_extmu 3s 4s -25%
sk_s2hat_get_poly 3s 3s +0%
sk_t0hat_get_poly 3s 1s +200%
sys_check_capability 3s 3s +0%
unpack_pk_t1 3s 4s -25%
yvec_init 3s 3s +0%
caddq 2s 2s +0%
keccak_f1600_x1_native_aarch64 2s 4s -50%
keccak_f1600_x1_native_aarch64_v84a 2s 1s +100%
keccak_finalize 2s 4s -50%
keccak_init 2s 3s -33%
keccakf1600_permute 2s 2s +0%
keccakf1600x4_extract_bytes 2s 1s +100%
mld_ct_get_optblocker_i64 2s 1s +100%
mld_ct_get_optblocker_u8 2s 2s +0%
mld_keccakf1600x4_extract_bytes_c 2s 5s -60%
mld_value_barrier_i64 2s 1s +100%
mld_value_barrier_u8 2s 3s -33%
poly_caddq_native_aarch64 2s 1s +100%
poly_chknorm 2s 3s -33%
poly_decompose_32_native_aarch64 2s 2s +0%
poly_invntt_tomont_native 2s 5s -60%
poly_ntt_c 2s 3s -33%
poly_permute_bitrev_to_custom_optional 2s 3s -33%
poly_pointwise_montgomery_native 2s 3s -33%
poly_use_hint_native 2s 3s -33%
polyt0_pack 2s 3s -33%
polyt1_unpack 2s 2s +0%
polyveck_pack_w1 2s 4s -50%
polyvecl_pack_eta 2s 1s +100%
polyvecl_uniform_gamma1 2s 2s +0%
polyz_unpack_19_native_aarch64 2s 3s -33%
shake128_absorb 2s 3s -33%
shake128_finalize 2s 2s +0%
shake128_init 2s 1s +100%
shake128_release 2s 6s -67%
shake128x4_absorb_once 2s 4s -50%
shake256 2s 2s +0%
shake256_absorb 2s 2s +0%
shake256_init 2s 2s +0%
shake256_squeeze 2s 3s -33%
sign_signature_pre_hash_internal 2s 5s -60%
unpack_sk_s2hat 2s 2s +0%
unpack_sk_t0hat 2s 3s -33%
use_hint 2s 2s +0%
keccak_f1600_x4_native_aarch64_v84a 1s 2s -50%
keccak_f1600_x4_native_aarch64_v8a_scalar_hybrid 1s 1s +0%
keccak_f1600_x4_native_aarch64_v8a_v84a_scalar_hybrid 1s 3s -67%
keccak_squeeze 1s 2s -50%
mld_ct_abs_i32 1s 3s -67%
mld_value_barrier_u32 1s 4s -75%
montgomery_reduce 1s 4s -75%
pack_sig_c 1s 4s -75%
poly_use_hint 1s 2s -50%
poly_use_hint_native_aarch64 1s 4s -75%
shake128x4_squeezeblocks 1s 4s -75%

@oqs-bot
Copy link
Copy Markdown
Contributor

oqs-bot commented May 4, 2026

CBMC Results (ML-DSA-44)

Full Results (199 proofs)
Proof Status Current Previous Change
**TOTAL** 1684s 1674s +0.6%
polyvecl_pointwise_acc_montgomery_c 246s 249s -1%
rej_uniform_native 120s 124s -3%
mld_invntt_layer 94s 96s -2%
poly_pointwise_montgomery_c 90s 97s -7%
mld_ct_memcmp 70s 67s +4%
mld_attempt_signature_generation 57s 58s -2%
mld_ntt_layer 40s 43s -7%
polyvec_matrix_expand 29s 29s +0%
fqmul 28s 29s -3%
sign_signature_internal 28s 28s +0%
keccakf1600x4_permute_native 25s 21s +19%
sign_verify_internal 25s 27s -7%
mld_ntt_butterfly_block 18s 16s +12%
polyvecl_chknorm 18s 15s +20%
rej_uniform_c 18s 20s -10%
poly_chknorm_c 16s 17s -6%
rej_uniform 16s 16s +0%
mld_check_pct 15s 17s -12%
compute_pack_t0_t1 14s 15s -7%
poly_uniform_eta_4x 14s 14s +0%
polyt0_unpack 14s 15s -7%
poly_uniform_4x 13s 12s +8%
polyeta_unpack 13s 12s +8%
polyvec_matrix_pointwise_montgomery_yvec 13s 13s +0%
polyz_unpack_c 12s 11s +9%
mld_compute_pack_z 11s 8s +38%
poly_add 11s 11s +0%
poly_power2round 11s 10s +10%
polyvec_matrix_expand_serial 10s 11s -9%
keccak_absorb_once_x4 9s 8s +12%
mld_keccakf1600_permute_c 9s 8s +12%
poly_decompose_c 9s 8s +12%
poly_invntt_tomont_c 9s 9s +0%
keccak_absorb 8s 6s +33%
pointwise_acc_native_aarch64 8s 5s +60%
polyveck_decompose 8s 6s +33%
pointwise_acc_native_x86_64 7s 6s +17%
sign_verify_pre_hash_internal 7s 4s +75%
poly_ntt 6s 1s +500%
polyeta_pack 6s 2s +200%
polyveck_caddq 6s 2s +200%
sign 6s 7s -14%
sign_keypair 6s 6s +0%
sign_pk_from_sk 6s 5s +20%
sign_verify_extmu 6s 5s +20%
unpack_sk_t0hat 6s 4s +50%
intt_native_x86_64 5s 6s -17%
keccak_squeezeblocks_x4 5s 4s +25%
keccakf1600x4_xor_bytes_native 5s 3s +67%
pack_sk_rho_key_tr_s2 5s 4s +25%
poly_caddq 5s 3s +67%
poly_caddq_c 5s 3s +67%
poly_decompose_32_native_aarch64 5s 1s +400%
poly_invntt_tomont 5s 3s +67%
poly_ntt_native 5s 7s -29%
poly_pointwise_montgomery_native 5s 2s +150%
poly_uniform 5s 4s +25%
poly_uniform_gamma1_4x 5s 5s +0%
polyt0_pack 5s 6s -17%
polyz_pack 5s 3s +67%
polyz_unpack_native 5s 3s +67%
rej_eta_c 5s 4s +25%
sign_keypair_internal 5s 5s +0%
sign_signature_extmu 5s 4s +25%
sign_verify_pre_hash_shake256 5s 3s +67%
unpack_sk 5s 3s +67%
unpack_sk_s2hat 5s 2s +150%
decompose 4s 2s +100%
keccakf1600x4_xor_bytes 4s 2s +100%
mld_ct_cmask_nonzero_u32 4s 2s +100%
mld_ct_sel_int32 4s 2s +100%
mld_h 4s 2s +100%
mld_keccakf1600x4_extract_bytes_c 4s 4s +0%
mld_prepare_domain_separation_prefix 4s 4s +0%
montgomery_reduce 4s 3s +33%
ntt_native_aarch64 4s 4s +0%
nttunpack_native_x86_64 4s 5s -20%
pack_sig_h 4s 1s +300%
pack_sk_s1 4s 3s +33%
poly_caddq_native_aarch64 4s 4s +0%
poly_challenge 4s 4s +0%
poly_decompose_native 4s 3s +33%
poly_use_hint_c 4s 5s -20%
poly_use_hint_native 4s 6s -33%
polyt1_unpack 4s 3s +33%
polyveck_chknorm 4s 5s -20%
polyveck_unpack_eta 4s 4s +0%
polyvecl_ntt 4s 7s -43%
polyvecl_pointwise_acc_montgomery 4s 3s +33%
polyvecl_pointwise_acc_montgomery_native 4s 2s +100%
polyz_unpack 4s 3s +33%
polyz_unpack_17_native_aarch64 4s 5s -20%
rej_eta_native 4s 5s -20%
shake128_init 4s 3s +33%
sig_unpack_hints 4s 4s +0%
sign_signature 4s 6s -33%
sign_signature_pre_hash_internal 4s 3s +33%
sign_signature_pre_hash_shake256 4s 4s +0%
sk_t0hat_get_poly 4s 3s +33%
unpack_sk_s1hat 4s 3s +33%
keccak_init 3s 4s -25%
keccak_squeeze 3s 2s +50%
keccakf1600_xor_bytes 3s 2s +50%
keccakf1600x4_extract_bytes 3s 3s +0%
keccakf1600x4_extract_bytes_native 3s 3s +0%
keccakf1600x4_permute 3s 2s +50%
mld_ct_abs_i32 3s 3s +0%
mld_ct_cmask_neg_i32 3s 2s +50%
mld_keccakf1600_extract_bytes 3s 2s +50%
mld_polymat_expand_entry 3s 2s +50%
mld_value_barrier_u32 3s 1s +200%
mld_value_barrier_u8 3s 3s +0%
ntt_native_x86_64 3s 4s -25%
pack_sig_c 3s 2s +50%
pack_sig_z 3s 1s +200%
pointwise_native_aarch64 3s 2s +50%
pointwise_native_x86_64 3s 5s -40%
poly_caddq_native 3s 5s -40%
poly_chknorm_native 3s 3s +0%
poly_chknorm_native_aarch64 3s 2s +50%
poly_decompose_88_native_aarch64 3s 4s -25%
poly_permute_bitrev_to_custom_optional 3s 3s +0%
poly_pointwise_montgomery 3s 6s -50%
poly_reduce 3s 3s +0%
poly_shiftl 3s 4s -25%
poly_uniform_eta 3s 4s -25%
poly_use_hint_native_aarch64 3s 3s +0%
polyt1_pack 3s 3s +0%
polyveck_invntt_tomont 3s 5s -40%
polyveck_pack_eta 3s 3s +0%
polyveck_reduce 3s 3s +0%
polyvecl_unpack_z 3s 3s +0%
power2round 3s 1s +200%
reduce32 3s 4s -25%
rej_eta 3s 1s +200%
shake128_absorb 3s 4s -25%
shake128_release 3s 3s +0%
shake128_squeeze 3s 1s +200%
shake128x4_absorb_once 3s 3s +0%
shake128x4_squeezeblocks 3s 1s +200%
shake256_squeeze 3s 4s -25%
shake256x4_absorb_once 3s 2s +50%
sign_open 3s 4s -25%
sign_verify 3s 3s +0%
sk_s2hat_get_poly 3s 3s +0%
sys_check_capability 3s 5s -40%
yvec_get_poly 3s 2s +50%
fqscale 2s 2s +0%
intt_native_aarch64 2s 4s -50%
keccak_f1600_x1_native_aarch64 2s 1s +100%
keccak_f1600_x4_native_aarch64_v84a 2s 2s +0%
keccak_f1600_x4_native_aarch64_v8a_scalar_hybrid 2s 2s +0%
keccak_f1600_x4_native_avx2 2s 2s +0%
keccak_finalize 2s 2s +0%
keccakf1600_extract_bytes (big endian) 2s 4s -50%
keccakf1600_permute 2s 2s +0%
keccakf1600_permute_native 2s 1s +100%
make_hint 2s 2s +0%
mld_ct_cmask_nonzero_u8 2s 5s -60%
mld_ct_get_optblocker_u32 2s 3s -33%
mld_ct_get_optblocker_u8 2s 1s +100%
mld_keccakf1600x4_xor_bytes_c 2s 2s +0%
mld_sample_s1_s2 2s 4s -50%
mld_sample_s1_s2_serial 2s 3s -33%
poly_chknorm 2s 4s -50%
poly_decompose 2s 5s -60%
poly_invntt_tomont_native 2s 4s -50%
poly_ntt_c 2s 3s -33%
poly_permute_bitrev_to_custom_optional_native 2s 3s -33%
poly_sub 2s 2s +0%
poly_uniform_gamma1 2s 3s -33%
poly_use_hint 2s 2s +0%
polyvec_matrix_pointwise_montgomery_row 2s 3s -33%
polyveck_pack_w1 2s 3s -33%
polyvecl_pack_eta 2s 3s -33%
polyvecl_uniform_gamma1 2s 2s +0%
polyvecl_uniform_gamma1_serial 2s 3s -33%
polyvecl_unpack_eta 2s 1s +100%
polyw1_pack 2s 3s -33%
rej_uniform_native_aarch64 2s 3s -33%
shake256 2s 3s -33%
shake256_absorb 2s 3s -33%
shake256_finalize 2s 1s +100%
shake256_init 2s 3s -33%
shake256_release 2s 1s +100%
shake256x4_squeezeblocks 2s 3s -33%
sk_s1hat_get_poly 2s 4s -50%
unpack_pk_t1 2s 2s +0%
use_hint 2s 5s -60%
yvec_init 2s 4s -50%
caddq 1s 4s -75%
keccak_f1600_x1_native_aarch64_v84a 1s 2s -50%
keccak_f1600_x4_native_aarch64_v8a_v84a_scalar_hybrid 1s 2s -50%
keccakf1600_xor_bytes (big endian) 1s 2s -50%
mld_ct_get_optblocker_i64 1s 4s -75%
mld_value_barrier_i64 1s 3s -67%
polyveck_ntt 1s 3s -67%
polyz_unpack_19_native_aarch64 1s 5s -80%
shake128_finalize 1s 3s -67%

@oqs-bot
Copy link
Copy Markdown
Contributor

oqs-bot commented May 4, 2026

CBMC Results (ML-DSA-87)

Full Results (199 proofs)
Proof Status Current Previous Change
**TOTAL** 2074s 2060s +0.7%
polyvecl_pointwise_acc_montgomery_c 277s 261s +6%
polyvec_matrix_expand 176s 177s -1%
rej_uniform_native 129s 128s +1%
mld_attempt_signature_generation 105s 102s +3%
mld_invntt_layer 101s 93s +9%
poly_pointwise_montgomery_c 101s 96s +5%
sign_verify_internal 89s 87s +2%
mld_ct_memcmp 70s 70s +0%
sign_signature_internal 56s 52s +8%
mld_ntt_layer 45s 45s +0%
polyvec_matrix_expand_serial 39s 40s -3%
fqmul 29s 26s +12%
compute_pack_t0_t1 24s 25s -4%
keccakf1600x4_permute_native 24s 23s +4%
polyvec_matrix_pointwise_montgomery_yvec 22s 21s +5%
rej_uniform_c 20s 17s +18%
mld_ntt_butterfly_block 18s 15s +20%
polyt0_unpack 17s 16s +6%
poly_chknorm_c 16s 16s +0%
rej_uniform 16s 17s -6%
poly_uniform_eta_4x 14s 15s -7%
polyeta_unpack 14s 14s +0%
mld_check_pct 13s 16s -19%
poly_uniform_4x 13s 10s +30%
polyveck_decompose 13s 11s +18%
keccak_absorb_once_x4 11s 10s +10%
poly_add 11s 12s -8%
polyveck_invntt_tomont 11s 10s +10%
polyveck_caddq 10s 9s +11%
poly_invntt_tomont_c 9s 7s +29%
polyveck_ntt 9s 9s +0%
mld_compute_pack_z 8s 9s -11%
pointwise_acc_native_aarch64 8s 5s +60%
poly_power2round 8s 10s -20%
sign 8s 8s +0%
keccak_absorb 7s 5s +40%
pointwise_acc_native_x86_64 7s 7s +0%
polyveck_chknorm 7s 8s -12%
polyvecl_chknorm 7s 6s +17%
polyvecl_ntt 7s 7s +0%
keccak_f1600_x4_native_avx2 6s 3s +100%
mld_keccakf1600_permute_c 6s 8s -25%
mld_sample_s1_s2 6s 5s +20%
mld_sample_s1_s2_serial 6s 4s +50%
polyt0_pack 6s 3s +100%
polyvecl_uniform_gamma1 6s 4s +50%
polyvecl_unpack_z 6s 2s +200%
rej_eta_c 6s 3s +100%
fqscale 5s 2s +150%
intt_native_aarch64 5s 5s +0%
mld_keccakf1600x4_xor_bytes_c 5s 3s +67%
pack_sig_c 5s 2s +150%
poly_caddq_native_aarch64 5s 3s +67%
poly_challenge 5s 3s +67%
poly_shiftl 5s 4s +25%
poly_use_hint 5s 5s +0%
polyvec_matrix_pointwise_montgomery_row 5s 3s +67%
polyveck_unpack_eta 5s 4s +25%
polyvecl_unpack_eta 5s 6s -17%
polyz_unpack_c 5s 7s -29%
rej_eta 5s 3s +67%
shake256_init 5s 2s +150%
sign_keypair_internal 5s 4s +25%
sign_pk_from_sk 5s 6s -17%
sign_verify_pre_hash_internal 5s 2s +150%
sign_verify_pre_hash_shake256 5s 6s -17%
sk_t0hat_get_poly 5s 3s +67%
unpack_sk 5s 4s +25%
keccak_f1600_x1_native_aarch64 4s 3s +33%
keccak_squeezeblocks_x4 4s 4s +0%
keccakf1600x4_xor_bytes 4s 3s +33%
mld_polymat_expand_entry 4s 3s +33%
pack_sk_rho_key_tr_s2 4s 3s +33%
pack_sk_s1 4s 4s +0%
pointwise_native_x86_64 4s 4s +0%
poly_decompose_32_native_aarch64 4s 3s +33%
poly_ntt_c 4s 3s +33%
poly_uniform_eta 4s 2s +100%
poly_uniform_gamma1_4x 4s 5s -20%
poly_use_hint_c 4s 4s +0%
polyveck_pack_w1 4s 3s +33%
polyveck_reduce 4s 1s +300%
polyvecl_pointwise_acc_montgomery_native 4s 3s +33%
polyz_unpack_17_native_aarch64 4s 6s -33%
power2round 4s 2s +100%
rej_eta_native 4s 4s +0%
shake128_release 4s 3s +33%
sign_keypair 4s 5s -20%
sign_signature 4s 3s +33%
sign_signature_pre_hash_internal 4s 6s -33%
sign_verify 4s 6s -33%
unpack_sk_s1hat 4s 4s +0%
yvec_init 4s 4s +0%
intt_native_x86_64 3s 5s -40%
keccak_f1600_x1_native_aarch64_v84a 3s 2s +50%
keccak_f1600_x4_native_aarch64_v84a 3s 3s +0%
keccak_f1600_x4_native_aarch64_v8a_v84a_scalar_hybrid 3s 2s +50%
keccak_finalize 3s 3s +0%
keccakf1600_extract_bytes (big endian) 3s 4s -25%
keccakf1600_xor_bytes 3s 2s +50%
keccakf1600x4_extract_bytes 3s 3s +0%
make_hint 3s 6s -50%
mld_ct_cmask_nonzero_u32 3s 3s +0%
mld_ct_cmask_nonzero_u8 3s 3s +0%
mld_ct_get_optblocker_i64 3s 1s +200%
mld_ct_get_optblocker_u32 3s 2s +50%
mld_ct_get_optblocker_u8 3s 3s +0%
mld_prepare_domain_separation_prefix 3s 5s -40%
mld_value_barrier_u32 3s 1s +200%
montgomery_reduce 3s 2s +50%
ntt_native_aarch64 3s 3s +0%
pack_sig_h 3s 3s +0%
pointwise_native_aarch64 3s 3s +0%
poly_caddq 3s 3s +0%
poly_caddq_c 3s 4s -25%
poly_chknorm 3s 6s -50%
poly_chknorm_native 3s 3s +0%
poly_decompose_88_native_aarch64 3s 3s +0%
poly_decompose_c 3s 3s +0%
poly_decompose_native 3s 4s -25%
poly_invntt_tomont 3s 2s +50%
poly_invntt_tomont_native 3s 5s -40%
poly_ntt 3s 3s +0%
poly_permute_bitrev_to_custom_optional_native 3s 4s -25%
poly_pointwise_montgomery_native 3s 3s +0%
poly_uniform 3s 7s -57%
poly_uniform_gamma1 3s 2s +50%
poly_use_hint_native_aarch64 3s 2s +50%
polyeta_pack 3s 3s +0%
polyt1_pack 3s 2s +50%
polyt1_unpack 3s 2s +50%
polyveck_pack_eta 3s 3s +0%
polyvecl_pointwise_acc_montgomery 3s 6s -50%
polyvecl_uniform_gamma1_serial 3s 4s -25%
reduce32 3s 2s +50%
rej_uniform_native_aarch64 3s 7s -57%
shake128_absorb 3s 4s -25%
shake128_squeeze 3s 3s +0%
shake128x4_absorb_once 3s 2s +50%
shake256_absorb 3s 2s +50%
shake256_finalize 3s 3s +0%
shake256x4_absorb_once 3s 2s +50%
sign_signature_extmu 3s 5s -40%
sign_signature_pre_hash_shake256 3s 5s -40%
sign_verify_extmu 3s 4s -25%
sk_s1hat_get_poly 3s 4s -25%
unpack_pk_t1 3s 1s +200%
unpack_sk_s2hat 3s 4s -25%
unpack_sk_t0hat 3s 5s -40%
use_hint 3s 5s -40%
yvec_get_poly 3s 6s -50%
caddq 2s 4s -50%
decompose 2s 4s -50%
keccak_init 2s 2s +0%
keccak_squeeze 2s 3s -33%
keccakf1600_permute 2s 4s -50%
keccakf1600_permute_native 2s 3s -33%
keccakf1600_xor_bytes (big endian) 2s 3s -33%
keccakf1600x4_extract_bytes_native 2s 5s -60%
keccakf1600x4_permute 2s 5s -60%
keccakf1600x4_xor_bytes_native 2s 2s +0%
mld_ct_cmask_neg_i32 2s 3s -33%
mld_ct_sel_int32 2s 1s +100%
mld_keccakf1600_extract_bytes 2s 2s +0%
mld_value_barrier_i64 2s 3s -33%
ntt_native_x86_64 2s 3s -33%
pack_sig_z 2s 3s -33%
poly_chknorm_native_aarch64 2s 2s +0%
poly_decompose 2s 5s -60%
poly_ntt_native 2s 5s -60%
poly_pointwise_montgomery 2s 2s +0%
poly_reduce 2s 2s +0%
poly_sub 2s 5s -60%
poly_use_hint_native 2s 4s -50%
polyw1_pack 2s 4s -50%
polyz_pack 2s 2s +0%
polyz_unpack_19_native_aarch64 2s 4s -50%
shake128x4_squeezeblocks 2s 4s -50%
shake256 2s 3s -33%
shake256_release 2s 2s +0%
shake256_squeeze 2s 4s -50%
shake256x4_squeezeblocks 2s 1s +100%
sig_unpack_hints 2s 5s -60%
sign_open 2s 3s -33%
sk_s2hat_get_poly 2s 3s -33%
sys_check_capability 2s 4s -50%
keccak_f1600_x4_native_aarch64_v8a_scalar_hybrid 1s 2s -50%
mld_ct_abs_i32 1s 3s -67%
mld_h 1s 2s -50%
mld_keccakf1600x4_extract_bytes_c 1s 3s -67%
mld_value_barrier_u8 1s 3s -67%
nttunpack_native_x86_64 1s 3s -67%
poly_caddq_native 1s 3s -67%
poly_permute_bitrev_to_custom_optional 1s 3s -67%
polyvecl_pack_eta 1s 3s -67%
polyz_unpack 1s 3s -67%
polyz_unpack_native 1s 2s -50%
shake128_finalize 1s 1s +0%
shake128_init 1s 3s -67%

@oqs-bot
Copy link
Copy Markdown
Contributor

oqs-bot commented May 4, 2026

CBMC Results (ML-DSA-65)

Full Results (199 proofs)
Proof Status Current Previous Change
**TOTAL** 2043s 2016s +1.3%
polyvecl_pointwise_acc_montgomery_c 343s 319s +8%
polyvec_matrix_expand 156s 154s +1%
rej_uniform_native 128s 133s -4%
poly_pointwise_montgomery_c 105s 103s +2%
mld_invntt_layer 98s 97s +1%
mld_ct_memcmp 76s 76s +0%
mld_attempt_signature_generation 72s 70s +3%
sign_verify_internal 72s 70s +3%
mld_ntt_layer 46s 45s +2%
sign_signature_internal 46s 47s -2%
fqmul 30s 27s +11%
polyvec_matrix_pointwise_montgomery_yvec 30s 29s +3%
keccakf1600x4_permute_native 24s 23s +4%
polyvec_matrix_expand_serial 24s 25s -4%
rej_uniform_c 20s 22s -9%
poly_chknorm_c 17s 16s +6%
rej_uniform 17s 17s +0%
compute_pack_t0_t1 15s 12s +25%
mld_ntt_butterfly_block 15s 18s -17%
poly_uniform_4x 15s 12s +25%
mld_check_pct 14s 14s +0%
polyt0_unpack 14s 16s -12%
polyveck_decompose 14s 15s -7%
poly_add 13s 12s +8%
poly_uniform_eta_4x 13s 13s +0%
polyveck_chknorm 12s 11s +9%
keccak_absorb_once_x4 11s 9s +22%
sign 10s 12s -17%
poly_invntt_tomont_c 9s 10s -10%
poly_power2round 9s 9s +0%
polyveck_invntt_tomont 9s 9s +0%
mld_compute_pack_z 8s 7s +14%
pointwise_acc_native_aarch64 8s 6s +33%
polyveck_caddq 8s 7s +14%
keccak_absorb 7s 7s +0%
mld_keccakf1600_permute_c 7s 6s +17%
pointwise_acc_native_x86_64 7s 6s +17%
poly_decompose_c 7s 8s -12%
mld_sample_s1_s2 6s 4s +50%
poly_caddq_c 6s 5s +20%
poly_decompose_native 6s 5s +20%
polyveck_ntt 6s 7s -14%
sign_keypair 6s 5s +20%
sign_pk_from_sk 6s 7s -14%
keccakf1600x4_permute 5s 3s +67%
mld_sample_s1_s2_serial 5s 4s +25%
poly_challenge 5s 5s +0%
poly_uniform 5s 4s +25%
poly_uniform_eta 5s 5s +0%
poly_use_hint 5s 3s +67%
polyt1_unpack 5s 4s +25%
polyvecl_ntt 5s 9s -44%
polyvecl_pack_eta 5s 4s +25%
polyvecl_pointwise_acc_montgomery_native 5s 4s +25%
polyvecl_uniform_gamma1 5s 5s +0%
polyz_unpack_19_native_aarch64 5s 5s +0%
shake128_init 5s 4s +25%
sign_keypair_internal 5s 2s +150%
sign_open 5s 5s +0%
sign_verify 5s 6s -17%
sign_verify_pre_hash_shake256 5s 2s +150%
sk_t0hat_get_poly 5s 2s +150%
sys_check_capability 5s 4s +25%
keccak_squeeze 4s 4s +0%
keccak_squeezeblocks_x4 4s 4s +0%
keccakf1600_extract_bytes (big endian) 4s 3s +33%
keccakf1600x4_extract_bytes_native 4s 3s +33%
keccakf1600x4_xor_bytes_native 4s 5s -20%
mld_ct_cmask_nonzero_u8 4s 3s +33%
mld_ct_get_optblocker_u32 4s 2s +100%
mld_polymat_expand_entry 4s 2s +100%
pack_sk_rho_key_tr_s2 4s 5s -20%
poly_caddq_native 4s 2s +100%
poly_chknorm_native_aarch64 4s 4s +0%
poly_decompose 4s 2s +100%
poly_decompose_88_native_aarch64 4s 4s +0%
poly_reduce 4s 2s +100%
poly_uniform_gamma1_4x 4s 5s -20%
poly_use_hint_native_aarch64 4s 2s +100%
polyeta_unpack 4s 4s +0%
polyvec_matrix_pointwise_montgomery_row 4s 3s +33%
polyveck_pack_w1 4s 4s +0%
polyvecl_chknorm 4s 5s -20%
polyvecl_pointwise_acc_montgomery 4s 4s +0%
polyvecl_unpack_z 4s 3s +33%
polyz_unpack_native 4s 2s +100%
rej_eta_c 4s 3s +33%
rej_eta_native 4s 4s +0%
shake128x4_absorb_once 4s 3s +33%
shake256_absorb 4s 2s +100%
sign_signature_extmu 4s 3s +33%
sign_verify_pre_hash_internal 4s 4s +0%
sk_s2hat_get_poly 4s 4s +0%
unpack_sk 4s 3s +33%
unpack_sk_t0hat 4s 5s -20%
caddq 3s 2s +50%
decompose 3s 2s +50%
intt_native_aarch64 3s 3s +0%
keccak_f1600_x1_native_aarch64 3s 5s -40%
keccak_f1600_x1_native_aarch64_v84a 3s 3s +0%
keccak_f1600_x4_native_avx2 3s 2s +50%
keccakf1600_xor_bytes 3s 2s +50%
keccakf1600_xor_bytes (big endian) 3s 5s -40%
keccakf1600x4_extract_bytes 3s 3s +0%
mld_ct_abs_i32 3s 1s +200%
mld_ct_cmask_nonzero_u32 3s 1s +200%
mld_ct_sel_int32 3s 3s +0%
mld_h 3s 4s -25%
mld_keccakf1600_extract_bytes 3s 2s +50%
mld_value_barrier_i64 3s 2s +50%
mld_value_barrier_u32 3s 2s +50%
ntt_native_aarch64 3s 2s +50%
ntt_native_x86_64 3s 4s -25%
pack_sig_h 3s 4s -25%
pack_sk_s1 3s 2s +50%
pointwise_native_aarch64 3s 3s +0%
pointwise_native_x86_64 3s 6s -50%
poly_caddq 3s 3s +0%
poly_caddq_native_aarch64 3s 2s +50%
poly_chknorm_native 3s 5s -40%
poly_invntt_tomont_native 3s 3s +0%
poly_ntt 3s 2s +50%
poly_ntt_c 3s 3s +0%
poly_permute_bitrev_to_custom_optional 3s 5s -40%
poly_permute_bitrev_to_custom_optional_native 3s 4s -25%
poly_pointwise_montgomery 3s 3s +0%
poly_shiftl 3s 3s +0%
poly_sub 3s 3s +0%
poly_use_hint_native 3s 3s +0%
polyeta_pack 3s 3s +0%
polyt0_pack 3s 3s +0%
polyt1_pack 3s 4s -25%
polyvecl_unpack_eta 3s 3s +0%
polyz_pack 3s 2s +50%
polyz_unpack_17_native_aarch64 3s 3s +0%
polyz_unpack_c 3s 2s +50%
rej_eta 3s 3s +0%
rej_uniform_native_aarch64 3s 2s +50%
shake128_finalize 3s 2s +50%
shake128_squeeze 3s 3s +0%
shake256 3s 4s -25%
shake256_finalize 3s 1s +200%
shake256_squeeze 3s 1s +200%
sig_unpack_hints 3s 3s +0%
sign_signature 3s 5s -40%
sign_verify_extmu 3s 7s -57%
sk_s1hat_get_poly 3s 4s -25%
unpack_pk_t1 3s 4s -25%
unpack_sk_s2hat 3s 3s +0%
yvec_init 3s 2s +50%
fqscale 2s 3s -33%
keccak_f1600_x4_native_aarch64_v84a 2s 2s +0%
keccak_f1600_x4_native_aarch64_v8a_scalar_hybrid 2s 1s +100%
keccak_f1600_x4_native_aarch64_v8a_v84a_scalar_hybrid 2s 1s +100%
keccak_finalize 2s 3s -33%
keccak_init 2s 2s +0%
keccakf1600_permute 2s 1s +100%
keccakf1600_permute_native 2s 3s -33%
keccakf1600x4_xor_bytes 2s 2s +0%
mld_ct_cmask_neg_i32 2s 3s -33%
mld_ct_get_optblocker_u8 2s 1s +100%
mld_keccakf1600x4_xor_bytes_c 2s 2s +0%
mld_prepare_domain_separation_prefix 2s 5s -60%
mld_value_barrier_u8 2s 3s -33%
montgomery_reduce 2s 2s +0%
nttunpack_native_x86_64 2s 2s +0%
pack_sig_c 2s 1s +100%
pack_sig_z 2s 2s +0%
poly_chknorm 2s 4s -50%
poly_invntt_tomont 2s 4s -50%
poly_ntt_native 2s 4s -50%
poly_pointwise_montgomery_native 2s 4s -50%
poly_uniform_gamma1 2s 2s +0%
poly_use_hint_c 2s 3s -33%
polyveck_pack_eta 2s 3s -33%
polyveck_reduce 2s 4s -50%
polyveck_unpack_eta 2s 2s +0%
polyvecl_uniform_gamma1_serial 2s 5s -60%
polyz_unpack 2s 5s -60%
power2round 2s 3s -33%
reduce32 2s 2s +0%
shake128_absorb 2s 3s -33%
shake128_release 2s 1s +100%
shake128x4_squeezeblocks 2s 1s +100%
shake256_init 2s 2s +0%
shake256x4_absorb_once 2s 3s -33%
shake256x4_squeezeblocks 2s 3s -33%
sign_signature_pre_hash_internal 2s 3s -33%
sign_signature_pre_hash_shake256 2s 3s -33%
unpack_sk_s1hat 2s 3s -33%
yvec_get_poly 2s 3s -33%
intt_native_x86_64 1s 5s -80%
make_hint 1s 4s -75%
mld_ct_get_optblocker_i64 1s 2s -50%
mld_keccakf1600x4_extract_bytes_c 1s 4s -75%
poly_decompose_32_native_aarch64 1s 2s -50%
polyw1_pack 1s 6s -83%
shake256_release 1s 2s -50%
use_hint 1s 3s -67%

Wraps bench binaries on x86_64 EC2 runners in `setarch --addr-no-randomize`
to work around benchmarking instability.

Signed-off-by: Matthias J. Kannwischer <matthias@zerorisc.com>
@mkannwischer mkannwischer force-pushed the experiment/main-with-setarch branch from 478e7c6 to 11b8908 Compare May 22, 2026 02:47
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 11b8908 Previous: 6c13542 Ratio
ML-DSA-44 verify 237407 cycles 227773 cycles 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants