Align bench iteration macros between component and API benchmarks#1121
Conversation
CBMC Results (ML-DSA-87, REDUCE-RAM)Full Results (198 proofs)
|
CBMC Results (ML-DSA-44, REDUCE-RAM)Full Results (198 proofs)
|
CBMC Results (ML-DSA-65, REDUCE-RAM)Full Results (198 proofs)
|
CBMC Results (ML-DSA-87)Full Results (198 proofs)
|
CBMC Results (ML-DSA-44)Full Results (198 proofs)
|
CBMC Results (ML-DSA-65)Full Results (198 proofs)
|
The API-level benchmarks test/bench/bench_mldsa.c use
the macros MLD_BENCHMARK_{NTESTS, NWARMUP, NITERATIONS}
to control the setup and iterations to be conducted for
the benchmark.
Inconsistently, the component-level benchmarks use plain
NWARMUP, NITERATIONS, NTESTS for the benchmark configuration.
In particular, platform-specific adjustments as done e.g. in
test/baremetal/platform/m33-an524/platform.mk do not apply
to the component benchmarks.
Adjust the component-level benchmarks to use the same macros
MLD_BENCHMARK_{NWARMUP, NITERATIONS, NTESTS} to configure the
setup and iteration count for the component benchmarks.
Signed-off-by: Hanno Becker <beckphan@amazon.co.uk>
f977a8d to
f881cbb
Compare
There was a problem hiding this comment.
Mac Mini (M1, 2020) benchmarks (opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
46536 cycles |
46506 cycles |
1.00 |
ML-DSA-44 sign |
131072 cycles |
131094 cycles |
1.00 |
ML-DSA-44 verify |
47346 cycles |
47318 cycles |
1.00 |
ML-DSA-65 keypair |
81689 cycles |
81694 cycles |
1.00 |
ML-DSA-65 sign |
215387 cycles |
215403 cycles |
1.00 |
ML-DSA-65 verify |
79307 cycles |
79306 cycles |
1.00 |
ML-DSA-87 keypair |
132416 cycles |
132423 cycles |
1.00 |
ML-DSA-87 sign |
277445 cycles |
277327 cycles |
1.00 |
ML-DSA-87 verify |
134234 cycles |
134241 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Mac Mini (M1, 2020) benchmarks (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
112817 cycles |
112751 cycles |
1.00 |
ML-DSA-44 sign |
401105 cycles |
400893 cycles |
1.00 |
ML-DSA-44 verify |
120189 cycles |
120108 cycles |
1.00 |
ML-DSA-65 keypair |
192868 cycles |
192871 cycles |
1.00 |
ML-DSA-65 sign |
649934 cycles |
649926 cycles |
1.00 |
ML-DSA-65 verify |
192957 cycles |
192954 cycles |
1.00 |
ML-DSA-87 keypair |
318775 cycles |
318773 cycles |
1.00 |
ML-DSA-87 sign |
828794 cycles |
828946 cycles |
1.00 |
ML-DSA-87 verify |
326669 cycles |
326677 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 4th gen (c7i)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
45354 cycles |
45346 cycles |
1.00 |
ML-DSA-44 sign |
136120 cycles |
136065 cycles |
1.00 |
ML-DSA-44 verify |
47235 cycles |
47253 cycles |
1.00 |
ML-DSA-65 keypair |
78792 cycles |
78910 cycles |
1.00 |
ML-DSA-65 sign |
222552 cycles |
222709 cycles |
1.00 |
ML-DSA-65 verify |
77747 cycles |
77580 cycles |
1.00 |
ML-DSA-87 keypair |
124856 cycles |
125286 cycles |
1.00 |
ML-DSA-87 sign |
275576 cycles |
277479 cycles |
0.99 |
ML-DSA-87 verify |
122053 cycles |
123025 cycles |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 4th gen (c7i) (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
94373 cycles |
94253 cycles |
1.00 |
ML-DSA-44 sign |
330090 cycles |
329726 cycles |
1.00 |
ML-DSA-44 verify |
98940 cycles |
98817 cycles |
1.00 |
ML-DSA-65 keypair |
161673 cycles |
161747 cycles |
1.00 |
ML-DSA-65 sign |
538541 cycles |
539015 cycles |
1.00 |
ML-DSA-65 verify |
160440 cycles |
160331 cycles |
1.00 |
ML-DSA-87 keypair |
264347 cycles |
264318 cycles |
1.00 |
ML-DSA-87 sign |
694947 cycles |
694782 cycles |
1.00 |
ML-DSA-87 verify |
265709 cycles |
266187 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 3rd gen (c6a)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
56304 cycles |
57272 cycles |
0.98 |
ML-DSA-44 sign |
167628 cycles |
167121 cycles |
1.00 |
ML-DSA-44 verify |
59425 cycles |
58441 cycles |
1.02 |
ML-DSA-65 keypair |
98811 cycles |
96775 cycles |
1.02 |
ML-DSA-65 sign |
270632 cycles |
271203 cycles |
1.00 |
ML-DSA-65 verify |
99283 cycles |
97802 cycles |
1.02 |
ML-DSA-87 keypair |
157542 cycles |
161584 cycles |
0.97 |
ML-DSA-87 sign |
332648 cycles |
334686 cycles |
0.99 |
ML-DSA-87 verify |
157179 cycles |
153662 cycles |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton2
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
112538 cycles |
112432 cycles |
1.00 |
ML-DSA-44 sign |
354658 cycles |
354864 cycles |
1.00 |
ML-DSA-44 verify |
117243 cycles |
117286 cycles |
1.00 |
ML-DSA-65 keypair |
195576 cycles |
194493 cycles |
1.01 |
ML-DSA-65 sign |
587368 cycles |
585017 cycles |
1.00 |
ML-DSA-65 verify |
194148 cycles |
193050 cycles |
1.01 |
ML-DSA-87 keypair |
321264 cycles |
321235 cycles |
1.00 |
ML-DSA-87 sign |
750838 cycles |
749984 cycles |
1.00 |
ML-DSA-87 verify |
318976 cycles |
318304 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 3rd gen (c6a) (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
134634 cycles |
133896 cycles |
1.01 |
ML-DSA-44 sign |
525739 cycles |
523758 cycles |
1.00 |
ML-DSA-44 verify |
147571 cycles |
147252 cycles |
1.00 |
ML-DSA-65 keypair |
223061 cycles |
223126 cycles |
1.00 |
ML-DSA-65 sign |
850113 cycles |
848868 cycles |
1.00 |
ML-DSA-65 verify |
233006 cycles |
232502 cycles |
1.00 |
ML-DSA-87 keypair |
372504 cycles |
372442 cycles |
1.00 |
ML-DSA-87 sign |
1074391 cycles |
1074448 cycles |
1.00 |
ML-DSA-87 verify |
384991 cycles |
385421 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
820695 cycles |
820103 cycles |
1.00 |
ML-DSA-44 sign |
3223079 cycles |
3223936 cycles |
1.00 |
ML-DSA-44 verify |
917347 cycles |
916987 cycles |
1.00 |
ML-DSA-65 keypair |
1391016 cycles |
1391801 cycles |
1.00 |
ML-DSA-65 sign |
5232017 cycles |
5231007 cycles |
1.00 |
ML-DSA-65 verify |
1465063 cycles |
1465182 cycles |
1.00 |
ML-DSA-87 keypair |
2300073 cycles |
2300807 cycles |
1.00 |
ML-DSA-87 sign |
6618541 cycles |
6620998 cycles |
1.00 |
ML-DSA-87 verify |
2407881 cycles |
2409364 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton4
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
67205 cycles |
67371 cycles |
1.00 |
ML-DSA-44 sign |
201228 cycles |
201270 cycles |
1.00 |
ML-DSA-44 verify |
70308 cycles |
70332 cycles |
1.00 |
ML-DSA-65 keypair |
119184 cycles |
119547 cycles |
1.00 |
ML-DSA-65 sign |
328412 cycles |
328462 cycles |
1.00 |
ML-DSA-65 verify |
116952 cycles |
116947 cycles |
1.00 |
ML-DSA-87 keypair |
196429 cycles |
196660 cycles |
1.00 |
ML-DSA-87 sign |
424473 cycles |
424654 cycles |
1.00 |
ML-DSA-87 verify |
193192 cycles |
192979 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 4th gen (c7a)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
47144 cycles |
47594 cycles |
0.99 |
ML-DSA-44 sign |
144490 cycles |
144788 cycles |
1.00 |
ML-DSA-44 verify |
50142 cycles |
50010 cycles |
1.00 |
ML-DSA-65 keypair |
83440 cycles |
85833 cycles |
0.97 |
ML-DSA-65 sign |
229971 cycles |
234204 cycles |
0.98 |
ML-DSA-65 verify |
83548 cycles |
84326 cycles |
0.99 |
ML-DSA-87 keypair |
132521 cycles |
131180 cycles |
1.01 |
ML-DSA-87 sign |
283563 cycles |
281915 cycles |
1.01 |
ML-DSA-87 verify |
130277 cycles |
129852 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton2 (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
213352 cycles |
212228 cycles |
1.01 |
ML-DSA-44 sign |
757236 cycles |
758008 cycles |
1.00 |
ML-DSA-44 verify |
229502 cycles |
229769 cycles |
1.00 |
ML-DSA-65 keypair |
379082 cycles |
378353 cycles |
1.00 |
ML-DSA-65 sign |
1242005 cycles |
1241044 cycles |
1.00 |
ML-DSA-65 verify |
372582 cycles |
372526 cycles |
1.00 |
ML-DSA-87 keypair |
602443 cycles |
604041 cycles |
1.00 |
ML-DSA-87 sign |
1581724 cycles |
1582156 cycles |
1.00 |
ML-DSA-87 verify |
618957 cycles |
618533 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton4 (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
128481 cycles |
128480 cycles |
1.00 |
ML-DSA-44 sign |
445187 cycles |
444925 cycles |
1.00 |
ML-DSA-44 verify |
136699 cycles |
136555 cycles |
1.00 |
ML-DSA-65 keypair |
220328 cycles |
220141 cycles |
1.00 |
ML-DSA-65 sign |
717915 cycles |
718690 cycles |
1.00 |
ML-DSA-65 verify |
220939 cycles |
221126 cycles |
1.00 |
ML-DSA-87 keypair |
365943 cycles |
365459 cycles |
1.00 |
ML-DSA-87 sign |
918892 cycles |
917854 cycles |
1.00 |
ML-DSA-87 verify |
371129 cycles |
371453 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 3rd gen (c6i)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
62059 cycles |
62444 cycles |
0.99 |
ML-DSA-44 sign |
191990 cycles |
192831 cycles |
1.00 |
ML-DSA-44 verify |
66619 cycles |
66957 cycles |
0.99 |
ML-DSA-65 keypair |
110980 cycles |
111136 cycles |
1.00 |
ML-DSA-65 sign |
317964 cycles |
316953 cycles |
1.00 |
ML-DSA-65 verify |
110537 cycles |
110743 cycles |
1.00 |
ML-DSA-87 keypair |
172501 cycles |
173753 cycles |
0.99 |
ML-DSA-87 sign |
382178 cycles |
388841 cycles |
0.98 |
ML-DSA-87 verify |
171836 cycles |
175622 cycles |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
AMD EPYC 4th gen (c7a) (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
119319 cycles |
119001 cycles |
1.00 |
ML-DSA-44 sign |
447123 cycles |
447144 cycles |
1.00 |
ML-DSA-44 verify |
129249 cycles |
129064 cycles |
1.00 |
ML-DSA-65 keypair |
201912 cycles |
201605 cycles |
1.00 |
ML-DSA-65 sign |
720612 cycles |
718902 cycles |
1.00 |
ML-DSA-65 verify |
207616 cycles |
206881 cycles |
1.00 |
ML-DSA-87 keypair |
333145 cycles |
333124 cycles |
1.00 |
ML-DSA-87 sign |
914136 cycles |
913840 cycles |
1.00 |
ML-DSA-87 verify |
341100 cycles |
341881 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Intel Xeon 3rd gen (c6i) (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
150784 cycles |
151004 cycles |
1.00 |
ML-DSA-44 sign |
547158 cycles |
544494 cycles |
1.00 |
ML-DSA-44 verify |
163400 cycles |
163854 cycles |
1.00 |
ML-DSA-65 keypair |
258213 cycles |
259024 cycles |
1.00 |
ML-DSA-65 sign |
903680 cycles |
900756 cycles |
1.00 |
ML-DSA-65 verify |
265826 cycles |
265948 cycles |
1.00 |
ML-DSA-87 keypair |
426380 cycles |
426390 cycles |
1.00 |
ML-DSA-87 sign |
1134123 cycles |
1145772 cycles |
0.99 |
ML-DSA-87 verify |
437879 cycles |
439689 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
112415 cycles |
112474 cycles |
1.00 |
ML-DSA-44 sign |
354818 cycles |
354354 cycles |
1.00 |
ML-DSA-44 verify |
117303 cycles |
117102 cycles |
1.00 |
ML-DSA-65 keypair |
194462 cycles |
194672 cycles |
1.00 |
ML-DSA-65 sign |
585061 cycles |
584415 cycles |
1.00 |
ML-DSA-65 verify |
193016 cycles |
193002 cycles |
1.00 |
ML-DSA-87 keypair |
320832 cycles |
321262 cycles |
1.00 |
ML-DSA-87 sign |
748674 cycles |
749940 cycles |
1.00 |
ML-DSA-87 verify |
317984 cycles |
318684 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton3
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
71569 cycles |
71496 cycles |
1.00 |
ML-DSA-44 sign |
211533 cycles |
211355 cycles |
1.00 |
ML-DSA-44 verify |
74930 cycles |
74921 cycles |
1.00 |
ML-DSA-65 keypair |
125975 cycles |
125886 cycles |
1.00 |
ML-DSA-65 sign |
347667 cycles |
347953 cycles |
1.00 |
ML-DSA-65 verify |
124033 cycles |
124034 cycles |
1.00 |
ML-DSA-87 keypair |
206297 cycles |
206663 cycles |
1.00 |
ML-DSA-87 sign |
442976 cycles |
447428 cycles |
0.99 |
ML-DSA-87 verify |
204275 cycles |
204132 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Graviton3 (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
137947 cycles |
137985 cycles |
1.00 |
ML-DSA-44 sign |
481931 cycles |
481661 cycles |
1.00 |
ML-DSA-44 verify |
148906 cycles |
148702 cycles |
1.00 |
ML-DSA-65 keypair |
240846 cycles |
240625 cycles |
1.00 |
ML-DSA-65 sign |
784715 cycles |
785039 cycles |
1.00 |
ML-DSA-65 verify |
240762 cycles |
241068 cycles |
1.00 |
ML-DSA-87 keypair |
395719 cycles |
395145 cycles |
1.00 |
ML-DSA-87 sign |
1006182 cycles |
1004893 cycles |
1.00 |
ML-DSA-87 verify |
402789 cycles |
403180 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
212032 cycles |
212586 cycles |
1.00 |
ML-DSA-44 sign |
757374 cycles |
756614 cycles |
1.00 |
ML-DSA-44 verify |
229694 cycles |
229266 cycles |
1.00 |
ML-DSA-65 keypair |
378357 cycles |
378482 cycles |
1.00 |
ML-DSA-65 sign |
1240537 cycles |
1240204 cycles |
1.00 |
ML-DSA-65 verify |
372673 cycles |
371973 cycles |
1.00 |
ML-DSA-87 keypair |
603996 cycles |
602412 cycles |
1.00 |
ML-DSA-87 sign |
1581256 cycles |
1580081 cycles |
1.00 |
ML-DSA-87 verify |
618248 cycles |
618563 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
267075 cycles |
270848 cycles |
0.99 |
ML-DSA-44 sign |
804411 cycles |
805481 cycles |
1.00 |
ML-DSA-44 verify |
270153 cycles |
273558 cycles |
0.99 |
ML-DSA-65 keypair |
460552 cycles |
464887 cycles |
0.99 |
ML-DSA-65 sign |
1312468 cycles |
1330777 cycles |
0.99 |
ML-DSA-65 verify |
447219 cycles |
453550 cycles |
0.99 |
ML-DSA-87 keypair |
788430 cycles |
790338 cycles |
1.00 |
ML-DSA-87 sign |
1781200 cycles |
1800043 cycles |
0.99 |
ML-DSA-87 verify |
769803 cycles |
775488 cycles |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
455873 cycles |
458572 cycles |
0.99 |
ML-DSA-44 sign |
2116451 cycles |
2118694 cycles |
1.00 |
ML-DSA-44 verify |
548435 cycles |
552697 cycles |
0.99 |
ML-DSA-65 keypair |
767239 cycles |
770338 cycles |
1.00 |
ML-DSA-65 sign |
3454219 cycles |
3476761 cycles |
0.99 |
ML-DSA-65 verify |
852031 cycles |
857668 cycles |
0.99 |
ML-DSA-87 keypair |
1238781 cycles |
1244211 cycles |
1.00 |
ML-DSA-87 sign |
4259975 cycles |
4284288 cycles |
0.99 |
ML-DSA-87 verify |
1365003 cycles |
1373464 cycles |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
222935 cycles |
226322 cycles |
0.99 |
ML-DSA-44 sign |
625165 cycles |
627058 cycles |
1.00 |
ML-DSA-44 verify |
225098 cycles |
230347 cycles |
0.98 |
ML-DSA-65 keypair |
404051 cycles |
408663 cycles |
0.99 |
ML-DSA-65 sign |
1009998 cycles |
1059465 cycles |
0.95 |
ML-DSA-65 verify |
364942 cycles |
390209 cycles |
0.94 |
ML-DSA-87 keypair |
646779 cycles |
667215 cycles |
0.97 |
ML-DSA-87 sign |
1349759 cycles |
1430725 cycles |
0.94 |
ML-DSA-87 verify |
630991 cycles |
648530 cycles |
0.97 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)
Details
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
313834 cycles |
299370 cycles |
1.05 |
ML-DSA-44 sign |
1173717 cycles |
1157993 cycles |
1.01 |
ML-DSA-44 verify |
342751 cycles |
329642 cycles |
1.04 |
ML-DSA-65 keypair |
576240 cycles |
552631 cycles |
1.04 |
ML-DSA-65 sign |
1951323 cycles |
1849476 cycles |
1.06 |
ML-DSA-65 verify |
557222 cycles |
528847 cycles |
1.05 |
ML-DSA-87 keypair |
868301 cycles |
851001 cycles |
1.02 |
ML-DSA-87 sign |
2456581 cycles |
2396045 cycles |
1.03 |
ML-DSA-87 verify |
903097 cycles |
875347 cycles |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: f881cbb | Previous: 6a86580 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
313834 cycles |
299370 cycles |
1.05 |
ML-DSA-44 verify |
342751 cycles |
329642 cycles |
1.04 |
ML-DSA-65 keypair |
576240 cycles |
552631 cycles |
1.04 |
ML-DSA-65 sign |
1951323 cycles |
1849476 cycles |
1.06 |
ML-DSA-65 verify |
557222 cycles |
528847 cycles |
1.05 |
ML-DSA-87 verify |
903097 cycles |
875347 cycles |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
The API-level benchmarks test/bench/bench_mldsa.c use the macros MLD_BENCHMARK_{NTESTS, NWARMUP, NITERATIONS} to control the setup and iterations to be conducted for the benchmark.
Inconsistently, the component-level benchmarks use plain NWARMUP, NITERATIONS, NTESTS for the benchmark configuration. In particular, platform-specific adjustments as done e.g. in test/baremetal/platform/m33-an524/platform.mk do not apply to the component benchmarks.
Adjust the component-level benchmarks to use the same macros MLD_BENCHMARK_{NWARMUP, NITERATIONS, NTESTS} to configure the setup and iteration count for the component benchmarks.