Skip to content

Conversation

@paullegranddc
Copy link
Contributor

Motivation

Tests usually set the telemetry hearbeat interval to a small value to not have to wait to get data. For these tests also want to get telemetry metrics fast. This PR changes the metics flush interval to the heartbeat value if the hearbeat interval is set to a shorter duration than the default metrics flush interval.

# Motivation

Tests usually set the telemetry hearbeat interval to a small value to not have to wait to get data.
For these tests also want to get telemetry metrics fast.
This PR changes the metics flush interval to the heartbeat value if the hearbeat interval is set to a shorter duration than the default metrics flush interval.
@paullegranddc paullegranddc requested a review from a team as a code owner December 18, 2025 16:38
@codecov-commenter
Copy link

codecov-commenter commented Dec 18, 2025

Codecov Report

❌ Patch coverage is 87.50000% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 71.44%. Comparing base (13970ff) to head (ef9d964).
⚠️ Report is 12 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1418      +/-   ##
==========================================
+ Coverage   71.22%   71.44%   +0.21%     
==========================================
  Files         404      411       +7     
  Lines       64477    66046    +1569     
==========================================
+ Hits        45923    47185    +1262     
- Misses      18554    18861     +307     
Components Coverage Δ
libdd-crashtracker 58.68% <ø> (-0.28%) ⬇️
libdd-crashtracker-ffi 14.72% <ø> (-2.02%) ⬇️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.02% <ø> (+0.20%) ⬆️
libdd-data-pipeline-ffi 77.74% <ø> (+1.14%) ⬆️
libdd-common 81.33% <ø> (+0.20%) ⬆️
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 60.22% <87.50%> (+0.26%) ⬆️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 81.70% <ø> (+1.04%) ⬆️
libdd-profiling-ffi 67.83% <ø> (+4.41%) ⬆️
datadog-sidecar 35.88% <ø> (+0.01%) ⬆️
datdog-sidecar-ffi 10.88% <ø> (+0.08%) ⬆️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (-15.92%) ⬇️
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.92% <ø> (-0.06%) ⬇️
datadog-tracer-flare 62.06% <ø> (-1.43%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 18, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-12-26 16:16:52

Comparing candidate commit ef9d964 in PR branch paullgdc/telemetry/flush_metrics_faster with baseline commit e7c2ff8 in branch main.

Found 1 performance improvements and 14 performance regressions! Performance is the same for 42 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+3.291µs; +3.560µs] or [+4.180%; +4.522%]
  • 🟥 throughput [-550459.135op/s; -508847.159op/s] or [-4.334%; -4.006%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+3.516µs; +3.625µs] or [+5.127%; +5.286%]
  • 🟥 throughput [-733050.785op/s; -710648.031op/s] or [-5.027%; -4.873%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+7.250µs; +7.290µs] or [+16.132%; +16.222%]
  • 🟥 throughput [-3107475.440op/s; -3089670.246op/s] or [-13.965%; -13.885%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

  • 🟥 execution_time [+3.148µs; +3.345µs] or [+5.144%; +5.465%]
  • 🟥 throughput [-850812.689op/s; -798911.988op/s] or [-5.207%; -4.889%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+3.744µs; +3.796µs] or [+6.957%; +7.053%]
  • 🟥 throughput [-1224850.624op/s; -1208036.556op/s] or [-6.592%; -6.501%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+4.472µs; +4.564µs] or [+8.853%; +9.036%]
  • 🟥 throughput [-1641254.928op/s; -1609183.551op/s] or [-8.290%; -8.128%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+7.220µs; +7.260µs] or [+16.061%; +16.151%]
  • 🟥 throughput [-3096022.653op/s; -3076247.830op/s] or [-13.917%; -13.828%]

scenario:sql/obfuscate_sql_string

  • 🟩 execution_time [-3.944µs; -3.853µs] or [-4.424%; -4.322%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.020µs 5.105µs ± 0.047µs 5.095µs ± 0.018µs 5.116µs 5.199µs 5.202µs 5.202µs 2.10% 0.658 -0.241 0.91% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.098µs; 5.111µs] or [-0.127%; +0.127%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.191ms 14.262ms ± 0.041ms 14.257ms ± 0.018ms 14.277ms 14.319ms 14.426ms 14.533ms 1.94% 2.586 11.646 0.29% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.256ms; 14.268ms] or [-0.040%; +0.040%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.601ms 10.634ms ± 0.016ms 10.632ms ± 0.010ms 10.643ms 10.659ms 10.688ms 10.704ms 0.68% 0.918 2.376 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.632ms; 10.637ms] or [-0.021%; +0.021%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.949ms 3.954ms ± 0.007ms 3.953ms ± 0.002ms 3.955ms 3.959ms 3.973ms 4.041ms 2.22% 8.855 98.603 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.953ms; 3.955ms] or [-0.026%; +0.026%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.107ns 191.143ns ± 2.355ns 190.814ns ± 1.592ns 192.288ns 195.148ns 198.511ns 202.199ns 5.97% 1.477 3.747 1.23% 0.167ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.816ns; 191.469ns] or [-0.171%; +0.171%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 84.951µs 85.254µs ± 0.267µs 85.219µs ± 0.086µs 85.318µs 85.515µs 85.694µs 88.416µs 3.75% 8.456 96.846 0.31% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.217µs; 85.291µs] or [-0.043%; +0.043%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 545.950µs 548.882µs ± 0.532µs 548.836µs ± 0.183µs 549.027µs 549.520µs 549.671µs 554.347µs 1.00% 4.758 58.261 0.10% 0.038µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [548.808µs; 548.955µs] or [-0.013%; +0.013%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.327µs 2.379µs ± 0.020µs 2.378µs ± 0.009µs 2.387µs 2.427µs 2.433µs 2.443µs 2.70% 0.360 1.774 0.86% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.376µs; 2.382µs] or [-0.119%; +0.119%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.610µs 35.141µs ± 0.907µs 34.736µs ± 0.042µs 34.812µs 37.073µs 37.151µs 38.281µs 10.21% 1.743 1.199 2.57% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.016µs; 35.267µs] or [-0.358%; +0.358%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.453ms 61.933ms ± 2.329ms 61.623ms ± 0.059ms 61.695ms 61.914ms 74.908ms 84.146ms 36.55% 8.401 70.843 3.75% 0.165ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.610ms; 62.255ms] or [-0.521%; +0.521%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 532.960µs 533.815µs ± 0.407µs 533.780µs ± 0.209µs 533.988µs 534.433µs 534.755µs 537.114µs 0.62% 2.799 20.205 0.08% 0.029µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1861801.131op/s 1873309.544op/s ± 1425.223op/s 1873429.660op/s ± 732.423op/s 1874155.683op/s 1875112.769op/s 1875748.376op/s 1876312.591op/s 0.15% -2.767 19.872 0.08% 100.778op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.481µs 380.982µs ± 0.779µs 381.200µs ± 0.560µs 381.530µs 382.170µs 382.460µs 382.484µs 0.34% -0.241 -1.085 0.20% 0.055µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2614486.666op/s 2624805.509op/s ± 5372.449op/s 2623293.662op/s ± 3856.790op/s 2630333.226op/s 2633513.616op/s 2634183.426op/s 2635178.952op/s 0.45% 0.246 -1.087 0.20% 379.889op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.218µs 189.712µs ± 0.206µs 189.693µs ± 0.156µs 189.868µs 190.056µs 190.152µs 190.177µs 0.26% 0.093 -0.740 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5258260.829op/s 5271146.057op/s ± 5726.473op/s 5271689.354op/s ± 4329.300op/s 5275463.394op/s 5279834.191op/s 5281342.361op/s 5284919.496op/s 0.25% -0.089 -0.740 0.11% 404.923op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.834µs 36.940µs ± 0.037µs 36.940µs ± 0.028µs 36.967µs 36.995µs 37.018µs 37.040µs 0.27% -0.052 -0.372 0.10% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26997954.591op/s 27071066.733op/s ± 27156.358op/s 27070789.488op/s ± 20865.440op/s 27091795.747op/s 27112958.366op/s 27128475.376op/s 27148787.033op/s 0.29% 0.056 -0.371 0.10% 1920.244op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.917µs 45.144µs ± 0.170µs 45.115µs ± 0.135µs 45.293µs 45.418µs 45.521µs 45.571µs 1.01% 0.439 -1.018 0.38% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21943961.948op/s 22151442.422op/s ± 83341.641op/s 22165582.320op/s ± 66088.681op/s 22227205.519op/s 22252827.553op/s 22261158.142op/s 22263136.921op/s 0.44% -0.430 -1.032 0.38% 5893.144op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.759µs; 533.871µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1873112.022op/s; 1873507.066op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.874µs; 381.090µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2624060.939op/s; 2625550.078op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.684µs; 189.741µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5270352.422op/s; 5271939.691op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.935µs; 36.945µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27067303.123op/s; 27074830.343op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.121µs; 45.168µs] or [-0.052%; +0.052%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22139892.072op/s; 22162992.772op/s] or [-0.052%; +0.052%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.666µs 146.607µs ± 1.669µs 146.380µs ± 0.474µs 146.840µs 148.300µs 152.775µs 163.692µs 11.83% 6.406 56.777 1.14% 0.118µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.375µs; 146.838µs] or [-0.158%; +0.158%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.084µs 205.667µs ± 0.396µs 205.570µs ± 0.254µs 205.902µs 206.404µs 206.963µs 207.240µs 0.81% 1.114 1.484 0.19% 0.028µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4825312.599op/s 4862256.853op/s ± 9335.391op/s 4864513.760op/s ± 6009.490op/s 4869026.798op/s 4873671.441op/s 4875528.990op/s 4876040.508op/s 0.24% -1.102 1.436 0.19% 660.112op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.570µs 18.660µs ± 0.071µs 18.635µs ± 0.027µs 18.681µs 18.837µs 18.872µs 18.903µs 1.44% 1.581 1.822 0.38% 0.005µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52901750.689op/s 53591745.727op/s ± 204016.262op/s 53661779.812op/s ± 77959.544op/s 53720002.022op/s 53797964.185op/s 53845206.434op/s 53850050.427op/s 0.35% -1.566 1.774 0.38% 14426.128op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.663µs 10.765µs ± 0.053µs 10.754µs ± 0.031µs 10.790µs 10.866µs 10.912µs 10.934µs 1.68% 0.940 0.641 0.49% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 91456241.679op/s 92895799.929op/s ± 451654.479op/s 92988589.378op/s ± 264916.469op/s 93213389.285op/s 93460508.054op/s 93575691.771op/s 93781499.129op/s 0.85% -0.914 0.580 0.48% 31936.794op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.612µs; 205.721µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4860963.058op/s; 4863550.649op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.650µs; 18.670µs] or [-0.053%; +0.053%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53563471.035op/s; 53620020.418op/s] or [-0.053%; +0.053%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.758µs; 10.772µs] or [-0.068%; +0.068%] None None None
normalization/normalize_name/normalize_name/good throughput [92833204.962op/s; 92958394.896op/s] or [-0.067%; +0.067%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.589µs 162.407µs ± 0.398µs 162.340µs ± 0.183µs 162.583µs 162.994µs 163.501µs 165.822µs 2.14% 3.569 26.267 0.24% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.352µs; 162.462µs] or [-0.034%; +0.034%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.898ns 257.756ns ± 14.630ns 250.944ns ± 2.790ns 259.442ns 293.002ns 301.459ns 302.762ns 20.65% 1.788 2.023 5.66% 1.034ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.729ns; 259.784ns] or [-0.787%; +0.787%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.920µs 3.920µs 0.21% -0.525 6.541 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255086358.109op/s 255609608.939op/s ± 182543.421op/s 255622635.385op/s ± 108976.890op/s 255724294.803op/s 255848422.422op/s 255897003.354op/s 256726851.168op/s 0.43% 0.543 6.634 0.07% 12907.769op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 80.314µs 82.160µs ± 0.692µs 82.190µs ± 0.538µs 82.703µs 83.171µs 83.479µs 83.619µs 1.74% -0.285 -0.452 0.84% 0.049µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11958958.814op/s 12172208.722op/s ± 102767.957op/s 12166907.314op/s ± 79727.830op/s 12249139.680op/s 12364664.231op/s 12424124.512op/s 12451158.545op/s 2.34% 0.323 -0.412 0.84% 7266.792op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.506µs 75.045µs ± 0.197µs 75.037µs ± 0.121µs 75.157µs 75.394µs 75.589µs 75.758µs 0.96% 0.399 1.107 0.26% 0.014µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13199980.693op/s 13325419.669op/s ± 34995.211op/s 13326815.129op/s ± 21401.981op/s 13348224.906op/s 13376645.700op/s 13401879.298op/s 13421657.186op/s 0.71% -0.376 1.075 0.26% 2474.535op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.919µs 3.919µs 0.19% -1.535 12.317 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255145874.190op/s 255632610.166op/s ± 183118.066op/s 255618777.145op/s ± 94922.514op/s 255733232.545op/s 255885461.945op/s 255936245.536op/s 256955019.707op/s 0.52% 1.561 12.519 0.07% 12948.403op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.389µs 72.150µs ± 0.223µs 72.143µs ± 0.132µs 72.297µs 72.525µs 72.634µs 72.873µs 1.01% -0.083 1.057 0.31% 0.016µs 1 200
credit_card/is_card_number/378282246310005 throughput 13722504.888op/s 13860199.833op/s ± 42908.232op/s 13861431.261op/s ± 25323.929op/s 13883555.623op/s 13928161.210op/s 13970887.295op/s 14007857.703op/s 1.06% 0.111 1.063 0.31% 3034.070op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.124µs 52.210µs ± 0.097µs 52.199µs ± 0.027µs 52.226µs 52.258µs 52.311µs 53.159µs 1.84% 8.047 72.616 0.19% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18811386.846op/s 19153404.541op/s ± 35119.478op/s 19157337.567op/s ± 9777.414op/s 19166913.595op/s 19174385.516op/s 19181679.637op/s 19185058.676op/s 0.14% -7.992 71.923 0.18% 2483.322op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.690µs 5.852µs ± 0.074µs 5.857µs ± 0.057µs 5.901µs 5.968µs 6.001µs 6.032µs 3.00% -0.041 -0.685 1.27% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165769557.966op/s 170919904.644op/s ± 2177097.354op/s 170749901.346op/s ± 1649051.949op/s 172587732.081op/s 174586897.961op/s 175588433.844op/s 175749314.310op/s 2.93% 0.091 -0.687 1.27% 153944.030op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.910µs ± 0.002µs 3.910µs ± 0.001µs 3.911µs 3.914µs 3.914µs 3.915µs 0.12% -2.684 22.458 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255433810.090op/s 255734576.779op/s ± 141629.981op/s 255731579.019op/s ± 69175.595op/s 255801860.960op/s 255913670.472op/s 255977710.232op/s 256916456.152op/s 0.46% 2.713 22.746 0.06% 10014.752op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.180µs 64.450µs ± 0.200µs 64.383µs ± 0.115µs 64.563µs 64.778µs 65.010µs 65.417µs 1.61% 1.376 2.739 0.31% 0.014µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15286472.912op/s 15516081.132op/s ± 47838.005op/s 15532027.963op/s ± 27807.928op/s 15549380.552op/s 15571685.460op/s 15578050.875op/s 15581134.363op/s 0.32% -1.350 2.606 0.31% 3382.658op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.386µs 57.588µs ± 0.133µs 57.555µs ± 0.062µs 57.631µs 57.838µs 58.051µs 58.350µs 1.38% 2.241 7.238 0.23% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17138080.431op/s 17364774.544op/s ± 39824.258op/s 17374550.645op/s ± 18789.445op/s 17389268.650op/s 17405103.002op/s 17416318.572op/s 17425767.482op/s 0.29% -2.212 7.052 0.23% 2816.000op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.890µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.921µs 0.25% -1.809 15.246 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255022512.865op/s 255637457.281op/s ± 188575.398op/s 255651019.387op/s ± 120545.532op/s 255752417.263op/s 255863287.784op/s 255966713.938op/s 257069692.920op/s 0.55% 1.840 15.507 0.07% 13334.294op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.591µs 55.029µs ± 0.278µs 54.973µs ± 0.172µs 55.159µs 55.616µs 55.731µs 56.115µs 2.08% 1.032 0.947 0.50% 0.020µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17820646.551op/s 18172592.316op/s ± 91342.778op/s 18190896.366op/s ± 57084.876op/s 18244048.888op/s 18281227.065op/s 18298706.712op/s 18317973.243op/s 0.70% -1.004 0.854 0.50% 6458.910op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.133µs 52.193µs ± 0.035µs 52.188µs ± 0.020µs 52.212µs 52.257µs 52.287µs 52.373µs 0.36% 1.155 3.085 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19093635.087op/s 19159801.862op/s ± 12743.151op/s 19161674.736op/s ± 7522.116op/s 19167823.933op/s 19177410.356op/s 19181491.376op/s 19181838.635op/s 0.11% -1.148 3.047 0.07% 901.077op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.699µs 5.887µs ± 0.068µs 5.886µs ± 0.053µs 5.933µs 5.997µs 6.030µs 6.036µs 2.54% -0.036 -0.578 1.14% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165685686.761op/s 169880351.294op/s ± 1950760.340op/s 169894258.566op/s ± 1523470.200op/s 171488514.048op/s 172994102.030op/s 174188460.743op/s 175467681.130op/s 3.28% 0.086 -0.550 1.15% 137939.587op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255584310.177op/s; 255634907.702op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.064µs; 82.256µs] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12157966.071op/s; 12186451.372op/s] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.018µs; 75.072µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13320569.670op/s; 13330269.669op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255607231.763op/s; 255657988.569op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.119µs; 72.181µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/378282246310005 throughput [13854253.164op/s; 13866146.501op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.197µs; 52.224µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19148537.319op/s; 19158271.763op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.841µs; 5.862µs] or [-0.176%; +0.176%] None None None
credit_card/is_card_number/x371413321323331 throughput [170618179.889op/s; 171221629.399op/s] or [-0.177%; +0.177%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.910µs; 3.911µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ throughput [255714948.226op/s; 255754205.332op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.422µs; 64.478µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15509451.245op/s; 15522711.020op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.570µs; 57.607µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17359255.285op/s; 17370293.803op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255611322.544op/s; 255663592.018op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.991µs; 55.068µs] or [-0.070%; +0.070%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18159933.085op/s; 18185251.546op/s] or [-0.070%; +0.070%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.188µs; 52.197µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19158035.784op/s; 19161567.940op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.878µs; 5.897µs] or [-0.159%; +0.159%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [169609994.673op/s; 170150707.916op/s] or [-0.159%; +0.159%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.888µs 25.845µs ± 9.831µs 18.126µs ± 0.152µs 34.585µs 43.577µs 52.751µs 66.493µs 266.85% 1.076 1.127 37.94% 0.695µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.482µs; 27.207µs] or [-5.272%; +5.272%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.203µs 3.262µs ± 1.468µs 3.014µs ± 0.029µs 3.044µs 3.743µs 14.260µs 15.442µs 412.27% 7.247 54.193 44.89% 0.104µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.059µs; 3.466µs] or [-6.237%; +6.237%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ef9d964 1766764842 paullgdc/telemetry/flush_metrics_faster
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.588ms 9.854ms ± 0.058ms 9.859ms ± 0.027ms 9.886ms 9.928ms 9.974ms 10.032ms 1.76% -1.170 4.034 0.59% 0.004ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.846ms; 9.862ms] or [-0.081%; +0.081%] None None None

Baseline

Omitted due to size.

Copy link
Contributor

@ekump ekump left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this something we can easily unit test? Otherwise LGTM.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 18, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.48 MB 86.48 MB +0% (+904 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.49 MB 58.49 MB +0% (+544 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.45 MB 8.45 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.27 MB 100.28 MB +0% (+1.44 KB) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.61 MB 9.61 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.72 MB 19.72 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 140.14 MB 140.20 MB +.04% (+64.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 745.03 MB 745.03 MB +0% (+2.77 KB) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.37 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.75 MB 19.75 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.79 MB 38.79 MB +0% (+238 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.83 MB 16.83 MB +0% (+512 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.76 MB 142.81 MB +.03% (+48.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 733.36 MB 733.37 MB +0% (+4.51 KB) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.89 MB 4.89 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.99 MB 20.98 MB --.03% (-8.00 KB) 💪
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.54 MB 36.54 MB +0% (+392 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.80 MB 74.81 MB +0% (+640 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.88 MB 8.88 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.83 MB 59.83 MB +0% (+976 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.50 MB 9.50 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.46 MB 94.46 MB +0% (+552 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.32 MB 10.32 MB 0% (0 B) 👌

.field("cancellation_token", &self.cancellation_token)
.field("seq_id", &self.seq_id)
.field("runtime_id", &self.runtime_id)
.field("deadlines", &self.deadlines)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
.field("metrics_flush_interval", &self.metrics_flush_interval)
.field("deadlines", &self.deadlines)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants