Skip to content

feat(profiling): File endpoint for exporter #1421

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
danielsn wants to merge 3 commits into
base: main
Choose a base branch
from
Open

feat(profiling): File endpoint for exporter #1421

danielsn wants to merge 3 commits into from
+1,213 −114

Conversation

@danielsn
Copy link
Contributor

@danielsn danielsn commented Dec 19, 2025

What does this PR do?

Adds a file:// endpoint to the profile exporter.

Motivation

For testing and debugging purposes, its really useful to see exactly what bytes were sent. This is useful both within libdatadog, and also for any clients.

Additional Notes

Anything else we should know when reviewing?

How to test the change?

New integration tests in the PR.

@danielsn danielsn requested review from a team as code owners December 19, 2025 14:22
@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 19, 2025 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 87.06 MB 87.76 MB +.80% (+720.56 KB) 🔍
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.50 MB 7.57 MB +.83% (+64.00 KB) 🔍
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.87 MB 59.41 MB +.91% (+550.11 KB) 🔍
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.49 MB 8.57 MB +.94% (+81.96 KB) 🔍
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.62 MB 9.70 MB +.92% (+90.99 KB) 🔍
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.73 MB 101.50 MB +.75% (+783.70 KB) 🔍
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 20.06 MB 20.32 MB +1.29% (+267.00 KB) ⚠️
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 74.31 KB 74.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.05 MB 144.51 MB +1.73% (+2.46 MB) ⚠️
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 748.21 MB 766.39 MB +2.42% (+18.17 MB) ⚠️
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.41 MB 6.50 MB +1.43% (+94.50 KB) ⚠️
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 74.31 KB 74.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.90 MB 20.12 MB +1.09% (+224.00 KB) ⚠️
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.99 MB 39.45 MB +1.19% (+477.77 KB) ⚠️
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 17.12 MB 17.37 MB +1.47% (+258.50 KB) ⚠️
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 75.46 KB 75.46 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 144.69 MB 147.36 MB +1.84% (+2.66 MB) ⚠️
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 736.85 MB 754.54 MB +2.40% (+17.69 MB) ⚠️
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.92 MB 5.00 MB +1.50% (+76.00 KB) ⚠️
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 75.46 KB 75.46 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 21.17 MB 21.43 MB +1.21% (+264.00 KB) ⚠️
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.77 MB 37.22 MB +1.23% (+463.92 KB) ⚠️
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 75.34 MB 76.01 MB +.89% (+691.33 KB) 🔍
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.93 MB 8.99 MB +.69% (+64.00 KB) 🔍
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 60.20 MB 60.72 MB +.86% (+535.89 KB) 🔍
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.54 MB 9.62 MB +.84% (+83.02 KB) 🔍
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.90 MB 95.57 MB +.70% (+689.91 KB) 🔍
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.35 MB 10.43 MB +.75% (+79.57 KB) 🔍

@codecov-commenter
Copy link

codecov-commenter commented Dec 19, 2025 •
edited
Loading

Codecov Report

❌ Patch coverage is 85.43210% with 59 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.55%. Comparing base (5027515) to head (8c22595).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1421      +/-   ##
==========================================
+ Coverage   71.41%   71.55%   +0.13%     
==========================================
  Files         411      413       +2     
  Lines       66028    66426     +398     
==========================================
+ Hits        47156    47528     +372     
- Misses      18872    18898      +26
Components Coverage Δ
libdd-crashtracker 58.72% <ø> (+0.03%) ⬆️
libdd-crashtracker-ffi 14.72% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.68% <ø> (+0.01%) ⬆️
libdd-data-pipeline-ffi 75.75% <ø> (ø)
libdd-common 81.38% <ø> (+0.05%) ⬆️
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.92% <ø> (-0.04%) ⬇️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.71% <ø> (+0.10%) ⬆️
libdd-profiling 81.90% <85.43%> (+0.18%) ⬆️
libdd-profiling-ffi 67.83% <ø> (ø)
datadog-sidecar 36.17% <ø> (ø)
datdog-sidecar-ffi 12.37% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 90.07% <ø> (ø)
datadog-tracer-flare 61.06% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 19, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-12-19 17:21:22

Comparing candidate commit 8c22595 in PR branch dsn/file-exporter with baseline commit 5027515 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.019ns 255.439ns ± 13.246ns 250.561ns ± 4.131ns 256.066ns 286.060ns 297.184ns 299.332ns 19.46% 1.746 2.119 5.17% 0.937ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.603ns; 257.275ns] or [-0.719%; +0.719%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 539.186µs 540.158µs ± 0.469µs 540.120µs ± 0.291µs 540.410µs 540.848µs 541.818µs 542.241µs 0.39% 1.170 2.799 0.09% 0.033µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [540.093µs; 540.223µs] or [-0.012%; +0.012%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.218µs 3.254µs ± 1.441µs 3.016µs ± 0.027µs 3.040µs 3.729µs 13.977µs 15.047µs 398.86% 7.235 54.073 44.17% 0.102µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.054µs; 3.454µs] or [-6.136%; +6.136%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.701ms 10.727ms ± 0.018ms 10.724ms ± 0.008ms 10.734ms 10.750ms 10.788ms 10.861ms 1.28% 3.057 17.290 0.16% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.724ms; 10.729ms] or [-0.023%; +0.023%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.742µs 160.304µs ± 0.318µs 160.258µs ± 0.179µs 160.446µs 160.717µs 161.438µs 162.445µs 1.36% 2.436 11.260 0.20% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.259µs; 160.348µs] or [-0.027%; +0.027%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.356µs 204.896µs ± 0.340µs 204.821µs ± 0.204µs 205.062µs 205.506µs 205.981µs 206.259µs 0.70% 1.225 1.911 0.17% 0.024µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4848280.911op/s 4880529.653op/s ± 8078.550op/s 4882313.163op/s ± 4863.072op/s 4886672.614op/s 4890102.933op/s 4892636.520op/s 4893412.224op/s 0.23% -1.213 1.867 0.17% 571.240op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.565µs 18.662µs ± 0.093µs 18.625µs ± 0.020µs 18.665µs 18.843µs 19.008µs 19.161µs 2.88% 2.413 6.949 0.50% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52188511.982op/s 53585217.719op/s ± 265212.024op/s 53691372.889op/s ± 57227.599op/s 53733743.836op/s 53777923.024op/s 53806677.260op/s 53865340.301op/s 0.32% -2.367 6.614 0.49% 18753.322op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.827µs 10.925µs ± 0.041µs 10.923µs ± 0.023µs 10.947µs 11.004µs 11.040µs 11.070µs 1.35% 0.457 0.688 0.38% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90335617.666op/s 91534702.274op/s ± 344265.674op/s 91551294.433op/s ± 195479.906op/s 91737001.533op/s 92086187.430op/s 92250312.600op/s 92360047.885op/s 0.88% -0.430 0.645 0.38% 24343.259op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [204.849µs; 204.943µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4879410.043op/s; 4881649.262op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.649µs; 18.675µs] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53548461.883op/s; 53621973.555op/s] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.919µs; 10.931µs] or [-0.052%; +0.052%] None None None
normalization/normalize_name/normalize_name/good throughput [91486990.363op/s; 91582414.186op/s] or [-0.052%; +0.052%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.457µs 2.496µs ± 0.046µs 2.480µs ± 0.008µs 2.500µs 2.538µs 2.702µs 2.707µs 9.15% 3.392 12.081 1.82% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.490µs; 2.503µs] or [-0.253%; +0.253%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.913µs ± 0.003µs 3.912µs ± 0.001µs 3.914µs 3.919µs 3.920µs 3.922µs 0.25% -0.500 8.131 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254985479.689op/s 255590312.598op/s ± 200660.567op/s 255627095.153op/s ± 93260.188op/s 255716634.367op/s 255804363.064op/s 255835128.859op/s 256887100.982op/s 0.49% 0.523 8.273 0.08% 14188.845op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.087µs 79.018µs ± 1.035µs 78.916µs ± 0.734µs 79.703µs 80.774µs 81.428µs 81.827µs 3.69% 0.366 -0.463 1.31% 0.073µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12220962.704op/s 12657505.585op/s ± 164992.099op/s 12671695.235op/s ± 118356.613op/s 12774411.094op/s 12910609.026op/s 12958524.768op/s 12972394.336op/s 2.37% -0.312 -0.519 1.30% 11666.703op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.622µs 70.906µs ± 0.270µs 70.774µs ± 0.094µs 71.007µs 71.465µs 71.862µs 71.959µs 1.68% 1.581 2.407 0.38% 0.019µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13896735.233op/s 14103355.505op/s ± 53391.883op/s 14129510.897op/s ± 18703.389op/s 14142738.649op/s 14149650.984op/s 14155222.525op/s 14159904.894op/s 0.22% -1.559 2.310 0.38% 3775.376op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.913µs ± 0.007µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.921µs 3.988µs 1.91% 7.720 70.914 0.19% 0.001µs 1 200
credit_card/is_card_number/37828224631 throughput 250782887.070op/s 255527262.582op/s ± 479001.462op/s 255572538.731op/s ± 130854.937op/s 255696448.700op/s 255801077.555op/s 255892259.705op/s 256905129.439op/s 0.52% -7.644 70.045 0.19% 33870.518op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.412µs 67.812µs ± 0.292µs 67.735µs ± 0.141µs 67.936µs 68.467µs 68.573µs 69.077µs 1.98% 1.410 2.054 0.43% 0.021µs 1 200
credit_card/is_card_number/378282246310005 throughput 14476561.762op/s 14746938.962op/s ± 63017.084op/s 14763426.563op/s ± 30636.061op/s 14782236.556op/s 14819463.587op/s 14828088.715op/s 14834192.814op/s 0.48% -1.384 1.950 0.43% 4455.981op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.737µs 45.153µs ± 0.176µs 45.149µs ± 0.130µs 45.287µs 45.419µs 45.537µs 45.556µs 0.90% -0.116 -0.439 0.39% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21951148.609op/s 22147020.563op/s ± 86522.057op/s 22149078.184op/s ± 64086.448op/s 22208220.928op/s 22302742.969op/s 22347778.779op/s 22352999.576op/s 0.92% 0.134 -0.432 0.39% 6118.033op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.034µs ± 0.004µs 6.034µs ± 0.002µs 6.036µs 6.041µs 6.050µs 6.064µs 0.51% 2.923 15.747 0.07% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 164896098.540op/s 165719232.418op/s ± 116387.617op/s 165735343.063op/s ± 57206.712op/s 165787108.694op/s 165849958.216op/s 165877334.153op/s 165899228.383op/s 0.10% -2.904 15.580 0.07% 8229.847op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.920µs 0.19% -1.139 9.335 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255107589.156op/s 255596707.560op/s ± 165944.627op/s 255593724.130op/s ± 101647.785op/s 255704334.193op/s 255807808.951op/s 255853696.536op/s 256718762.738op/s 0.44% 1.159 9.472 0.06% 11734.057op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.105µs 65.868µs ± 0.108µs 65.878µs ± 0.035µs 65.921µs 65.960µs 65.984µs 66.262µs 0.58% -3.453 20.512 0.16% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15091631.522op/s 15181946.395op/s ± 24993.392op/s 15179594.830op/s ± 8177.774op/s 15186098.645op/s 15217652.782op/s 15273916.204op/s 15359843.750op/s 1.19% 3.505 20.881 0.16% 1767.300op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.965µs 53.027µs ± 0.033µs 53.020µs ± 0.017µs 53.045µs 53.087µs 53.127µs 53.143µs 0.23% 0.990 1.344 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18817284.861op/s 18858431.983op/s ± 11601.651op/s 18860853.356op/s ± 6195.979op/s 18865566.098op/s 18874621.562op/s 18877260.588op/s 18880562.461op/s 0.10% -0.985 1.332 0.06% 820.361op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.914µs 3.917µs 3.920µs 3.930µs 0.45% -0.148 14.968 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254469088.477op/s 255601999.517op/s ± 193010.178op/s 255625754.295op/s ± 94236.740op/s 255696755.654op/s 255815207.101op/s 255868792.230op/s 256912514.655op/s 0.50% 0.187 15.062 0.08% 13647.881op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.746µs 49.804µs ± 0.050µs 49.796µs ± 0.020µs 49.820µs 49.854µs 49.887µs 50.249µs 0.91% 5.776 45.994 0.10% 0.004µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19900944.780op/s 20078542.869op/s ± 19957.397op/s 20081750.709op/s ± 7918.053op/s 20089000.268op/s 20096710.671op/s 20101696.603op/s 20102297.693op/s 0.10% -5.733 45.498 0.10% 1411.201op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.533µs 45.150µs ± 0.221µs 45.163µs ± 0.145µs 45.317µs 45.481µs 45.516µs 45.558µs 0.88% -0.555 0.011 0.49% 0.016µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21950020.002op/s 22148889.889op/s ± 108621.097op/s 22142240.860op/s ± 71251.437op/s 22209951.173op/s 22359850.772op/s 22434907.506op/s 22455466.864op/s 1.41% 0.580 0.050 0.49% 7680.671op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.037µs ± 0.004µs 6.037µs ± 0.003µs 6.039µs 6.043µs 6.045µs 6.046µs 0.15% 0.048 -0.696 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165395508.744op/s 165651257.283op/s ± 101595.754op/s 165635722.540op/s ± 77602.952op/s 165741940.598op/s 165811058.772op/s 165839448.256op/s 165882675.926op/s 0.15% -0.045 -0.698 0.06% 7183.905op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255562502.974op/s; 255618122.223op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.875µs; 79.161µs] or [-0.181%; +0.181%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12634639.267op/s; 12680371.903op/s] or [-0.181%; +0.181%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.869µs; 70.944µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14095955.903op/s; 14110755.107op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.915µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631 throughput [255460877.586op/s; 255593647.578op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.772µs; 67.852µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/378282246310005 throughput [14738205.401op/s; 14755672.524op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.129µs; 45.178µs] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22135029.438op/s; 22159011.688op/s] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.034µs; 6.035µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 throughput [165703102.214op/s; 165735362.622op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255573709.231op/s; 255619705.889op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.853µs; 65.883µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15178482.552op/s; 15185410.239op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.022µs; 53.031µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18856824.105op/s; 18860039.860op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255575250.163op/s; 255628748.872op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.798µs; 49.811µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20075776.966op/s; 20081308.772op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.119µs; 45.181µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22133836.049op/s; 22163943.728op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.037µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165637177.088op/s; 165665337.477op/s] or [-0.008%; +0.008%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.108µs 534.947µs ± 0.929µs 534.807µs ± 0.222µs 535.050µs 535.706µs 537.673µs 545.771µs 2.05% 8.390 91.594 0.17% 0.066µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1832270.904op/s 1869349.841op/s ± 3199.017op/s 1869835.165op/s ± 776.167op/s 1870545.283op/s 1871714.422op/s 1872054.229op/s 1872279.275op/s 0.13% -8.271 89.598 0.17% 226.205op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.539µs 381.154µs ± 0.315µs 381.128µs ± 0.211µs 381.341µs 381.727µs 381.900µs 381.910µs 0.21% 0.382 -0.506 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2618418.548op/s 2623610.079op/s ± 2166.167op/s 2623789.387op/s ± 1456.381op/s 2625243.445op/s 2626594.024op/s 2627638.830op/s 2627853.949op/s 0.15% -0.378 -0.510 0.08% 153.171op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.850µs 190.485µs ± 0.305µs 190.465µs ± 0.208µs 190.676µs 191.045µs 191.258µs 191.352µs 0.47% 0.463 -0.164 0.16% 0.022µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5225983.958op/s 5249773.289op/s ± 8406.360op/s 5250315.693op/s ± 5738.782op/s 5255723.294op/s 5262213.535op/s 5264001.901op/s 5267318.383op/s 0.32% -0.455 -0.175 0.16% 594.419op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.262µs 37.411µs ± 0.044µs 37.410µs ± 0.026µs 37.437µs 37.478µs 37.536µs 37.568µs 0.42% 0.254 1.345 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26618297.418op/s 26729863.343op/s ± 31278.521op/s 26730656.889op/s ± 18754.213op/s 26748101.905op/s 26777541.842op/s 26799175.764op/s 26837223.613op/s 0.40% -0.242 1.337 0.12% 2211.725op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.828µs 45.897µs ± 0.036µs 45.892µs ± 0.025µs 45.920µs 45.963µs 46.005µs 46.020µs 0.28% 0.766 0.594 0.08% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21729798.280op/s 21787990.930op/s ± 16979.553op/s 21790429.157op/s ± 11922.552op/s 21801481.967op/s 21811288.523op/s 21817301.160op/s 21820690.565op/s 0.14% -0.761 0.582 0.08% 1200.636op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.818µs; 535.076µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868906.488op/s; 1869793.194op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.111µs; 381.198µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2623309.869op/s; 2623910.289op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.443µs; 190.527µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5248608.249op/s; 5250938.330op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.405µs; 37.417µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26725528.441op/s; 26734198.245op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.892µs; 45.902µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21785637.727op/s; 21790344.132op/s] or [-0.011%; +0.011%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 185.659ns 188.398ns ± 2.234ns 187.855ns ± 1.601ns 189.711ns 192.532ns 195.068ns 195.897ns 4.28% 0.967 0.570 1.18% 0.158ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [188.088ns; 188.707ns] or [-0.164%; +0.164%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.989ms 3.995ms ± 0.007ms 3.995ms ± 0.001ms 3.996ms 3.999ms 4.003ms 4.091ms 2.41% 11.827 154.248 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.994ms; 3.996ms] or [-0.025%; +0.025%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.110ms 60.527ms ± 2.178ms 60.234ms ± 0.059ms 60.302ms 60.558ms 66.826ms 82.510ms 36.98% 9.002 82.839 3.59% 0.154ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.226ms; 60.829ms] or [-0.499%; +0.499%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 90.065µs 90.583µs ± 0.295µs 90.566µs ± 0.125µs 90.680µs 90.921µs 91.089µs 93.663µs 3.42% 5.721 57.604 0.32% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.542µs; 90.624µs] or [-0.045%; +0.045%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.462ms 9.760ms ± 0.086ms 9.762ms ± 0.039ms 9.801ms 9.887ms 9.948ms 10.235ms 4.84% 0.356 5.117 0.88% 0.006ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.748ms; 9.772ms] or [-0.122%; +0.122%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.979µs 5.043µs ± 0.047µs 5.016µs ± 0.032µs 5.086µs 5.120µs 5.124µs 5.125µs 2.17% 0.357 -1.403 0.92% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.036µs; 5.049µs] or [-0.128%; +0.128%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 145.016µs 146.703µs ± 1.596µs 146.509µs ± 0.643µs 147.189µs 148.384µs 151.450µs 161.310µs 10.10% 5.455 42.121 1.09% 0.113µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.481µs; 146.924µs] or [-0.151%; +0.151%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.330µs 33.949µs ± 1.071µs 33.460µs ± 0.053µs 33.560µs 36.227µs 36.270µs 37.522µs 12.14% 1.723 1.110 3.15% 0.076µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.801µs; 34.098µs] or [-0.437%; +0.437%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.617µs 25.663µs ± 9.559µs 17.961µs ± 0.178µs 34.227µs 43.285µs 53.198µs 63.373µs 252.85% 0.897 0.242 37.15% 0.676µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.339µs; 26.988µs] or [-5.162%; +5.162%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8c22595 1766163678 dsn/file-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.871ms 13.909ms ± 0.029ms 13.903ms ± 0.008ms 13.912ms 13.957ms 14.024ms 14.111ms 1.49% 3.685 17.721 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.905ms; 13.913ms] or [-0.029%; +0.029%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@danielsn @codecov-commenter