Skip to content

Commit 657b2a7

Browse files
prrao87prrao87
authored
Update perf and security pages (#189)
* Update benchmarks/perf page for enterprise * Update security section * Update title * Fix broken links
1 parent ea2af1e commit 657b2a7

6 files changed

Lines changed: 94 additions & 86 deletions

File tree

‎docs/docs.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -50,7 +50,7 @@
5050
"enterprise/quickstart",
5151
"enterprise/architecture",
5252
"enterprise/security",
53-
"enterprise/benchmarks",
53+
"enterprise/performance",
5454
{
5555
"group": "Deployment",
5656
"pages": [

‎docs/enterprise/benchmarks.mdx‎

Lines changed: 0 additions & 76 deletions
This file was deleted.

‎docs/enterprise/index.mdx‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ With Lance OSS every query fetches data from S3, GCS, or Azure Blob. Each round
8080

8181
LanceDB Enterprise uses NVMe SSDs as a hybrid cache, before the data store is even accessed. The first read fills the cache, and subsequent reads come from the local disk and return in tens of milliseconds. Parallel chunked reads further reduce tail latency. This gap matters when the application serves interactive dashboards or real-time recommendations.
8282

83-
Read More: [LanceDB Enterprise Performance](/enterprise/benchmarks/)
83+
Read More: [LanceDB Enterprise Performance](/enterprise/performance/)
8484

8585
### Throughput of search queries
8686

‎docs/enterprise/performance.mdx‎

Lines changed: 82 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,82 @@
1+
---
2+
title: "Performance Characteristics"
3+
sidebarTitle: "Performance"
4+
description: "Understand LanceDB Enterprise performance characteristics, including representative latency and scalability benchmarks."
5+
icon: "tachometer-alt"
6+
---
7+
8+
LanceDB Enterprise is designed for low-latency, high-throughput search, but observed performance depends on factors such as dataset shape, index configuration, cache warmth, filter selectivity, concurrency, and cluster sizing. The figures on this page should be read as representative benchmark results for a specific test setup, not as universal guarantees for every deployment.
9+
10+
In our benchmark environment, warmed-cache vector search reached around **25ms** P50 latency, and metadata-filtered search reached around **50ms** P99 latency for the filter pattern shown below.
11+
12+
<Info>
13+
If you want performance guidance for your own workload, reach out to [contact@lancedb.com](mailto:contact@lancedb.com). The LanceDB engineering team can help map your latency, throughput, ingestion, and filtering requirements to an appropriate Enterprise cluster design.
14+
</Info>
15+
16+
| Percentile | Vector Search | Vector Search w. Filtering | Full-Text Search |
17+
|:------------:|:------------:|:-------------------------:|:----------------:|
18+
| P50 | 25ms | 30ms | 26ms |
19+
| P90 | 26ms | 39ms | 37ms |
20+
| P99 | 35ms | 50ms | 42ms |
21+
22+
Depending on workload and tuning, Enterprise clusters can also be configured for high concurrency, including thousands of QPS in some deployments, but the right configuration varies by use case. Training, search, and analytics workloads often benefit from different cluster shapes and resource allocation strategies. To understand which parts of the system influence these results, see the [Enterprise architecture](/enterprise/architecture) guide.
23+
24+
## Dataset
25+
26+
We used two datasets for this benchmark: the [dbpedia-entities-openai-1M](https://huggingface.co/datasets/KShivendu/dbpedia-entities-openai-1M)
27+
for vector search, and a synthetic dataset for vector search with metadata filtering.
28+
29+
| Name | # Vectors | Vector Dimension |
30+
|:------|:---------:|:---------------:|
31+
| dbpedia-entities-openai-1M | 1,000,000 | 1536 |
32+
| synthetic dataset | 15,000,000 | 256 |
33+
34+
These benchmark results are most useful as a directional baseline. Different data distributions, index choices, cache behavior, and cluster settings can materially change the latency profile.
35+
36+
## Vector Search
37+
38+
We ran vector queries against `dbpedia-entities-openai-1M` with a warmed-up cache. In that benchmark setup, we observed the following latency profile:
39+
40+
| Percentile | Latency |
41+
|:------------:|:-------:|
42+
| P50 | 25ms |
43+
| P90 | 26ms |
44+
| P99 | 35ms |
45+
| Max | 49ms |
46+
47+
## Full-Text Search
48+
49+
With the same dataset and a warmed-up cache, full-text search fell into the following range:
50+
51+
| Percentile | Latency |
52+
|:------------:|:-------:|
53+
| P50 | 26ms |
54+
| P90 | 37ms |
55+
| P99 | 42ms |
56+
| Max | 98ms |
57+
58+
## Vector Search with Metadata Filtering
59+
60+
We created a 15M-vector dataset to evaluate metadata-aware search under more complex filtering conditions.
61+
These filters can span a wide range of scalar columns, for example, "find Sci-fi movies since 1900".
62+
63+
With a warmed-up cache, slightly more selective filters, for example, "find Sci-fi movies between the years 2000 and 2012", produced the following representative results:
64+
65+
| Percentile | Latency |
66+
|:-----------:|:-------:|
67+
| P50 | 30ms |
68+
| P90 | 39ms |
69+
| P99 | 50ms |
70+
71+
Broader or less selective filters, for example, "find Sci-fi movies since 1900", moved the latency range to:
72+
73+
| Percentile | Latency |
74+
|:------------:|:-------:|
75+
| P50 | 65ms |
76+
| P90 | 76ms |
77+
| P99 | 100ms |
78+
79+
80+
<Info>
81+
These benchmarks are intended to provide consistent, reproducible reference points for LanceDB Enterprise rather than one-size-fits-all promises. We periodically re-run and update numbers as necessary, but production performance will still depend on workload shape, cluster tuning, and the architectural choices described in the [Enterprise architecture](/enterprise/architecture) guide.
82+
</Info>

‎docs/enterprise/security.mdx‎

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,26 @@
11
---
2-
title: "Security & compliance"
2+
title: "Security & Compliance"
33
sidebarTitle: "Security"
44
description: "Learn about LanceDB Enterprise security features and best practices."
55
icon: "shield-alt"
66
---
77

8-
LanceDB Enterprise maintains the highest security standards with SOC 2 Type II and HIPAA compliance certifications. Our security framework ensures enterprise-grade protection for your data and workloads across all deployment models.
8+
LanceDB Enterprise maintains high security standards with SOC 2 Type II, HIPAA, and GDPR compliance. Our security framework is designed to provide enterprise-grade protection for your data and workloads across deployment models.
99

1010
## Security Certifications
1111

1212
- **SOC 2 Type II**: Independent audit confirming our security controls and operational effectiveness
1313
- **HIPAA Compliance**: Certified to handle protected health information (PHI) in healthcare applications
14+
- **GDPR Compliance**: Supports organizations with data privacy requirements under the General Data Protection Regulation
1415
- **Regular Audits**: Ongoing security assessments to maintain compliance standards
1516

16-
### Future Compliance
17+
### Ongoing Compliance
1718

18-
Going forward, LanceDB will maintain SOC 2 Type II and HIPAA compliance by conducting continuous
19-
audits to ensure our security practices remain aligned with industry standards and evolving
20-
risks. Meanwhile, we are actively working on GDPR compliance.
21-
[Contact us](mailto:contact@lancedb.com) to request a letter of engagement.
19+
LanceDB maintains SOC 2 Type II, HIPAA, and GDPR compliance through ongoing audits and continuous improvement of our security practices as standards and risks evolve.
20+
21+
<Info>
22+
Visit the [LanceDB Trust Center](https://trust.lancedb.com/) to learn more about LanceDB's security posture, data privacy practices, and to request access to security documentation.
23+
</Info>
2224

2325
## LanceDB Enterprise
2426

‎docs/search/full-text-search.mdx‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -697,7 +697,7 @@ const multiMatchBoostingResults = await table.query()
697697

698698
- Create full-text search indices on text columns that will be frequently searched
699699
- For hybrid search combining text and vectors, see our [hybrid search guide](/search/hybrid-search/)
700-
- For performance benchmarks, check our [benchmark results](/enterprise/benchmarks/)
700+
- For performance benchmarks, check our [benchmark results](/enterprise/performance/)
701701
- For complex queries, use SQL to combine FTS with other filter conditions
702702
</Card>
703703

0 commit comments

Comments
 (0)