Skip to content

fix(sources): store chunk total on parse, stop homepage prefetch - #174

Merged
EricNGOntos merged 2 commits into
mainfrom
feat/wuchengke/store-parse-chunk-count
Sep 11, 2026
Merged

EricNGOntos merged 2 commits into
mainfrom
feat/wuchengke/store-parse-chunk-count

Conversation

@EricNGOntos

Copy link
Copy Markdown
Contributor

Summary

  • 打开首页不再为显示条数对每个已就绪资料拉一次 chunk。
  • 解析完成时,沿用已有的那次 listChunks,把 pagination.total 写入资料表。
  • Demo 加进资料时把目录里的条数一并写入。没有条数的旧资料只显示 Processed。

Test plan

  • tsc --noEmit
  • 相关单测 + 此前全量 805 通过
  • 合入后跑迁移 0018_source_chunk_count
  • 打开有观心资料的首页,确认不再为条数打 N 次请求
  • 新上传一份文件解析完成后,列表出现条数

Made with Cursor

EricNGOntos and others added 2 commits September 11, 2026 17:18
…ests

- Introduced chunkCount property in various source-related files to enhance source management.
- Updated the upsertMaterializedDemoSourceEffect to handle chunkCount during source insertion.
- Modified tests across multiple files to include chunkCount, ensuring consistency and coverage.
- Removed unused functions and types related to chunk counting to streamline the codebase.

This enhancement improves the handling of source chunk counts, facilitating better data management and retrieval.
Keep the parse-complete total write and homepage count-fetch removal only.

Co-authored-by: Cursor <cursoragent@cursor.com>
@vercel

vercel Bot commented Sep 11, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
knowhere-notebook-staging Ready Ready Preview Sep 11, 2026 9:26am UTC
1 Skipped Deployment
Project Deployment Actions Updated
knowhere-notebook Ignored Ignored Preview Sep 11, 2026 9:26am UTC

Request Review

@EricNGOntos
EricNGOntos merged commit c95d33d into main Sep 11, 2026
7 checks passed
@EricNGOntos
EricNGOntos deleted the feat/wuchengke/store-parse-chunk-count branch September 11, 2026 09:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant