Skip to content

feat(embedding): 청크 분할 단위 450 토큰으로 최적화 - #76

Merged
Jacob-9909 merged 1 commit into
mainfrom
feat/chunk-size-and-docs-expansion
Sep 6, 2026
Merged

feat(embedding): 청크 분할 단위 450 토큰으로 최적화#76
Jacob-9909 merged 1 commit into
mainfrom
feat/chunk-size-and-docs-expansion

Conversation

@Jacob-9909

Copy link
Copy Markdown
Owner

개요

  • 주식과 세금(평균 569자)과 동일한 고밀도 정밀 검색을 위해 DocumentParser 청크 크기를 750토큰에서 450토큰으로 최적화했습니다.

변경사항

  • pipelines/embedding/document_parser.py: chunk_size=450, chunk_overlap=100 설정.

@vercel

vercel Bot commented Sep 6, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
midas-touch Ready Ready Preview Sep 6, 2026 4:19am UTC

@Jacob-9909
Jacob-9909 merged commit db259c6 into main Sep 6, 2026
5 checks passed
@Jacob-9909
Jacob-9909 deleted the feat/chunk-size-and-docs-expansion branch September 6, 2026 04:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant