Skip to content

Add broader file support and folder indexing#1

Open
coloboxp wants to merge 30 commits intodevelopfrom
feature/file-support
Open

Add broader file support and folder indexing#1
coloboxp wants to merge 30 commits intodevelopfrom
feature/file-support

Conversation

@coloboxp
Copy link
Owner

Summary:

  • Add support for Office files, source code, and config files
  • Add folder indexing (Downloads, Documents, Desktop, and custom folders)
  • Add custom reader config and a sample reader
  • Add persisted index option and update docs/changelog

Credits:

Demo:

  • Open "Local Files" → check Downloads/Documents/Desktop
  • Add a custom folder
  • Upload .docx/.pptx/.xlsx and click Process

Testing:

  • pipenv sync
  • pipenv run python -m py_compile components/tabs/local_files.py components/page_state.py utils/llama_index.py utils/rag_pipeline.py utils/file_readers.py utils/readers/sample_reader.py
  • Streamlit headless boot smoke test
  • Ingestion smoke test with .txt/.json/.yaml/.ini/.py/.docx/.pptx/.xlsx

jonfairbanks and others added 30 commits February 20, 2024 22:01
Potential fix for Docker build failures
Ensure code is checked out for bump-tag step
Update volume syntax to support Windows
Logging, Caching & User Experience Improvements
Update docker-compose to better support Windows hosts
Website RAG, UX Improvements & Bug Fixes
Allow embeddings to use cuda devices
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants