Repository navigation

Feat/xgboost rework - #50

Merged

SeanClay10 merged 32 commits into

mainfrom

feat/xgboost-rework

Mar 15, 2026

Merged

Feat/xgboost rework#50
SeanClay10 merged 32 commits into
mainfrom
feat/xgboost-rework

Commits on Feb 28, 2026
- feat: cleans noisy features (doi, numbered references, figure captions, etc)
  raymondcen
  committed
  9042c78
- fix: text cleaning left blank lines
  raymondcen
  committed
  fa61459
- feat: temp pipeline for testing
  raymondcen
  committed
  688deaa
- fix: section headers being removed
  raymondcen
  committed
  af2836f
- use section priority rankings instead
  raymondcen
  committed
  0687e62
- save cleaned text to folder
  raymondcen
  committed
  317387d
- use parargraph scoring
  raymondcen
  committed
  17b7b55
- update data for comparison later
  raymondcen
  committed
  f738892
Commits on Mar 2, 2026
- added another filter to drop entire paragraphs that contain irrelevant info
  raymondcen
  committed
  ff34c74
- update instructions on files
  raymondcen
  committed
  b3b4abf
- added retry logic to retry null returns
  raymondcen
  committed
  af63973
- increased char and num-ctx limit on ollama
  raymondcen
  committed
  af6aa3a
- drops paragraphs with no neg or pos signal
  raymondcen
  committed
  cde64a1
- added long doc test
  raymondcen
  committed
  00bcf41
- switched to qwen2.5:7b
  raymondcen
  committed
  d6efaf3
- rewrote the system prompt to handle diverse study methods beyond stomach dissection
  raymondcen
  committed
  b3dcf46
- reformat
  raymondcen
  committed
  ad49f3c
Commits on Mar 12, 2026
- improved truncation
  raymondcen
  committed
  0b3a3d8
- added multi cpu processing option
  raymondcen
  committed
  f66d48d
- added --workers arg
  raymondcen
  committed
  208029d
- added sequqnetial pdf processing
  raymondcen
  committed
  4a01b9d
- loads SpellChecker() only once
  raymondcen
  committed
  33adda5
- xgboost trinaing set to gpu if available
  raymondcen
  committed
  823fd7f
- added bypass OCR because it froze workers
  raymondcen
  committed
  72388c1
- --labels option to process all useful papers
  raymondcen
  committed
  2263116
- fixed name scanning in labels.json
  raymondcen
  committed
  3320e37
Commits on Mar 14, 2026
- reformat
  raymondcen
  committed
  251d86c
Commits on Mar 15, 2026

Commits

Commits on Feb 28, 2026

Commits on Mar 2, 2026

Commits on Mar 12, 2026

Commits on Mar 14, 2026

Commits on Mar 15, 2026