Skip to content

Pull requests: mosaicml/streaming

New pull request New
24 Open 725 Closed
24 Open 725 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Make SparkConnect the data source
#934 opened Jun 25, 2025 by XiaohanZhangCMU Loading…
8 tasks
Update numpy requirement from <2.2.0,>=1.21.5 to >=1.21.5,<2.3.0 dependencies Pull requests that update a dependency file python Pull requests that update python code
#896 opened Apr 7, 2025 by dependabot bot Loading…
2
Add upper bound for prefix_int
#823 opened Nov 5, 2024 by XiaohanZhangCMU Loading…
8 tasks
6
add jpeg quality option
#818 opened Oct 28, 2024 by cabreraalex Loading…
8 tasks
1
12
Refactor spanner to avoid creating large array
#773 opened Sep 3, 2024 by XiaohanZhangCMU Loading…
8 tasks done
12
Heterogeneous
#684 opened May 24, 2024 by XiaohanZhangCMU • Draft
8 tasks
Column logical (not physical) type and allow_schema_mismatch
#606 opened Feb 22, 2024 by knighton Loading…
10
parallel merge index
#590 opened Feb 5, 2024 by XiaohanZhangCMU Loading…
8 tasks
37
Add varint to MDS
#574 opened Jan 23, 2024 by knighton Loading…
4
Add options to precompute the epoch
#569 opened Jan 20, 2024 by knighton Loading…
Nuke 1) torch dist, 2) shared memory, and 3) filelock
#556 opened Dec 30, 2023 by knighton Loading…
Add fine-grained timings to Writers
#555 opened Dec 30, 2023 by knighton Loading…
Let's blow away dist, and also shared memory
#552 opened Dec 26, 2023 by knighton • Draft
2 of 3 tasks
Parquet streaming [WIP]
#538 opened Dec 15, 2023 by knighton Loading…
Moved local directory creation and existence check from CloudUploader to Writer class
#520 opened Dec 6, 2023 by karan6181 • Draft
8 tasks
"Golden spike" PR
#488 opened Oct 28, 2023 by knighton • Draft
1
Hf ingestion
#483 opened Oct 23, 2023 by XiaohanZhangCMU Loading…
8 tasks
3
Modify dataframe_to_mds to accept streaming DF
#478 opened Oct 20, 2023 by maddiedawson Loading…
8 tasks
1
Training on PQ shards
#443 opened Sep 22, 2023 by knighton Loading…
8 tasks
4
tag shared and temp files with username
#430 opened Sep 11, 2023 by acutkosky Loading…
3 of 8 tasks
1
1
Experiment: much more powerful MDS type system ("DBS").
#384 opened Aug 16, 2023 by knighton • Draft
1
Parallelize StreamingDataset index downloads.
#285 opened Jun 2, 2023 by knighton Loading…
8 tasks
Shared lock
#250 opened Apr 29, 2023 by knighton Loading…
8 tasks
Redesign partitioning algorithm
#131 opened Jan 23, 2023 by knighton • Draft
8 tasks
52
ProTip! Mix and match filters to narrow down what you’re looking for.