Skip to content

macOS MPS: merge projector, prefer float32 on MPS, add smoke tests#27

Open
jetstartai wants to merge 2 commits into
bytedance:mainfrom
jetstartai:MacOS-MPS
Open

macOS MPS: merge projector, prefer float32 on MPS, add smoke tests#27
jetstartai wants to merge 2 commits into
bytedance:mainfrom
jetstartai:MacOS-MPS

Conversation

@jetstartai

Copy link
Copy Markdown

Fixes macOS MPS instability when running inference.

Summary:

  1. Merge projection safetensor into main checkpoint when PROJECTION_MODEL exists.
  2. Prefer float32 on Apple MPS devices by default for numeric stability.
  3. Add tools/smoke_minimal.py to run quick isolation tests and save outputs to output/inference/.

Related: #20

Notes: Branch is provided from fork: jetstartai:MacOS-MPS. Please review and assign as needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants