-
Notifications
You must be signed in to change notification settings - Fork 107
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
RFC: A Calibratable Offline Serving Simulator for PegaInfer
discussionDesign discussion before implementationDesign discussion before implementationenhancementNew feature or requestNew feature or requestroadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapStatus: Open.#1039 In pegainfer-project/pegainfer;[Model] Gemma 4 M3 31B
gemma4gemma4 model crate (pegainfer-gemma4)gemma4 model crate (pegainfer-gemma4)roadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapStatus: Open.#986 In pegainfer-project/pegainfer;[Model] Gemma 4 M2 26B-A4B
gemma4gemma4 model crate (pegainfer-gemma4)gemma4 model crate (pegainfer-gemma4)hw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verifyroadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapStatus: Open.#985 In pegainfer-project/pegainfer;[Model] Gemma 4 M1 12B
gemma4gemma4 model crate (pegainfer-gemma4)gemma4 model crate (pegainfer-gemma4)hw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verifyroadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapStatus: Open.#984 In pegainfer-project/pegainfer;ci: fuse duplicate PR gates and reduce repeated setup
enhancementNew feature or requestNew feature or requesthw:noneNo GPU required — CPU-only / docs / infraNo GPU required — CPU-only / docs / infraStatus: Open.#975 In pegainfer-project/pegainfer;Reduce duplicated CPU operator oracles in the HD256/HD512 QK-RoPE smokes
enhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededhw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verifystaleAutomatically marked after inactivityAutomatically marked after inactivityStatus: Open.#943 In pegainfer-project/pegainfer;Make explicitly selected Qwen model gates fail closed
bugSomething isn't workingSomething isn't workinghw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verifyqwen3Qwen3 model crate (pegainfer-qwen3)Qwen3 model crate (pegainfer-qwen3)qwen35Qwen3.5 model crate (pegainfer-qwen35)Qwen3.5 model crate (pegainfer-qwen35)Status: Open.#942 In pegainfer-project/pegainfer;qwen3/dflash: DFlash 2 proposer — top-16 path selector + two-tap dynamic convolution (~+21% acceptance length over DFlash)
enhancementNew feature or requestNew feature or requesthw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verifyqwen3Qwen3 model crate (pegainfer-qwen3)Qwen3 model crate (pegainfer-qwen3)Status: Open.#930 In pegainfer-project/pegainfer;Migrate qwen3 onto openinfer-kv-store (retire the remote-fetch state machine)
enhancementNew feature or requestNew feature or requesthw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verifyqwen3Qwen3 model crate (pegainfer-qwen3)Qwen3 model crate (pegainfer-qwen3)Status: Open.#828 In pegainfer-project/pegainfer;kv-store: unified KV cache orchestration — design + migration tracking
roadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapstaleAutomatically marked after inactivityAutomatically marked after inactivityStatus: Open.#824 In pegainfer-project/pegainfer;glm52: two NCCL copies in one process corrupt the TP4 prefill comm (missing libnccl.so symlink in shared lib dir)
bugSomething isn't workingSomething isn't workingglm52GLM5.2 model crate (pegainfer-glm52)GLM5.2 model crate (pegainfer-glm52)hw:multi-gpuNeeds multiple GPUs to verifyNeeds multiple GPUs to verifyStatus: Open.#810 In pegainfer-project/pegainfer;glm52: session-affinity / cache-aware decode routing for wide EP fleets
enhancementNew feature or requestNew feature or requestglm52GLM5.2 model crate (pegainfer-glm52)GLM5.2 model crate (pegainfer-glm52)hw:multi-gpuNeeds multiple GPUs to verifyNeeds multiple GPUs to verifyStatus: Open.#806 In pegainfer-project/pegainfer;