Skip to content

add sagemaker inference component deployment for mutiple deepseek models#50

Open
qingyuan18 wants to merge 1 commit intoaws-samples:mainfrom
qingyuan18:main
Open

add sagemaker inference component deployment for mutiple deepseek models#50
qingyuan18 wants to merge 1 commit intoaws-samples:mainfrom
qingyuan18:main

Conversation

@qingyuan18
Copy link

Issue #, if available:

Description of changes:
use SageMaker new inference Componet to deply mutiple DeepSeek R1 Distill Model

  • use SM DLC lmi image
  • use mutiple GPU seperation & division for copies of DeepSeek R1 models(32B + 1.5B)

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant