Search results

Better Documentation for Custom Inference and HF_MODEL_ID

Status: Open.

#140 In aws/sagemaker-huggingface-inference-toolkit;

· rotexhawk opened on Jul 8, 2025

Unable to deploy on SageMaker diffusers dropped device_type="auto"

Status: Open.

#139 In aws/sagemaker-huggingface-inference-toolkit;

· liogate opened on May 14, 2025

Task image-text-to-text fails with AttributeError: 'str' object has no attribute 'pad_token_id'

Status: Open.

#135 In aws/sagemaker-huggingface-inference-toolkit;

· TrevinAvery opened on Mar 14, 2025

Error while loading Mixtral-8x7B-Instruct-v0.1 tokenizer with AutoTokenizer.from_pretrained

Status: Open.

#134 In aws/sagemaker-huggingface-inference-toolkit;

· will-johnstunning opened on Jan 11, 2025

Server reruns same task multiple times

Status: Open.

#133 In aws/sagemaker-huggingface-inference-toolkit;

· kurtgdl opened on Dec 4, 2024

Support load_lora_weights in inference API deploy

Status: Open.

#131 In aws/sagemaker-huggingface-inference-toolkit;

· haktan-suren opened on Aug 21, 2024

SageMaker fails because Conversation object is not found

Status: Open.

#129 In aws/sagemaker-huggingface-inference-toolkit;

· adrihercer opened on Jun 28, 2024

Can’t create an inference service for models that depend on packages i.e. espeak

Status: Open.

#128 In aws/sagemaker-huggingface-inference-toolkit;

· ghubnerr opened on Jun 23, 2024

Custom Inference Code - model_fn() takes more positional argument

Status: Open.

#126 In aws/sagemaker-huggingface-inference-toolkit;

· dil-bhantos opened on Jun 17, 2024

Sagemaker HuggingfaceModel fails on phi3 model deployment

Status: Open.

#123 In aws/sagemaker-huggingface-inference-toolkit;

· manikawnth opened on May 21, 2024

Sagemaker endpoint inference Fails when following a tutorial

Status: Open.

#122 In aws/sagemaker-huggingface-inference-toolkit;

· IoannisDem opened on May 9, 2024

device kernel image is invalid

Status: Open.

#119 In aws/sagemaker-huggingface-inference-toolkit;

· geraldstanje1 opened on May 7, 2024