Popular repositories Loading

1. sagemaker-genai-hosting-examples sagemaker-genai-hosting-examples Public

   Forked from aws-samples/sagemaker-genai-hosting-examples

   Jupyter Notebook 1

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 1

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

4. sample-openai-on-aws sample-openai-on-aws Public

   Forked from aws-samples/sample-openai-on-aws

   Jupyter Notebook 1

5. semantic-router semantic-router Public

   Forked from vllm-project/semantic-router

   Intelligent Mixture-of-Models Router for Efficient LLM Inference

   Python 1

6. hf-mem hf-mem Public

   Forked from alvarobartt/hf-mem

   A CLI to estimate inference memory requirements for Hugging Face models, written in Python.

   Python 1