This is the official repository for the virtual machine version of Nutanix GPT-in-a-Box.
Nutanix GPT-in-a-Box is a new turnkey solution that includes everything needed to build AI-ready infrastructure for organizations wanting to implement GPT capabilities while maintaining control of their data and applications.
This new solution includes:
- Software-defined Nutanix Cloud Platform™ infrastructure supporting GPU-enabled server nodes for seamless scaling of virtualized compute, storage, and networking supporting both traditional virtual machines and Kubernetes-orchestrated containers
- Files and Objects storage; to fine-tune and run a choice of GPT models
- Open source software to deploy and run AI workloads including PyTorch framework & KubeFlow MLOps platform
- The management interface for enhanced terminal UI or standard CLI
- Support for a curated set of LLMs including Llama2, Falcon and MPT
Refer to the official GPT-in-a-Box Documentation to deploy and validate the inference server on virtual machine