tfservingke : Autoscaling TensorFlow Model Deployments # TF Serving # Kubernetes # ResNet101 # Locust
- Configure GKE cluster with an autoscaling node pool.
- Create a GKE cluster with autoscaling enabled on a default node pool
- Deploy TensorFlow Serving in an autoscalable configuration.
- Deploy ResNet101 model using TensorFlow Serving
- Configure Horizontal Pod Autoscaler
- Monitor serving performance & resource utilization
- Install Locust
- Load ResNet101 model
- Monitor the model deployment




























