Skip to content

tfservingke πŸ›ŒπŸ§ πŸ‹οΈ : Autoscaling TensorFlow Model Deployments # TF Serving # Kubernetes # ResNet101 # Locust

Notifications You must be signed in to change notification settings

miozilla/tfservingke

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

tfservingke πŸ›ŒπŸ§ πŸ‹οΈ

tfservingke : Autoscaling TensorFlow Model Deployments # TF Serving # Kubernetes # ResNet101 # Locust

Objective

  • Configure GKE cluster with an autoscaling node pool.
    • Create a GKE cluster with autoscaling enabled on a default node pool
  • Deploy TensorFlow Serving in an autoscalable configuration.
    • Deploy ResNet101 model using TensorFlow Serving
  • Configure Horizontal Pod Autoscaler
  • Monitor serving performance & resource utilization
    • Install Locust
    • Load ResNet101 model
    • Monitor the model deployment

Autoscaling TensorFlow Model Deployments with TF Serving and Kubernetes

tfservingke001.png

tfservingke002.png

tfservingke003.png

tfservingke004.png

tfservingke005.png

tfservingke006.png

tfservingke007.png

tfservingke008.png

tfservingke009.png

tfservingke010.png

tfservingke011.png

tfservingke012.png

tfservingke013.png

tfservingke014.png

tfservingke015.png

tfservingke016.png

tfservingke017.png

tfservingke018.png

tfservingke019.png

tfservingke020.png

tfservingke021.png

tfservingke022.png

tfservingke023.png

tfservingke024.png

tfservingke025.png

tfservingke026.png

tfservingke027.png

tfservingke028.png

tfservingke029.png

About

tfservingke πŸ›ŒπŸ§ πŸ‹οΈ : Autoscaling TensorFlow Model Deployments # TF Serving # Kubernetes # ResNet101 # Locust

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published