Skip to content
View V-3604's full-sized avatar

Block or report V-3604

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
V-3604/README.md

Varshith Gowda K

Data Science undergraduate at the University of Minnesota (BS, May 2027). I work on LLM serving infrastructure, multi-tenant Kubernetes platforms, and cloud cost attribution — production vLLM endpoints with per-team isolation and token-level billing, a K8s competition platform that served 300+ users, and a first-authored multimodal ML benchmark.

Most of my public work is upstream, in other people's repositories.


Upstream contributions

12 merged pull requests across 5 projects. Every link below goes to the PR.

LLM serving and inference

vllm-project/vllm — inference engine

  • #43362[Bugfix] FusedMoE: coerce shape-(1,) per-tensor scales to 0-D scalarmerged
  • #43931[Bugfix] V1: clear stale allowed_token_ids mask in InputBatch.condensein review

vllm-project/aibrix — Kubernetes control plane for LLM serving

  • #2404[Bug] Reflect KubernetesJob worker counts and usage on finalizemerged
  • #2366[Bug] Propagate Redis password to KubernetesJob batch workermerged
  • #2331[Bug] Fix per-model metrics cross-talk on multi-model podsmerged
  • #2450[API] Add explicit StormService deployment mode fieldin review

BerriAI/litellm — LLM gateway: routing, guardrails, spend tracking

  • #28849fix(customer_endpoints): restrict /customer/daily/activity to admin-onlymerged
  • #28764feat(proxy): allow use_redis_transaction_buffer without redis cachemerged
  • #28563fix(guardrails): disable_global_guardrails overrides team listmerged
  • #28260fix(fallbacks): preserve fallback model in SDK fallback responsesmerged
  • #34779fix(complexity_router): escalate a session pin when a turn scores higherin review

ML platform and cloud cost

mlflow/skills (Databricks) — agent skills for MLflow

  • #18feat: Add Gemini/Google provider support across MLflow skillsmerged
  • #19fix(tracing): flush async trace queue before verifying tracesmerged
  • #20feat(annotate-mlflow-trace): add trace tagging and feedback skillin review

opencost/opencost (CNCF) — Kubernetes cost allocation

  • #3821Add field queryProjectID to BigQueryConfigurationmerged
  • #3820fix(azure): make ondemand pricing OS-aware for Windows nodesmerged

Cloud infrastructure

aws/karpenter-provider-aws — EKS node autoscaling

  • #9256fix: set MetadataOptions on the RunInstances dry-run requestin review

Projects

WalkBench — first-authored multimodal benchmark for urban walkability. Four cities, 19,624 intersections, built end to end from data pipeline through fine-tuning and evaluation. A multi-task LoRA adapter on SigLIP-SO400M under leave-one-city-out cross-validation; a three-backbone ensemble reaches cross-city Spearman rho = 0.763, and rho = 0.84–0.86 zero-shot on fully held-out Pittsburgh. Workshop paper under review; arXiv preprint August 2026.

agentds-bench — published PyPI package for competition submissions, scoring, and live leaderboards. Built for AgentDS, a Kubernetes platform I solo-built (JupyterHub, 100 isolated pods, per-team storage isolation, automated evaluation) that served 300+ participants in a $10K competition.

Indelible — multi-region tamper-evident audit ledger on Amazon Aurora DSQL. Hash-chained appends over optimistic concurrency control, Ed25519-signed RFC 6962 checkpoints anchored outside the database trust domain, an offline verifier, and an MCP server for AI-agent audit trails. AWS x Vercel hackathon.

GPU MODE (NVIDIA B200) — custom CUDA/Triton Cholesky kernels benchmarked against cuSOLVER; ranked 18/94.


Stack

Python · TypeScript · SQL · Bash · C++/CUDA Kubernetes · Docker · Terraform · AWS (VPC, IAM, PrivateLink, S3, EC2) · Azure AKS vLLM · PyTorch · Hugging Face Transformers · FastAPI · PostgreSQL · PostGIS

LinkedIn · kvarshithgowda@gmail.com

Pinned Loading

  1. mlflow/skills mlflow/skills Public

    Python 68 21

  2. tenantbench tenantbench Public

    Multi-tenant goodput and fairness benchmark for LLM inference engines

    Python

  3. opencost opencost Public

    Forked from opencost/opencost

    Cost monitoring for Kubernetes workloads and cloud costs

    Go

  4. WalkBench WalkBench Public

    Python 1

  5. vllm vllm Public

    Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python