Skip to content
View nbethala's full-sized avatar
1 follower · 6 following

Block or report nbethala

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
nbethala/README.md

Nancy Bethala-Frounjian

Senior AI Infrastructure Engineer | GPU & Inference Systems

Hi, I’m Nancy. I build and debug AI systems from the infrastructure up - from CUDA and GPU environments to inference runtimes and agentic workflows. Most of my projects begin as experiments: I build, break, test, and turn what I learn into repeatable workflows. I bring 14 years of earlier experience in enterprise infrastructure, data systems, high-availability operations, and incident response.

LinkedIn StackBytes GitHub Labs Email

Open-Source Contributions

  • vLLM — PR #34978: Investigated a DeepSeek-R1 reasoning-boundary failure involving speculative decoding and structured output, then submitted scheduler/parser changes and validation for the failure path.

Current Focus

Most of my hands-on builds live at @scalable-ml-systems:

  • GPU platform reliability: NVIDIA and AMD/ROCm environment qualification, hardware/runtime compatibility, Kubernetes GPU scheduling, observability, and failure recovery.

  • Inference systems: vLLM and Triton serving, workload characterization, TTFT/ITL/throughput analysis, KV-cache behavior, routing, fallback, and backend health.

  • Reliable AI workflows: evidence contracts, bounded agent execution, evaluation, provenance, and human approval boundaries.

  • Frontier systems exploration: world-model training and inference infrastructure, accelerators, reliability, and evaluation.

📖 I write about what I’m building and learning at StackBytes.

📬 Contact: nfrounjian@gmail.com | Connect on LinkedIn

Pinned Loading

  1. scalable-ml-systems/llm-inference-platform scalable-ml-systems/llm-inference-platform Public

    Distributed LLM Inference Platform (vLLM)

    Python 3 2

  2. scalable-ml-systems/amd-rocm-platform-engineering scalable-ml-systems/amd-rocm-platform-engineering Public

    AMD Instinct Production AI Platform Engineering Lab

    HTML

  3. scalable-ml-systems/gpu-platform-engineering-lab scalable-ml-systems/gpu-platform-engineering-lab Public

    This repository documents a practical GPU platform engineering lab for Kubernetes-based AI infrastructure.

    Python

  4. scalable-ml-systems/llm-inference-baseline scalable-ml-systems/llm-inference-baseline Public

    This project characterizes a single vLLM backend under realistic workload shapes before adding routing, scheduling, or multi-backend orchestration.

    Python

  5. scalable-ml-systems/llm-systems-engineering-lab scalable-ml-systems/llm-systems-engineering-lab Public

    Kubernetes-native LLM inference systems lab focused on performance triage, routing, distributed serving, and operational reliability.

    Shell

  6. scalable-ml-systems/full-stack-ai-systems-platform scalable-ml-systems/full-stack-ai-systems-platform Public

    Full-Stack AI Systems Platform

    Python