Saloni Garg

01Experience

• Jul 2025 to Present

  Staff Machine Learning Engineer, Adobe (Firefly)

  San Jose, CA

  - Led development of the post-training and RLHF pipelines for multimodal foundation models, supporting SFT, DPO, and reward model training across 1,000+ GPU clusters using PyTorch, CUDA, FSDP, and NCCL.

  - Built distributed training pipelines that supported 500+ large-scale training runs per week, reducing end-to-end training time by 2.2x through mixed precision, activation checkpointing, and communication optimizations.

  - Developed automated evaluation infrastructure spanning 50+ benchmarks and 10,000+ model evaluations per day, enabling rapid iteration on model quality, reasoning, and safety.

  - Built RLHF preference data generation and curation pipelines processing 100M+ model responses and producing 20M+ preference pairs for post-training and alignment.

  - Improved multi-node training efficiency by increasing GPU utilization from 58% to 86%, reducing GPU compute cost by 40% while improving cluster reliability.

  - Partnered with research scientists to productionize post-training algorithms for multimodal models ranging from 7B to 30B parameters, enabling weekly model releases and reproducible large-scale experimentation.

  - Optimized video diffusion inference by profiling UNet, attention, VAE, and temporal modules with PyTorch Profiler, NVIDIA Nsight Systems/Compute, and CUDA Graphs, identifying GPU synchronization, kernel launch, and memory bottlenecks responsible for 34% of end-to-end latency.

  - Refactored GPU execution to overlap preprocessing, denoising, attention, and VAE stages using asynchronous execution and CPU-GPU pipelining, improving sustained GPU utilization from 55% to 82% and recovering 15-20% additional serving capacity.

  - Developed dynamic batching and request scheduling policies for variable-length video generation workloads, improving throughput per GPU by 1.8x while maintaining p95 latency under 20 seconds.

• Oct 2020 to Jul 2025

  Senior ML Infrastructure Engineer, Wayfair

  Mountain View, CA

  - Productized ML systems for the search and recommendation platform, serving 5M+ customer interactions daily and improving ranking and recommendation quality for high-traffic surfaces.

  - Optimized distributed model-serving pipelines for latency and throughput, reducing p95 inference latency by 32% and increasing serving throughput by 2.1x through batching, parallel execution, feature-pipeline optimization, and resource tuning.

  - Developed high-throughput Python/C++ inference and feature-processing components, profiling CPU, memory, network, and serialization overhead to eliminate bottlenecks in latency-sensitive production services.

  - Designed scalable offline and online inference pipelines processing billions of product, customer, and behavioral signals, improving feature freshness while reducing compute and infrastructure costs by 27%.

  - Built distributed benchmarking and performance-analysis tooling to evaluate model execution, feature retrieval, batch sizes, concurrency, and resource utilization across production workloads, reducing performance-debugging cycles from days to hours.

  - Improved model serving efficiency through dynamic batching, caching, asynchronous execution, and resource-aware scheduling, increasing hardware utilization by ~35% while maintaining production latency SLOs.

• Jul 2017 to Oct 2020

  Founding ML Engineer, Brisko

  Bengaluru, India

  - Built the core voice AI/NLP stack from scratch: speech-to-text, intent classification, entity extraction, and dialogue-understanding models that achieved 90%+ intent accuracy across 50+ voice intents.

  - Developed and optimized real-time voice inference pipelines for conversational assistants, reducing end-to-end response latency by 40% and supporting ~2k voice interactions/month across early customer deployments.

• Education

  B.Tech, Computer Science and Engineering, LNMIIT Jaipur

  The LNM Institute of Information Technology, Jaipur, India.

02Selected work

• 2026

  Memline

  Trustworthy memory layer for AI applications: a grounding write gate that rejects memories the source does not support, temporal validity with full revision history, explainable retrieval, and Memory Health reporting. Ships a /v1 REST API, Python and TypeScript SDKs, an MCP server, and a migration and audit tool for existing memory stores. Open core published under Apache 2.0. v0.1.0 Release

  Python / FastAPI / SQLite / MCP / Apache 2.0

• 2026

  AgentLab

  A reproducible laboratory for studying the scaling behavior of LLM agent organizations — config-driven experiments, calibration gates, deterministic replay, and sealed, auditable results. Version 1.0 released publicly. v1.0 Release

• 2026

  gpu-train-debug

  RL environment for diagnosing GPU training failures, in Prime Intellect Verifiers format. Published on the Prime Intellect Hub and as a dataset on Hugging Face, with train, hard, test, and out-of-distribution splits and a full validation run on A100 hardware.

  Python / Verifiers / Prime Intellect / Hugging Face

• 2026

  memfix

  Provenance-first, correctable memory layer for AI agents: source pointers, append-only log, tombstones, and an MCP server. Published under MIT; listed on Glama.

  Python / MCP / SQLite or Postgres / MIT

• 2026

  jev-max

  Browser agent for general web tasks: shadow DOM and iframe handling, canvas vision fallback, uploads, drag and drop, multi-tab support, MCP server, and a benchmark suite. Published under MIT.

  TypeScript / Playwright / MCP / MIT

• Ongoing

  Open source

  Contributor to Ray and PyTorch. Full list of repositories at github.com/saloni-garg.

03Open source contributions

Pull requests I have sent upstream, grouped by the bug or feature. Statuses as of November 2026; every title links to the PR itself. Three have landed so far: the Triton interpreter fix (merged), and both torch_tpu fixes (landed on main via Copybara, which closes the GitHub PR without a merged flag).

One bug, five codebases: uniform-reward GRPO groups

In GRPO training, when every response in a group earns the same reward, the advantage should be exactly zero. Float32 group statistics invented a nonzero one instead. I found the bug class, fixed it, and sent the same fix upstream five times:

• verl-project/verl

  "[algo] fix: give uniform reward groups exactly zero grpo advantage."

  Scalar and vectorized paths fixed; new tests cover uniform groups at several sizes.

  PR #8349

• THUDM/slime

  "fix(data): give uniform reward groups exactly zero advantage."

  Fix in the grouped-reward post-processing, with new grouped-reward tests.

  PR #2494

• OpenRLHF/OpenRLHF

  "fix(ppo): give uniform reward groups exactly zero advantage in group_norm."

  The most severe instance found: uniform groups were getting advantages up to about 0.98 instead of 0.

  PR #1383

• NovaSky-AI/SkyRL

  "[fix][train] Give uniform reward groups exactly zero GRPO advantage."

  Fix in the PPO utilities, with new unit tests for uniform groups.

  PR #2531

• hiyouga/EasyR1

  "[algo] fix grpo giving uniform reward groups nonzero advantages."

  EasyR1 vendors the same algorithm code, bug included; fixed with tests.

  PR #11020

RLHF reward correctness

• allenai/open-instruct

  "Fix R1-style format reward gate for non-default reward scales."

  The format reward gate compared scores against a literal 1 instead of the configured reward scale, so non-default scales were gated wrong; the fix compares against the configured scale, with tests.

  PR #2134

• allenai/open-instruct

  "Fix: Key local dataset directory caches on directory content, not path."

  Dataset caches for a local directory of shards were keyed on the directory path alone, so rewriting the shards in place silently trained on stale rows; the fix keys the cache on a hash of the directory contents, with tests.

  PR #2159

• NovaSky-AI/SkyRL

  "[fix][arctic_rl] detect limit at the top level only when capping bird reward queries."

  The arctic_rl BIRD reward skipped its 5000-row cap whenever the text LIMIT appeared anywhere in a query, including inside a subquery or a comment; the fix counts only a top level LIMIT clause, with tests.

  PR #2603

Compilers, TPU, and Triton

• google-pytorch/torch_tpu

  "Fix view decomposition returning a base larger than the view storage."

  The view decomposition fallback could build a base tensor larger than the storage it views; the fix re-checks the base and declines the decomposition. Landed on main via Copybara, 30 October 2026.

  PR #5846 - landed

• google-pytorch/torch_tpu

  "Fix view decomposition IndexError on 0-d views with a storage offset."

  Zero-dimensional views with a storage offset crashed the decomposition; the fix declines it cleanly instead. Landed on main via Copybara, 29 October 2026.

  PR #5847 - landed

• triton-lang/triton

  "[Interpreter] Fix NaN/Inf handling in interpreter float conversions."

  The Triton interpreter's float conversions mishandled NaN and infinity; fixed with regression tests. Merged 30 October 2026.

  PR #12489 - merged

Verifiers and evaluation tooling

• openenv/OpenEnv

  "fix: stop awm code verifiers from passing on an untouched database."

  Over a thousand AWM code verifiers passed against a freshly seeded database; the fix adds a no-change guard. Test suite passing.

  PR #1477

• openai/human-eval

  "Fix completions ending in a decorator replacing the test's check()."

  In the execution harness, a completion ending in a bare decorator could replace the test's own check function and pass without running; the fix isolates the test block.

  PR #72

• anthropics/jacobian-lens

  "Raise in JacobianLens.save() when the storage dtype would turn finite entries into inf."

  Saving cast Jacobians to fp16 unchecked, silently turning large finite entries into infinity; the fix raises a clear error naming the layer.

  PR #21

Inference serving

• ai-dynamo/dynamo

  "fix(profiler): recognize SGLang --tp-size/--pp-size spellings in multinode placement."

  The profiler sized SGLang workers launched with the short size spellings as single-GPU instances and stripped their multinode placement; the fix teaches the parser those spellings, with the first unit tests for set_multinode_config.

  PR #17502

• ai-dynamo/dynamo

  "fix(operator): reject backendFramework resolution failures at admission."

  Admission validation for disaggregated serving configs now resolves each component's backend framework the way the renderer does and rejects what it cannot resolve, including mixed worker frameworks across a graph, with tests.

  PR #17801

• sgl-project/sglang

  "[Feat] metrics: expose detokenizer worker processing time."

  Adds a processing time histogram for the detokenizer worker (sglang:detokenizer_processing_seconds), one slice of the metric coverage umbrella in issue #43304, with tests.

  PR #47877

• NVIDIA/Model-Optimizer

  "fix static nvfp4 fake quant for unpromoted weight quantizers in TensorQuantizer."

  Static NVFP4 fake quantization in TensorQuantizer raised NotImplementedError for weight quantizers; the fix routes it through the static blockwise fake quant path, with tests.

  PR #3167

Also open: a listing PR adding memfix to punkpeye/awesome-mcp-servers (PR #16020).

04Publications and IP

• Book: Retrieval-Augmented Generation (RAG) for Enhancing AI Applications. De Gruyter, 2026. Publisher page via the book link.
• Patent: A System and Method for Automated Drift Detection and Model Retraining in Machine Learning Pipelines. Indian Patent Office, 2025.
• Patent: AI and Computer Vision-Based Animal Surveillance System. Indian Patent Office, 2024.
• The Compression Tax: An Audit of How Post-Training Quantization Redistributes Safety and Fairness Failures in Open Language Models. With Amit Sagtani. ACM FAccT 2027 submission. Paper (PDF).
• ClaimWork: A Reproducible Evaluation Platform for Procedural AI Systems. Status paper, 2026.
• Unsolvability Ceiling in Multi-LLM Routing: An Empirical Study of Evaluation Artifacts. arXiv.
• ECG-Lense: Benchmarking ML and DL Models on PTB-XL Dataset. IEEE, 2024.
• Climate Change Analytics Using AI. IEEE ETNCC, 2024.
• Further papers: Production-Grade Retrieval-Augmented Generation: Architecture, Failure Modes, and Optimization at Scale; Cost-Efficient Large Language Model Serving Through Adaptive Inference and Resource-Aware Scheduling; Designing Scalable Agentic Retrieval Systems for Autonomous Decision-Making Under Real-World Constraints; Inference-First Architectures for Large Language Models in Cloud-Native Environments.

05Talks

• 2026

  AI Risk Summit. KV-Cache as Attack Surface: Side Channels in Shared LLM Inference Infrastructure.

• 2026

  CloudX. Token Spikes, Timeout Cascades, and Silent Failures: Debugging GenAI Systems in Production.

• 2025

  Vector Search Conference. GPU or CPU? Optimizing Vector Search Infrastructure for Cost and Speed.

• 2025

  CloudX. How to Build a Blameless Debugging Culture with Observability Tools.

• 2024

  NDC London. Neural Style Transfer: The Art and Science of Generative AI.

• 2023

  BuildStuff, Vilnius. Can You Guess Which Song Snippets Are Written by AI?

• 2023

  CloudX PRO. Serverless: Because Managing Servers Is So 2022.

• 2019

  Red Hat Summit, Boston. Women in Open Source Award segment, and an interview on theCUBE.

• 2019

  Linux App Summit, Barcelona. Lightning talk, "Open Source is great, how can we spread it?", with Amit Sagtani; filmed interview with Nextcloud founder Frank Karlitschek.

• 2019

  UseData Conf, Moscow. Machine Learning Based Autonomous Car Driving Algorithms.

• Also

  PyCon; ILP Summit. Tech speaker.

06Awards and recognition

• 2026 CITRIS Award by UC Berkeley.
• Adobe Employee Spot Bonus, 2026.
• AI and Data Science Leader of the Year, 2025. WomenTech Global Awards.
• AI for Good Impact Award, 2025.
• International Women in Open Source Award, 2019. Red Hat, Boston.
• Google Venkat Panchapakesan Memorial Scholar. Selected top 6 from 1000+ applicants.
• Silicon Valley Fellowship. Top 100 out of 20,000 applicants.
• Mozilla Open Leader, 2019.

07Contact

LinkedIn: linkedin.com/in/saloni-garg
Google Scholar: Google Scholar profile
GitHub: github.com/saloni-garg

Email salonigarg2318@gmail.com