Staff Machine Learning Engineer, Adobe Firefly
San Jose, California
Saloni Garg is a Staff Machine Learning Engineer at Adobe Firefly, where she is Tech Lead for post-training multimodal LLM optimizations and technical lead for distillation of diffusion models used in video generation and editing. Her work covers post-training infrastructure, RLHF pipelines, and high-throughput GPU training.
She previously worked at Wayfair as a Senior Machine Learning Engineer and a Machine Learning Engineer, and as a Data Scientist at The Linux Foundation. She is co-author of a textbook on retrieval-augmented generation (De Gruyter, 2026) and recipient of the 2026 CITRIS Athena Award.
Focus: post-training / distillation / RLHF, SFT and DPO / GPU training infrastructure (PyTorch, CUDA, FSDP, NCCL) / retrieval-augmented generation
LinkedIn / GitHub / Google Scholar / Book / Hugging Face / OpenReview / Email
Firefly, San Jose, CA. Tech Lead for post-training multimodal LLM optimizations.
- Lead post-training infrastructure for LLMs and diffusion models (PyTorch, CUDA, FSDP, NCCL), enabling fast iteration on quality and alignment.
- Own end-to-end RLHF pipelines (reward models, preference data, policy optimization) for production LLM alignment; implemented SFT and preference-based optimization (DPO) pipelines.
- Technical lead for distillation of diffusion models for video generation, editing, and propagation-based editing. Distilled models are live in production, preserving 98%+ teacher model quality in internal human-preference evaluations while reducing sampling steps from 50 to 4-8.
- Developed high-throughput GPU training pipelines with mixed precision (FP16/BF16), gradient checkpointing, and optimized dataloaders; reduced training time by 2.2x for Firefly video generation.
- Led a team of 6 ML engineers on generative models and large-scale distributed training.
San Francisco Bay Area. Designed and developed a visual product search system using deep image embeddings to retrieve visually similar furniture products across 30M+ catalog images. Built multimodal retrieval models combining product images, titles, descriptions, and catalog attributes for search and recommendation candidate generation.
Berlin, Germany. Developed image-text matching models aligning customer queries with product imagery; built pipelines to extract product attributes (color, material, style, shape, room placement) from product images; developed computer vision classifiers across 3k+ furniture categories; created large-scale multimodal datasets from product images, descriptions, taxonomy labels, reviews, and interaction data.
The LNM Institute of Information Technology, Jaipur, India.
RL environment for diagnosing GPU training failures, in Prime Intellect Verifiers format. Published on the Prime Intellect Hub and as a dataset on Hugging Face, with train, hard, test, and out-of-distribution splits and a full validation run on A100 hardware.
Python / Verifiers / Prime Intellect / Hugging Face
Contribution to OpenEnv: code verifiers no longer pass on an untouched database. Marked ready for review, with the environment test suite passing.
Python / RL environments / open source contribution
Provenance-first, correctable memory layer for AI agents: source pointers, append-only log, tombstones, and an MCP server. Published under MIT; listed on Glama.
Python / MCP / SQLite or Postgres / MIT
Browser agent for general web tasks: shadow DOM and iframe handling, canvas vision fallback, uploads, drag and drop, multi-tab support, MCP server, and a benchmark suite. Published under MIT.
TypeScript / Playwright / MCP / MIT
Contributor to Ray and PyTorch. Full list of repositories at github.com/saloni-garg.
AI Risk Summit. KV-Cache as Attack Surface: Side Channels in Shared LLM Inference Infrastructure.
CloudX. Token Spikes, Timeout Cascades, and Silent Failures: Debugging GenAI Systems in Production.
Vector Search Conference. GPU or CPU? Optimizing Vector Search Infrastructure for Cost and Speed.
CloudX. How to Build a Blameless Debugging Culture with Observability Tools.
NDC London. Neural Style Transfer: The Art and Science of Generative AI.
BuildStuff, Vilnius. Can You Guess Which Song Snippets Are Written by AI?
CloudX PRO. Serverless: Because Managing Servers Is So 2022.
Red Hat Summit, Boston. Women in Open Source Award segment, and an interview on theCUBE.
Linux App Summit, Barcelona. Lightning talk, "Open Source is great, how can we spread it?", with Amit Sagtani; filmed interview with Nextcloud founder Frank Karlitschek.
UseData Conf, Moscow. Machine Learning Based Autonomous Car Driving Algorithms.
PyCon; ILP Summit. Tech speaker.
LinkedIn: linkedin.com/in/saloni-garg
Google Scholar: Google Scholar profile
GitHub: github.com/saloni-garg
Email salonigarg2318@gmail.com