Senior Applied Scientist at Zillow in Remote-USA

Job description

• The Agentic Foundations team is a focused group of 15–20 applied scientists within Zillow's broader Agentic AI organization, building the foundational AI technologies that power the next generation of home shopping experiences. This Senior Applied Scientist will focus on model post-training and reward modeling — the science that lets our agents measurably improve over time as part of a self-evolving agentic system. The role will drive complex, ambiguous work end-to-end, partnering closely with product, engineering, science, platform, and data teams to translate the latest advances in LLMs, reinforcement learning, and post-training into production impact. This is an exciting time to join as Zillow is building agentic skills across the full home-shopping journey — from search and personalized guidance to offer strategy and financing — at a scale of hundreds of millions of requests per day.
• About the role

Responsibilities

• Own LLM post-training pipelines — SFT, DPO, and reinforcement fine-tuning (RFT/GRPO) — running training end-to-end on GPU infrastructure.
• Build and train fast, multi-category reward models (PRMs) that emit scalar signals from contrastive preference pairs.
• Design on-policy and online assessment: score live agent trajectories using LLM-as-a-Judge frameworks.
• Translate offline evaluation rubrics into generalizable reward functions that work on arbitrary production traces.
• Independently drive complex work end-to-end by collaborating across partner teams.
• Provide technical leadership and mentorship while helping translate state-of-the-art AI research into production impact.

Requirements

• Who you are
• Master's degree or higher in Computer Science or a related field.
• Hands-on experience with LLM post-training and RL fine-tuning: SFT, DPO, RFT/GRPO, running end-to-end training runs on GPU infrastructure.
• Exposure to reward model development — research-level experience is sufficient; production deployment is not required.
• Strong knowledge of generative AI, including foundation models, transformers, reinforcement learning, and preference learning.
• Ability to independently scope and solve ambiguous problems end-to-end while providing technical leadership to scientists and MLEs.
• Strong programming skills, especially Python, plus experience with ML frameworks such as PyTorch or TensorFlow.
• PhD in Computer Science, Machine Learning, or a related field.
• Experience evaluating agentic AI: multi-turn trace analysis, LLM-as-a-Judge, and the interaction between offline evals and online monitoring.
• Published work in post-training, RLHF/RLAIF, preference learning, or reward modeling.
• Experience with GPU training platforms such as Databricks or Fireworks.

Skills

Required

• LLM post-training (SFT, DPO, RFT/GRPO)
• Reinforcement learning fine-tuning
• Reward model development
• Generative AI
• Foundation models
• Transformers
• Preference learning
• Python
• PyTorch
• TensorFlow

Preferred

• Agentic AI evaluation
• Multi-turn trace analysis
• LLM-as-a-Judge

Benefits

• In California, Connecticut, Maryland, Massachusetts, New Jersey, New York, Washington state, and Washington DC the standard base pay range for this role is $160,900.00 - $257,100.00 annually. This base pay range is specific to these locations and may not be applicable to other locations.
• In Colorado, Hawaii, Illinois, Maine, Minnesota, Nevada, Ohio, Rhode Island, Vermont, and Virginia the standard base pay range for this role is $152,900.00 - $244,300.00 annually. The base pay range is specific to these locations and may not be applicable to other locations.
• In addition to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location. Actual amounts will vary depending on experience, performance and location. Employees in this role will not be paid below the salary threshold for exempt employees in the state where they reside.