Senior Data Scientist, Experimentation & AI Measurement

About the team The Zillow Experimentation Platform (ZEXP) team enables Zillow Group's Product, Engineering, and Data Science organizations to test bold ideas, validate strategies, and make trustworthy decisions quickly. Our mission is to make rigorous, self-service experimentation and measurement possible for anyone — regardless of their role — through powerful tools, clear guidance, and scientific rigor. We're part of the Core Data Tech organization, partnering with engineers, data scientists, and machine learning practitioners to scale experimentation and measurement across the Zillow ecosystem. Our work fuels Zillow's Housing Super App strategy by enabling fast, safe, and accurate decision-making rooted in trustworthy data. Learn more about what we're building at About the role As a Senior Data Scientist working in ZEXP, you'll deliver value through your analyses and by elevating the work of the team around you. You'll bring statistical rigor to two connected problems: making Zillow's experimentation practice more self-service and trustworthy, and measuring whether Zillow's growing investment in AI-assisted engineering and development tools creates durable, high-quality value rather than just activity. This is an experienced individual-contributor role that blends hands-on measurement, causal inference, and applied statistics with team leadership. You'll act as a focal point for projects, mentor other scientists and analysts, and represent data science and experimentation to partner teams — advocating for sound measurement wherever decisions get made. You'll balance depth and speed in an environment of competing priorities, and you'll know when further rigor stops adding value. You will get to Design, build, and validate statistically rigorous methods for experiment design and analysis — productionizing techniques such as variance-reduction and sequential testing as reusable, self-service platform capabilities.
Build and improve automated guardrails that prevent the common causes of experiment restarts and manual interventions — in-flight monitoring and alerting, ramp-plan adherence, early-stopping thresholds, and cross-line-of-business guardrail-harm checks — in support of reliable and trustworthy experimentation practices. Lead experiment design reviews for high-visibility launches, catching issues like ill-suited experimental populations, misaligned hypotheses, or contradictory launch criteria, protecting Zillow’s biggest decisions from flawed experimental practices. Define and scale a measurement framework for AI's impact on engineering and behavior — segmenting usage and proficiency at the team and org level, and connecting adoption to behavioral change, productivity, quality, and financial outcomes. Pair velocity signals with lagging quality measures (reverts, change-failure rate, MTTR, defects, maintainability) so that speed gains are never mistaken for net value. Apply causal-inference thinking to AI product and tooling measurement — establishing sound, defensible methods for measuring whether AI investments deliver real value.
Turn complex analyses into leadership-ready narratives and self-service insight experiences that partners can explore on their own. Mentor junior scientists and analysts on the core data science toolkit, share best practices across the team, and lead workstreams end to end. This role has been categorized as a teleworker position. Teleworkers do not have a permanent corporate office workplace and instead work from a physical location of their choice, which must be identified to the Company. Employees may live anywhere in Mexico, with availability to travel to Mexico City, as we recommend attendance at occasional office events. In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location. Who you are Strong applied background in online experimentation and causal inference — frequentist and Bayesian methods, experimental and quasi-experimental designs, and the judgment to know which methods are best suited to answer a given question. Familiar with the common failure modes of experimentation platforms (e.g., sample ratio mismatch, experiment interference, temporal exposure bias, multiple comparisons) and the expertise to detect, diagnose, and design the platform around them. Experienced with measuring productivity or product quality from telemetry — comfortable defining metrics, documenting their limitations, and resisting the urge to over-claim causality from cross-sectional observational data. A clear communicator who tells a persuasive story with data and tailors the level of technical detail to the audience, from engineers to executives. Proficient in Python and SQL, with relevant libraries (e.g., NumPy, pandas, scikit-learn); comfortable moving between different tools, codebases, and data sources. A trusted mentor and partner who raises the bar on best practices and advocates for data science across disciplines without alienating others. Curious about AI/ML measurement — LLM-assisted analysis, agentic tools, and how to evaluate them rigorously — a strong plus. Qualifications PhD and 2+ years, MS and 4+ years, or BS and 6+ years of experience in Statistics, Econometrics, Data Science, Machine Learning, Operations Research, or a related quantitative field. Demonstrated track record of owning analyses end to end and turning them into decisions that partners trust. Transferable Skills Here at Zillow, we value the experience and perspective of candidates with non-traditional backgrounds. We encourage you to apply if you have transferable skills or related experience. Get to know us At Zillow, we’re reimagining how people move—through the real estate market and through their careers. As the most-visited real estate platform in the U.S., we help people navigate buying, selling, financing and renting with greater ease and confidence. Whether you're working in tech, sales, operations, or design, you’ll be part of a company that's reshaping an industry and helping more people make home a reality. How we work is a key part of that transformation. Through Cloud HQ, our strategic approach to distributed work, most employees have the flexibility to work from wherever they’re most productive—enabling us to move fast, stay connected and deliver on our people promise.
Zillow is honored to be recognized among the best workplaces in the U.S.. Zillow was named one of FORTUNE 100 Best Companies to Work For® in 2026, and included on TIME’s America’s Best Companies 2026 list, reflecting our commitment to creating an innovative, inclusive, and engaging culture where employees are empowered to grow. No matter where you sit in the organization, your work will help drive innovation, support our customers, and move the industry—and your career—forward, together. Zillow Group is committed to fostering an inclusive, innovative environment and to providing equal employment opportunities. We comply with applicable laws that prohibit discrimination in employment and recruitment. If you have a disability or special need that requires reasonable accommodation during the recruitment process, please contact your recruiter directly. Qualified applicants will be considered for employment based on their qualifications and ability to perform the functions of the position, without discrimination and in accordance with applicable law. Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.