Machine Learning Scientist III - Experimentation Science (Statistical Methodologies)

Expedia, Inc.; London; On-site; GBP 65,000 - 85,000; Full time

Job summary

A leading travel technology company in London seeks a Machine Learning Scientist III. The candidate will develop statistical methodologies for A/B testing and collaborate closely with engineers. A bachelor's degree in a quantitative field and strong programming skills are essential. Join us if you have a passion for redefining travel experiences through data-driven insights.

Benefits

Medical/dental/vision benefits

Paid time off

Travel discounts

Employee Assistance Program

Qualifications

• Proven expertise in hypothesis testing and design of experiments.
• Solid programming skills in at least one language like Python or R.
• Experience applying statistical rigor to real-world business problems.

Responsibilities

• Lead the development of advanced statistical methodologies for A/B testing.
• Collaborate with platform engineers to enhance testing frameworks.
• Conduct original research to address experimentation challenges.

Skills

Statistical methodologies

Hypothesis testing

Design of experiments

Analytical mindset

Programming in Python or R

Strong communication skills

Independent research

Education

Bachelor’s degree or higher in Mathematics, Statistics, or a related field

Tools

Python

R

PySpark

Job description

Machine Learning Scientist III - Experimentation Science

Introduction to team: As a Machine Learning Scientist III on our Experimentation Science team, you will play a critical role in shaping the statistical methodologies that underpin Expedia Group’s experimentation platform. Your work will ensure that every feature change on our website—from button colors to booking flows—is rigorously tested to maximize business impact. This role blends research and practical application, requiring you to design, evaluate, and improve hypothesis testing frameworks and experimentation techniques. You will collaborate closely with platform engineers to implement scalable solutions, provide expert guidance to stakeholders, and drive innovation through cutting-edge statistical research. This position offers a unique opportunity to apply deep statistical expertise in a dynamic environment where your contributions directly influence product decisions and customer experiences worldwide.

In this role, you will:

• Lead the development and validation of advanced statistical methodologies to support Expedia Group’s experimentation platform, ensuring robust and reliable A/B testing across the website’s features and user experiences
• Collaborate closely with the experimentation platform team to design, implement, and scale new testing frameworks and tools that enhance the platform’s capabilities and reporting accuracy
• Provide expert guidance and training to cross-functional teams on experimental design, hypothesis testing, and statistical best practices to optimize test duration, sample size, and overall experiment quality
• Conduct original research to explore and develop innovative approaches for experimentation challenges, including designing proof-of-concept studies and integrating new methodologies into production workflows
• Analyze complex experimental data, build simulation frameworks to quantify error rates, and communicate findings clearly to both technical and non-technical stakeholders to inform business decisions

What we\'re looking for:

• Deep expertise in statistical methodologies, particularly hypothesis testing, design of experiments, and interpretation of p-values and confidence intervals, with the ability to apply these concepts rigorously in an experimentation context
• Strong analytical mindset with the capability to structure complex business problems and translate them into statistically sound experimental designs and solutions
• Proficiency in programming with experience in Python, PySpark, R, or similar languages, sufficient to implement and test statistical models and simulations, with an emphasis on correctness over advanced coding skills
• Demonstrated ability to conduct independent research, quickly learn new statistical techniques, and develop proof-of-concept models that can be scaled and integrated into production experimentation platforms
• Excellent communication skills to clearly explain complex statistical concepts and experimental results to both technical and non-technical stakeholders, ensuring alignment and understanding across teams

Experience and qualifications:

• A bachelor’s degree or higher in Mathematics, Statistics, or a closely related quantitative field, providing a strong foundation in statistical theory and experimental design
• Proven expertise in hypothesis testing, design of experiments, and statistical methodologies critical to experimentation science
• Solid programming skills in at least one language such as Python, R, or PySpark, with the ability to write clean, maintainable code to support research and implementation
• Experience applying statistical rigor to real-world business problems, with the ability to independently lead and deploy methodologies at scale
• Strong analytical mindset with the capacity to research, evaluate, and implement new statistical approaches and simulation frameworks
• Excellent communication skills to clearly explain complex statistical concepts and results to both technical and non-technical stakeholders
• Ability to work collaboratively within a small, focused team and liaise effectively with platform engineers and business partners
• Prior experience in experimentation platforms or A/B testing environments is highly desirable
• Autonomy and accountability to serve as a point of contact for statistical methodologies within the team

Expedia Group is proud to offer a wide range of benefits to support employees and their families, including medical/dental/vision, paid time off, and an Employee Assistance Program. To fuel each employee’s passion for travel, we offer a wellness & travel reimbursement, travel discounts, and an International Airlines Travel Agent (IATAN) membership. View our full list of benefits.

Accommodation requests

If you need assistance with any part of the application or recruiting process due to a disability, or other physical or mental health conditions, please reach out to our Recruiting Accommodations Team through the Accommodation Request.

We are proud to be named as a Best Place to Work on Glassdoor in 2024 and be recognized for award-winning culture by organizations like Forbes, TIME, Disability:IN, and others.

Expedia Group's family of brands includes: Brand Expedia, Hotels.com, Expedia Partner Solutions, Vrbo, trivago, Orbitz, Travelocity, Hotwire, Wotif, ebookers, CheapTickets, Expedia Group Media Solutions, Expedia Local Expert, CarRentals.com, and Expedia Cruises. 2024 Expedia, Inc. All rights reserved. Trademarks and logos are the property of their respective owners. CST: 2029030-50

Employment opportunities and job offers at Expedia Group will always come from Expedia Group’s Talent Acquisition and hiring teams. Never provide sensitive, personal information to someone unless you’re confident who the recipient is. Expedia Group does not extend job offers via email or any other messaging tools to individuals with whom we have not made prior contact. Our email domain is expediagroup.com. The official website to find and apply for job openings at Expedia Group is careers.expediagroup.com/jobs.

Expedia is committed to creating an inclusive work environment with a diverse workforce. All qualified applicants will receive consideration for employment without regard to race, religion, gender, sexual orientation, national origin, disability or age.