Senior Software Engineer, Ads Experimentation Platform

Reddit, Inc.; Ontario; Hybrid; CAD 80,000 - 130,000; Full time

Job summary

An established industry player is seeking a Senior Software Engineer to join their Ads Experimentation Platform team. In this pivotal role, you will enhance experimentation tools and methodologies that drive advertising performance. Collaborating closely with data science and product leaders, you will tackle complex challenges in the ads marketplace, ensuring robust and efficient testing frameworks. This is a unique opportunity to contribute to innovative solutions that support a diverse range of advertisers while working in a dynamic and collaborative environment. If you are passionate about technology and eager to make a significant impact, this role is perfect for you.

Qualifications

• 5+ years of experience in high-quality code for production systems.
• Experience leading engineering teams and collaborating with data science.

Responsibilities

• Build A/B testing tools for the Ads marketplace.
• Develop scalable ad pacing platforms for efficient experimentation.

Skills

Backend Programming Languages

API Development

Service Frameworks (Thrift, Protobuf)

Collaboration with Data Science

A/B Testing Methodologies

Education

Degree in Quantitative Discipline

Tools

AWS

GCP

Job description

Senior Software Engineer, Ads Experimentation Platform

Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

As a company, Reddit primarily generates revenue through advertising, and we're working towards building a massive business to fund our mission. We distinguish ourselves from other digital ad platforms by attracting advertisers who want to connect with a specific target audience because of our passionate and engaged communities.

The Ads Experimentation Platform (AEXP) team builds tools for our engineers and scientists to accurately test new products and efficiently verify new ideas in the ads marketplace. Have you heard about Budget Cannibalization? Have you wondered why a user-split A/B testing is insufficient in testing products in the Ads marketplace? How can we make the most out of rare and sparse samples (e.g. conversion events)? How can I explore 100 algorithmic candidates at the same time? These are the typical problems we are dealing with on a daily basis.

Meanwhile, Ads Pacing plays a crucial role in both supporting the dynamism of the marketplace and accommodating the budget-aware A/B experiments, therefore our team is also committed to building scalable and flexible pacing infrastructures that improve market efficiency and budget-aware testing capacity.

Some of the project highlights include:

• An A/B testing framework that splits both users and ad budgets to create parallel and mutually exclusive control/treatment sub ads marketplaces.
• An exploration tool that can run multiple (hundreds of) A/B testing pairs of campaigns over multiple algorithmic candidates for pacing.
• Partitioning the pacing and budgeting systems to accommodate the growing number of advertisers and maintain the refreshing rate above once per minute.

As a senior software engineer in the Ads Experimentation Platform team, you will work closely with data science partners and product leaders to improve the capacity and efficiency of existing experimentation tools, research and build new testing methodologies and tools, and lead the experimentation practices across the Ads marketplace teams. You will collaborate with cross-functional engineering, product, and data science teams to ensure that our customers’ voices are represented in your work.

Responsibilities:

• Building A/B testing tools customized for the Ads marketplace.
• Building A/B testing tools for measuring infra cost by each ad product.
• Building advertiser-facing tools for exploring through Reddit Ads products and optimizing for the best performances.
• Building scalable and reliable ad pacing platform to enable efficient experimentation and research on the control algorithms.

Who You Might Be:

• Degree in a quantitative discipline: engineering, statistics, operations research, computer science, informatics, applied mathematics, economics, etc.
• 5+ years of contributing high-quality code to production systems that operate at scale.
• 3+ years of experience building ads-serving related systems, including but not limited to ads targeting, ads ranking, ads pacing.
• Experience leading large engineering teams and collaborating with cross-functional partners is required, especially with data science partners.

Required qualifications:

• Significant experience in one or more backend programming languages, experience with Go or Scala is preferable.
• Significant experience with API development and service frameworks, e.g. Thrift and Protobuf.
• A cloud service provider like AWS or GCP.