Engineering Manager - Experimentation Platform

The Briefed; New York (NY); On-site; USD 204,000 - 306,000; Full time

Benefits offered by this job

Competitive equity

Catered meals and snacks

Comprehensive healthcare

Professional development budget

Hackathon and PTO

Job summary

Duolingo in New York City seeks an Engineering Manager and Team Lead for the Experiments Team to scale the in-house Experiment Platform, define experiments, route features, and process large data pipelines across mobile and web applications.

You will mentor engineers, expand A/B capabilities, collaborate with product managers and data scientists, and ensure reliability with robust SLOs in a fast-paced consumer tech company.

Qualifications

• Proven experience leading software engineering teams.
• Experience building high-scale distributed infrastructure.
• Strong understanding of A/B testing systems and feature flags.

Responsibilities

• Lead, mentor, and grow a team building high-throughput experimentation infrastructure and data pipelines.
• Expand architecture for advanced experimental designs and statistical evaluation engines.
• Evolve feature flag configurations and automated experimentation workflows.

Skills

Software Engineering Management

Data & Scalable Infrastructure

A/B Testing Mastery

Cross-Functional Collaboration

Education

Bachelor's degree in Computer Science or related

Tools

Experiment Platform

Job description

Duolingo is the world's most popular learning platform, on a mission to develop the best education in the world and make it universally available. A/B testing sits at the heart of Duolingo's product development lifecycle, with virtually every feature change evaluated through experimentation—running over 300 concurrent A/B tests with our half a billion learners.

As the Engineering Manager and Team Lead for the Experiments Team, you will manage and scale Duolingo’s in-house Experiment Platform. This mission-critical platform is responsible for defining experiments, dynamically routing and gating features in real time across mobile and web apps, and processing massive statistical pipelines to measure product outcomes. In this role, you will balance platform scalability with direct product impact—advancing statistical methods, accelerating feature delivery automation, and advising cross-functional product teams across all of Duolingo on experimentation strategy.

Key Responsibilities

• Platform Leadership & Scaling: Lead, mentor, and grow a specialized team of software engineers building high-throughput, low-latency experimentation infrastructure and data pipelines.
• Advanced A/B Capabilities: Expand the technical architecture of the Experiment Platform to support sophisticated experimental designs (e.g., sequential testing, multi-armed bandits, cluster-randomized trials) and cost-efficient statistical evaluation engines.
• Feature Gating & Automation: Evolve backend-driven feature flag configurations and automated experimentation workflows to accelerate feature shipping across mobile and web clients.
• Cross-Functional Experimentation Strategy: Partner directly with Product Managers, Data Scientists, and Engineering leads across Duolingo to design complex experiment structures and interpret metric evaluations.
• Reliability & Operational Excellence: Maintain extreme availability and low latency for the experimentation assignment engine embedded directly in critical user app paths, establishing robust SLOs, monitoring, and disaster recovery.

Requirements

Engineering Management & Experimentation Depth

• Software Engineering Management: Proven experience leading, building, and developing teams of software engineers, with a strong track record of hiring, coaching, and retaining technical talent.
• Data & Scalable Infrastructure: Demonstrated experience building high-scale, distributed software infrastructure capable of processing high-volume datasets.
• A/B Testing Mastery: Solid technical understanding of A/B testing systems, feature flagging platforms, or statistical evaluation pipelines (either building experimentation infrastructure or leveraging advanced A/B testing in high-speed product environments).
• Cross-Functional Collaboration: Exceptional communication and leadership skills, with a track record of bridging platform engineering capabilities with product team requirements.

Education & Work Logistics

• Bachelor’s degree in Computer Science, Software Engineering, or a related technical field (or equivalent practical experience).
• Ability to work onsite from or relocate to Pittsburgh, PA or New York City, NY.

Preferred Qualifications

• Prior experience designing, building, or operating an in-house experimentation platform or commercial A/B testing/feature management tooling at scale.
• Experience operating within a high-velocity, consumer technology product organization.
• Deep familiarity with the statistical foundation of hypothesis testing (power calculations, variance reduction/CUPED, p-value adjustments, confidence intervals).

Total Rewards & Benefits

• Compensation & Equity: Base salary of $204,000 – $306,000 USD supplemented by competitive equity grants.
• Food & Well-Being: Catered in-house breakfast and lunch, language learning opportunities, monthly social celebrations, and active employee clubs.
• Comprehensive Healthcare: Top-tier medical, dental, and vision insurance coverage options for employees and eligible dependents.
• Time Off & Growth: Company-wide annual Hackathon, generous PTO, paid company holidays, and dedicated professional development budgets.