As a Staff Software Engineer specializing in Experimentation Infrastructure, you will serve as the company-wide technical authority defining and executing the long-term technology roadmap for Faire’s centralized experimentation platform. Embedded within the Platform Group, you will bridge hands‑on software development with cross‑organizational technical leadership. You will architect and scale an enterprise‑grade experimentation and measurement ecosystem—powered by Eppo and integrated into Faire's modern data stack (Snowflake, Databricks, Airflow, Spark). Partnering directly with Product Engineering, Data Science, Strategy & Analytics, and Product Management, you will establish unified standards for A/B testing, progressive delivery, metric generation, statistical guardrails, and automated result interpretation across millions of marketplace interactions.
Key Responsibilities
Technical Vision & Experimentation Architecture
- Company-Wide Experimentation Strategy: Define, execute, and scale the multi-year technology strategy for experimentation, feature flags, and statistical measurement across Faire.
- Centralized Platform Engineering: Build and maintain Faire's centralized experimentation platform integrated with Eppo, managing the end-to-end experiment lifecycle from hypothesis and configuration to metric calculation and governance.
- Data Ecosystem Integration: Architect scalable data pipelines and analytical data models connecting experimentation infrastructure to Faire's data warehouse and data lake (Snowflake, Databricks, Airflow, Spark).
- Quality & Observability Integration: Implement automated data quality, metrics validation, and observability guardrails using tools such as Anomalo.
Strategic Partnering & Engineering Standards
- Cross-Disciplinary Alignment: Partner closely with Data Science, Strategy & Analytics, Product Management, and Product Engineering to translate complex business objectives into reliable measurement capabilities.
- Standards & Best Practices: Establish best practices for statistical experiment design, multivariate testing, progressive delivery, feature rollout, and trustworthy decision-making.
- Technical Mentorship: Drive technical design reviews, mentor software and analytics engineers, and champion engineering excellence across organizational boundaries.
Requirements
Technical Depth & Platform Foundations
- Extensive Domain Expertise: Extensive software engineering background with a primary focus on designing, building, scaling, and operating experimentation platforms and analytics infrastructure (experience in marketplace or e-commerce environments is highly valuable).
- Experimentation Methodologies: Deep understanding of A/B testing, multivariate testing, progressive feature delivery, statistical power analysis, and experiment lifecycle governance.
- Commercial & Open-Source Tools: Hands‑on experience implementing commercial or open-source experimentation platforms (direct experience with Eppo is strongly preferred).
- Modern Data Stack Mastery: Hands‑on proficiency with modern cloud data infrastructure (Snowflake, Databricks, AWS, Airflow, Spark).
- Data Quality & Modeling: Strong SQL skills, deep experience designing scalable analytical data models, and familiarity with data observability tools (Anomalo or equivalent).
- Core Technical Stack: Proficiency in software development across Python, Kotlin, SQL, and cloud‑native backend environments.
- Cross-Functional Influence: Proven ability to define a clear technical vision, build alignment across non‑engineering disciplines, and drive adoption across organizational silos.
Preferred Qualifications
- Direct experience migrating or scaling Eppo across multi-product SaaS or two‑sided marketplace platforms.
- Background in advanced statistical methodologies (e.g., CUPED variance reduction, sequential testing, causal inference models).
- Experience working with high‑throughput stream processing platforms for real‑time feature evaluation.
Total Rewards & Benefits
- Compensation & Equity: San Francisco base salary range ($231,000 - $318,000 USD) + competitive equity grants + comprehensive benefits package.
- Time Off & Workplace Flexibility: Flexible Paid Time Off (PTO), company-wide recharge days, and 4 weeks of remote work flexibility annually for hybrid employees.
- Family & Parental Support: Paid parental leave (up to 16 weeks) alongside comprehensive family‑building and fertility benefits through Carrot (including a lifetime reimbursement allowance).
- Health & Mental Wellbeing: Comprehensive medical, dental, and vision insurance coverage, plus mental health support and dedicated coaching through Modern Health.
- Stipends & Retirement: Professional development stipends, wellness allowances, work‑from‑home setup stipends, and an employer‑sponsored retirement plan.