Senior Product Analytics Engineer - AI Metrics & CI/CD Lead

Eightelevengroup; New York (NY); Hybrid; USD 83,000 - 103,000; Full time

Job summary

Eightelevengroup in New York, NY is seeking a Senior Product Analytics Engineer for a 6-month hybrid contract. You will join a small, agile pod, embedding into one product workstream at a time and building foundational analytics tools to power product decisions.

The role emphasizes metrics-as-code, CI/CD, and AI analytics benchmarking, collaborating with data engineering and product teams to drive analytics excellence across streaming-focused initiatives.

Qualifications

• 5+ years of experience in product analytics or analytics engineering.
• Advanced SQL for large-scale event data.
• Hands-on Databricks and Unity Catalog experience.
• Proficient in Python and Git-based CI/CD workflows.
• Experience documenting LLM/agent benchmarks and QA pairs.
• Strong knowledge of product metrics (engagement, retention, funnels).
• Ability to work independently in a small pod and rotate across workstreams.
• Familiarity with experimentation and A/B testing (preferred).
• Background in streaming/media or consumer subscriptions (preferred).
• Experience with Tableau or BI tools (preferred).

Responsibilities

• Implement metric, cohort, and segment definitions in the Databricks Metrics View on Unity Catalog using metrics-as-code practices.
• Build Workstream Scorecard templates and pipelines linking goals, drivers, and KPIs with refresh cycles.
• Develop and benchmark the AI Analytics Agent with eval sets, QA pairs, and CI/CD promotion.
• Co-own Data Engineering intake within assigned workstreams and track issues to resolution.
• Collaborate with PMs, engineers, and designers to translate business questions into measurable metrics.
• Document metric logic and data quality issues in a version-controlled environment.
• Partner with Analytics Engineering Manager to harden pod delivery patterns.

Skills

5+ years product analytics

SQL

Python

A/B testing

Metrics analysis

Tools

Databricks

Unity Catalog

dbt

Cube

MetricFlow

Git

Job description

Eightelevengroup in New York, NY is seeking a Senior Product Analytics Engineer for a 6-month hybrid contract. You will join a small, agile pod, embedding into one product workstream at a time and building foundational analytics tools to power product decisions.

The role emphasizes metrics-as-code, CI/CD, and AI analytics benchmarking, collaborating with data engineering and product teams to drive analytics excellence across streaming-focused initiatives.