Data Engineer - Scaled Experimentation Platform

super; United States; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical / Health Insurance

Open Annual Leave

Employee Assistance Programme

Training & Learning Development

Job summary

Super is hiring a Data Engineer to own the data backbone of the internal Experimentation Platform, including the metric store and evaluation pipelines. You will deploy services end-to-end with Docker and GitOps on Kubernetes, and partner with backend engineers, data scientists, and product managers to shape experimentation at scale.

You will contribute RFCs, design docs, and robust documentation while improving developer experience through data exports and tooling, with emphasis on data quality

Qualifications

• Python production-grade code and API development.
• Experience with Airflow and Snowflake.
• Strong SQL debugging and optimization.
• Experience deploying services with Kubernetes and CI/CD.
• Clear written communication and RFCs.

Responsibilities

• Own and evolve the Metric Store, including the FastAPI service layer and Git-backed workflows.
• Build and maintain evaluation and monitoring pipelines in Airflow on Snowflake.
• Deploy services end-to-end using Docker, GitOps Kubernetes, and CI/CD.
• Investigate data quality issues, reconcile counts, and validate bucketing/hashing.
• Collaborate with engineers, data scientists, and product managers; contribute RFCs and docs.
• Improve developer experience with tooling, data exports, and AI-assisted interfaces.

Skills

Python

Airflow

Snowflake

SQL

CI/CD

Docker/Kubernetes

Observability

Data quality

Documentation

Tools

FastAPI

Kubernetes

Prometheus

Grafana

GitHub Actions

Docker

DataHub

Job description

Super is hiring a Data Engineer to own the data backbone of the internal Experimentation Platform, including the metric store and evaluation pipelines. You will deploy services end-to-end with Docker and GitOps on Kubernetes, and partner with backend engineers, data scientists, and product managers to shape experimentation at scale.

You will contribute RFCs, design docs, and robust documentation while improving developer experience through data exports and tooling, with emphasis on data quality