Senior Platform Engineer: Data Infrastructure & Scale

Snorkel AI; New York (NY); On-site; USD 220,000 - 300,000; Full time

Job summary

Snorkel AI is seeking Platform Engineers to design and operate the agent-first infrastructure that powers data access, event-driven pipelines, and scalable backend services. You will help move from a single-database path to a multi-source platform while enabling product teams to deliver high-quality data efficiently.

The role spans building scalable pipelines, governance, and cost-aware design, with multiple levels of seniority.

Qualifications

• 5+ years building platform infrastructure, backend services, or data systems in production.
• Strong proficiency in Python, and experience designing REST APIs for internal services and developers.
• Strong background in distributed systems and cloud platforms (AWS preferred).
• Familiarity with data orchestration tools (Prefect, Airflow, or Dagster) and transformation frameworks (dbt).
• Understanding of data governance concepts — RBAC, PII handling, audit logging, data lineage.
• Track record of leading complex engineering initiatives, influencing stakeholders, and delivering measurable impact.
• Ability to work in a fast-paced environment with strong technical communication skills.
• Fluency with modern developer tooling and a willingness to adopt new tools quickly.

Responsibilities

• Design and build agent infrastructure that allows us to safely and reliably speed up workflows from engineering and operation teams.
• Design and implement event-driven data flows using event brokers, CDC connectors, schema registries, event routing, and dead letter queues — ensuring events flow reliably and failures are visible and recoverable
• Build the systems that track how data moves through the platform (lineage), enforce who can access what (governance and RBAC), and log what happened (auditing), including PII handling, retention policy enforcement, and audit infrastructure for enterprise and regulatory compliance
• Set strategy and architecture for build systems, testing frameworks, and CI/CD pipelines, and drive the transition toward robust, automated continuous deployment
• Instrument services with OpenTelemetry, define and monitor SLOs (query latency, pipeline success rates, service reliability), and build alerting that catches issues before they become incidents — you will be on-call for the systems you build
• Contribute to infrastructure cost visibility and optimization — query cost estimation, workload right-sizing, and routing data to the most cost-effective storage tier for its access pattern
• Collaborate with engineers, product managers, and designers to bring consistency and high standards to codebases, infrastructure, and processes

Skills

Python

REST APIs

Distributed systems

AWS

Data governance

ETL/ELT pipelines

Telemetry/observability

Team leadership

Tools

Prefect

Airflow

Dagster

dbt

OpenTelemetry

ClickHouse

Ray

Terraform

AWS services (S3, RDS, EKS, IAM)

Job description

Snorkel AI is seeking Platform Engineers to design and operate the agent-first infrastructure that powers data access, event-driven pipelines, and scalable backend services. You will help move from a single-database path to a multi-source platform while enabling product teams to deliver high-quality data efficiently.

The role spans building scalable pipelines, governance, and cost-aware design, with multiple levels of seniority.