Platform Engineer: Data Pipelines & Observability

AI Chopping Block; New York (NY); On-site; USD 220,000 - 300,000; Full time

Job summary

Snorkel AI is seeking Platform Engineers who blend strong infrastructure chops with backend depth. You will build and operate the systems and agent infrastructure enabling product teams to move fast while maintaining reliability and governance. You’ll shape data access, lineage, and security at scale.

You will collaborate with cross-functional roles to ensure high standards, cost awareness, and robust deployment practices as the platform evolves for enterprise needs.

Qualifications

• 5+ years building platform infrastructure, backend services, or data systems in production.
• Proficiency in Python and designing REST APIs for internal services and developers.
• Strong background in distributed systems and cloud platforms (AWS).
• Experience with data orchestration tools (Prefect, Airflow, Dagster) and transformation frameworks (dbt).
• Understanding of data governance concepts (RBAC, PII handling, audit logging, data lineage).
• Track record of leading complex engineering initiatives and delivering impact.

Responsibilities

• Design and build agent infrastructure to safely speed up workflows for engineering and operations teams.
• Design and implement event-driven data flows using brokers, CDC connectors, registries, routing, and dead-letter queues.
• Build systems to track data movement (lineage), access governance, auditing, and regulatory compliance.
• Set strategy for build systems, testing frameworks, and CI/CD pipelines toward automated deployment.
• Instrument services with OpenTelemetry, monitor SLOs, and build proactive alerting; on-call for the systems you build.
• Contribute to infrastructure cost visibility and optimization, including cost estimation and storage tiering.
• Collaborate with engineers, product managers, and designers to maintain high standards across code, infra, and processes.

Skills

Platform engineering

Python

REST APIs

Distributed systems

AWS

Terraform

OpenTelemetry

Data governance

Leadership

Technical communication

Tools

Terraform

OpenTelemetry

ClickHouse

Ray

Dagster

Job description

Snorkel AI is seeking Platform Engineers who blend strong infrastructure chops with backend depth. You will build and operate the systems and agent infrastructure enabling product teams to move fast while maintaining reliability and governance. You’ll shape data access, lineage, and security at scale.

You will collaborate with cross-functional roles to ensure high standards, cost awareness, and robust deployment practices as the platform evolves for enterprise needs.