Software Engineer — Platform

Snorkel AI; New York, San Francisco (NY, CA); Hybrid; USD 220,000 - 300,000; Full time

Job summary

Snorkel AI is seeking Platform Engineers to design and operate the agent-first infrastructure and data pipelines that scale, enabling product teams to move fast with reliability.

You will drive architecture, governance, and cost optimization while collaborating with cross-functional teams to deliver enterprise-grade platforms and services.

Qualifications

• 5+ years building platform infrastructure, backend services, or data systems in production
• Strong proficiency in Python and REST API design
• Experience with distributed systems and cloud platforms (AWS preferred)
• Familiarity with data orchestration tools (Prefect, Airflow, Dagster) and transformation frameworks (dbt)
• Understanding of data governance concepts (RBAC, PII handling, audit logging)
• Track record of leading complex engineering initiatives and delivering measurable impact
• Ability to work in a fast-paced environment with strong technical communication
• Nice to Have: experience with event-driven architectures and observability tools

Responsibilities

• Design and build agent infrastructure to speed up workflows for engineering and operations
• Create event-driven data flows using brokers, CDC connectors, registries, routing, and dead-letter queues
• Build systems to track data lineage, governance, auditing, and access control
• Set strategy for build systems, testing, and CI/CD pipelines, enabling automated deployments
• Instrument services with OpenTelemetry and define/monitor SLOs, balancing reliability and cost
• Improve cost visibility and routing data to cost-effective storage tiers
• Collaborate with engineers, product managers, and designers to raise code quality and standards

Skills

Python

REST APIs

Distributed systems

AWS

Terraform

Data governance

OpenTelemetry

Communication

Tools

AWS

Terraform

Prefect

Airflow

Dagster

dbt

ClickHouse

OpenTelemetry

Job description

About Snorkel

At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

About the Team

Snorkel’s Platform organization owns the infrastructure and services that power everything at Snorkel — the pipelines, evals, access layers, event systems, governance, compute, and agent infrastructure that every product team and customer deployment depends on. We’re a small team with a large surface area, and we’re in the middle of a foundational architecture shift: moving from a single-database data path to a multi-source, event-driven agent first platform. The decisions being made now will define how our platform scales for years. You will be making them.

About the Role

We’re looking for Platform Engineers who combine strong infrastructure chops with real backend engineering depth. You’ll build and operate the systems, services, and agent infrastructure that let product teams move fast and reliably — from data access layers and event-driven pipelines to the agent first architecture that will transform our ability to scale. Your work will directly allow us to scale the amount of high quality data we are able to deliver to our customers. We are looking to grow our team of Platform Engineers, and are hiring at multiple levels.

What You’ll Do

• Design and build agent infrastructure that allows us to safely and reliably speed up workflows from engineering and operation teams
• Design and implement event-driven data flows using event brokers, CDC connectors, schema registries, event routing, and dead letter queues — ensuring events flow reliably and failures are visible and recoverable
• Build the systems that track how data moves through the platform (lineage), enforce who can access what (governance and RBAC), and log what happened (auditing), including PII handling, retention policy enforcement, and audit infrastructure for enterprise and regulatory compliance
• Set strategy and architecture for build systems, testing frameworks, and CI/CD pipelines, and drive the transition toward robust, automated continuous deployment
• Instrument services with OpenTelemetry, define and monitor SLOs (query latency, pipeline success rates, service reliability), and build alerting that catches issues before they become incidents — you will be on‑call for the systems you build
• Contribute to infrastructure cost visibility and optimization — query cost estimation, workload right‑sizing, and routing data to the most cost‑effective storage tier for its access pattern
• Collaborate with engineers, product managers, and designers to bring consistency and high standards to codebases, infrastructure, and processes

What You’ll Bring

• 5+ years building platform infrastructure, backend services, or data systems in production — you have built and operated pipelines, data access layers, distributed services, or ETL/ELT systems at scale
• Strong proficiency in Python, and experience designing REST APIs for internal services and developers
• Strong background in distributed systems and cloud platforms (AWS preferred) — hands‑on experience with services like S3, RDS, EKS, EventBridge, and IAM, and comfort working in a Terraform‑managed environment
• Familiarity with data orchestration tools (Prefect, Airflow, or Dagster) and transformation frameworks (dbt)
• Understanding of data governance concepts — RBAC, PII handling, audit logging, data lineage
• Track record of leading complex engineering initiatives, influencing stakeholders, and delivering measurable impact
• Ability to work in a fast‑paced environment with strong technical communication skills
• Fluency with modern developer tooling and a willingness to adopt new tools quickly — the team evaluates and integrates new tooling regularly to improve velocity and reliability
• Nice to Have Experience building shared libraries or SDKs consumed by multiple teams — versioning, backwards compatibility, migration support
• Nice to Have Experience with event‑driven architectures — CDC, event buses, schema registries, at‑least‑once delivery semantics
• Nice to Have Experience with OpenTelemetry, ClickHouse, or similar observability infrastructure
• Nice to Have Prior work in regulated environments (SOC 2, FedRAMP, HIPAA) where compliance requirements shaped system design
• Nice to Have Experience with Ray or similar frameworks for distributed compute workloads
• Nice to Have Experience in hyper‑growth startup environments or scaling engineering orgs
• Nice to Have Prior experience as a Tech Lead, Team Lead, or hands‑on Engineering Manager

Why This Role

You’ll have meaningful ownership over the infrastructure and services that every product team and customer deployment depends on. This isn’t a maintenance role — you’ll be making foundational architecture decisions that shape how the company scales, with a team that cares deeply about reliability, craft, and moving fast without breaking things. Snorkel is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel embraces diversity and provides equal employment opportunities to all employees and applicants for employment.

Salary

Salary range(s) for this role $220,000 — $300,000 USD

Be Your Best at Snorkel

Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.

Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

Please contact us to request accommodation.