Software Engineer - Platform

Snorkel AI

New York (NY)

On-site

USD 180,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Snorkel AI is seeking Platform Engineers to design and operate agent infrastructure and event-driven pipelines. You will enable scalable data delivery to customers, implement governance, and support enterprise-grade compliance while collaborating with product teams to raise engineering standards.

You will work on infrastructure that moves fast and reliably, with on-call responsibility and strong emphasis on telemetry, cost visibility, and automation.

Qualifications

  • 5+ years building platform infrastructure, backend services, or data systems in production.
  • Strong proficiency in Python and designing REST APIs for internal services.
  • Distributed systems and cloud platforms (AWS preferred) with practical experience.
  • Familiarity with data orchestration tools and dbt transformation frameworks.
  • Understanding of data governance concepts and audit logging.

Responsibilities

  • Design and build agent infrastructure enabling fast, reliable workflows.
  • Create event-driven data flows with brokers, CDC connectors, and schema registries.
  • Develop lineage, governance, RBAC, and auditing across data platforms.
  • Lead CI/CD strategy and automated deployment for robust pipelines.
  • Instrument services with OpenTelemetry, monitor SLOs, and enable proactive alerting.
  • Improve cost visibility and routing data to cost-effective storage tiers.
  • Collaborate with product teams to raise standards across code, infra, and processes.

Skills

Python
REST APIs
Distributed systems
AWS
Terraform
Event-driven architecture
Data governance
CI/CD pipelines
OpenTelemetry
RBAC
PII handling
Airflow/Prefect/Dagster

Tools

S3
RDS
EKS
EventBridge
IAM

Job description

About Snorkel

At Snorkel, we believe meaningful AI doesn't start with the model, it starts with the data.

We're on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world's largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before.

About the Team

Snorkel's Platform organization owns the infrastructure and services that power everything at Snorkel - the pipelines, evals, access layers, event systems, governance, compute, and agent infrastructure that every product team and customer deployment depends on. We're a small team with a large surface area, and we're in the middle of a foundational architecture shift: moving from a single-database data path to a multi-source, event-driven agent first platform. The decisions being made now will define how our platform scales for years. You will be making them.

About the Role

We're looking for Platform Engineers who combine strong infrastructure chops with real backend engineering depth. You'll build and operate the systems, services, and agent infrastructure that let product teams move fast and reliably - from data access layers and event-driven pipelines to the agent first architecture that will transform our ability to scale. Your work will directly allow us to scale the amount of high quality data we are able to deliver to our customers.

We are looking to grow our team of Platform Engineers, and are hiring at multiple levels.

What You'll Do
  • Design and build agent infrastructure that allows us to safely and reliably speed up workflows from engineering and operation teams
  • Design and implement event-driven data flows using event brokers, CDC connectors, schema registries, event routing, and dead letter queues - ensuring events flow reliably and failures are visible and recoverable
  • Build the systems that track how data moves through the platform (lineage), enforce who can access what (governance and RBAC), and log what happened (auditing), including PII handling, retention policy enforcement, and audit infrastructure for enterprise and regulatory compliance
  • Set strategy and architecture for build systems, testing frameworks, and CI/CD pipelines, and drive the transition toward robust, automated continuous deployment
  • Instrument services with OpenTelemetry, define and monitor SLOs (query latency, pipeline success rates, service reliability), and build alerting that catches issues before they become incidents - you will be on-call for the systems you build
  • Contribute to infrastructure cost visibility and optimization - query cost estimation, workload right-sizing, and routing data to the most cost-effective storage tier for its access pattern
  • Collaborate with engineers, product managers, and designers to bring consistency and high standards to codebases, infrastructure, and processes
What You'll Bring
  • 5+ years building platform infrastructure, backend services, or data systems in production - you have built and operated pipelines, data access layers, distributed services, or ETL/ELT systems at scale
  • Strong proficiency in Python, and experience designing REST APIs for internal services and developers
  • Strong background in distributed systems and cloud platforms (AWS preferred) - hands-on experience with services like S3, RDS, EKS, EventBridge, and IAM, and comfort working in a Terraform-managed environment
  • Familiarity with data orchestration tools (Prefect, Airflow, or Dagster) and transformation frameworks (dbt)
  • Understanding of data governance concepts - RBAC, PII handling, audit logging, data lineage
  • Track record of leading complex engineering initiatives, influencing stakeholders, and delivering measurable impact
  • Ability to work in a fast-paced environment with strong technical communication skills
  • Fluency with modern developer tooling and a willingness to adopt new tools quickly - the team evaluates and integrates new tooling regularly to improve velocity and reliability
Nice to Have
  • Experience building shared libraries or SDKs consumed by multiple teams - versioning, backwards compatibility, migration support
  • Experience with event-driven architectures - CDC, event buses, schema registries, at-least-once delivery semantics
  • Experience with OpenTelemetry, ClickHouse, or similar observability infrastructure
  • Prior work in regulated environments (SOC 2, FedRAMP, HIPAA) where compliance requirements shaped system design
  • Experience with Ray or similar frameworks for d
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior / Staff Software Engineer — Platform
Senior / Staff Software Engineer — Platform

Soter Insure • New York (NY)

On-site
USD 220,000 - 300,000
Platform Engineer: Scale Infrastructure & Data Pipelines
Platform Engineer: Scale Infrastructure & Data Pipelines

Snorkel AI, Inc. • New York (NY)

On-site
USD 220,000 - 300,000
Senior / Staff Software Engineer — AI Platform
Senior / Staff Software Engineer — AI Platform

Soter Insure • New York (NY)

Hybrid
USD 180,000 - 280,000
Platform Engineer: Scale Data Pipelines & Infra
Platform Engineer: Scale Data Pipelines & Infra

Snorkel AI • New York (NY)

On-site
USD 180,000 - 230,000
Senior Manager of Forward Deployed Engineering
Senior Manager of Forward Deployed Engineering

Snorkel AI • San Francisco (CA)

On-site
USD 200,000 - 260,000
Health insurance
Wellness stipend
Unlimited PTO
+4
IT Platform and Automation Engineer
IT Platform and Automation Engineer

Snorkel AI • New York (NY)

Hybrid
USD 120,000 - 170,000
Senior / Staff Software Engineer — Product (Backend-Focused)
Senior / Staff Software Engineer — Product (Backend-Focused)

Snorkel AI • San Francisco (CA)

Hybrid
USD 208,000 - 315,000
Staff Software Engineer, Data Platform
Staff Software Engineer, Data Platform

News Corp • Austin (TX)

On-site
USD 150,000 - 210,000
Engineering Manager, Federal & Regulated Infrastructure
Engineering Manager, Federal & Regulated Infrastructure

Snorkel AI • United States

Remote
USD 210,000 - 315,000
Equity (stock options)
IT Platform and Automation Engineer
IT Platform and Automation Engineer

Snorkel AI • San Francisco (CA)

On-site
USD 120,000 - 185,000