Senior Backend Engineer - Data Pipelines & Validation

Three Pillars Recruiting; San Francisco (CA); On-site; USD 180,000 - 230,000; Full time

Job summary

Three Pillars Recruiting in San Francisco is seeking a Senior Software Engineer - Backend, Data Products who will build the composable, self-correcting pipelines customers rely on and shape the backend/GraphQL surface. You will implement Reactors, connectors, and validation, collaborate with product and data science in sprint cycles, and help scale ETL/ELT workflows for real-world data.

This role emphasizes robust design, observable systems, and performance, with modern Python, Temporal/NATS,

Qualifications

• 5+ years writing production software with modern Python.
• Experience designing APIs using GraphQL and/or REST.
• Experience building and validating data pipelines at scale.
• Strong PostgreSQL schema design and query optimization.

Responsibilities

• Build and extend Reactors to enable composable pipelines.
• Develop connectors, ingestion, and transformation tooling for diverse data sources.
• Incorporate data validation and quality checks into pipelines (e.g., contract-style checks).
• Design and ship the backend/GraphQL surface for pipeline capabilities.
• Orchestrate multi-step pipeline work with Temporal and event-driven systems (NATS/Kafka).
• Collaborate in sprint cycles with product and data science to productionize analytics.

Skills

Python

GraphQL

Pandas

SQLAlchemy

Async/await

Pydantic

Tools

Temporal

NATS

Kafka

REST

Job description

Three Pillars Recruiting in San Francisco is seeking a Senior Software Engineer - Backend, Data Products who will build the composable, self-correcting pipelines customers rely on and shape the backend/GraphQL surface. You will implement Reactors, connectors, and validation, collaborate with product and data science in sprint cycles, and help scale ETL/ELT workflows for real-world data.

This role emphasizes robust design, observable systems, and performance, with modern Python, Temporal/NATS,