Senior Platform Infra Engineer - Scale Core Data Pipelines

davidjoseph-co

San Francisco (CA)

On-site

USD 250,000 - 350,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive equity

Job summary

AfterQuery is seeking a Senior Software Engineer, Infrastructure/Platform to design and build the core infrastructure powering data generation, evaluation, and agentic systems. The role offers broad ownership and direct collaboration with the founding team in a highly technical environment.

You will architect and develop shared infrastructure, build scalable systems for large datasets, and create reusable APIs for engineers and researchers to move quickly and reliably.

Qualifications

  • 5+ years building and owning production distributed systems.
  • Strong backend proficiency in Python and/or JavaScript (Node.js/Next.js).
  • Cloud infrastructure experience in GCP or AWS.
  • Message queues and event‑driven systems (Kafka, RabbitMQ, Pub/Sub).
  • High‑throughput data pipelines and asynchronous processing.
  • System scalability, performance, and reliability ownership.
  • Shared infrastructure, APIs, and internal platform development.
  • Observability, monitoring, and fault tolerance design.
  • Long‑term architecture ownership across data pipelines, compute and storage.
  • Cross‑functional collaboration with engineering and research teams.

Responsibilities

  • Architect and develop the shared infrastructure powering data generation platforms, human-in-the-loop systems, and evaluation pipelines
  • Build systems capable of processing large-scale datasets and high-throughput workloads with strong reliability guarantees
  • Create reusable infrastructure and APIs that let product engineers and researchers build quickly and reliably on top of core systems
  • Design systems with strong observability, monitoring, and fault tolerance for production workloads at scale
  • Help define long‑term system architecture across data pipelines, compute infrastructure, task orchestration, and storage systems
  • Work closely with engineers and researchers to support new AI experimentation workflows and platform capabilities
  • Define standards for system design, deployment, reliability, and infrastructure operations

Skills

Distributed systems
Backend development
Cloud experience
Data pipelines
Observability
APIs
Cross-functional collaboration
Architecture ownership

Education

Undergraduate degree

Tools

Kafka
RabbitMQ
Pub/Sub
GCP
AWS

Job description

AfterQuery is seeking a Senior Software Engineer, Infrastructure/Platform to design and build the core infrastructure powering data generation, evaluation, and agentic systems. The role offers broad ownership and direct collaboration with the founding team in a highly technical environment.

You will architect and develop shared infrastructure, build scalable systems for large datasets, and create reusable APIs for engineers and researchers to move quickly and reliably.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Platform & Data Infrastructure Engineer
Senior Platform & Data Infrastructure Engineer

Thomas Talent Network • San Francisco (CA)

On-site
USD 250,000 - 350,000
Senior Data Engineer: Scale Data Platform & Pipelines
Senior Data Engineer: Scale Data Platform & Pipelines

Instrumentl • United States

On-site
USD 120,000 - 160,000
Senior Data Platform Engineer — Scale AI Data Pipelines
Senior Data Platform Engineer — Scale AI Data Pipelines

Weights & Biases • San Francisco (CA)

On-site
USD 165,000 - 242,000
Medical, dental, and vision insurance
401(k) with employer match
Paid Parental Leave
+4
Senior Data Platform Engineer: Scale AI Data Pipelines
Senior Data Platform Engineer: Scale AI Data Pipelines

Weights & Biases • New York (NY)

On-site
USD 165,000 - 242,000
Medical, dental, and vision insurance
Company-paid Life Insurance
401(k) with employer match
+5
Senior Data Platform Engineer — Scale Pipelines
Senior Data Platform Engineer — Scale Pipelines

Persona • San Francisco (CA)

On-site
USD 130,000 - 180,000
Medical, Dental, and Vision Insurance
401(k) contribution
Unlimited PTO
+2
Senior Infrastructure Platform Engineer for AI Data
Senior Infrastructure Platform Engineer for AI Data

David Joseph & Company • San Francisco (CA)

On-site
USD 250,000 - 350,000
Equity
Senior Data Platform Architect: Scale Pipelines & Observability
Senior Data Platform Architect: Scale Pipelines & Observability

Perplexity AI Inc. • New York (NY)

On-site
USD 130,000 - 180,000
Senior Data Platform Engineer
Senior Data Platform Engineer

Harnham • Los Angeles (CA)

On-site
USD 120,000 - 150,000
Senior Data Engineer — Scale Data Pipelines & Analytics
Senior Data Engineer — Scale Data Pipelines & Analytics

Authologic • Town of Poland (NY)

On-site
USD 130,000 - 170,000
Senior Data Platform Engineer - Scale & Secure Pipelines
Senior Data Platform Engineer - Scale & Secure Pipelines

FloQast • San Jose (CA)

On-site
USD 144,000 - 216,000
Medical benefits
Dental benefits
Vision benefits
+2