Senior API & Data Connectors Engineer

Three Pillars Recruiting

San Francisco (CA)

Hybrid

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Three Pillars Recruiting is seeking a Senior Software Engineer for our Data Products team in San Francisco. You will own and extend core data ingestion frameworks and SDK abstractions, building high-throughput native connectors and a Flask-based runtime service.

You will design extensible connectors, integrate PyAirbyte, and optimize data transfer while maintaining strong typing and developer ergonomics for teams consuming the data platform.

Qualifications

  • 5+ years writing production Python software with strong OOP and typing.
  • Experience building microservices/APIs using Flask for high-throughput data.
  • Proven track record developing extensible SDKs or framework components.

Responsibilities

  • Architect Connector Abstractions: define core interfaces for data ingestion.
  • Build native connectors using DuckDB, Arrow, Iceberg with memory efficiency.
  • Own the Flask runtime service exposing catalog, check, discover, read.
  • Integrate PyAirbyte to unlock 300+ external data sources.
  • Optimize data transfer semantics for low latency data passing.
  • Enhance developer experience with well-typed, extensible plugins.

Skills

Python
APIs & Microservices
High-Performance Data

Tools

Flask
Docker
Git
pytest
Poetry

Job description

Three Pillars Recruiting is seeking a Senior Software Engineer for our Data Products team in San Francisco. You will own and extend core data ingestion frameworks and SDK abstractions, building high-throughput native connectors and a Flask-based runtime service.

You will design extensible connectors, integrate PyAirbyte, and optimize data transfer while maintaining strong typing and developer ergonomics for teams consuming the data platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - API & Data Connectors - MarTech/AdTech
Senior Software Engineer - API & Data Connectors - MarTech/AdTech

Three Pillars Recruiting • San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Senior Backend Engineer - Data Pipelines & Validation
Senior Backend Engineer - Data Pipelines & Validation

Three Pillars Recruiting • San Francisco (CA)

On-site
USD 180,000 - 230,000
Senior Data Platform Architect & Tech Coach
Senior Data Platform Architect & Tech Coach

Strategic Employment Partners (SEP, Inc.) • San Francisco (CA)

On-site
USD 200,000 - 230,000
Equity
Top-tier benefits
Senior Data Engineer
Senior Data Engineer

Serene Healthcare Staffing • San Francisco (CA)

On-site
USD 170,000 - 210,000
Senior Software Engineer — Remote (Azure/.NET Expert)
Senior Software Engineer — Remote (Azure/.NET Expert)

3Pillar Global, Inc. • United States

Hybrid
USD 90,000 - 130,000
Senior Python Data Engineer REQ_115, REQ_118
Senior Python Data Engineer REQ_115, REQ_118

3Pillar Global, Inc. • United States

Remote
USD 120,000 - 190,000
Medical Insurance
Life Insurance
Paid vacation
+2
Senior Backend Engineer – AI-Powered Data Platforms
Senior Backend Engineer – AI-Powered Data Platforms

Airbyte • United States

Remote
USD 210,000 - 260,000
Flexible PTO
Parental leave (16 weeks)
Medical, dental, vision coverage
+4
Senior Data Backend Engineer — Python, Cloud & Leadership
Senior Data Backend Engineer — Python, Cloud & Leadership

SteerBridge, Inc. • Vienna (VA)

Hybrid
USD 145,000 - 175,000
Health insurance
Dental insurance
Vision insurance
+4
Senior Data Engineer - Data Platform & Pipelines
Senior Data Engineer - Data Platform & Pipelines

Plaid Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity compensation
Medical, dental, vision, 401(k)
Senior Software Engineer (.NET / Python) REQ_83
Senior Software Engineer (.NET / Python) REQ_83

3Pillar Global, Inc. • United States

Remote
USD 120,000 - 180,000