Senior Data Engineer

Strategic Employment Partners (SEP); San Francisco (CA); Hybrid; USD 120,000 - 160,000; Full time

Job summary

Strategic Employment Partners (SEP) is partnering with a leading consumer marketplace platform to find a Senior Data Engineer in San Francisco. In this pivotal role, you will manage data pipelines and collaborate with business stakeholders to understand their data requirements. This position requires strong communication skills and a solid foundation in data engineering, with an emphasis on cloud technologies.

Ideal candidates will have over 5 years of data engineering experience, particularly in orchestration tools like Airflow or Jenkins, and the ability to build pipelines in AWS, GCP, or Azure.

Qualifications

• 5+ years of data engineering experience.
• Experience with workflow orchestration tools.
• Strong stakeholder communication skills.

Responsibilities

• Own the data pipeline infrastructure for key business domains.
• Translate requirements into technical specs.
• Build and maintain production data pipelines.

Skills

Data engineering

Workflow orchestration (Airflow, Luigi, Jenkins)

Public cloud (AWS, GCP, Azure)

Stakeholder communication

Tools

Kubernetes

Docker

Redshift

EMR

AI coding tools

Job description

We are partnering with a large consumer marketplace platform to find a Senior Data Engineer to join their growing data engineering team in San Francisco.

In this role you will own the data pipeline infrastructure for a key business domain, working directly with stakeholders to understand their data needs, build and maintain production pipelines, and deliver high‑quality data sets that drive business decisions. You will be embedded within the business unit, attending stakeholder meetings, translating ambiguous requirements into technical specs, and managing your domain end to end.

What you need:

• 5+ years of data engineering experience
• Production experience with Airflow, Luigi, Jenkins, or comparable workflow orchestration
• Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
• Strong stakeholder communication – you push back, clarify, and manage expectations proactively
• Based in or able to commute to San Francisco 3 days per week (Mon/Wed/Thu)

Nice to have: experience in marketing data, Kubernetes, Docker, Redshift, EMR, or active use of AI coding tools.