Senior Data Pipeline Engineer: Python, SQL, Cloud

NextGenEnergyJobs; San Francisco (CA); On-site; USD 130,000 - 170,000; Full time

Job summary

Redwood is building a local-global battery supply chain, delivering production-grade data pipelines for reporting and automation. The role focuses on code-based data analyses, not BI tooling, and requires translating business needs into scalable data solutions.

You will work closely with finance, supply chain, and operations to deliver reliable datasets and automations while deploying pipelines on cloud infrastructure and maintaining code quality through CI/CD practices.

Qualifications

• 3+ years building, deploying, and maintaining production data pipelines.
• Bachelor’s degree in quantitative or technical field; graduate degree preferred.
• Domain expertise in financial metrics or in supply chain and operations.
• Strong Python and SQL skills.
• Experience with orchestration tools (Dagster/Airflow) and dbt.
• Working knowledge of cloud infrastructure.
• Familiarity with CI/CD and good coding practices.
• Ability to translate stakeholder conversations into scalable data pipelines.
• Experience with Starburst and OpenMetadata.

Responsibilities

• Build, deploy, and maintain production-grade automated data pipelines using Python and SQL.
• Collaborate with stakeholders in finance, supply chain, and operations to scope and deliver automated data products.
• Develop and orchestrate pipelines using Dagster or Airflow, and manage transformations with dbt.
• Apply CI/CD and software engineering practices to data workflows.
• Deploy pipelines on cloud infrastructure and ensure reliability of deliverables.
• Own delivery end-to-end from scoping to follow-through.

Skills

Python

SQL

CI/CD

Cloud

Stakeholder communication

Education

Bachelor's degree in quantitative/technical field

Tools

Dagster

Airflow

dbt

Starburst

OpenMetadata

AWS

Job description

Redwood is building a local-global battery supply chain, delivering production-grade data pipelines for reporting and automation. The role focuses on code-based data analyses, not BI tooling, and requires translating business needs into scalable data solutions.

You will work closely with finance, supply chain, and operations to deliver reliable datasets and automations while deploying pipelines on cloud infrastructure and maintaining code quality through CI/CD practices.