Senior Data Engineer - Remote Pipelines & ML Enablement

Python Software Foundation; United States; Remote; Confidential; Full time

Job summary

The Python Software Foundation is looking for a Senior Data Engineer to join our team remotely within the USA. This role involves designing, building, and maintaining scalable data systems. You will have the opportunity to work with cross-functional teams to tackle complex data challenges and leverage your expertise to improve data quality and support various data-driven initiatives.

The ideal candidate will have substantial experience in data engineering, including building data pipelines, and the ability to work collaboratively across teams to deliver production-ready solutions.

Qualifications

• Strong experience in data pipeline architecture and implementation.
• Hands-on with ETL/ELT tools, especially Airflow, Dagster.
• Solid skills in Python for data engineering tasks.
• Experience with cloud-based data infrastructure and processing.
• Ability to work with both structured and unstructured datasets.

Responsibilities

• Design and build scalable data pipelines.
• Develop ETL workflows for efficient data processing.
• Implement data validation and quality checks.
• Support machine learning workflows and data preparation.
• Collaborate with teams on complex data challenges.

Skills

Data pipeline architecture and implementation

ETL/ELT orchestration tools (e.g., Airflow)

Python-based data engineering

Cloud-based data infrastructure

Data modeling and schema design

Handling structured and unstructured datasets

Experience with time-series data

Supporting machine learning with reliable workflows

Version control and testing practices

Collaboration in software development

Tools

Airflow

Python

AWS

Google Cloud

Azure

Job description

The Python Software Foundation is looking for a Senior Data Engineer to join our team remotely within the USA. This role involves designing, building, and maintaining scalable data systems. You will have the opportunity to work with cross-functional teams to tackle complex data challenges and leverage your expertise to improve data quality and support various data-driven initiatives.

The ideal candidate will have substantial experience in data engineering, including building data pipelines, and the ability to work collaboratively across teams to deliver production-ready solutions.