Remote Data Engineering Lead: AWS, PySpark & ETL

Jobgether; Oregon; Hybrid; USD 140,000 - 210,000; Full time

Job summary

Jobgether is seeking a Data Engineering Lead in the United States to oversee the design, development, and delivery of scalable cloud-based data solutions. You will drive architecture, build robust pipelines using AWS Glue, EMR, S3, Python and PySpark, and mentor teams in enterprise data initiatives.

You will lead data integration efforts, define standards, and collaborate with stakeholders to ensure high quality, reliable data products in a remote-first environment.

Qualifications

• Proven leadership of data engineering teams.
• Expertise in AWS data pipelines and enterprise data integration.
• Strong Python, PySpark, SQL and ETL/ELT skills.

Responsibilities

• Lead architecture, design and development of scalable data pipelines.
• Drive enterprise data integration initiatives and ETL/ELT workflows.
• Lead the development of reliable, scalable data products.
• Define and maintain engineering standards, best practices, and development guidelines.
• Conduct technical design and code reviews to ensure quality.
• Optimize data pipelines for performance and quality.
• Mentor Data Engineers and guide their technical growth.
• Collaborate with architecture and business teams to align with enterprise objectives.

Skills

AWS data engineering

Python/PySpark

ETL/ELT

Data pipelines design

Leadership

Tools

Amazon S3

AWS Glue

Amazon EMR

SQL

Python

PySpark

Job description

Jobgether is seeking a Data Engineering Lead in the United States to oversee the design, development, and delivery of scalable cloud-based data solutions. You will drive architecture, build robust pipelines using AWS Glue, EMR, S3, Python and PySpark, and mentor teams in enterprise data initiatives.

You will lead data integration efforts, define standards, and collaborate with stakeholders to ensure high quality, reliable data products in a remote-first environment.