Lead Cloud Data Engineer — AWS, PySpark & ETL

Deloitte France; Philadelphia (Philadelphia County); On-site; USD 140,000 - 195,000; Full time

Job summary

Deloitte is seeking a Lead Software Engineer to design, build, and operate AWS cloud and data-engineering solutions that modernize client platforms. You will develop scalable data processing capabilities and integrate data across systems in a client-focused delivery environment.

You will work on cloud migration, data engineering, and legacy modernization, leading Python and PySpark workloads, ETL pipelines with AWS Glue and S3, and infrastructure via CloudFormation.

Qualifications

• Bachelor’s degree or equivalent experience.
• 7+ years’ experience developing Python applications and PySpark workloads for distributed data processing.
• 5+ years’ experience designing, building, or maintaining ETL data pipelines using AWS Glue, Amazon S3, and SQL.
• Experience provisioning AWS infrastructure using AWS CloudFormation.
• Experience integrating APIs, relational databases, or NoSQL databases with workflows.
• Experience working in Financial Services/Investment Management.
• Ability to travel up to 10%.
• Limited immigration sponsorship may be available.

Responsibilities

• Design and build Python applications and PySpark workloads in AWS.
• Develop, test, and maintain ETL pipelines using AWS Glue and S3.
• Provision AWS resources via CloudFormation.
• Integrate APIs, databases, and source systems into workflows.
• Perform code reviews, support deployment, troubleshoot issues, document designs.

Skills

Independent work & collaboration

Effective communication

Attention to detail

Lead projects or workstreams

Multi-task in fast-paced environment

Interpersonal skills

Meet deadlines

Provide clear guidance to others

Education

Bachelor’s degree or equivalent experience

Tools

AWS CloudFormation

AWS Glue

SQL

Git

Job description

Deloitte is seeking a Lead Software Engineer to design, build, and operate AWS cloud and data-engineering solutions that modernize client platforms. You will develop scalable data processing capabilities and integrate data across systems in a client-focused delivery environment.

You will work on cloud migration, data engineering, and legacy modernization, leading Python and PySpark workloads, ETL pipelines with AWS Glue and S3, and infrastructure via CloudFormation.