Senior Data Engineer: Python, PySpark & AWS ETL

engineeringjobs.net, Inc.; Philadelphia (Philadelphia County); On-site; USD 120,000 - 180,000; Full time

Job summary

engineeringjobs.net, Inc. seeks a data engineer to design and build Python applications and PySpark workloads to process data within AWS environments. You will develop and maintain ETL pipelines and provision AWS infrastructure to support client modernization initiatives.

The role requires a bachelor's degree and at least 7 years of experience in Python and PySpark development, plus 5+ years building ETL pipelines using AWS Glue and Amazon S3. Strong SQL and cloud migration skills are essential.

Qualifications

• Bachelor's degree required.
• 7+ years of Python and PySpark development experience.
• 5+ years building ETL pipelines using AWS Glue and Amazon S3.

Responsibilities

• Design and build Python applications and PySpark workloads to process data within AWS environments.
• Develop and maintain ETL pipelines and provision AWS infrastructure to support client modernization initiatives.

Skills

Python

PySpark

AWS Glue

Amazon S3

SQL

AWS CloudFormation

ETL Pipelines

Data Engineering

Cloud Migration

API Integration

Database Management

Code Reviews

Production Support

Technical Documentation

Project Leadership

Education

Bachelor's degree

Job description

engineeringjobs.net, Inc. seeks a data engineer to design and build Python applications and PySpark workloads to process data within AWS environments. You will develop and maintain ETL pipelines and provision AWS infrastructure to support client modernization initiatives.

The role requires a bachelor's degree and at least 7 years of experience in Python and PySpark development, plus 5+ years building ETL pipelines using AWS Glue and Amazon S3. Strong SQL and cloud migration skills are essential.