Remote Data Engineer - AWS, PySpark & ETL

Comcast (CC) of Willow Grove; Philadelphia (Philadelphia County); On-site; USD 110,000 - 150,000; Full time

Job summary

Comcast Advertising is seeking a data engineer to join a team responsible for building data pipelines in an AWS cloud environment. You will work with S3, RDS, Lambda, and CloudWatch, perform SQL operations, and develop APIs while collaborating with cross-functional teams.

The role involves ETL with Python, PySpark, and Spark, and leveraging GitHub for version control, Concourse for CI/CD, and SAFe practices in a DevOps culture.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related technical field.
• 2+ years of experience in data engineering in an AWS/cloud data environment.
• Experience with S3, RDS, Lambda, and CloudWatch; ETL with Python, PySpark, Spark.

Responsibilities

• Contribute to data engineering in an AWS cloud environment.
• Perform SQL CRUD operations and advanced queries.
• Develop and consume APIs and build CI/CD pipelines in a DevOps setup.

Skills

GitHub

Python

SAFe

Education

Bachelor's degree in Computer Science, Engineering, or related technical field

Tools

Terraform

Concourse

GitHub Copilot

Job description

Comcast Advertising is seeking a data engineer to join a team responsible for building data pipelines in an AWS cloud environment. You will work with S3, RDS, Lambda, and CloudWatch, perform SQL operations, and develop APIs while collaborating with cross-functional teams.

The role involves ETL with Python, PySpark, and Spark, and leveraging GitHub for version control, Concourse for CI/CD, and SAFe practices in a DevOps culture.