Senior Data Engineer: AWS, PySpark & Streaming Pipelines

Comcast

Chester (Delaware County)

On-site

USD 140,000 - 190,000

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Comcast in the Philadelphia area seeks an experienced Data Engineer to design, build and optimize scalable data pipelines across enterprise datasets. You will work with AWS, Databricks, PySpark, and Airflow MWAA, shaping real-time processing and batch workflows.

You’ll mentor junior engineers and partner with Product, Data Governance, Analytics, and Engineering teams to improve data quality and reliability.

Qualifications

Bachelor's degree in CS, Engineering or related field, or equivalent practical experience.
5+ years of experience in Data Engineering or related disciplines.
Hands-on with AWS, PySpark, and Databricks; strong ETL/ELT pipeline experience.
Knowledge of distributed systems and large-volume data processing.
Experience with data warehousing concepts and modern data architectures.
Experience orchestrating workflows with Airflow/MWAA; good Python skills.

Responsibilities

Design, develop, maintain, and optimize scalable data pipelines for enterprise datasets.
Build cloud-native data solutions using AWS, Databricks, and PySpark.
Develop and support batch and streaming data processing frameworks.
Ingest and process high-volume data using Kafka, Databricks streaming, and real-time methods.
Tune performance, automate processes, and improve operations across the platform.
Provide production support, troubleshooting, and root-cause analysis for critical workflows.
Mentor junior engineers and contribute to team growth within Engineering I.
Collaborate with Product, Data Governance, Analytics, and Engineering teams.