Cloud Platform Data Engineer - Databricks, PySpark, AWS

Comcast; West Chester (Chester County); On-site; USD 120,000 - 180,000; Full time

Job summary

Comcast is seeking a Data Engineer (Engineer 3) to join the Data Product Engineering Team responsible for the enterprise Data Lake supporting critical datasets across the GTO organization. You will design and optimize scalable data pipelines, leverage AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow to enable analytics and business decision‑making.

The role processes over massive datasets with high throughputs and requires collaboration with cross‑functional teams in onshore and offshore

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field, or equivalent practical experience.
• 5+ years of experience in Data Engineering, Data Platform Engineering, or related disciplines.
• Strong hands‑on experience with AWS, PySpark, Databricks.
• Experience building and maintaining large‑scale ETL/ELT pipelines.
• Experience orchestrating workflows using Apache Airflow/MWAA.

Responsibilities

• Design, develop, maintain, and optimize scalable data pipelines supporting workforce, billing, interaction, and other enterprise datasets.
• Build and enhance cloud-native data solutions using AWS, Databricks, and PySpark.
• Develop and support batch and streaming data processing frameworks, integrating source systems and interfaces.
• Leverage Kafka and Databricks streaming solutions to ingest and process high-volume data in near real‑time.
• Drive data pipeline performance tuning, automation initiatives, and operational improvements across the platform.
• Provide production support, troubleshooting, and root‑cause analysis for critical data workflows.
• Work with large-scale distributed systems and high‑concurrency environments processing tens of terabytes of data.
• Utilize MWAA to orchestrate and manage data workflows.
• Collaborate with Product, Data Governance, Analytics, and Engineering teams across onshore and offshore delivery models.
• Support data warehousing initiatives and help establish best practices for data quality, scalability, and reliability.
• Mentor junior engineers, provide technical guidance, and contribute to the growth and development of Engineering I team members.
• Participate in architectural discussions and contribute to the long‑term evolution of the enterprise data platform.

Skills

Distributed data engineering

Cloud data platforms

Python

Education

Bachelor's degree

Tools

AWS

Databricks

PySpark

Airflow

Kubernetes

Job description

Comcast is seeking a Data Engineer (Engineer 3) to join the Data Product Engineering Team responsible for the enterprise Data Lake supporting critical datasets across the GTO organization. You will design and optimize scalable data pipelines, leverage AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow to enable analytics and business decision‑making.

The role processes over massive datasets with high throughputs and requires collaboration with cross‑functional teams in onshore and offshore