Senior Data Platform Engineer - Cloud Pipelines

Comcast (CC) of Willow Grove; West Whiteland Township (Chester County); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Comprehensive benefits

Job summary

Comcast (CC) of Willow Grove seeks an experienced Data Engineer to join the Data Product Engineering team, managing an enterprise Data Lake for critical datasets. You will build scalable pipelines, leverage AWS, PySpark, Databricks, and Kafka to deliver high-performance data products.

The role emphasizes collaboration across Product, Data Governance, Analytics, and Engineering, with on-site work preferred and remote considerations where applicable.

Qualifications

• Bachelor's degree or equivalent experience in CS/Engineering/IS.
• 5+ years in Data Engineering or related roles.
• Hands-on with AWS, PySpark, Databricks; ETL/ELT pipelines.
• Experience with distributed systems and large-volume data processing.
• Familiar with data warehousing concepts and modern architectures.
• Experience with Airflow/MWAA; Kubernetes fundamentals.
• Proficient in Python in data engineering contexts.
• Strong communication and cross-team collaboration.

Responsibilities

• Design, develop, and optimize scalable data pipelines for enterprise datasets.
• Build cloud-native data solutions using AWS, Databricks, and PySpark.
• Develop batch and streaming processing frameworks with modern architectures.
• Use Kafka and Databricks streaming for near real-time data.
• Tune performance and drive automation across the platform.
• Provide production support and root-cause analysis for data workflows.
• Work with large-scale distributed systems across onshore/offshore teams.
• Mentor junior engineers and contribute to architectural discussions.
• Support data warehousing initiatives and data quality practices.

Skills

AWS

PySpark

Data pipelines

Distributed systems

Python

Airflow

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field

Tools

Databricks Platform

Apache Airflow/MWAA

Kubernetes

Snowflake

Amazon EKS

Job description

Comcast (CC) of Willow Grove seeks an experienced Data Engineer to join the Data Product Engineering team, managing an enterprise Data Lake for critical datasets. You will build scalable pipelines, leverage AWS, PySpark, Databricks, and Kafka to deliver high-performance data products.

The role emphasizes collaboration across Product, Data Governance, Analytics, and Engineering, with on-site work preferred and remote considerations where applicable.