Senior Data Platform Engineer - AWS, Databricks & Streaming

Comcast; Chester (Delaware County); On-site; USD 120,000 - 160,000; Full time

Job summary

Comcast is seeking a Data Engineer to join the Data Product Engineering team responsible for managing the enterprise Data Lake supporting critical datasets across the GTO organization. The role focuses on scalable, reliable data solutions for analytics and decision-making, handling environments processing over 50TB of data with AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow.

The ideal candidate will have 5+ years in data engineering, strong distributed systems knowledge, and experience

Qualifications

• Bachelor's degree or equivalent practical experience.
• 5+ years of experience in Data Engineering, Data Platform Engineering, or related disciplines.
• Strong hands-on experience with AWS, PySpark, Databricks.
• Experience building and maintaining large-scale ETL/ELT pipelines.
• Strong understanding of distributed systems and large-volume data processing.
• Experience with data warehousing concepts and modern data architectures.
• Experience orchestrating workflows using Apache Airflow/MWAA.
• Knowledge of Kubernetes fundamentals and Python development in data environments.
• Experience supporting production data platforms and driving operational excellence.
• Strong communication and collaboration skills across multiple teams.

Responsibilities

• Design, develop, maintain, and optimize scalable data pipelines for enterprise datasets.
• Build and enhance cloud-native data solutions using AWS, Databricks, and PySpark.
• Develop and support batch and streaming data processing frameworks.
• Utilize Kafka and Databricks streaming for high-volume data processing.
• Drive data pipeline performance tuning and automation initiatives.
• Provide production support and root-cause analysis for critical data workflows.
• Collaborate with Product, Data Governance, Analytics, and Engineering teams.
• Mentor junior engineers and contribute to team growth.
• Participate in architectural discussions for long-term data platform evolution.

Skills

AWS

PySpark

Databricks

ETL Pipelines

Python

Airflow/MWAA

Kubernetes

Data Warehousing

Communication

Mentorship

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field

Tools

Snowflake

Kafka

Amazon EKS

Apache Airflow

Job description

Comcast is seeking a Data Engineer to join the Data Product Engineering team responsible for managing the enterprise Data Lake supporting critical datasets across the GTO organization. The role focuses on scalable, reliable data solutions for analytics and decision-making, handling environments processing over 50TB of data with AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow.

The ideal candidate will have 5+ years in data engineering, strong distributed systems knowledge, and experience