Data Platform Engineer - AWS, Databricks & PySpark

Comcast Technology Solutions; Chester (Delaware County); On-site; USD 110,000 - 170,000; Full time

Job summary

Comcast Technology Solutions is seeking a Data Engineer to join the Data Product Engineering team responsible for managing the enterprise Data Lake and critical datasets across the GTO organization.

The ideal candidate will design distributed data pipelines in cloud environments, handle high-volume data, and partner with cross-functional teams to deliver impactful data products. You will work with AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow/MWAA.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field, or equivalent practical experience.
• 5+ years of experience in Data Engineering, Data Platform Engineering, or related disciplines.
• Strong hands-on experience with AWS, PySpark, Databricks; experience building and maintaining large-scale ETL/ELT pipelines; knowledge of distributed systems and large-volume data processing; experience with data warehousing concepts and modern data architectures; experience orchestrating workflows using Apache Airflow/MWAA; knowledge of Kubernetes fundamentals; proficient in Python in data engineering contexts; experience supporting production data platforms and driving operational excellence.

Responsibilities

• Design, develop, maintain, and optimize scalable data pipelines supporting workforce, billing, interaction, and other enterprise datasets.
• Build and enhance cloud-native data solutions using AWS, Databricks, and PySpark.
• Develop and support batch and streaming data processing frameworks, integrating source systems and interfaces through modern data architectures.
• Leverage Kafka and Databricks streaming solutions to ingest and process high-volume data in near real-time.
• Drive data pipeline performance tuning, automation initiatives, and operational improvements across the platform.
• Provide production support, troubleshooting, and root-cause analysis for critical data workflows.
• Work with large-scale distributed systems and high-concurrency environments processing tens of terabytes of data.
• Utilize MWAA to orchestrate and manage data workflows.
• Collaborate with Product, Data Governance, Analytics, and Engineering teams across onshore and offshore delivery models.
• Support data warehousing initiatives and help establish best practices for data quality, scalability, and reliability.
• Mentor junior engineers and contribute to the growth of Engineering I team members.
• Participate in architectural discussions and contribute to the long-term evolution of the enterprise data platform.

Skills

AWS

PySpark

Databricks

Kafka

Kubernetes

Python

Airflow

Data Engineering

Distributed systems

Education

Bachelor's degree

Tools

MWAA

Snowflake

Amazon EKS

Job description

Comcast Technology Solutions is seeking a Data Engineer to join the Data Product Engineering team responsible for managing the enterprise Data Lake and critical datasets across the GTO organization.

The ideal candidate will design distributed data pipelines in cloud environments, handle high-volume data, and partner with cross-functional teams to deliver impactful data products. You will work with AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow/MWAA.