Data Engineer

Comcast; Chester (Delaware County); On-site; USD 140,000 - 190,000; Full time

Job summary

Comcast in the Philadelphia area seeks an experienced Data Engineer to design, build and optimize scalable data pipelines across enterprise datasets. You will work with AWS, Databricks, PySpark, and Airflow MWAA, shaping real-time processing and batch workflows.

You’ll mentor junior engineers and partner with Product, Data Governance, Analytics, and Engineering teams to improve data quality and reliability.

Qualifications

• Bachelor's degree in CS, Engineering or related field, or equivalent practical experience.
• 5+ years of experience in Data Engineering or related disciplines.
• Hands-on with AWS, PySpark, and Databricks; strong ETL/ELT pipeline experience.
• Knowledge of distributed systems and large-volume data processing.
• Experience with data warehousing concepts and modern data architectures.
• Experience orchestrating workflows with Airflow/MWAA; good Python skills.

Responsibilities

• Design, develop, maintain, and optimize scalable data pipelines for enterprise datasets.
• Build cloud-native data solutions using AWS, Databricks, and PySpark.
• Develop and support batch and streaming data processing frameworks.
• Ingest and process high-volume data using Kafka, Databricks streaming, and real-time methods.
• Tune performance, automate processes, and improve operations across the platform.
• Provide production support, troubleshooting, and root-cause analysis for critical workflows.
• Mentor junior engineers and contribute to team growth within Engineering I.
• Collaborate with Product, Data Governance, Analytics, and Engineering teams.

Skills

Data Engineering

Mentorship

PySpark

AWS

Databricks Platform

Communication

ETL Pipelines

Education

Bachelor's degree

Tools

Databricks Platform

Airflow/MWAA

Kubernetes

Python

Job description

Job Summary

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Description

Thispositionis ineligible for visa sponsorship. To beconsidered for thisrole, you must belegally authorized to work in theUnited States andnot requiresponsorship for employment now or inthe future.

Key Responsibilities

• Design, develop, maintain, and optimize scalable data pipelines supporting workforce, billing, interaction, and other enterprise datasets.


• Build and enhance cloud-native data solutions using AWS, Databricks, and PySpark.


• Develop and support batch and streaming data processing frameworks, integrating source systems and interfaces through modern data architectures.


• Leverage technologies such as Kafka and Databricks streaming solutions to ingest and process high-volume data in near real-time.


• Drive data pipeline performance tuning, automation initiatives, and operational improvements across the platform.


• Provide production support, troubleshooting, and root-cause analysis for critical data workflows.


• Work with large-scale distributed systems and high-concurrency environments processing tens of terabytes of data.


• Utilize MWAA (Managed Workflows for Apache Airflow) to orchestrate and manage data workflows.


• Collaborate closely with Product, Data Governance, Analytics, and Engineering teams across both onshore and offshore delivery models.


• Support data warehousing initiatives and help establish best practices for data quality, scalability, and reliability.


• Mentor junior engineers, provide technical guidance, and contribute to the growth and development of Engineering I team members.


• Participate in architectural discussions and contribute to the long-term evolution of the enterprise data platform.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent practical experience.


• 5+ years of experience in Data Engineering, Data Platform Engineering, or related disciplines.


• Strong hands-on experience with:
  
  
  
  • AWS
  
  
  • PySpark
  
  
  • Databricks
  
  
  
  


• Experience building and maintaining large-scale ETL/ELT pipelines.


• Strong understanding of distributed systems and large-volume data processing.


• Experience with data warehousing concepts and modern data architectures.


• Experience orchestrating workflows using Apache Airflow/MWAA.


• Knowledge of Kubernetes fundamentals, including pod lifecycle, job orchestration, and workload configuration.


• Proficiency in Python development within data engineering environments.


• Experience supporting production data platforms and driving operational excellence.


• Strong communication and collaboration skills with the ability to work effectively across multiple teams.

Preferred Qualifications

• Experience with Snowflake.


• Experience with Kafka and streaming data architectures.


• Experience with Amazon EKS (Elastic Kubernetes Service).


• Background working with large-scale interaction, advertising, marketing, or customer engagement datasets.


• Experience implementing data platform automation, observability, and monitoring solutions.


• Prior experience mentoring junior engineers and leading technical initiatives.

Disclaimer

This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills

Data Engineering; Mentorship; PySpark; Amazon Web Services (AWS); Databricks Platform; Communication; ETL Pipelines

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

5-7 Years