Senior Platform Data Engineer: AWS, Databricks & PySpark

Blueface Ltd

West Whiteland Township (Chester County)

On-site

USD 120,000 - 160,000

Full time

6 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Comcast is seeking a Data Engineer (Engineer 3) to join our Data Product Engineering Team. You will help manage and evolve the enterprise Data Lake, handling large-scale workforce, billing, and interaction datasets to enable analytics and decision-making.

The role emphasizes building scalable, reliable data solutions in cloud environments, processing over 50TB of data with AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow.

Qualifications

Bachelor's degree or equivalent in CS/engineering.
5+ years in Data Engineering or related fields.
Strong AWS, PySpark, Databricks, and ELT/ETL pipeline experience.
Experience with Airflow/MWAA and Kubernetes.
Proficient Python and data warehousing concepts.

Responsibilities

Design, build, and optimize scalable data pipelines for workforce, billing, and interactions.
Develop cloud-native data solutions with AWS, Databricks, and PySpark.
Implement batch and streaming processing and integrate source systems.
Leverage Kafka and Databricks streaming for near real-time data.
Tune performance, automate operations, and improve data workflows.
Provide production support and root-cause analysis for critical pipelines.
Mentor engineers and collaborate with cross-functional teams.

Skills

AWS

Apache Airflow

Databricks Platform

PySpark

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

Kubernetes

MWAA

Snowflake

Job description

The role emphasizes building scalable, reliable data solutions in cloud environments, processing over 50TB of data with AWS, PySpark, Databricks, Kafka, Kubernetes, and Airflow.

Get your free, confidential resume review.

or drag and drop your file here.