Senior Data Engineer: Pipelines & Cloud Data Platforms

Comcast (CC) of Willow Grove; Chicago (IL); On-site; USD 104,000 - 155,000; Full time

Job summary

Comcast is seeking a data engineering professional to design, build, and manage advanced data structures and pipelines ensuring quality and accessibility. This role drives data solutions across platforms while complying with privacy and regulatory standards.

The candidate will optimize data processes, support business initiatives, and collaborate with cross-functional teams to refine data sourcing and processing, including Kubernetes, Teradata, and cloud services.

Qualifications

• Strong SQL proficiency.
• Programming language proficiency (Python preferred).
• Proficiency in distributed computing frameworks (e.g., Apache Spark).
• Cloud Data Warehouse management.
• Knowledge of at least one cloud provider (AWS, GCP, or Azure).
• Familiarity with data pipeline design pattern.
• Knowledge of data observability.
• Exposure to embedded BI like Looker is desired but not required.
• Exposure to modern data stack such as dbt, Airflow, Snowflake, Apache Spark is highly desired.
• Exposure to Data Consumption challenges and solutions is highly desired.

Responsibilities

• Designing and constructing data architectures and pipelines to standardize, transform, and ensure data integrity for business insights.
• Guaranteeing data quality throughout ingestion, processing, and loading phases with high standards.
• Engineering robust ingestion frameworks for various data types and monitoring data quality.
• Developing accessible methods for data consumption (APIs, database views, data extracts).
• Implementing data solutions on platforms like Kubernetes, Teradata, AWS and Databricks.
• Selecting appropriate data storage platforms based on data sensitivity and access needs.
• Mastering data lineage and applying transformation rules for change management.
• Collaborating with cross-functional teams to refine data sourcing and processing for quality and efficiency.
• Performing duties with independence and reliability; willingness to work nights/weekends.

Skills

SQL proficiency

Python

Distributed computing (Spark)

Cloud data warehouse

Cloud provider knowledge (AWS/GCP/AZ)

Data pipeline design patterns

Data observability

Looker exposure

dbt/Airflow/Snowflake/Spark exposure

Data consumption solutions

Education

Bachelor's Degree

Tools

Kubernetes

Teradata

AWS

Databricks

Looker

dbt

Airflow

Snowflake

Job description

Comcast is seeking a data engineering professional to design, build, and manage advanced data structures and pipelines ensuring quality and accessibility. This role drives data solutions across platforms while complying with privacy and regulatory standards.

The candidate will optimize data processes, support business initiatives, and collaborate with cross-functional teams to refine data sourcing and processing, including Kubernetes, Teradata, and cloud services.