Data Engineer III: Pipelines, Quality & Cloud Data

DataJobs; Chicago (IL); On-site; USD 104,000 - 170,000; Full time

Benefits offered by this job

Best-in-class benefits

Personalized benefits options

Job summary

Comcast Corporation is seeking a Data Engineer 3 to design and run advanced data structures and pipelines that support data quality, accessibility, and privacy and regulatory compliance.

The role focuses on building robust data architectures, ensuring data accuracy across ingestion and processing, and delivering accessible data through APIs, views, and extracts. Collaboration with cross-functional teams is essential for efficient, compliant data solutions.

Qualifications

• SQL proficiency.
• Programming language proficiency (Python preferred).
• Distributed computing framework proficiency (e.g., Apache Spark).
• Cloud Data Warehouse management experience.
• Knowledge of at least one cloud provider: AWS, GCP, or Azure.
• Familiarity with data pipeline design patterns.
• Knowledge of data observability.

Responsibilities

• Design and build data architectures and pipelines to standardize, transform, and protect data integrity for business insights.
• Maintain data quality across ingestion, processing, and loading, with consistent high standards.
• Develop ingestion frameworks for multiple data types, including data quality monitoring and reporting.
• Create accessible data consumption paths such as APIs, database views, and data extracts for user applications.
• Implement data solutions across platforms including Kubernetes, Teradata, and cloud services such as AWS and Databricks.
• Select data storage platforms based on data sensitivity, privacy requirements, and access needs.
• Use data lineage and apply transformation rules to support change management and issue resolution.
• Partner with cross-functional teams to refine data sourcing and processing for improved quality and efficiency.
• Exercise independent judgment and discretion in matters of significance.
• Maintain regular, consistent, and punctual attendance; able to work nights and weekends and adjust to variable schedules as necessary.
• Perform other duties and responsibilities as assigned.

Skills

SQL

Python

Distributed computing

APIs

Education

Bachelor’s Degree

Tools

Apache Spark

Kubernetes

Teradata

Databricks

dbt

Airflow

Snowflake

Looker

Job description

Comcast Corporation is seeking a Data Engineer 3 to design and run advanced data structures and pipelines that support data quality, accessibility, and privacy and regulatory compliance.

The role focuses on building robust data architectures, ensuring data accuracy across ingestion and processing, and delivering accessible data through APIs, views, and extracts. Collaboration with cross-functional teams is essential for efficient, compliant data solutions.