Data Engineer III: Scalable Pipelines & AI Insights

Comcast (CC) of Willow Grove; Philadelphia (Philadelphia County); Presencial; USD 109.000 - 163.000; Jornada completa

Descripción de la vacante

Comcast National Traffic and Capacity Management is hiring a Data Engineer III to design, build, and operate scalable data pipelines and planning tools supporting network capacity planning and optimization. You will work across data engineering, analytics, and applied AI, enabling forecasting, analysis, and decision-making.

The role involves ELT/ETL development for batch and streaming data, data-quality checks, automation, and collaboration with cross-functional teams to deliver reliable data

Formación

• Strong proficiency in SQL and Python or similar programming languages, with experience in data engineering, data quality, data product development or application development and data analytics.
• Hands-on experience building production data applications using AWS, Databricks, Spark, or comparable cloud and distributed-processing technologies.
• Deep experience building, monitoring, and optimizing large scale data pipelines and data-intensive applications.
• Working knowledge of machine learning workflows, including model development, deployment, evaluation, and monitoring.

Responsabilidades

• Design, develop, test, deploy, and support scalable data applications, planning tools, APIs, and data pipelines for network capacity planning and analysis.
• Build and optimize ELT and ETL processes across batch and streaming datasets.
• Develop automated data-quality checks, anomaly detection, mastery data management, metadata management, lineage, and monitoring processes.
• Develop automation for recurring workflows, including orchestration, validation, monitoring, and issue notification.
• Provide system documentation and perform ad hoc data analysis to support AI-assisted insights.

Conocimientos

SQL

Python

AWS

Databricks

Spark

ELT/ETL

Data pipelines

Data quality

Airflow

BI tools

ML workflows

Educación

Bachelor's Degree

Herramientas

Tableau

Power BI

Airflow

Spark

Descripción del empleo

Comcast National Traffic and Capacity Management is hiring a Data Engineer III to design, build, and operate scalable data pipelines and planning tools supporting network capacity planning and optimization. You will work across data engineering, analytics, and applied AI, enabling forecasting, analysis, and decision-making.

The role involves ELT/ETL development for batch and streaming data, data-quality checks, automation, and collaboration with cross-functional teams to deliver reliable data