Data Engineer 3 - Virtual

Visa Hunt; United States; On-site; USD 80,000 - 185,000; Full time

Job summary

Comcast Advertising is seeking a Data Engineer to build and optimize large-scale data pipelines using SQL, Python, and Spark on AWS. You will design robust data lake architectures with Delta Lake and Iceberg, empower self-service analytics, and drive data quality and governance across the platform.

The role emphasizes hands-on build, collaboration with Product and Engineering, and contributing to a modern, scalable data platform used by many internal teams and partners.

Qualifications

• Experience building large-scale data pipelines and data architectures.

Responsibilities

• Architect high-performance data pipelines for large-scale processing.
• Develop Big Data ETL workflows using modern frameworks like Delta Live Tables.
• Design data lake architectures with Delta Lake and Apache Iceberg.
• Define and enforce data engineering best practices for quality and performance.
• Lead observability across pipelines including cataloging and lineage.
• Produce thorough documentation of data flows and architectures.

Skills

SQL

Python

Apache Spark

AWS

Databricks

Delta Lake

Iceberg

Looker

Education

Bachelor's Degree

Tools

Databricks

Snowflake

Kubernetes

Teradata

Job description

Comcast Advertising is driving the TV advertising industry forward, from delivering ads to linear and digital audiences to pioneering the tech that makes it possible. We help brands connect with their audiences on every screen using advanced data, technology, and premium video content. Our media sales division helps local, regional, and national brands reach potential customers through multiscreen TV advertising. Our ad tech division FreeWheel provides comprehensive adtech that makes it easier to buy and sell premium video advertising across all screens, data types, and sales channels.

Job Summary

Looking for a skilled Data Engineer with expertise in SQL and Python experienced in building large-scale data pipelines using Apache Spark and designing robust data architectures on AWS. The ideal applicant will have hands‑on experience and curiosity to learn and develop skills in data lake architectures, open table formats (Delta Lake), and modern data platforms delivery self‑service analytics for large number of users. If you are a problem solver, a data platform enthusiast, and someone who thrives in fast‑paced environments, this is an opportunity for you!

Job Description

What you can expect to do as part of this role

• Architect, design, and build high-performance, scalable data pipelines that support large-scale data processing needs.
• Develop complex Big Data ETL workflows using modern frameworks such as Databricks Delta Live Tables (DLT).
• Design and implement robust data lake architectures, including open table formats such as Delta Lake and Apache Iceberg.
• Define, promote, and enforce data engineering best practices to ensure data quality, integrity, reliability, and performance.
• Lead the implementation of observability and monitoring across pipelines, including data cataloging, lineage, and metadata management.
• Contribute to peer reviews, knowledge sharing, production support, incident resolution, and change management activities.
• Adhere to code management and version control best practices across all development workflows.
• Produce high-quality documentation including data flows, lineage diagrams, and architecture details, aligned to data engineering documentation standards.
• Ensure comprehensive code coverage through the creation of unit and integration tests, following test‑driven development (TDD) principles.
• Own critical components of large-scale batch ETL systems and clearly articulate data models and design decisions to Product, Engineering, and Leadership stakeholders.
• Manage multiple priorities effectively, balancing long‑term architectural direction with immediate business needs.
• Build advanced semantic layers and support the creation of customer‑facing self‑service analytics solutions.
• Exercise independent judgment and discretion in handling complex and impactful technical decisions.
• Maintain regular, consistent, and punctual attendance, with flexibility to work nights, weekends, or variable schedules as required.
• Demonstrate strong understanding of semantic layer technologies such as Looker, Tab, Snowflake, and Databricks.
• Perform additional duties and responsibilities as assigned.

Things that will come in handy

• Experience in Data Engineering.
• Proficient in Python, PySpark. Good grasp on SQL.
• Hands‑on experience in Databricks and/or Snowflake is preferred.
• Data Warehouse modeling paradigms.
• Understanding of Cloud based architectures. We use AWS.
• Problem‑solving skills.
• Certifications.
• AWS Certified Developer Associate.
• Databricks Certified Data Engineer Associate.
• SnowProAdvanced: Data Engineer.

Responsibilities

• Designing and constructing data architectures and pipelines to standardize, transform, and ensure the integrity of data for business insights
• Guaranteeing data quality throughout the ingestion, processing, and loading phases, with a focus on maintaining high standards
• Engineering robust ingestion frameworks for a variety of data types, while monitoring and reporting on data quality
• Developing accessible methods for data consumption, including APIs, database views, and data extracts for user applications
• Implementing data solutions on multiple platforms such as Kubernetes, Teradata, and cloud services like AWS and Databricks
• Selecting appropriate data storage platforms based on data sensitivity, privacy requirements, and access needs
• Mastering data lineage and applying transformation rules for effective change management and issue resolution
• Collaborating with cross‑functional teams to refine data sourcing and processing, ensuring optimal data quality and efficiency
• Consistent exercise of independent judgment and discretion in matters of significance.
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
• Other duties and responsibilities as assigned.

Employees at all levels are expected to:

• Understand our Operating Principles; make them the guidelines for how you do your job.
• Own the customer experience think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
• Know your stuff be enthusiastic learners, users and advocates of our game‑changing technology, products and services, especially our digital tools and experiences.
• Win as a team make big things happen by working together and being open to new ideas.
• Be an active part of the Net Promoter System a way of working that brings more employee and customer feedback into the company by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
• Drive results and growth.
• Support a culture of inclusion in how you work and lead.
• Do what’s right for each other, our customers, investors and our communities.

Disclaimer

Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Skills

Change Management, Collaboration, Data Processing, Data Quality, Problem Resolution

Compensation

National Pay Range: $78,966.34 USD-$185,077.36 USD Illinois Pay Range: $83,901.74 USD - $162,868.08 USD Colorado Pay Range: $88,837.13 USD - $170,271.17 USD Hawaii Pay Range: $103,643.32 USD - $155,464.99 USD Washington DC Pay Range: $113,514.12 USD - $170,271.17 USD Maryland Pay Range: $93,772.53 USD - $170,271.17 USD Minnesota Pay Range: $88,837.13 USD - $155,464.99 USD New York Pay Range: $93,772.53 USD - $185,077.36 USD Washington Pay Range: $88,837.13 USD - $177,674.27 USD New Jersey Pay Range: $98,707.93 USD - $177,674.27 USD Vermont Pay Range: $93,772.53 USD - $148,061.89 USD Massachusetts Pay Range: $98,707.93 USD - $177,674.27 USD Virginia Pay Range: $88,837.13 USD - $170,271.17 USD Maine Pay Range: $88,837.13 USD - $148,061.89 USD California Pay Range: $88,837.13 USD - $164,513.21

Comcast intends to offer the selected candidate base pay within the posted range for this role at the time of posting dependent on job‑related, non‑discriminatory factors such as experience. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non‑sales positions are eligible for a Bonus. Additionally, Comcast provides best‑in‑class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always‑on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Education

Bachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Certifications (if applicable)

Relevant Work Experience

5–7 Years. Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment applicants with arrest or conviction records in accordance with the requirements of applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Please note that federal state, or local laws and regulations may restrict or prohibit Comcast from hiring individuals convicted of certain crimes. Additionally, an applicant’s criminal history may have a direct, adverse, and negative relationship on the job duties of this position, which may result in the withdrawal of a conditional offer of employment.

Originally posted on Himalayas