Lead Software Engineer (Data)-7999

Comcast; Reston (VA); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Remote work

Job summary

Comcast’s FreeWheel unit is seeking a technical leader to guide a team building data processing software using Apache Flink. The role involves designing ETL pipelines with Flink, Spark, Kafka, AWS EMR, Azkaban, and Airflow; storing structured data in HBase; and developing ad tech platforms including ad serving, decisioning, and audience targeting.

The candidate will also develop streaming pipelines with Apache Kafka, manage AWS resources, and mentor junior engineers while collaborating with

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related technical field.
• Seven years of experience developing data processing software using Apache Flink and related technologies.
• Three years of experience developing streaming data pipelines with Apache Kafka; experience with AWS services (S3, EC2, CloudWatch, IAM).

Responsibilities

• Provide technical leadership to a team developing data processing software using Apache Flink.
• Design ETL pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban, and Airflow.
• Mentor junior engineers and collaborate with stakeholders to define requirements.
• Develop and maintain streaming data pipelines and ad tech platforms as part of a broader advertising tech stack.

Skills

Team leadership

Mentoring

Data processing

Education

Bachelor’s degree in Computer Science or related field

Tools

Apache Flink

Apache Kafka

HBase

Spark

AWS EMR

Azkaban

Airflow

Job description

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.

Job Description

DUTIES: Provide technical leadership to a team responsible for developing data processing software using Apache Flink; design extract-transform-load (ETL) data pipelines based on company’s proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; store structured data using HBase; develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; develop streaming data pipelines using Apache Kafka; store data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; automate tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting; support applications under development and customize current applications; assist with the software update process for existing applications, and roll‑outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior‑level engineers. Position is eligible to work remotely one or more days per week, per company policy.

Requirements

Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience developing data processing software using Apache Flink; of which five (5) years of experience include designing extract-transform-load (ETL) data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; storing structured data using HBase; and developing business‑level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; of which three (3) years include developing streaming data pipelines using Apache Kafka; storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; and automating tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting.

Disclaimer

This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills

• Apache Kafka
• HBase
• Apache Flink

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non‑sales positions are eligible for a Bonus. Additionally, Comcast provides best‑in‑class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always‑on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.