Data Engineer II-9682

Xfinity; Philadelphia (Philadelphia County); Remote; USD 70,000 - 90,000; Full time

Job summary

A leading company in advertising technology is looking for a Data Analyst to transform complex data into effective business solutions while ensuring accuracy and quality. This role involves utilizing tools like SQL, Spark, and AWS to manage data flows and support analytics initiatives. Ideal candidates will have a relevant degree and experience in data analysis and ETL processes, with the opportunity to work 100% remotely.

Qualifications

• At least 1 year of experience in data analysis with SQL and Spark SQL.
• Experience developing ETL jobs with Databricks and PySpark.
• Proficiency in data quality checks using PySpark.

Responsibilities

• Transform large, complex data into accessible business databases.
• Develop ETL jobs utilizing Databricks, Jupyter, and PySpark.
• Conduct data quality checks on large datasets.

Skills

Data Quality

PySpark

Spark SQL

AWS Lambda

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Databricks

Jupyter

Job description

Comcast Advertising is driving the TV advertising industry forward, delivering ads to linear and digital audiences, and pioneering the technology behind it. We help brands connect with audiences on every screen using advanced data, technology, and premium video content. Our media sales division assists local, regional, and national brands in reaching potential customers through multiscreen TV advertising. Our ad tech division, FreeWheel, provides comprehensive adtech solutions to facilitate the buying and selling of premium video advertising across all screens, data types, and sales channels.

Job Summary

Job Description

Responsibilities:

• Transform large, complex data into accessible business databases and applications for self-service analytics and reporting.
• Perform data analysis using SQL and Spark SQL queries.
• Develop ETL jobs utilizing Databricks, Jupyter, and PySpark.
• Automate ETL processes with AWS services such as S3, Athena, Lambda, RDS, Glue, and EMR.
• Conduct data quality checks and exploratory data analysis on large datasets using PySpark.
• Create system architecture, design, and specifications to solve complex development problems.
• Source and determine appropriate data for analysis.
• Collaborate with data modelers and analysts to understand business needs and enhance data assets.
• Implement database design, data manipulation, ETL, and data flow analysis.
• Resolve technical issues by applying knowledge of policies and processes.
• Monitor system notifications and logs to ensure data quality.
• Address abstract problems by reusing existing data files and flags.
• Identify critical issues, analyze trends, and quantify data source volumes.
• Participate in implementing solutions within big data systems like Hadoop and SQL.
• Work with business and technical teams to ensure data relevance and actionability.
• Optimize data storage solutions and organize data relations within tables.
• Collaborate with platform management to improve data sourcing and processing rules.

This position is eligible for 100% remote work.

Requirements:

• Bachelor’s degree or equivalent in Computer Science, Engineering, or related field.
• At least 1 year of experience in data analysis with SQL and Spark SQL.
• Experience developing ETL jobs with Databricks, Jupyter, and PySpark.
• Experience automating ETL processes using AWS services such as S3, Athena, Lambda, RDS, Glue, and EMR.
• Proficiency in data quality checks and exploratory data analysis on large datasets using PySpark.

Disclaimer: This description provides a general overview of the role and is not an exhaustive list of duties, responsibilities, or qualifications.

Skills: AWS Lambda, Data Quality, PySpark, Spark SQL

We offer benefits designed to support your physical, financial, and emotional well-being. For more details, visit our benefits summary on our careers site.

Comcast is an equal opportunity employer, considering all qualified applicants regardless of race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or other legally protected status.