Data Engineer II Fandango AWSRedshiftPySpark

NBCUniversal; Orlando (FL); Remote; USD 100,000 - 130,000; Full time

Job summary

A leading media and entertainment company is seeking a Data Engineer II to design and maintain data pipelines for critical projects. The ideal candidate has 5+ years of experience in Data Engineering, strong programming skills in languages such as Python, and expertise in working with AWS. The role is fully remote and offers a collaborative environment focused on innovative solutions for data challenges.

Qualifications

• 5+ years of applied experience in Data Engineering.
• Strong working experience with various data sources.
• Experience with processing large datasets and building code.

Responsibilities

• Design, build, test, and maintain data pipelines.
• Collaborate with engineers and product managers to understand data needs.
• Troubleshoot and resolve production issues.

Skills

Data Pipeline Development

Programming in Python

Data Warehousing

Agile/Scrum Environment

Data Modeling

Education

Bachelor's degree in Computer Science

Tools

AWS (S3, Redshift, DynamoDB)

Apache Airflow

Talend

Job description

Overview

As a Data Engineer II, you will be working on our data systems and services with other data engineers to deliver projects and systems critical to Fandango's business. We expect our data engineers to be versatile, display leadership qualities and be enthusiastic about taking on new problems across our businesses as we continue to build great things for fellow movie fans.

Responsibilities

• Contribute to and help team in design, build, testing, scaling, and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements.
• Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies.
• Collaborate with engineers and product managers to understand data needs.
• Participate in Agile ceremonies (standups, retros, sprint planning, etc.)
• Troubleshoot and fix production issues as they occur.

Qualifications

• Bachelor\'s degree in Computer Science, Computer Engineering, or related technical field, or equivalent practical experience.
• 5+ years of applied experience in Data Engineering, including but not limited to: building Data Pipelines, Orchestration, Data Modeling & Data Lake.
• Programming skills in one or more of the following: Python, Java, Scala, plus SQL and experience in writing reusable/efficient code to automate analysis and data processes.
• Experience in Data Warehousing (Relational and dimensional data modeling).
• Strong working experience with a variety of data sources such as APIs, real-time feeds, structured and semi-structured file formats.
• Experience with processing large datasets and building code using Glue, Apache Airflow / Amazon MWAA, SQL, Python, and pySpark.
• Experience of near Real Time & Batch Data Pipeline development.
• Experience with AWS data management (S3, Redshift, DynamoDB) and related tools (Athena, EMR, Glue, Lambda).
• Experience working in an agile/scrum environment.

Desired Characteristics

• Familiar with software build, release, deployment and monitoring tools and practices.
• Experience with Talend, Informatica, or other off-the-shelf ETL tools.
• Experience working with Terraform.
• Strong Test-Driven Development background, with understanding of levels of testing required to continuously deliver value to production.
• Team-oriented and collaborative approach with a demonstrated aptitude, enthusiasm, and willingness to learn new methods, tools, practices, and skills.
• Ability to work effectively across functions, disciplines, and levels

Remote

Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence.

#LI-remote

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to [e-mail].

Although you\'ll be hired as an NBCU employee, your employment and the responsibilities associated with this job likely will transition to Versant in the future. By joining at this pivotal time, you\'ll be a part of this exciting company as it takes shape.