Sr Data Engineer (Scala/Spark)

NBCUniversal; Englewood Cliffs (NJ); Remote; USD 115,000 - 145,000; Full time

Job summary

An established industry player is seeking a Senior Data Engineer to join their dynamic Data & Analytics team. In this role, you will harness the power of data to build robust pipelines and applications that drive strategic decision-making in the media sector. You'll collaborate closely with business partners, leveraging cutting-edge technologies like AWS and Python to create innovative solutions. This fully remote position offers a unique opportunity to contribute to a forward-thinking company that values community engagement and inclusivity. If you thrive in an agile environment and are passionate about data, this role is perfect for you.

Benefits

Medical insurance

Dental insurance

Vision insurance

401(k) plan

Paid leave

Tuition reimbursement

Employee discounts

Qualifications

• 5+ years of relevant experience in data engineering.
• Experience with AWS tech stack and serverless technologies.

Responsibilities

• Build data pipelines to support business partners' analytics needs.
• Collaborate with business partners to develop analytical tools.

Skills

Data Modeling

Data Architecture

ETL

SQL

Python

AWS

Spark

Scala

Education

Bachelor's degree in Engineering

Computer Science

Information Systems

Tools

AWS EMR

AWS Lambda

Iceberg

Linux

Pandas

Job description

Company Description

NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our theme parks and consumer experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, MSNBC, CNBC, NBC Sports, Telemundo, NBC Local Stations, Bravo, USA Network, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through Universal Filmed Entertainment Group and Universal Studio Group, and have world-renowned theme parks and attractions through Universal Destinations & Experiences. NBCUniversal is a subsidiary of Comcast Corporation.

Company Description

NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our theme parks and consumer experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, MSNBC, CNBC, NBC Sports, Telemundo, NBC Local Stations, Bravo, USA Network, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through Universal Filmed Entertainment Group and Universal Studio Group, and have world-renowned theme parks and attractions through Universal Destinations & Experiences. NBCUniversal is a subsidiary of Comcast Corporation.

Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world.

Comcast NBCUniversal has announced its intent to create a new publicly traded company ('SpinCo') comprised of most of NBCUniversal's cable television networks, including USA Network, CNBC, MSNBC, Oxygen, E!, SYFY and Golf Channel along with complementary digital assets Fandango, Rotten Tomatoes, GolfNow, GolfPass, and SportsEngine. The well-capitalized company will have significant scale as a pure-play set of assets anchored by leading news, sports and entertainment content. The spin-off is expected to be completed during 2025.

Job Description

As the Senior Data Engineer for the Data & Analytics team, you will have the opportunity to build data pipelines to land, profile, and store multiple internal & external datasets, and build applications that surface this data to support our business partners’ strategic decision making for analytics solution in media industry.

We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We are seeking people who are comfortable with ambiguity and figuring out an execute. While the key focus for this role is on backend engineering, the ability to architect in a cyber compliant way will be especially considered.

• Be a Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions.
• Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (AWS tech stack, data lake, Python, Spark, Scala, Iceberg, EMR Serverless, SNS, SQS, AWS Lambda, Step Functions, Event Triggers etc.)
• Educate and inform business partners on architecture, capabilities, best practices, and solutions to build out future enhancements.
• Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions.
• Write easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time.
  
  

Qualifications

• Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 5+ years of relevant experience.
• 1+ Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL and Data Warehouse methodologies and technologies.
• Demonstrated experience as an engineering lead in implementing scalable, distributed, and highly available systems using cloud technologies, specifically Amazon Web Services.
• Experience in any combination of the following: SQL, AWS EMR/Lambda, Iceberg, Linux, Python, Web technologies, APIs, Spark, Scala.
• 2+ years’ experience with AWS tech stack. Experience using serverless technologies is highly desirable.
• Basic understanding of relational data modeling and be able to clearly articulate the reasons to use non-relational systems in our architecture.
• Experience with Python and Pandas in an AWS Lambda framework is a nice to have.
  
  

Desired Characteristics

• Experience in Media industry with various linear & digital platforms such as Operative One, Google Ad Manager, Freewheel, WO Traffic etc
• Experience in Snowflake is desired but relevant experience in any of the following is acceptable: Redshift, SingleStore, Athena, MSSQL Server, Oracle.
• Decent understanding for the media ad sales business and ad serving technologies with experience working with ad serving transactional data logs.
• Experience in any BI tool is desired with a preference for MicroStrategy but is not required.
• Candidate will have strong analytical focus, results-oriented and execution driven with strong problem-solving skills.
• Ability and desire to work within a cross-functional team environment with people from multiple business units, vendors, countries, and cultures.
• Self-driven/self-initiator and resourceful to achieve goals independently as well as in teams. Promotes an open flow of information so that all stakeholders are well informed.
• Committed and solution focused with the ability to perform under pressure and meeting deadlines.
  
  

Additional Requirements

• Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence.
  
  

This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $115,000 - $145,000

We are accepting applications for this position on an ongoing basis.

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

If you are a qualified individual with a disability or a disabled veteran, you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access nbcunicareers.com as a result of your disability. You can request reasonable accommodations by emailing [e-mail].

For LA County and City Residents Only: NBCUniversal will consider for employment qualified applicants with criminal histories, or arrest or conviction records, in a manner consistent with relevant legal requirements, including the City of Los Angeles' Fair Chance Initiative For Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, where applicable.

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Full-time

Job function

• Industries

  Broadcast Media Production and Distribution, Entertainment Providers, and Media Production

Referrals increase your chances of interviewing at NBCUniversal by 2x

Sign in to set job alerts for “Senior Data Engineer” roles.

New York, NY $153,000.00-$210,000.00 4 months ago

Senior Software Engineer, Lead - Supply Chain

Senior Solutions Engineer - HCM/HRIS/ADP Specialist

New York, NY $140,000.00-$160,000.00 3 months ago

New York City Metropolitan Area 3 weeks ago

New York, NY $140,000.00-$200,000.00 1 month ago

Director, Software Engineering - Data Infrastructure

Senior Project Controls Analyst – Data Center Construction

New York City Metropolitan Area $180,000.00-$220,000.00 1 week ago

New York, NY $126,100.00-$186,800.00 1 week ago

New York, NY $113,000.00-$130,000.00 2 months ago

New York, NY $150,000.00-$190,000.00 1 month ago

New York, NY $120,000.00-$140,000.00 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.