Senior Data Engineer: Scale Big Data Pipelines (Hybrid)

SmartRecruiters, Inc.; New York, Northern (NY, KY); Hybrid; USD 115,000 - 145,000; Full time

Benefits offered by this job

Hybrid schedule

Medical, dental, and vision insurance

Tuition reimbursement

401(k) and paid leave

Job summary

NBCUniversal is seeking a Senior Data Engineer to join the Content Delivery Engineering team in New York City. You will design, build, and maintain large-scale data pipelines that ingest, process, and store vast amounts of data from internal and partner systems.

You will work with Snowflake, Databricks, and cloud platforms to enable analytics, dashboards, and real-time insights. The role requires collaboration across teams, strong communication, and a hybrid work arrangement.

Qualifications

• Bachelor's degree in computer science, information technology, or a related field.
• 5+ years of experience with big data: ETL, pipeline development, and analysis.
• Experience with Snowflake, Databricks, GCP, or AWS.
• Experience with CI/CD pipelines and test automation.
• Experience with data visualization tools.
• Experience with Site Reliability Engineering (SRE) practices in cloud environments.
• Familiarity with Agile methodologies.

Responsibilities

• Design, develop & maintain data systems and pipelines, with a focus on reliability, testability and ease of use.
• Assist in cleansing, discretization, imputation, selection, generalization etc. to create high quality features for the modeling process
• Work with business stakeholders to define business requirements including KPI and acceptance criteria
• Use big data, relational and non-relational data sources, to access data at the appropriate level of granularity for the needs of specific analytical projects
• Maintain up to date knowledge of the relevant data set structures and participate in defining necessary upgrades and modifications
• Collaborate with software and data architects in building real-time and automated batch implementations of the data science solutions and integrating them into the streaming service architecture
• Ensure a consistent, diligent approach to peer review of code and configuration change within sensible, maintained repository structures and CI/CD pipelined deployment.
• Participate in, or lead design reviews, architectural discussions and team knowledge-sharing sessions with peers and stakeholders.
• Make best use of our observability systems & advanced analytics to surface issues, drive diagnosis and develop fixes.

Skills

Big data analytics

Programming experience

Communication skills

Education

Bachelor's degree in CS or related field

Tools

Snowflake

Databricks

GCP

AWS

CI/CD pipelines

Test automation

Job description

NBCUniversal is seeking a Senior Data Engineer to join the Content Delivery Engineering team in New York City. You will design, build, and maintain large-scale data pipelines that ingest, process, and store vast amounts of data from internal and partner systems.

You will work with Snowflake, Databricks, and cloud platforms to enable analytics, dashboards, and real-time insights. The role requires collaboration across teams, strong communication, and a hybrid work arrangement.