Sr Data Engineer

5 Star Recruitment; Glendale (CA); On-site; USD 103,320 - 130,872; Full time

Job summary

A leading recruitment firm is seeking a Senior Data Engineer for a prominent client in the entertainment sector based in Glendale, CA. In this role, you will manage and expand existing Core Data platform data pipelines while collaborating closely with various teams. Ideal candidates should have over 7 years of experience in data engineering, proficiency in Python, and hands-on experience with tools like Spark and Snowflake. This position is onsite 3-4 days a week and requires a background check.

Qualifications

• 7+ years of data engineering experience developing large data pipelines.
• Proficient in at least one major programming language (Python, Java, Scala).
• Hands-on production experience with distributed processing systems such as Spark.

Responsibilities

• Contribute to maintaining, updating, and expanding existing data pipelines.
• Build and maintain APIs to expose data to downstream applications.
• Develop real-time streaming data pipelines.

Skills

Data pipeline development

Python

Snowflake

Spark

Airflow

API development

Tools

Databricks

Delta Lake

Job description

Job Title: Sr Data Engineer

Location: Glendale, CA Onsite 3-4 days a week

The Company

Headquartered in Los Angeles, this leader in the Entertainment & Media space is focused on delivering world-class stories and experiences to it’s global audience. To offer the best entertainment experiences, their technology teams focus on continued innovation and utilization of cutting edge technology.

Platform / Stack

You will work with technologies that include Python, AWS, Snowflake, Databricks, and Airflow.

Compensation Expectation: $75 95/hr W2

What You’ll Do As a Sr Data Engineer:

• Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines
• Build and maintain APIs to expose data to downstream applications
• Develop real‑time streaming data pipelines
• Tech stack includes Airflow, Spark, Databricks, Delta Lake, and Snowflake
• Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
• Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more
• Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)

Qualifications:

You could be a great fit if you have:

• 7+ years of data engineering experience developing large data pipelines
• Proficiency in at least one major programming language (e.g. Python, Java, Scala)
• Hands‑on production environment experience with distributed processing systems such as Spark
• Hands‑on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
• Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query).
• Experience in developing APIs with GraphQL
• Advance understanding of OLTP vs OLAP environments
• Graph Database experience a plus
• Realtime Event Streaming experience a plus

This client requires that a background check be completed. A background check is required to protect our company/client and its stakeholders by ensuring that we hire individuals with a trustworthy history, which helps maintain a safe and secure workplace. This proactive measure minimizes potential risks and promotes a culture of integrity within the organization.