Sr Data Engineer
Innoventrics
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Qualifications
- 5+ years of data engineering experience developing large data pipelines.
- Proficiency in at least one major programming language like Python.
- Hands-on experience with Spark and Airflow for creating data pipelines.
Responsibilities
- Maintain and expand existing Core Data platform data pipelines.
- Build and maintain APIs for downstream applications.
- Develop real-time streaming data pipelines.
Skills
Job description
Job Title: Sr Data Engineer
Location: Glendale, CA – Onsite 4 days a week
Headquartered in Los Angeles, this leader in the Entertainment & Media space is focused on delivering world-class stories and experiences to its global audience. To offer the best entertainment experiences, their technology teams focus on continued innovation and utilization of cutting edge technology.
You will work with technologies that include Python, AWS, Spark, Snowflake, Databricks, and Airflow.
- Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines
- Build and maintain APIs to expose data to downstream applications
- Develop real-time streaming data pipelines
- Tech stack includes Airflow, Spark, Databricks, Delta Lake, and Snowflake
- Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
- Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more
- Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all stakeholders (Engineering, Data Science, Operations, and Analytics teams)
- 5+ years of data engineering experience developing large data pipelines
- Proficiency in at least one major programming language (e.g. Python, Java, Scala)
- Hands‑on production environment experience with distributed processing systems such as Spark
- Hands‑on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
- Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, BigQuery)
- Experience in developing APIs with GraphQL
- Advanced understanding of OLTP vs OLAP environments
- Strong background in at least one of the following: distributed data processing or software engineering of data services, or data modeling
This client requires that a background check be completed. A background check is required to protect our company/client and its stakeholders by ensuring that we hire individuals with a trustworthy history, which helps maintain a safe and secure workplace. This proactive measure minimizes potential risks and promotes a culture of integrity within the organization.
- 3 levels of medical insurance for you and your family
- Dental insurance for you and your family
- 401k
- Overtime
- California has the following sick leave policy: accrue 1 hour for every 30 hours worked up to 48 hours. If you are based in a different state, please inquire about that state’s sick leave policy.
pipelines, core data, snowflake, airflow, processing, spark, technology, data
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
