Lead Data Engineer: SAP to BigQuery Lakehouse Innovator

Elanco; United States; Hybrid; USD 41,000 - 72,000; Full time

Job summary

Elanco is seeking a Lead Data Engineer in Bangalore, India with 6+ years of experience to modernize ERP data architecture. You will build near real-time SAP data replication into Google BigQuery and integrate with Databricks for AI/ML and global reporting.

You will own production pipelines, drive efficiencies, and mentor junior engineers while collaborating with analysts and data scientists to translate requirements into robust technical stories.

Qualifications

• Bachelor's degree or equivalent in CS/SE.
• 6+ years delivering enterprise data solutions.
• Experience with Google BigQuery and Databricks required.

Responsibilities

• Own end-to-end data pipelines across SAP datasets.
• Mentor engineers on tooling and testing patterns.
• Own production incidents and implement permanent fixes.
• Collaborate with analysts/scientists to translate requirements into technical stories.
• Promote Elanco data standards and code reviews.
• Monitor pipelines and optimize performance/memory usage.
• Design data quality checks and CI/CD tests.
• Share knowledge and contribute to the data engineering community.

Skills

BigQuery

Databricks PySpark

SQL

Python

Spark

DevSecOps

CI/CD

TDD

Education

Bachelor's degree in Computer Science or related

Tools

Git

GitHub

VS Code

SonarQube

Copilot

BigQuery Studio

Databricks

Job description

Elanco is seeking a Lead Data Engineer in Bangalore, India with 6+ years of experience to modernize ERP data architecture. You will build near real-time SAP data replication into Google BigQuery and integrate with Databricks for AI/ML and global reporting.

You will own production pipelines, drive efficiencies, and mentor junior engineers while collaborating with analysts and data scientists to translate requirements into robust technical stories.