Databricks Data Engineering Lead

Baker Hughes Company; Bengaluru; Hybrid; INR 2,500,000 - 4,500,000; Full time

Benefits offered by this job

Contemporary work-life balance

Private medical care

Life insurance

Disability programs

Tailored financial programmes

Additional benefits

Job summary

Baker Hughes is seeking a Databricks Data Engineering Lead to drive data engineering activities, build and maintain pipelines, and provide technical guidance across teams. The role supports analytics, reporting, and AI use cases while aligning with data governance and architectural standards.

You will collaborate with stakeholders to understand business processes, data definitions, and ensure delivery excellence using agile practices and modern engineering techniques.

Qualifications

• Bachelor's degree in Computer Science or STEM disciplines.
• 2+ years of Databricks experience.
• Experience with Python, PySpark, SQL, and AWS-based data platforms.
• Familiarity with Git, CI/CD pipelines, ServiceNow processes, and Agile delivery methodologies.
• Basic experience with Rally (Agile Central) for backlog management, user story tracking, and sprint execution.

Responsibilities

• Lead and coordinate Data Engineering activities, ensuring timely and high-quality delivery across teams.
• Develop and maintain data pipelines and transformations when required.
• Provide technical guidance, design reviews, and implementation support to Data Engineers and vendors.
• Implement and oversee data quality, testing, and monitoring controls.
• Support analytics, reporting, and AI use cases.

Skills

Databricks experience

Python

PySpark

SQL

AWS platforms

Git

CI/CD pipelines

Agile delivery

ServiceNow processes

Rally (Agile Central)

Education

Bachelor's Degree in Computer Science or STEM

Tools

ServiceNow

CI/CD tooling

Job description

Databricks Data Engineering Lead

Would you like to lead digital transformation? Would you like to be involved in bringing innovative solutions to our clients? Join our dynamic Digital Technology Team. We operate at the heart of the digital transformation of our business. Our team is responsible for digitization initiatives, from defining digital strategy to enabling employee success, the Digital Technology team provides world class products and services to our business partners.

Fuel your passion

To be successful in this role you will:

• Data Engineering Lead and coordinate Data Engineering activities, ensuring timely and high-quality delivery across teams.
• Develop and maintain data pipelines and transformations when required.
• Provide technical guidance, design reviews, and implementation support to Data Engineers and vendors.
• Implement and oversee data quality, testing, and monitoring controls.
• Support analytics, reporting, and AI use cases.
• Contribute to data modeling, architecture alignment, and technical standards.
• Coordinate workspace operational requests, configurations, and platform support activities.

Standards & Governance

Apply engineering standards and development best practices. Ensure compliance with testing, documentation, deployment, and operational requirements. Contribute to continuous improvement initiatives.

Service Management Support

Support ServiceNow incidents, changes, and service requests. Participate in root cause analysis and operational reporting. Ensure operational processes are consistently followed.

Data Modeling & Business Knowledge

Quickly understand business processes, source systems, and data structures. Collaborate with stakeholders to clarify requirements and data definitions. Support logical and physical data modeling activities.

Data Governance & Data Custodian

Support Data Governance activities for assigned datasets and data products. Maintain metadata, lineage, and catalog information. Implement data quality controls and validation rules. Support data classification, access controls, and audit requirements. Participate in data quality monitoring and resolution activities.

AI-Driven Engineering

Use AI assistants to accelerate development, testing, troubleshooting, and documentation. Contribute to AI-enabled software engineering practices. Improve productivity, quality, and delivery efficiency through AI adoption.

Required Qualifications

• Bachelor's Degree in Computer Science or STEM disciplines.
• 2+ years of Databricks experience.
• Have atleast 3+ years of experience.
• Experience with Python, PySpark, SQL, and AWS-based data platforms.
• Familiarity with Git, CI/CD pipelines, ServiceNow processes, and Agile delivery methodologies.
• Basic experience with Rally (Agile Central) for backlog management, user story tracking, and sprint execution.
• Experience supporting production environments.

Desired Characteristics

• Strong analytical and problem-solving skills.
• Ability to quickly understand new business domains and datasets.
• Delivery-oriented and collaborative mindset with the ability to work across business and technical teams.
• Basic understanding of Agile/Scrum practices, including user stories, backlog refinement, and sprint ceremonies.
• Interest in AI technologies and modern engineering practices.
• Strong focus on quality, automation, governance, and continuous improvement.

Work in a way that works for you

We recognize that everyone is different and that the way in which people want to work and deliver at their best is different for everyone too. In this role, we can offer the following flexible working patterns:

• Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
• Working with us.

Working with us

Our people are at the heart of what we do at Baker Hughes. We know we are better when all of our people are developed, engaged and able to bring their whole authentic selves to work. We invest in the health and well‑being of our workforce, train and reward talent and develop leaders at all levels to bring out the best in each other.

Working for you

Our inventions have revolutionised energy for over a century. But to keep going forward tomorrow, we know we have to push the boundaries today. We prioritise rewarding those who embrace change with a package that reflects how much we value their input. Join us, and you can expect:

• Contemporary work‑life balance policies and wellbeing activities
• Comprehensive private medical care options
• Safety net of life insurance and disability programs
• Tailored financial programmes
• Additional elected or voluntary benefits

The Baker Hughes internal title for this role is: Digital Technology Specialist - Project Management

At Baker Hughes, we are transforming the future of energy. With operations in over 120 countries, we are developing and deploying industry-leading technologies and services to take energy forward. For more than a century, our inventions have revolutionised energy. Today, we are bringing our expertise to make oil and gas safer, cleaner, and more efficient. Our people are the trusted experts, relied on to solve customer challenges big and small. We invest in the health and well‑being of our workforce, train and reward talent, and develop leaders at all levels to bring out the best in each other. We believe in creating an environment of diversity and inclusion, without bias. We know we are better when all of our people are developed, engaged, and able to bring their whole authentic selves to work. We’re makers, inventors, and leaders who aren’t afraid of the tough challenges. We believe pushing boundaries will help to lead the way for a new energy future.