Lead Data Engineer

Epiroc; Bengaluru; Hybrid; INR 4,000,000 - 7,000,000; Full time

Job summary

Join Epiroc Mining India Private Ltd in Bengaluru as a Lead Data Engineer, driving data pipelines, ETL, and scalable analytics in a hybrid, India-based setup. You will collaborate with AI/ML teams to enable end-to-end data solutions across global systems.

We seek a senior data engineer with 10+ years of experience, strong Python, PySpark, SQL skills, and proficiency in Azure DataBricks, Azure DevOps, and REST APIs, plus a cloud architecture mindset.

Qualifications

• Bachelor's or Master's in CS or related field with 10+ years experience in data engineering.
• Proficiency with Python, PySpark, and SQL for scalable data solutions.
• Hands-on experience with Azure DataBricks, Azure DevOps, and Visual Studio Code.
• Strong knowledge of REST APIs for data integration.
• Familiarity with Generative AI concepts and LLM integration is desirable.
• Cloud-based data platforms and scalable architectures.

Responsibilities

• Design, implement, and maintain scalable data pipelines and ETL processes.
• Monitor data pipeline performance and reliability; optimize workflows.
• Integrate data from structured and unstructured sources from global platforms.
• Identify and integrate new data sources to improve analytics.
• Optimize indexing for large-scale, multi-domain datasets.
• Ensure data quality, consistency, and compliance with standards.
• Develop monitoring and alerting to track pipeline health and SLA.
• Collaborate with AI/ML teams to enable data-driven solutions.
• Align data engineering work with project roadmaps and deadlines.

Skills

Python

PySpark

SQL

Azure DataBricks

Azure DevOps

REST APIs

Education

Bachelor's or Master’s in Computer Science or related field

Tools

Azure DataBricks

Azure DevOps

Visual Studio Code

Job description

Select how often (in days) to receive an alert:

Functional area: IT

Onsite or Remote: Hybrid

Country/Region: IN

Location:

Bengaluru, KA, IN, 560058

Company name: Epiroc

Date of posting: Oct 19, 2026

Join Epiroc Mining India Private Ltd in Bengaluru as a Lead Data Engineer and become an integral part of our Corporate Units within the Research and Development department. This role presents a unique opportunity to contribute to Epiroc's rapidly evolving AI and digital transformation journey, working within a dynamic and technology-driven environment.

About the Role

As a Lead Data Engineer, you will spearhead the design, development, and maintenance of robust data pipelines and ETL processes that ensure reliable, high-quality data for business and product needs. You will take ownership of performance monitoring and optimization of data workflows, proactively addressing challenges and streamlining processes to support scalable data solutions.

Your expertise will be essential in integrating data from diverse structured and unstructured sources across global systems, identifying new data opportunities to enhance analytical capabilities and fuel innovation. You will play a key role in optimizing indexing strategies for large-scale, multi-domain datasets, ensuring data quality, consistency, and compliance with enterprise standards.

Collaboration is at the heart of this position. You will work closely with AI/ML engineers, data scientists, and product teams to deliver comprehensive end-to-end data solutions. Through active communication and alignment with cross-functional teams, you will help shape data engineering efforts to meet project roadmaps and timelines effectively. Additionally, you will implement monitoring and alerting systems to maintain data pipeline health and ensure service-level agreements are met consistently.

Responsibilities

• Design, implement, and maintain scalable and reliable data pipelines and ETL processes to support diverse business requirements.
• Continuously monitor data pipeline performance and reliability, optimizing workflows and proactively resolving issues.
• Integrate and connect various data sources, including structured and unstructured data from global platforms.
• Identify, evaluate, and integrate new data sources to broaden the scope and improve the quality of available data sets.
• Optimize indexing strategies for handling large-scale, multi-domain datasets efficiently.
• Ensure strict adherence to data quality, consistency, and enterprise compliance standards throughout data processing.
• Develop and implement monitoring and alerting mechanisms to track data pipeline health and SLA compliance.
• Partner with AI/ML engineers, data scientists, and product teams to enable seamless delivery of data-driven solutions.
• Collaborate with cross-functional teams to ensure data engineering initiatives align with strategic project objectives and deadlines.

Qualifications & Skills

• Bachelor's or Master’s degree in Computer Science Engineering or related field, accompanied by 10+ years of professional experience in data engineering.
• Proficiency with programming languages including Python, PySpark, and SQL for developing efficient and scalable data solutions.
• Hands-on experience with leading data engineering tools such as Azure DataBricks, Azure DevOps, and Visual Studio Code.
• Strong knowledge of REST APIs, facilitating effective data integration and automation.
• Familiarity with Generative AI concepts and experience integrating Large Language Models (LLM) is highly desirable.
• Solid understanding of cloud-based data platforms and designing scalable data architectures.

Success Behaviors

The ideal candidate is a proactive team player who excels in transparent communication, providing consistent updates to both the team and stakeholders. A customer-focused and adaptable mindset is crucial to navigate a varied and fast-paced work environment. We value a collaborative, approachable, and transparent individual who remains calm and effective in handling critical and urgent situations. Demonstrating these behaviors will empower you to thrive within Epiroc’s inclusive and innovative culture.

Why Work with Us?

By joining Epiroc, you become part of a forward-thinking organisation with a strong commitment to innovation and digital transformation. You will engage with cutting-edge technologies, collaborate with global talent, and gain valuable exposure across multiple business functions. Epiroc fosters continuous learning and career growth, providing a stimulating environment where your expertise can flourish and make a tangible impact on our products and services.

It all starts with people. The world needs metals and minerals for the energy transition and our cities and infrastructure must be developed to serve a growing population. To succeed, we need to speed up the shift towards more sustainable mining and construction industries. We at Epiroc accelerate this transformation, together with customers and business partners in more than 150 countries, by developing and providing innovative and safe equipment, digital solutions, and aftermarket support.

All new thinkers are welcome. We are looking for those who want to develop, grow, and dare to think new. In Epiroc we attract, develop, and retain diverse talent valuing authenticity and unique perspectives, driving our spirit of innovation. We foster an inclusive culture where diversity isn't just a goal but a part of our values and way of working. This is how we do business for a sustainable future.Learn more at www.epiroc.com