Sr Data Engineer - ETRM

Shell; Bengaluru; Hybrid; INR 1,500,000 - 2,100,000; Full time

Benefits offered by this job

Flexible working hours

Remote/mobile working

Competitive salary and benefits

Job summary

Shell India is seeking a Senior Data Engineer to design and deliver scalable data solutions for energy trading and supply, leveraging Azure Data Factory, ADLS, Databricks, PySpark, Python and SQL. You will craft end-to-end data pipelines, implement robust data models, and drive platform optimization in an Agile setting.

You will collaborate with cross-functional teams, manage CI/CD pipelines, and ensure governance across data products, with a focus on performance and value delivery for trading

Qualifications

• Bachelor’s degree in Engineering, Computer Science, Information Technology, or a related field; MCA qualification is also acceptable.
• With at least 8 - 10 years of experience in Data Engineering, with a proven track record of delivering enterprise-scale data solutions.
• Deep understanding of the Energy Trading business domain and experience building data solutions that support trading operations and decision-making.
• Databricks Certified Associate certification required.

Responsibilities

• Design, develop, and maintain scalable, high-performance data engineering solutions that support business decision-making and generate measurable value.
• Build and optimize end-to-end data pipelines using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Databricks, PySpark, Python, and SQL.
• Develop data engineering solutions for the Energy Trading & Supply business, leveraging domain knowledge of ETRM (Endur, and Nucleus).
• Implement data modeling strategies to support enterprise reporting, analytics, and operational requirements.
• Drive continuous improvement initiatives by optimizing data products, processes, applications, and platform performance.
• Apply performance tuning and optimization techniques using PySpark and SQL to improve data processing efficiency and scalability.
• Design and support enterprise data platforms, Master Data Management (MDM), Data Catalog, and analytics solutions.
• Collaborate with cross-functional teams in an Agile environment, ensuring adherence to data engineering best practices, quality standards, and governance requirements.
• Manage source control, CI/CD, and release management processes using GitHub, Azure DevOps, and related tools.
• Work with relational and non-relational databases to support data integration, transformation, and analytics initiatives.
• Partner with business and technical stakeholders to translate Energy Trading business requirements into scalable data solutions.
• Contribute to innovation initiatives, including the evaluation and adoption of emerging technologies and AI-driven solutions.

Skills

Azure Data Factory

ADLS

Databricks

PySpark

Python

SQL

MDM

Data Catalog

Data Modeling

GitHub

Azure DevOps

Data pipelines

Perf tuning

Agile

Communication

Education

Bachelor’s degree in Engineering/CS/IT

MCA acceptable

Tools

Endur

Nucleus

Azure Fabric

Power BI

Job description

, India

Job Family Group:

Information Technology (IT)

Worker Type:

Regular

Posting Start Date:

September 1, 2026

Business Unit:

Projects and Technology

Experience Level:

Experienced Professionals

Job Description:

Where you fit?

An exciting opportunity to work at the Trading & Supply- Shell Energy Software Engineering & Analytics organization. We are looking for a talentedSenior Data Engineerwith great interpersonal skills to join our team.

What’s the role?

Senior Data Engineeris an individualwith proven experience in adhering to Data Engineering best practices, delivering Data related optimal & performance driven solutions which helps business making quick decision while generating value. They are expected to have continuous improvement mindset, driving value-based process, product/application optimization.

What you’ll be doing?

• Design, develop, and maintain scalable, high-performance data engineering solutions that support business decision-making and generate measurable value.
• Build and optimize end-to-end data pipelines using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Databricks, PySpark, Python, and SQL.
• Develop data engineering solutions for the Energy rading & Supply business, leveraging domain knowledge of ETRM ( Endur, and Nucleus).
• Implement data modeling strategies to support enterprise reporting, analytics, and operational requirements.
• Drive continuous improvement initiatives by optimizing data products, processes, applications, and platform performance.
• Apply performance tuning and optimization techniques using PySpark and SQL to improve data processing efficiency and scalability.
• Design and support enterprise data platforms, Master Data Management (MDM), Data Catalog, and analytics solutions.
• Collaborate with cross-functional teams in an Agile environment, ensuring adherence to data engineering best practices, quality standards, and governance requirements.
• Manage source control, CI/CD, and release management processes using GitHub, Azure DevOps, and related tools.
• Work with relational and non-relational databases to support data integration, transformation, and analytics initiatives.
• Partner with business and technical stakeholders to translate Energy Trading business requirements into scalable data solutions.
• Contribute to innovation initiatives, including the evaluation and adoption of emerging technologies and AI-driven solutions.

What we need from you?

• Bachelor’s degree in Engineering, Computer Science, Information Technology, or a related field; MCA qualification is also acceptable.
• With at least 8 - 10 years of experience in Data Engineering, with a proven track record of delivering enterprise-scale data solutions.
• Strong experience in the Trading & Supply domain, including Endur and Nucleus.
• Deep understanding of the Energy Trading business domain and experience building data solutions that support trading operations and decision-making.
• Expertise in Microsoft Azure technologies, including:
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • Azure Databricks
  • Data Pipeline Development
  • Azure Fabric
• Strong hands‑on experience with PySpark, Python, Advanced SQL and Data Modeling
• Experience working with both relational and non‑relational database technologies.
• Proven expertise in SQL query optimization and PySpark performance tuning.
• Experience with source control and DevOps practices, including GitHub, Azure DevOps, build pipelines, and release management.
• Hands‑on experience implementing enterprise data platforms, Master Data Management (MDM), Data Catalog, and analytics solutions.
• Experience working in Agile delivery environments and applying engineering best practices.
• Databricks Certified Associate certification required.
• Excellent verbal and written communication skills.

Preferred Qualifications

• Experience working with data products and platforms within the Energy sector.
• Knowledge of ETRM (Energy Trading and Risk Management) systems, particularly Endur, and its integration with enterprise energy applications.
• Experience implementing AI‑powered solutions and platforms, such as AI Foundry and Databricks Genie.
• Hands‑on experience with Microsoft Fabric and/or Power BI.
• Exposure to advanced analytics, data governance, and modern cloud‑based data architectures.

What we offer

You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet. You’ll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another. You’ll be able to balance your priorities as you become the best version of yourself.

• Progress as a person as we work on the energy transition together.
• Continuously grow the transferable skills you need to get ahead.
• Work at the forefront of technology, trends, and practices.
• Collaborate with experienced colleagues with unique expertise.
• Achieve your balance in a values‑led culture that encourages you to be the best version of yourself.
• Benefit from flexible working hours, and the possibility of remote/mobile working.
• Perform at your best with a competitive starting salary and annual performance related salary increase – our pay and benefits packages are considered to be among the best in the world.
• Take advantage of paid parental leave, including for non‑birthing parents.
• Join an organisation working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply.
• Grow as you progress through diverse career opportunities in national and
• international teams.
• Gain access to a wide range of training and development programmes.

We’d like you to know that Shell has a bold goal: to become one of the world’s most diverse and inclusive companies. You can get to know more about how we’re working towards that goal, click here .

Shell in India

Shell is a diversified energy company in India with 13,000 employees, and presence in Integrated Gas, Downstream, Power, Renewable and Upstream. Additionally, we have deep capabilities in R&D, digitalization, and business operations.

Our global strategy, Powering Progress, is designed to generate value for our shareholders, customers, and the wider society, and focuses on creating more value with less emissions. The strategy supports our purpose of providing more and cleaner energy solutions, with the aim of profitably transforming Shell into a net‑zero emissions energy business by 2050. As India moves towards its target of net‑zero emissions by 2070, Shell India aims to play a leading role in securing vital energy for today, while investing in, and helping to build, the energy system of the future through strategic investments in the country.

Our Lubricants business serves over 50,000 consumers through a strong network of over 200 distributors, and operates an end‑to‑end value chain that spans conceptualization, development, and production at a world‑class blending plant at Taloja. Through our 350‑plus retail stations, we offer an integrated mobility experience including fuels, cafes, and convenience stores, with a prominent network of EV recharging facilities.

Shell owns and operates an LNG re‑gasification terminal at Hazira, Surat, with a capacity of 5 MTPA and an LNG truck‑loading unit that plays a crucial role in helping meet India’s growing demand for gas across sectors. In 2022, Shell acquired Spring Energy in a $1.55 billion deal to build an integrated energy transition business in the country. Spring is a leading renewable energy company in India which develops and manages solar, wind, and hybrid power generation facilities and infrastructure.

Our three capability centers across Bangalore and Chennai serve as a technology and innovation powerhouse for Shell globally, working as a delivery engine for core technical, digital, and finance processes: pioneering digital innovation and cutting‑edge technologies across the energy sector. We also have strong academic partnerships and collaborations with leading universities and technology institutes to accelerate decarbonization efforts within the energy sector.

We are committed to positively contributing to the communities in which we operate through programs on STEM Education, Skilling, and Livelihood across India. We nurture and invest in startups developing initiatives focused on accelerating energy innovation through programs such as Shell E4 and Shell Eco‑marathon. We also have strategic investments in new energy companies such as Husk Power, d.light, Orb Energy, and Cleantech Solar.

DISCLAIMER:

Please note: We occasionally amend or withdraw Shell jobs and reserve the right to do so at any time, including prior to the advertised closing date. Before applying, you are advised to read our data protection policy. This policy describes the processing that may be associated with your personal data and informs you that your personal data may be transferred to Shell/Shell Group companies around the world. The Shell Group and its approved recruitment consultants will never ask you for a fee to process or consider your application for a career with Shell. Anyone who demands such a fee is not an authorized Shell representative and you are strongly advised to refuse any such demand. Shell is an Equal Opportunity Employer.