Senior Data Engineer

Arthur J. Gallagher & Co. (AJG); Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Competitive compensation

Career development

Learning opportunities

People-first culture

Global reach

Job summary

Gallagher in India is seeking a Senior Data Engineer to design, build, test, and maintain scalable data pipelines, data models, and governance-ready data assets for global teams. You will work with SQL, Python/PySpark, ETL/ELT, warehousing, cloud platforms, and data quality controls, collaborating with Data Owners, platform teams, and analysts to enable analytics and reporting.

This role offers the chance to contribute to cross-functional projects, adhere to engineering standards, and grow in a

Qualifications

• 5–8 years of experience in data engineering and ETL/ELT development.
• Strong SQL skills with complex joins, aggregations, and performance tuning.
• Proficient in Python or PySpark and data engineering languages.
• Experience with data warehousing, dimensional modelling, and cloud platforms.
• Familiar with orchestration, monitoring, logging, and failure handling in production pipelines.
• Knowledge of data quality engineering, lineage, and governance concepts.

Responsibilities

• Design, build, test, and maintain scalable data pipelines across source systems and data stores.
• Develop reusable ingestion, transformation, and load routines using SQL, Python, and orchestration tools.
• Model and optimise relational and dimensional data warehouses for BI and governance needs.
• Embed data quality checks, lineage, and automated monitoring into pipelines.
• Collaborate with Data Owners, Data Analysts, BI Developers, and platform teams.
• Provide production support and troubleshoot pipeline issues to ensure reliability.
• Document designs, data dictionaries, mappings, runbooks, and patterns.

Skills

SQL

Python

PySpark

Scala

Java

ETL/ELT

Airflow

Data modelling

Data warehousing

Data governance

Cloud data platforms

Education

Bachelor's degree

Tools

Microsoft Fabric

Azure Data Factory

Azure Synapse

Snowflake

Databricks

dbt

Informatica

Airflow

Job description

Introduction

Welcome to Gallagher in India - where expertise, technology, and purpose come together. Since 2006, Gallagher in India has supported global teams by delivering quality, service, and speed through deep expertise, smart technology, and specialized knowledge services. More than just an operations center, it's a place where careers grow through collaboration, continuous learning, and purposeful work. We drive efficiency, compliance, and innovation so our teams can focus on serving clients. If you enjoy solving problems and working with purpose, Gallagher is the place where you can grow and feel a sense of belonging.

Overview

The Senior Data Engineer will support GGB UK's Chief Data Office by designing, building, testing, and maintaining reliable data pipelines, data models, and engineering solutions that turn source system data into governed, trusted, and reusable data assets. The role requires strong hands-on experience in SQL, Python or equivalent programming, ETL/ELT development, data warehousing, cloud data platforms, data quality controls, source-to-target mapping, orchestration, and production support. The role will work closely with Data Owners, Data Stewards, Business Analysts, Data Analysts, Product Owners, platform teams, and governance stakeholders to deliver scalable data foundations, improve data reliability, automate ingestion and transformation workflows, and enable analytics, reporting, governance, and downstream data products.

How you'll make an impact

• Data Pipeline Engineering: Design, build, test, deploy, and maintain scalable batch and near-real-time data pipelines across source systems, staging layers, data warehouses, lakehouses, and reporting-ready data layers.
• ETL/ELT Development and Automation: Develop reusable ingestion, transformation, cleansing, enrichment, and load routines using SQL, Python, orchestration tools, and approved enterprise data platforms.
• Data Modelling and Warehousing: Build and optimise relational, dimensional, and analytical data models that support business intelligence, data quality monitoring, governance reporting, and self-service analytics.
• Data Quality Engineering: Embed data quality checks, reconciliation controls, validation rules, exception handling, lineage checks, and automated monitoring into data pipelines to improve completeness, accuracy, consistency, timeliness, and reliability.
• Source-to-Target Mapping and Data Lineage: Interpret business requirements, source system structures, data definitions, and transformation rules to create, validate, and maintain technical mappings and lineage documentation.
• Platform Collaboration and Production Support: Work with cloud, database, DevOps, BI, analytics, and governance teams to troubleshoot pipeline failures, optimise performance, manage dependencies, support releases, and ensure stable production operations.
• Documentation and Engineering Standards: Maintain technical design documents, data dictionaries, source-to-target mappings, runbooks, control evidence, deployment notes, and reusable engineering patterns to ensure repeatability, auditability, and maintainability.
• Continuous Improvement and Optimisation: Improve pipeline performance, reduce manual effort, automate recurring data processes, optimise compute and storage usage, strengthen controls, and contribute to engineering best practices across the data ecosystem.

About you

Minimum Required Degree: Bachelor's degree

Preferred Degree: Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, Software Engineering, Engineering, Mathematics, Statistics, Data Science, or a related quantitative or technology discipline

Certificate(s)/Special Training: Preferred certification or training in SQL, Python, Data Engineering, ETL/ELT, Azure Data Fundamentals, Azure Data Engineer, Microsoft Fabric, Snowflake, Databricks, Apache Spark, Airflow or equivalent orchestration tools, dbt, Informatica, data quality, data governance, or cloud data platforms

Experience (Career Level Guide): Senior-Level: 5 to 8 years of experience in data engineering, ETL/ELT development, SQL-based data transformation, data warehousing, cloud data platforms, pipeline orchestration, data modelling, production support, data quality engineering, or source-to-target implementation. Experience in BFSI, insurance, consulting, shared services, or global capability centre environments is preferred.

Knowledge, Skills and Ability:

• Strong hands‑on SQL skills, including joins, aggregations, window functions, stored procedures, query optimisation, data transformation, validation, and troubleshooting
• Experience designing, developing, testing, deploying, and supporting ETL/ELT pipelines across databases, data warehouses, lakehouses, and cloud data platforms
• Proficiency in Python, PySpark, Scala, Java, or equivalent programming/scripting languages used for data engineering and automation
• Working knowledge of data warehousing, dimensional modelling, relational modelling, partitioning, indexing, incremental loads, and performance optimisation
• Experience with orchestration, scheduling, monitoring, logging, alerting, retry mechanisms, and failure handling for production data pipelines
• Understanding of data quality engineering, including automated checks for completeness, accuracy, consistency, validity, timeliness, uniqueness, and reconciliation
• Ability to interpret business requirements, data definitions, source-to-target mappings, transformation rules, and lineage needs and convert them into technical implementation designs
• Experience with Microsoft Fabric, Azure Data Factory, Azure Synapse, Snowflake, Databricks, dbt, Informatica, Airflow, or equivalent enterprise data engineering tools is desirable
• Good understanding of data governance concepts including metadata, business glossary, Critical Data Elements, data ownership, stewardship, controls, and issue management
• Ability to collaborate with Data Analysts, BI Developers, Business Analysts, Product Owners, platform teams, and business stakeholders to deliver reliable data assets
• Strong ownership mindset, attention to detail, documentation discipline, problem-solving ability, and willingness to work in a global stakeholder environment

Additional Information

At Gallagher, we believe supporting our colleagues goes far beyond the role itself. For more information, visit our Benefits page.

• Competitive compensation
• Comprehensive benefits programs designed to support your well-being
• Career development opportunities and ongoing learning
• A collaborative, people-first culture with accessible leadership
• The opportunity to do meaningful work with global reach and local impact

At Gallagher, we are dedicated to building an inclusive and authentic workplace. If your past experience doesn't align perfectly, we encourage you to join our Talent Community to stay connected to additional career opportunities. At times, we will consider transferable skills from previous roles.

Gallagher is an affirmative action/equal opportunity employer (Minorities/Females/Veterans/Disabled)