Senior Data Engineer

1203 Barclays Global Serv. Cent; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

1203 Barclays Global Serv. Cent is looking for a Senior Data Engineer in Pune, IN. This role involves building and maintaining data systems that ensure data accuracy and security. The ideal candidate will have strong experience in Data Engineering and proficiency in SQL, Apache Spark, and various AWS services.

You will work collaboratively with data scientists and lead projects in a fast-paced environment. A focus on data governance and compliance will be key aspects of this role, along with the responsibility of overseeing data pipelines and architectures.

Qualifications

• Strong experience in Data Engineering with enterprise delivery exposure.
• Hands-on expertise building data pipelines.
• Proven experience building and operating enterprise-scale data platforms.

Responsibilities

• Build and maintain data architectures and pipelines.
• Design and implement data warehouses and data lakes.
• Collaborate with data scientists to build and deploy machine learning models.

Skills

Data Engineering

Apache Spark (Scala & PySpark)

Data modeling

SQL proficiency

Airflow or similar orchestration tools

AWS services (S3, Glue, Athena)

Apache Iceberg

dbt, Snowflake, Databricks

IaC (Terraform)

Data governance

Job description

Senior Data Engineer – Pune, IN

Overview

Purpose of the role: Build and maintain systems that collect, store, process, and analyze data, including data pipelines, data warehouses, and data lakes, to ensure all data is accurate, accessible, and secure.

Accountabilities

• Build and maintain data architectures and pipelines that enable durable, complete, and consistent data transfer and processing.
• Design and implement data warehouses and data lakes capable of managing appropriate data volumes and velocity while adhering to required security measures.
• Develop processing and analysis algorithms suited to the intended data complexity and volumes.
• Collaborate with data scientists to build and deploy machine learning models.

Leadership Expectations

Demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver consistently excellent results:

• L – Listen and be authentic (L)
• E – Energise and inspire (E)
• A – Align across the enterprise (A)
• D – Develop others (D)

Strategic and operational responsibilities include resource planning, budget management, policy development, continuous improvement, and risk mitigation. Leaders must manage policies and processes, deliver improvements, and address policy breaches.

Individual Contributor Expectations

Lead collaborative, multi‑year assignments, guide team members through structured assignments, identify the need for additional specializations, and provide information affecting long‑term profitability, organizational risks, and strategic decisions. Train, guide, and coach less experienced specialists and advise key stakeholders on functional and cross‑functional alignment.

Technical Skills & Experience

• Strong experience in Data Engineering with enterprise delivery exposure.
• Hands‑on expertise building data pipelines using Apache Spark (Scala & PySpark).
• Proven experience building and operating enterprise‑scale data platforms, including IaC/Terraform.
• Strong data‑modeling skills and SQL proficiency.
• Experience with Airflow or similar orchestration tools.
• Experience with AWS services: S3, AWS Glue (Jobs & Catalog), Athena, Lakehouse architectures, Step Functions, Lambda.
• Hands‑on experience with Apache Iceberg.
• Experience integrating Snowflake and/or Databricks with AWS data lakes and metadata catalogs.
• Prior experience with dbt, Snowflake, Databricks, and SQL data frameworks.
• Experience with IaC (Terraform) for infrastructure deployment.
• Strong knowledge of data governance, compliance, and regulatory requirements in large enterprise environments.
• Experience with complex enterprise data governance and compliance patterns is highly valued.
• Additional orchestration experience beyond Airflow is a plus.

Required Values & Mindset

Demonstrate Barclays Values: Respect, Integrity, Service, Excellence, Stewardship. Operate with the Barclays Mindset: Empower, Challenge, Drive.