Data Engineering Lead

1203 Barclays Global Serv. Cent; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Barclays seeks a Senior Data Engineer in Pune to architect and maintain data pipelines, warehouses and lakes for secure, scalable data processing and analytics. You will collaborate with data scientists to deploy models and implement robust processing algorithms.

Strong Python skills and hands-on experience with AWS services (S3, Glue, Athena) and modern data platforms (Snowflake, Databricks, Iceberg) are required. This role is based in our Pune office.

Qualifications

• Experience with data engineering and automation using Python.
• Strong knowledge of cloud data services and architectures.
• Experience with data warehouses and data lakes design.

Responsibilities

• Build and maintain data pipelines for collection, storage, processing, and analysis of data.
• Design and implement data warehouses and data lakes with proper security and governance.
• Develop processing and analysis algorithms for large-scale data.
• Collaborate with data scientists to deploy machine learning models.

Skills

Python

Data pipelines

Data warehouses

Data lakes

AWS

ETL

Tools

S3

Glue

Athena

Lake Formation

CloudFormation

Snowflake

Databricks

Starburst

Iceberg

Job description

Job Description Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Accountabilities

Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended data complexity and volumes. Collaboration with data scientist to build and deploy machine learning models.

Vice President Expectations

To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and elevate breaches of policies/procedures. If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements. If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others.

OR for an individual contributor

They will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions.

Advise key stakeholders

Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment. Manage and mitigate risks through assessment, in support of the control and governance agenda. Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does. Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.

Collaborate with other areas of work

Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.

Create solutions based on sophisticated analytical thought

Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions. Adopt and include the outcomes of extensive research in problem solving processes. Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

Values, Mindset and Culture

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.

Join us as a Support Data Engineer at Barclays

Join us as a Support Data Engineer at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness technology to build new strategic market data platform for the bank with real impact to the business.

To be successful as a Senior Data Engineer, you should have experience with:

• AWS cloud services such as S3, Glue, Athena, Lake Formation, CloudFormation etc.
• Python language on senior level for data engineering and automation purposes
• Snowflake, ETL frameworks, data transformation and data quality tools

Some other highly valued skills may include:

• AWS Data Engineer certification
• Previous working experience within banking or financial services domain
• Experience with IAM and Permissions management in AWS cloud
• Experience with Databricks, Snowflake, Starburst, Iceberg

You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills.

This role will be based in our Pune office.

Our Work Experience

Our Work Experience is the combination of everything that's unique about us: our culture, our core values, our company meetings, our commitment to sustainability, our recognition programs, but most importantly, it's our people. Our employees are self-disciplined, hard working, curious, trustworthy, humble, and truthful. They make choices according to what is best for the team, they live for opportunities to collaborate and make a difference, and they make us the #1 Top Workplace in the area.