Data Platform & Engineering Lead

Barclays; Maharashtra; On-site; INR 3,000,000 - 5,500,000; Full time

Job summary

Barclays in Pune is seeking a Data Platform & Engineering Lead to drive evolution of our data infra, pipelines, and cloud-native solutions. You will design, build, and scale robust platforms that support digital banking services.

You will lead Python/PySpark development, AWS-based data platforms, data warehousing, and production reliability initiatives, collaborating across teams to deliver secure, high-performance software.

Qualifications

• Expert Python/PySpark development for large-scale data engineering solutions.
• Hands-on AWS data platform expertise in AWS cloud services.
• Strong Data Warehousing, SQL, Data Modelling, and ETL experience (Informatica preferred).
• Experience leading platform stability, resiliency, production support, technical upgrades, and operational excellence initiatives.

Responsibilities

• Development and delivery of high-quality software solutions with scalable, maintainable code.
• Cross-functional collaboration with product managers, designers, and other engineers to define software requirements and strategies.
• Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing.
• Stay informed of industry technology trends and actively contribute to the organisation’s technology communities.
• Adherence to secure coding practices to mitigate vulnerabilities and protect data.
• Implementation of effective unit testing practices to ensure proper code design and reliability.

Skills

Python

PySpark

AWS

Data Warehousing

SQL

Data Modelling

ETL

Security

Tools

Informatica

Databricks

Snowflake

Power BI

CI/CD

Infrastructure as Code

Job description

Join us as a Data Platform & Engineering Lead at Barclays where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting‑edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions.

To be successful as a Data Platform & Engineering Lead, you should have experience with

• Expert Python/PySpark development for large‑scale data engineering solutions
• Hands‑on AWS data platform expertise in AWS cloud services, supporting the design and deployment of cloud‑native data solutions
• Strong Data Warehousing, SQL, Data Modelling, and ETL experience (Informatica preferred)
• Experience leading platform stability, resiliency, production support, technical upgrades, and operational excellence initiatives

Some Other Highly Valued Skills May Include

• BI/Analytics platforms (Power BI, QlikView, Tableau)
• DevOps, CI/CD, Infrastructure as Code, and automation
• Databricks, Snowflake
• Previous working experience within banking or financial services domain

You may be assessed on key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen, strategic thinking and digital and technology, as well as job‑specific technical skills.

The role is based out of Pune.

Purpose of the role

To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues.

Accountabilities

• Development and delivery of high‑quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimised for performance.
• Cross‑functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives.
• Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing.
• Stay informed of industry technology trends and innovations and actively contribute to the organisation’s technology communities to foster a culture of technical excellence and growth.
• Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions.
• Implementation of effective unit testing practices to ensure proper code design, readability, and reliability.

Vice President Expectations

• To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escape breaches of policies/procedures.
• If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements.
• If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others.
• OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi‑year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialiation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions.
• Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
• Manage and mitigate risks through assessment, in support of the control and governance agenda.
• Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
• Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
• Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
• Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In‑depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
• Adopt and include the outcomes of extensive research in problem solving processes.
• Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.