Lead data engineer- Ab Initio & AWS

1203 Barclays Global Serv. Cent; Pune District; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Barclays in Pune is seeking a Lead Data Engineer specializing in Ab Initio and AWS to drive the evolution of our data platform and empower data-driven decision making. You will lead complex data integration initiatives, implement scalable ETL processes, and partner with cross‑functional teams to align data architecture with business goals.

The role requires hands‑on expertise in Ab Initio, AWS data technologies, and modern data engineering tools, with a focus on governance, compliance, and

Qualifications

• Strong hands‑on expertise in Ab Initio development, including Graph Development, GDE, Conduct>IT, EME, and standard ETL design patterns across UNIX/Linux and Hadoop platforms.
• Excellent understanding of data structures, algorithms, and data engineering principles, with proven experience delivering medium to large‑scale data integration and transformation solutions along with strong SQL and data processing skills, particularly with Hive, Impala, and AWS data technologies such as Athena, Glue, and related cloud‑native services.
• Experience working on AWS and cloud‑based data platforms, with a good understanding of modern data architecture and migration patterns with proficiency in modern data engineering and scripting technologies, including DBT, Python, Databricks, Shell Scripting, and other automation frameworks.

Skills

Ab Initio development

Graph Development

GDE

ETL design patterns

UNIX/Linux

Hadoop

Hive

Impala

AWS data technologies

Athena

Glue

Python

Databricks

DBT

Shell Scripting

Automation frameworks

Tools

Databricks

DBT

Shell Scripting

Job description

Job Description Purpose of the role

To provide operating and administrative support to senior leaders, simultaneously shaping and executing long-term strategic change, whilst helping to navigate complex challenges in the performance of their roles

Accountabilities

Implementation of Target Operating Model, business development, and financial and non-financial resource allocation, providing strategic insight and thought leadership. Strategic support to and oversight of demand pipeline and the book of work, including assistance in the development and execution of strategic initiatives, projects, research, and analysis to support decision‑making. Support to and guidance for operational efficiency and colleague/customer/client experience within the organisation, including the identification of areas for improvement, streamlining of processes, and implementation of best practices to enhance productivity, effectiveness and experience. Management of people plan, talent development and succession planning including the identification of high‑potential employees, provision of mentorship and guidance, and support to leadership development and diversity initiatives. Communication with internal and external stakeholders, management of communication channels and ensuring effective coordination across different departments and teams. Participation in compliance activities such as SMR and other regulatory registrations/certifications, as well as support for crisis management and risk mitigation, including the development of contingency plans, coordination of responses to emergencies, and business continuity. Management of all organisational/team requirements relating to technology, real estate, people and communications in conjunction with relevant partners across the firm. Enablement of oversight of risk management and compliance with internal and external requirements, including internal Governance on critical control activities in partnership with the CCO team, such as Records Inventory and RCSAs. Cost control and workforce management of the Business/Function, including involvement in financial analysis and planning, forecasting, and monitoring of financial performance against targets.

Assistant Vice President Expectations

Consult on complex issues; providing advice to People Leaders to support the resolution of escalated issues. Identify ways to mitigate risk and developing new policies/procedures in support of the control and governance agenda. Take ownership for managing risk and strengthening controls in relation to the work done. Perform work that is closely related to that of other areas, which requires understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub‑function. Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategy. Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practices (in other areas, teams, companies, etc.) to solve problems creatively and effectively. Communicate complex information. 'Complex' information could include sensitive information or information that is difficult to communicate because of its content or its audience. Influence or convince stakeholders to achieve outcomes. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.

Join us as a Lead data engineer- Ab Initio & AWS at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting‑edge technology to revolutionise our digital offerings, ensuring unapparelled customer experiences. You may be assessed on the key critical skills relevant for success in role, such as experience with, skills to meet business requirement as well as job‑specific skillsets. To be successful as a Lead data engineer- Ab Initio & AWS , you should have experience with:

Basic/ Essential Qualifications:

Strong hands‑on expertise in Ab Initio development, including Graph Development, GDE, Conduct>IT, EME, and standard ETL design patterns across UNIX/Linux and Hadoop platforms. Excellent understanding of data structures, algorithms, and data engineering principles, with proven experience delivering medium to large‑scale data integration and transformation solutions along with strong SQL and data processing skills, particularly with Hive, Impala, and AWS data technologies such as Athena, Glue, and related cloud‑native services. Experience working on AWS and cloud‑based data platforms, with a good understanding of modern data architecture and migration patterns with proficiency in modern data engineering and scripting technologies, including DBT, Python, Databricks, Shell Scripting, and other automation frameworks.

Desirable skillsets/ good to have:

Experience with regulatory, governance, and controlled delivery environments would be advantageous, particularly within large financial services organizations. Ability to work effectively in an Agile delivery environment, adapting to evolving business priorities, changing requirements, and demanding delivery timelines while maintaining high quality standards. Excellent stakeholder communication and collaboration skills, with the ability to work closely with Business Analysts, Architects, Product Owners, and cross‑functional engineering teams along with experience with regulatory, governance, and controlled delivery environments.

This role is based out of Pune. Our Work Experience is the combination of everything that’s unique about us: our culture, our core values, our company meetings, our commitment to sustainability, our recognition programs, but most importantly, it's our people. Our employees are self‑disciplined, hard working, curious, trustworthy, humble, and truthful. They make choices according to what is best for the team, they live for opportunities to collaborate and make a difference, and they make us the #1 Top Workplace in the area.