Lead Cloud & Data Engineer

Mployee.me

Pune

On-site

INR 2,800,000 - 5,500,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Barclays is seeking a Lead Cloud and Data Engineer to drive the evolution of our infrastructure and deployment pipelines in Pune. You will build scalable, secure systems for data collection, storage, processing and analytics, enabling reliable delivery of our digital solutions.

You will apply expertise in AWS cloud services, data engineering, and modern DevOps practices to design end-to-end cloud-native data platforms, including data pipelines, warehouses and data lakes.

Qualifications

  • Strong experience architecting end-to-end technology solutions across complex enterprise environments.
  • Strong knowledge of AWS cloud services, cloud-native architecture, data engineering, and engineering principles.
  • Experience designing and implementing data transformation, integration, and data movement solutions.
  • Hands-on engineering experience using Python or comparable programming technologies.
  • Practical experience with data technologies such as S3, AWS Glue, Lambda, Athena and relational or NoSQL data stores.
  • Experience with containerized workloads and modern application deployment approaches.
  • Experience with modern software engineering and DevOps practices, including CI/CD, automated testing, version control, and Infrastructure as Code.
  • Strong understanding of security, resilience, scalability, performance, and operational requirements when designing cloud solutions.
  • Ability to translate architecture into implementable engineering designs and reusable technical patterns.
  • Experience working across architecture and engineering teams to take solutions from concept and design through implementation and production readiness.

Responsibilities

  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes.
  • Collaboration with data scientist to build and deploy machine learning models.

Skills

End-to-end design
AWS cloud
Data engineering
Python
CI/CD
DevOps practices
Security & scalability
Cross-team collaboration

Tools

S3
AWS Glue
Lambda
Athena
Databricks
dbt
Apache Airflow
Kubernetes

Job description

Join us as a Lead Cloud and Data Engineer where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions.

Basic/ Essential Qualifications
  • Strong experience architecture and designing end-to-end technology solutions across complex enterprise environments.
  • Strong knowledge of AWS cloud services, cloud-native architecture, data engineering, and engineering principles.
  • Experience designing and implementing data transformation, integration, and data movement solutions.
  • Hands-on engineering experience using Python or comparable programming technologies.
  • Practical experience with data technologies such as S3, AWS Glue, Lambda, Athena and relational or NoSQL data stores, where appropriate to the workload.
  • Experience with containerized workloads and modern application deployment approaches.
  • Experience with modern software engineering and DevOps practices, including CI/CD, automated testing, version control, and Infrastructure as Code.
  • Strong understanding of security, resilience, scalability, performance, and operational requirements when designing cloud solutions.
  • Ability to translate architecture into implementable engineering designs and reusable technical patterns.
  • Experience working across architecture and engineering teams to take solutions from concept and design through implementation and production readiness.
Some Other Highly Valued Skills May Include
  • Experience working in financial services or other highly regulated environments, with awareness of security, risk, control and governance expectations.
  • Practical experience with modern AWS data and analytics services, and designing cloud-native data platforms.
  • Exposure to modern data-engineering technologies such as Databricks, dbt, Apache Airflow/Astronomer and Apache Iceberg.
  • Experience with containerization and orchestration, including Docker and Kubernetes/EKS.
  • Experience in legacy/data-platform modernization, including migration of on-premises or traditional analytical workloads to AWS.
  • Exposure to AI/ML and GenAI technologies, particularly AWS-native services, where applicable to modern data and analytics solutions.
  • Relevant certifications such as AWS Certified Solutions Architect - Professional, AWS Data Engineer or equivalent cloud/data certifications.
Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Accountabilities
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes.
  • Collaboration with data scientist to build and deploy machine learning models.
Vice President Expectations
  • To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escape breaches of policies/procedures..
  • If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements..
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others..
  • OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
  • Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
  • Manage and mitigate risks through assessment, in support of the control and governance agenda.
  • Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
  • Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
  • Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
  • Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
  • Adopt and include the outcomes of extensive research in problem solving processes.
  • Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Cloud & Data Engineer
Lead Cloud & Data Engineer

Barclays • Pune District

On-site
INR 350,000 - 600,000
Data Engineer - AWS Cloud Engineer
Data Engineer - AWS Cloud Engineer

Mployee.me • Bengaluru

On-site
INR 1,400,000 - 2,100,000
Data Engineer - AWS Cloud Engineer
Data Engineer - AWS Cloud Engineer

Barclays • Bengaluru

On-site
INR 2,500,000 - 4,000,000
Cloud Data Engineer
Cloud Data Engineer

Mployee.me • Pune

On-site
INR 1,800,000 - 3,200,000
Lead Cloud & Data Engineer
Lead Cloud & Data Engineer

Barclays • Pune

On-site
INR 1,500,000 - 4,000,000
Data Lead - VP
Data Lead - VP

Barclays • Maharashtra

On-site
INR 6,000,000 - 9,500,000
Data Lead - VP
Data Lead - VP

Barclays • Pune District

On-site
INR 1,200,000 - 1,800,000
IFC - Cloud Data Engineer
IFC - Cloud Data Engineer

Barclays • Maharashtra

On-site
INR 2,800,000 - 4,600,000
VP - Data Engineering Lead - IDL Technology
VP - Data Engineering Lead - IDL Technology

Barclays Capital • Pune

On-site
INR 1,500,000 - 2,100,000
Data Engineer-VP
Data Engineer-VP

Barclays • Maharashtra

On-site
INR 3,500,000 - 7,500,000