Data Integration Lead

JR United Kingdom; London; On-site; EUR 50,000 - 90,000; Full time

Job summary

An established industry player is seeking a Data Platform Integration Lead to drive data ingestion into an Azure-based platform. This role involves technical leadership, managing ingestion pipelines, and collaborating with teams to ensure compliance with data security standards. You will play a pivotal role in enhancing data workflows and troubleshooting issues, while also staying updated on the latest Azure features. Join a forward-thinking company that values innovation and teamwork, and contribute to shaping a more sustainable and inclusive future through technology.

Qualifications

• Proven track record in technical leadership in Azure data technologies.
• Experience in designing and managing technical teams.

Responsibilities

• Lead data ingestion from OnPrem and cloud sources into Azure.
• Document integration processes and manage pipeline development.

Skills

Technical Leadership in Azure Data Technologies

SQL

Azure Data Factory

Databricks

PySpark

Agile Project Environment

Insurance Experience

DevOps

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership.

Key Responsibilities

1. Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements.
2. Document data integration processes, including pipeline designs, configurations, and troubleshooting guides.
3. Manage the development and deployment of data ingestion pipelines.
4. Support Data Engineers with technical leadership in Azure ingestion stack.
5. Maintain platform compliance with data security and privacy regulations.
6. Monitor platform performance and usage metrics, identifying opportunities for improvement.
7. Maintain and update pipeline configurations, ensuring compatibility with evolving source and target systems.
8. Coordinate with infrastructure teams to ensure proper connectivity between on-premises systems and Azure cloud environments.
9. Troubleshoot and resolve pipeline failures, minimizing downtime and ensuring data availability.
10. Stay updated on Azure Data Factory and Databricks features and recommend enhancements to improve ingestion workflows.
11. Understand how FCA Conduct Rules apply to you as an employee of client and specifically, how they apply to this role and understand clients Conduct Framework, how it applies to this role, and the behaviours/actions that you need to demonstrate in consistently delivering good customer outcomes.

Skills and Experience:

1. Proven track record in technical leadership in Azure data technologies.
2. Experience in designing, managing and overseeing task assignment for technical teams.
3. Strong exposure to SQL.
4. Azure Data Factory, Databricks & PySpark is a must have.
5. Experience in Agile project environment.
6. Insurance experience – Policy and Claims.
7. Understanding of DevOps, continuous integrations, and continuous improvements.

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Get The Future You Want | www.capgemini.com