Lead Data Engineer – Azure Databricks & Data Operations

Tata Consultancy Services; Redditch; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Tata Consultancy Services invites applications for a Lead Data Engineer to build scalable cloud-native applications and data platforms using Azure technologies in Redditch. The role combines technical leadership, Azure Databricks expertise, stakeholder engagement and end-to-end ownership of data operations.

You will lead an offshore data engineering team, ensure stability and continuous improvement of the data platform, and partner with business stakeholders to translate requirements into

Qualifications

• Advanced SQL and Python development skills.
• Strong experience with ETL/ELT and data pipeline development.
• Experience supporting production data platforms and operational services.
• Data modelling and data architecture knowledge.
• Incident management, root cause analysis and troubleshooting skills.
• Experience leading and managing offshore delivery teams.
• Strong stakeholder management and business-facing communication skills.
• Ability to drive end-to-end ownership of data engineering services.
• Microsoft Fabric exposure.
• Azure Data Factory and Synapse experience.
• Retail, Commercial or Finance Analytics domain knowledge.
• DevOps, CI/CD and automation experience.
• Experience supporting large-scale analytics and reporting platforms.

Responsibilities

• Lead end-to-end operations and support for Azure-based data platforms.
• Manage and mentor an offshore Data Engineering team.
• Own operational stability, service delivery and incident management.
• Design, maintain and optimise data pipelines and data workflows.
• Support Azure Databricks environments, notebooks and data processing frameworks.
• Drive root cause analysis and resolution of production issues.
• Collaborate with business stakeholders to translate requirements into technical solutions.
• Establish operational runbooks, governance and support processes.
• Ensure data quality, performance and platform reliability.
• Support platform modernisation, automation and continuous improvement initiatives.

Skills

Advanced SQL

Python development

ETL/ELT

Data pipelines

Offshore leadership

Stakeholder management

Azure Databricks

Fabric exposure

Azure Data Factory

Azure Synapse

CI/CD

DevOps

Analytics platforms

Data modelling

Incident management

Job description

Job Type: Permanent

Location: Redditch, UK

Mode of Working: Hybrid

Working Hours: 40 hours per week (Full-time)

Are you looking to build scalable cloud-native applications and data platforms using Azure technologies?

We have an exciting opportunity for you - Lead Data Engineer – Azure Databricks & Data Operations!

Careers at TCS: It Means More

TCS is a purpose-led transformation company, built on belief. We go beyond helping businesses transform through technology, we enable them to make a meaningful difference to the people and communities they serve. Our clients include leading organisations across the UK and globally. At TCS, it means more, more opportunity to make an impact that matters through challenging projects that demand innovation, collaboration, and thought leadership.

• Align technology solutions with business outcomes while building expertise in modern cloud and data platforms.
• Contribute to transformative projects within a global financial services environment.
• Design secure, scalable, and resilient solutions that support critical business operations and customer trust.

The Role

You will play a key role in transforming business-critical Data & Analytics function supporting enterprise data platforms, analytics solutions and operational reporting. The role combines technical leadership, Azure Databricks expertise, stakeholder engagement and end-to-end ownership of data operations.

You will lead a team of offshore data engineers, act as the primary technical interface for business stakeholders, and ensure the stability, scalability and continuous improvement of the data platform while supporting future analytics and transformation initiatives.

Key Responsibilities

• Lead end-to-end operations and support for Azure-based data platforms.
• Manage and mentor an offshore Data Engineering team.
• Own operational stability, service delivery and incident management.
• Design, maintain and optimise data pipelines and data workflows.
• Support Azure Databricks environments, notebooks and data processing frameworks.
• Drive root cause analysis and resolution of production issues.
• Collaborate with business stakeholders to translate requirements into technical solutions.
• Establish operational runbooks, governance and support processes.
• Ensure data quality, performance and platform reliability.
• Support platform modernisation, automation and continuous improvement initiatives.

Your Profile

Essential skills/knowledge/experience

• Advanced SQL and Python development skills.
• Strong experience with ETL/ELT and data pipeline development.
• Experience supporting production data platforms and operational services.
• Data modelling and data architecture knowledge.
• Incident management, root cause analysis and troubleshooting skills.
• Experience leading and managing offshore delivery teams.
• Strong stakeholder management and business-facing communication skills.
• Ability to drive end-to-end ownership of data engineering services.
• Microsoft Fabric exposure.
• Azure Data Factory and Synapse experience.
• Retail, Commercial or Finance Analytics domain knowledge.
• DevOps, CI/CD and automation experience.
• Experience supporting large-scale analytics and reporting platforms.

TCS is consistently voted as a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

We offer health & wellness initiatives and sports events; we are the proud sponsors of the London Marathon.

Diversity, Inclusion and Wellbeing

Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the UK Equality Act 2010 and the UK Human Rights Act 1998.

We welcome and embrace diversity in race, nationality, ethnicity, disability, neurodiversity, gender identity, age, physical ability, gender reassignment, sexual orientation. We are a disability inclusive employer and encourage disabled people to apply for this role.

As a Disability Confident Employer, we offer an interview to applicants with disabilities or long-term conditions who meet the minimum criteria for the role. Please email us at [e-mail] if you would like to opt in.