Azure Databricks Data Ops Lead - Senior Data Engineer

Tata Consultancy Services; Redditch; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Tata Consultancy Services invites applications for a Lead Data Engineer to build scalable cloud-native applications and data platforms using Azure technologies in Redditch. The role combines technical leadership, Azure Databricks expertise, stakeholder engagement and end-to-end ownership of data operations.

You will lead an offshore data engineering team, ensure stability and continuous improvement of the data platform, and partner with business stakeholders to translate requirements into

Qualifications

• Advanced SQL and Python development skills.
• Strong experience with ETL/ELT and data pipeline development.
• Experience supporting production data platforms and operational services.
• Data modelling and data architecture knowledge.
• Incident management, root cause analysis and troubleshooting skills.
• Experience leading and managing offshore delivery teams.
• Strong stakeholder management and business-facing communication skills.
• Ability to drive end-to-end ownership of data engineering services.
• Microsoft Fabric exposure.
• Azure Data Factory and Synapse experience.
• Retail, Commercial or Finance Analytics domain knowledge.
• DevOps, CI/CD and automation experience.
• Experience supporting large-scale analytics and reporting platforms.

Responsibilities

• Lead end-to-end operations and support for Azure-based data platforms.
• Manage and mentor an offshore Data Engineering team.
• Own operational stability, service delivery and incident management.
• Design, maintain and optimise data pipelines and data workflows.
• Support Azure Databricks environments, notebooks and data processing frameworks.
• Drive root cause analysis and resolution of production issues.
• Collaborate with business stakeholders to translate requirements into technical solutions.
• Establish operational runbooks, governance and support processes.
• Ensure data quality, performance and platform reliability.
• Support platform modernisation, automation and continuous improvement initiatives.

Skills

Advanced SQL

Python development

ETL/ELT

Data pipelines

Offshore leadership

Stakeholder management

Azure Databricks

Fabric exposure

Azure Data Factory

Azure Synapse

CI/CD

DevOps

Analytics platforms

Data modelling

Incident management

Job description

Tata Consultancy Services invites applications for a Lead Data Engineer to build scalable cloud-native applications and data platforms using Azure technologies in Redditch. The role combines technical leadership, Azure Databricks expertise, stakeholder engagement and end-to-end ownership of data operations.

You will lead an offshore data engineering team, ensure stability and continuous improvement of the data platform, and partner with business stakeholders to translate requirements into