Azure Data Engineer — ETL & Analytics Pipelines

Tata Consultancy Services; East Midlands; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Pension

Health care

Life assurance

Laptop

Phone

Training resources

Discounts - Tata network

Wellness initiatives

London Marathon sponsor

Job summary

Tata Consultancy Services in the United Kingdom is seeking a Data Engineer to design, develop and maintain Azure-based data pipelines, leveraging Azure Data Factory, Databricks, Synapse and Data Lake to support data integration, migration and analytics.

You will collaborate with stakeholders to translate business needs into reliable, scalable data solutions, monitor data health and expose insights via Power BI and APIs.

Qualifications

• Develop fully functional azure data pipelines.
• Strong analytical, problem solving, client facing, troubleshooting and multi-tasking skills.
• Data Modeling, ETL Processes and Data Warehousing.
• Data Security, Compliance Standard and data privacy policies.
• Develop fully functional azure data pipelines & Data Migrations.

Responsibilities

• Design, develop and implement data pipelines to perform ETL from multiple sources into Azure Services.
• Proficiency in programming languages (Python, SQL, PySpark) and data manipulation tools.
• Knowledge of DevOps tools.
• Manage and monitor the health of data integration processes, troubleshooting.
• Experience in Data Migrations to Azure from on-premises or other platforms.
• Experience with Azure ARM templates, PowerShell and CI/CD using Azure DevOps.
• Experience with exposing data to end-users via Power BI, Azure API Apps.
• Understanding of on-premises and cloud-based data architecture and integration.
• Knowledge of DevOps practices and tools.

Skills

Python

SQL

PySpark

Azure

Azure Data Factory

Databricks

Synapse

Power BI

CI/CD

Azure DevOps

Tools

Azure ARM templates

PowerShell

Job description

Tata Consultancy Services in the United Kingdom is seeking a Data Engineer to design, develop and maintain Azure-based data pipelines, leveraging Azure Data Factory, Databricks, Synapse and Data Lake to support data integration, migration and analytics.

You will collaborate with stakeholders to translate business needs into reliable, scalable data solutions, monitor data health and expose insights via Power BI and APIs.