Azure Databricks Data Engineer: Pipelines & Delta Lake

Wipro Ltd.

Warwick

Hybrid

GBP 65,000 - 90,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Wipro Ltd. in the United Kingdom seeks an experienced Azure Databricks Data Engineer to design, build and optimise scalable data pipelines on the Azure cloud.

You will work with data scientists and business stakeholders to deliver reliable, secure analytics-ready data platforms, with a focus on Python, PySpark, SQL and Delta Lake, in a hybrid-working setup in Warwick. The role emphasizes building robust data solutions, performance tuning and collaboration across teams to enable data-driven

Qualifications

  • Experience in Python, PySpark and SQL development.
  • Proven Azure Databricks, Spark and Delta Lake experience.
  • Knowledge of ETL/ELT, data warehousing and dimensional modelling.
  • Experience building batch and real-time data pipelines.
  • Familiarity with data quality, security, governance and metadata.
  • Experience with Git, CI/CD and DevOps in Agile environments.
  • Degree in CS/Engineering/IT or equivalent.
  • Strong communication and collaboration skills.

Responsibilities

  • Design, build and maintain scalable data pipelines using Python and Azure Databricks.
  • Develop ETL/ELT workflows for large datasets.
  • Create big-data solutions using Spark and PySpark.
  • Integrate structured and unstructured data from multiple sources.
  • Implement data quality, security, governance standards.
  • Develop metadata and supporting technical documentation.
  • Tune performance for large-scale data-processing workloads.
  • Monitor production pipelines, troubleshoot failures and resolve data issues.
  • Collaborate with data scientists, analysts and stakeholders.
  • Support CI/CD, deployment automation and Agile delivery.

Skills

Python
PySpark
SQL
Azure Databricks
Delta Lake
ETL/ELT
Data modelling
Data governance
CI/CD
Agile

Education

Bachelor's degree in Computer Science, Engineering, Information Technology or related field

Tools

Azure Databricks
Apache Spark
Delta Lake

Job description

Wipro Ltd. in the United Kingdom seeks an experienced Azure Databricks Data Engineer to design, build and optimise scalable data pipelines on the Azure cloud.

You will work with data scientists and business stakeholders to deliver reliable, secure analytics-ready data platforms, with a focus on Python, PySpark, SQL and Delta Lake, in a hybrid-working setup in Warwick. The role emphasizes building robust data solutions, performance tuning and collaboration across teams to enable data-driven

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Data Engineer
Azure Databricks Data Engineer

Wipro Ltd. • Warwick

Hybrid
GBP 65,000 - 90,000
Databricks Data Engineer: Azure Data Pipelines & AI-Ready
Databricks Data Engineer: Azure Data Pipelines & AI-Ready

Dufrain Consulting Ltd • England

On-site
GBP 70,000 - 100,000
Azure Databricks Engineer for Data Pipelines & Lakes
Azure Databricks Engineer for Data Pipelines & Lakes

Capgemini • Greater London

Hybrid
GBP 70,000 - 100,000
Disability Confident Employer (Level 2
Data Engineer - Azure Databricks Data Pipelines
Data Engineer - Azure Databricks Data Pipelines

SSE Enterprise • Reading

Hybrid
GBP 36,000 - 54,000
Private healthcare discounts
Gym memberships
Online GP service
+3
Azure Data Engineer: Pipelines, Migrations & Analytics
Azure Data Engineer: Pipelines, Migrations & Analytics

Tata Consultancy Services Limited • East Midlands

On-site
GBP 60,000 - 80,000
Pension
Health care
Life assurance
+4
Remote Data Engineer: Azure Databricks & Data Pipelines
Remote Data Engineer: Azure Databricks & Data Pipelines

MBN Solutions • United Kingdom

Remote
GBP 70,000 - 90,000
Databricks Data Engineer: Scalable Lakehouse Pipelines
Databricks Data Engineer: Scalable Lakehouse Pipelines

Pulse Group • Reading

On-site
GBP 63,000 - 77,000
Azure Data Engineer: Scalable Pipelines & Insights
Azure Data Engineer: Scalable Pipelines & Insights

Livestock Information Limited • United Kingdom

Remote
GBP 45,000 - 50,000
Fully remote working
Flexible working hours
25 days annual leave
+2
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines

Capco • City of Edinburgh

Hybrid
GBP 70,000 - 100,000
Discretionary bonus
Health insurance
Pension
+3
Azure Data Platform Engineer: Databricks & Delta Lake
Azure Data Platform Engineer: Databricks & Delta Lake

Somerset Bridge • Newcastle upon Tyne

Hybrid
GBP 53,000 - 67,000
Hybrid working - 2 days in the office
25 days annual leave
Discretionary annual bonus
+1