Azure Databricks Data Engineer

Wipro Ltd.

Warwick

Hybrid

GBP 65,000 - 90,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Wipro Ltd. in the United Kingdom seeks an experienced Azure Databricks Data Engineer to design, build and optimise scalable data pipelines on the Azure cloud.

You will work with data scientists and business stakeholders to deliver reliable, secure analytics-ready data platforms, with a focus on Python, PySpark, SQL and Delta Lake, in a hybrid-working setup in Warwick. The role emphasizes building robust data solutions, performance tuning and collaboration across teams to enable data-driven

Qualifications

  • Experience in Python, PySpark and SQL development.
  • Proven Azure Databricks, Spark and Delta Lake experience.
  • Knowledge of ETL/ELT, data warehousing and dimensional modelling.
  • Experience building batch and real-time data pipelines.
  • Familiarity with data quality, security, governance and metadata.
  • Experience with Git, CI/CD and DevOps in Agile environments.
  • Degree in CS/Engineering/IT or equivalent.
  • Strong communication and collaboration skills.

Responsibilities

  • Design, build and maintain scalable data pipelines using Python and Azure Databricks.
  • Develop ETL/ELT workflows for large datasets.
  • Create big-data solutions using Spark and PySpark.
  • Integrate structured and unstructured data from multiple sources.
  • Implement data quality, security, governance standards.
  • Develop metadata and supporting technical documentation.
  • Tune performance for large-scale data-processing workloads.
  • Monitor production pipelines, troubleshoot failures and resolve data issues.
  • Collaborate with data scientists, analysts and stakeholders.
  • Support CI/CD, deployment automation and Agile delivery.

Skills

Python
PySpark
SQL
Azure Databricks
Delta Lake
ETL/ELT
Data modelling
Data governance
CI/CD
Agile

Education

Bachelor's degree in Computer Science, Engineering, Information Technology or related field

Tools

Azure Databricks
Apache Spark
Delta Lake

Job description

Wipro's dynamic approach to people, process and technology has established us as an industry leader. We provide professional services that help enterprises accelerate transformation, modernise processes and unlock greater value from their technology and data.

We are looking for an experienced Azure Databricks Data Engineer to design, build and optimise scalable data pipelines and modern cloud data platforms. You will combine strong Python, PySpark and SQL expertise with hands-on experience across Azure Databricks and the wider Microsoft Azure data ecosystem.

Working closely with Data Scientists, Analysts, Architects and business stakeholders, you will deliver reliable, secure and high-performing data solutions that enable analytics, reporting and data-driven decision-making.

Key Responsibilities
  • Design, develop and maintain scalable data pipelines using Python and Azure Databricks.
  • Build and optimise ETL/ELT workflows for ingesting and transforming large datasets.
  • Develop big-data processing solutions using Apache Spark and PySpark.
  • Integrate structured and unstructured data from multiple sources.
  • Implement data quality, security, reliability and governance standards.
  • Develop data models, metadata and supporting technical documentation.
  • Tune performance for large-scale data-processing workloads.
  • Monitor production pipelines, troubleshoot failures and resolve data issues.
  • Collaborate with technical and business teams to translate requirements into effective data solutions.
  • Support CI/CD pipelines, deployment automation and Agile delivery practices.
What We’re Looking For
  • Strong hands-on Python, PySpark and SQL development skills.
  • Proven experience with Azure Databricks, Apache Spark and Delta Lake.
  • Strong understanding of ETL/ELT, data warehousing and dimensional modelling.
  • Experience developing batch and real-time data pipelines.
  • Knowledge of data quality, security, governance and metadata management.
  • Experience with Git, CI/CD pipelines and DevOps practices.
  • Experience working within Agile delivery environments.
  • A degree in Computer Science, Engineering, Information Technology or a related discipline, or equivalent professional experience.
  • Strong communication, collaboration and problem-solving skills.
Inclusion

At Wipro, we don’t just look at your CV. We are also focused on who you are and your potential. We understand that everyone has a life outside work, so we are happy to discuss flexible working arrangements.

We will do everything we can to support you during your application. If you require any adjustments to our recruitment process, please speak with our Talent Acquisition team, who will be happy to help.

With Wipro, you will receive a competitive salary, a generous benefits package, and access to training and development opportunities designed to help you grow your skills and career.

Wipro is an Equal Employment Opportunity employer. Employment decisions are made in accordance with applicable law, with a commitment to providing an inclusive and respectful recruitment experience.

If your application is successful, you will be asked to complete a Background Verification check

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Data Engineer: Pipelines & Delta Lake
Azure Databricks Data Engineer: Pipelines & Delta Lake

Wipro Ltd. • Warwick

Hybrid
GBP 65,000 - 90,000
Azure Databricks Developer
Azure Databricks Developer

Atos • United Kingdom

Hybrid
GBP 60,000 - 90,000
25 days paid leave
Pension scheme
Private medical cover
+4
Data Engineer
Data Engineer

RedRock Resourcing • Birmingham

On-site
GBP 40,000 - 60,000
Application Developers | Data engineers
Application Developers | Data engineers

Luxoft • United Kingdom

Remote
GBP 70,000 - 120,000
Azure Databricks Developer
Azure Databricks Developer

Atos • Wideopen

Remote
GBP 70,000 - 110,000
25 days leave + holidays
Pension scheme
Private medical cover
+3
Data Engineer
Data Engineer

Matchtech • West of England

On-site
GBP 60,000 - 90,000
Azure training
Professional development
Modern cloud platforms
+1
Senior Technology Architect_ Databricks
Senior Technology Architect_ Databricks

Infosys • Greater London

On-site
GBP 110,000 - 150,000
Databricks Senior Architect
Databricks Senior Architect

Infosys • Greater London

On-site
GBP 90,000 - 130,000
Azure Databricks Developer (Remote) - Data Engineering & AI
Azure Databricks Developer (Remote) - Data Engineering & AI

Atos • United Kingdom

Hybrid
GBP 60,000 - 90,000
25 days paid leave
Pension scheme
Private medical cover
+4
Remote Data Engineer: Azure Databricks & Data Pipelines
Remote Data Engineer: Azure Databricks & Data Pipelines

MBN Solutions • United Kingdom

Remote
GBP 70,000 - 90,000