Azure Data Tech Lead: Data Platform & Delta Lake Expert

Hexaware Technologies; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading technology solutions provider in Greater London is seeking a seasoned Data Engineer with over 10 years of experience in data projects. The ideal candidate should possess extensive hands-on experience with Azure Databricks, Pyspark, and Delta Lake, as well as expertise in developing CI/CD pipelines. Additionally, familiarity with SQL, NoSQL databases, and the London insurance market is advantageous. This role involves leading technical discussions and developing data engineering solutions using various Azure tools.

Qualifications

• 10+ years of experience with data projects.
• Solid hands-on experience with Azure Databricks, Pyspark coding, and Spark SQL.
• Lead technical conversations with clients and coordinate teams.

Responsibilities

• Hands-on experience in Azure dataplatform architecture and developing data engineering pipelines.
• Develop CI/CD pipelines for automated build and deployment.
• Participate in Agile ceremonies and conduct code reviews.

Skills

Azure Databricks

Pyspark

Spark SQL

Delta Lake

Data warehousing

Azure Data Factory

CI/CD Pipelines

Python

Scala

R

SQL databases

NoSQL databases

Tools

Azure Data Lake Gen2

Azure Synapse

Azure Analysis Services

Azure Functions

Job description

A leading technology solutions provider in Greater London is seeking a seasoned Data Engineer with over 10 years of experience in data projects. The ideal candidate should possess extensive hands-on experience with Azure Databricks, Pyspark, and Delta Lake, as well as expertise in developing CI/CD pipelines. Additionally, familiarity with SQL, NoSQL databases, and the London insurance market is advantageous. This role involves leading technical discussions and developing data engineering solutions using various Azure tools.