Azure Data Tech Lead

Hexaware Technologies; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading technology solutions provider in Greater London is seeking a seasoned Data Engineer with over 10 years of experience in data projects. The ideal candidate should possess extensive hands-on experience with Azure Databricks, Pyspark, and Delta Lake, as well as expertise in developing CI/CD pipelines. Additionally, familiarity with SQL, NoSQL databases, and the London insurance market is advantageous. This role involves leading technical discussions and developing data engineering solutions using various Azure tools.

Qualifications

• 10+ years of experience with data projects.
• Solid hands-on experience with Azure Databricks, Pyspark coding, and Spark SQL.
• Lead technical conversations with clients and coordinate teams.

Responsibilities

• Hands-on experience in Azure dataplatform architecture and developing data engineering pipelines.
• Develop CI/CD pipelines for automated build and deployment.
• Participate in Agile ceremonies and conduct code reviews.

Skills

Azure Databricks

Pyspark

Spark SQL

Delta Lake

Data warehousing

Azure Data Factory

CI/CD Pipelines

Python

Scala

R

SQL databases

NoSQL databases

Tools

Azure Data Lake Gen2

Azure Synapse

Azure Analysis Services

Azure Functions

Job description

Description

Key Skills

• Solid Hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have
• Solid Hands-on experience with Delta Lake House with Delta tables - Must have
• Solid Hands-on experience with Data warehousing - Must have
• Solid Hands-on experience with Azure Data Factory - Must have
• CI / CD Pipelines Integrations - Must have
• Lead all the technical conversation with client and team coordination
• 10+ Years of experience with Data Project
• London Insurance market data experience

Responsibilities

• Hand-on experience in Azure dataplatform architecture and developing data engineering pipelines
• Experience in working with both SQLand NoSQL databases.
• Hand-on experience in developing datasolutions using Azure Data platform tools( Azure data lake gen2,Azure Sql,Azure Data Factory , Mapping Dataflows , Azure Databricks , logic app, AzureSynapse ,Azure Analysis Services and Azure Functions).
• Strong knowledge and experience indata lake and delta lake-based data platform development using Azure Databricksand Azure Synapse Analytics .
• Strong experience with at least one ofthe programming languages : Python, PySpark, Scala, R.
• Able to develop CI / CD pipelines forautomated build and deploy
• Should be able to contributetotechnical solutions and must be able to translate functional / technical intocode, unit test and deliver to customer
• Experience with different databasetechnologies (., SQL database(s), Azure SQL)
• Strong Analytical & problem-solving skills
• Development, code review, unittesting,
• Participation in Agileceremonies
• Good communication skill
• Insurance knowledge will be addedadvantage