Azure Data Tech Lead

Hexaware Technologies; London; On-site; GBP 70,000 - 100,000; Full time

Job summary

A leading technology consulting firm is seeking an experienced Data Engineer specializing in Azure data services. The role involves architecting data solutions, developing pipelines, and enhancing data management practices, particularly within the London insurance sector. Ideal candidates should have strong programming skills and extensive project experience.

Qualifications

• 10+ years of experience with Data Projects.
• Experience in London Insurance market data is a plus.

Responsibilities

• Develop data engineering pipelines on Azure.
• Experience with SQL and NoSQL databases.
• Contribute to technical solutions and translate requirements into code.

Skills

Azure Databricks - Pyspark coding

Spark SQL coding

Delta Lake House

Data warehousing

Azure Data Factory

CI/CD Pipelines

Python

PySpark

Scala

R

Analytical skills

Problem-solving skills

Job description

Social network you want to login/join with:

• Solid Hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have
• Solid Hands-on experience with Delta Lake House with Delta tables - Must have
• Solid Hands-on experience with Data warehousing - Must have
• Solid Hands-on experience with Azure Data Factory - Must have
• CI/CD Pipelines Integrations - Must have
• Lead all the technical conversations with clients and team coordination
• 10+ Years of experience with Data Projects
• London Insurance market data experience

Responsibilities:

• Hands-on experience in Azure data platform architecture and developing data engineering pipelines
• Experience in working with both SQL and NoSQL databases.
• Strong knowledge and experience in data lake and delta lake-based data platform development using Azure Databricks and Azure Synapse Analytics.
• Strong experience with at least one of the programming languages: Python, PySpark, Scala, R.
• Ability to develop CI/CD pipelines for automated build and deployment
• Contribute to technical solutions and translate functional/technical requirements into code, unit test, and deliver to customers
• Experience with different database technologies (e.g., SQL databases, Azure SQL)
• Strong analytical and problem-solving skills
• Development, code review, unit testing
• Insurance knowledge will be an added advantage