Senior Data Engineer

Better Placed; London; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading company in the insurance sector is seeking a talented Data Engineer to enhance their growing Data team. The ideal candidate will have a substantial background in Azure along with a passion for data and strong communication skills. Responsibilities include designing efficient data solutions and collaborating closely with various teams. This role presents a unique opportunity for professionals eager to work with the latest technologies in data engineering.

Qualifications

• Minimum 3 years as Data Engineer, preferably with Azure.
• Strong knowledge of Azure data services and ETL/ELT concepts.
• Excellent communication and problem-solving skills.

Responsibilities

• Design and implement scalable data storage solutions on Azure.
• Build and maintain data pipelines for large data volumes.
• Collaborate with data scientists for optimized data models.

Skills

Data Engineering

SQL

Python

Scala

Problem Solving

Collaboration

Tools

Azure Data Lake Storage

Azure Databricks

Azure SQL Database

Job description

Social network you want to login/join with:

My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as being able to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP.

Responsibilities

Designing and implementing scalable and efficient data storage solutions on Azure.

Building and maintaining data pipelines to ingest, process, and transform large volumes of data.

Collaborating with data scientists and analysts to understand their requirements and develop optimized data models.

Monitoring and troubleshooting data pipeline performance issues.

Implementing security measures to protect our data assets.

Conducting regular data quality checks and applying necessary fixes.

Keeping up-to-date with the latest trends and technologies in the field of data engineering.

Requirements

Minimum of 3 years of experience working as a Data Engineer, preferably on the Azure platform.

Strong knowledge of Azure data services, such as Azure Data Lake Storage, Azure Databricks, and Azure SQL Database.

Proficiency in SQL and programming languages like Python or Scala.

Experience with data modeling and ETL/ELT concepts.

Strong problem-solving and troubleshooting skills.

Excellent communication and collaboration skills.