Data Engineer

GerrardWhite; Reigate; Hybrid; GBP 50,000 - 80,000; Full time

Job summary

A market-leading insurance company is seeking a Data Engineer to join their innovative team. This role involves designing and building cutting-edge machine learning and AI services, supporting analytics and product iteration across various business areas. You will collaborate with a diverse group of data & AI engineers, data scientists, and developers to create robust data platforms and frameworks that enhance data consumption and integration. If you are passionate about data and eager to work on transformative projects in a dynamic environment, this is the perfect opportunity for you.

Qualifications

• Strong hands-on experience with cloud data warehouses like Databricks or Snowflake.
• Proficiency in Python and experience with Spark and Airflow.

Responsibilities

• Build and support data products within the industry-leading platform.
• Collaborate with product managers to deliver technical solutions.

Skills

Python

Databricks

Snowflake

SQL

CI/CD pipelines

Data modeling

Data integration

Infrastructure as Code

Docker

Kubernetes

Tools

Git

Jenkins

Terraform

Spark

Airflow

Job description

Data Engineer

Inside IR35

Remote with some attendance to client site in Surrey as required

Working for a market-leading insurance company, you will work in a team of data & AI Engineers, data scientists, developers, analysts, and architects. You will work on designing and building cutting-edge machine learning and AI services, supporting analytics and product iteration across various business areas.

Key tasks:

1. Build and support data products within their industry-leading platform
2. Collaborate with product managers, data & AI engineers to deliver technical solutions for pressing data problems, including GenAI applications
3. Design, build, and maintain components of the data and analytics platform to enable seamless data consumption, including orchestration, monitoring, and performance optimization
4. Integrate data from various sources, ensuring adherence to data quality and technical standards
5. Create frameworks and processes for data pipelines across the platform
6. Establish and enforce coding and data process standards, promoting best practices

Key skills:

• A passion for designing and building robust data platforms
• Strong hands-on experience with modern cloud data warehouses such as Databricks or Snowflake, ideally on AWS
• Proficiency in Python, including experience with Spark and Airflow
• Experience in all phases of data modeling, from conceptualization to optimization, supported by advanced SQL skills
• Experience with CI/CD pipelines using Git, Jenkins, or similar tools
• Hands-on experience with batch and real-time data integration, performance assessment, debugging, and tuning
• Ability to acquire, ingest, cleanse, integrate, and structure large volumes of data from multiple sources
• Experience with Infrastructure as Code tools like Terraform is a plus
• Experience with Docker and Kubernetes for containerization and orchestration is a plus
• Exposure to Generative AI in production is advantageous

GWV Talent Solutions Limited (trading as Gerrard White Consulting and Vermelo RPO) acts as an employment agency for permanent recruitment and an employment business for temporary and contract workers. By applying for this job, you accept the terms of our Privacy Policy and Terms of Service, available at www.gerrrardwhite.com.