Data Engineer: Real-Time Pipelines & Analytics

Prima; Greater London; Hybrid; GBP 65,000 - 100,000; Full time

Benefits offered by this job

Work from home option

Learning resources

Private healthcare

Job summary

Prima, a data-driven motor insurance company in the UK, is seeking a Data Engineer to join our Engineering team. You will help build, publish, and maintain complex data products and pipelines that drive pricing, underwriting and growth.

You will join over 300 engineers across software development, infrastructure, and security, collaborating with data scientists and ML engineers to evolve our data infrastructure and analytics. A flexible work setup is available.

Qualifications

• Experience with batch and streaming data pipelines.
• Proficiency in Python and SQL software engineering best practices.
• Experience building data lakes/warehouses and data modelling.
• Familiarity with DevOps and IaC deployment practices.

Responsibilities

• Shape architecture of data products for analytics and data science use cases.
• Lead data transformation and governance to ensure reliable data.
• Build reusable components to ingest, store, transform, and serve data products.
• Collaborate with data scientists and ML engineers to refine data requirements.
• Stay updated with emerging data tech and participate in Meetups.

Skills

Batch processing

Streaming data

Python

SQL

DevOps

CI/CD

IaC

Data modelling

Data governance

Cloud computing

Data analytics

Machine learning basics

Education

Bachelor's degree in Computer Science

Tools

Kafka

Flink

Spark

Databricks

Redshift

PostgreSQL

NoSQL

Airflow

Oozie

AWS

Job description

Prima, a data-driven motor insurance company in the UK, is seeking a Data Engineer to join our Engineering team. You will help build, publish, and maintain complex data products and pipelines that drive pricing, underwriting and growth.

You will join over 300 engineers across software development, infrastructure, and security, collaborating with data scientists and ML engineers to evolve our data infrastructure and analytics. A flexible work setup is available.