Data Engineer

Lambda World; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Benefits offered by this job

Flexible working arrangements

Private healthcare

Gym discounts

Wellbeing programs

Mental health support

Job summary

Lambda World in Greater London is seeking a Senior Data Engineer to enhance its Engineering team. This role involves designing and optimizing data products while collaborating closely with data scientists and machine learning engineers.

You'll work on transformative data solutions that significantly impact the company's growth, leveraging your expertise in distributed data processing and cloud-based solutions. Enjoy flexible working arrangements and a range of employee perks tailored for your wellbeing.

Qualifications

• Experience with data lakes and big data analytics.
• Proficiency in CI/CD pipeline management.
• Hands-on experience with data quality and governance techniques.

Responsibilities

• Shape architecture of data products for analytics and forecasting.
• Lead best practices in data modelling and optimization.
• Collaborate closely with data scientists and ML engineers.

Skills

batch processing

distributed data processing

Kafka

Flink

Spark

AWS

Education

Relevant degree in Data Science or Engineering

Tools

PostgreSQL

Redshift

NoSQL databases

Job description

Fancy helping us shape the future of motor insurance? Prima could be the place for you.

Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly become the number one online motor insurance provider. In fact, we’re trusted by over 5 million drivers. And now we’re expanding to help millions more drivers in the UK and Spain.

To help fuel that growth, we need a Senior Data Engineer to join our Engineering team.

This team is the beating heart of Prima.

You’ll be joining over 350 engineers across software development, infrastructure, operations, and security. Fueled by curiosity, experimentation, and collaboration, you’ll help deliver scalable, impactful solutions that shape the future of insurance.

Excited to make an impact? Here are the details

You’ll be joining our Pricing and Underwriting domain to bridge the gap between machine learning/data science and engineering. You will help build, publish, and maintain our complex data products and pipelines — key elements with a significant impact on the company’s growth.

What you’ll do

• Shape the architecture of data products designed for:
  • data analytics
  • forecasting
  • feature engineering
  • customer behavior analysis
  • integration of new data sources

Data Transformation & Governance

• Lead best practices in:
  • data modelling
  • performance optimization
  • data governance
• consistent
• available
• reliable
• Build reusable technology enabling teams to:
  • ingest data
  • store data
  • transform data
  • serve their own data products

Collaboration & Product Thinking

• Work closely with:
  • data scientists
  • machine learning engineers
• Refine data requirements and evolve infrastructure capabilities
• Stay updated with emerging technologies
• Experiment with open source tools
• Participate in community-building initiatives such as meetups
• Continuously learn and improve engineering practices

What we’re looking for

• batch processing
• distributed data processing
• Experience with technologies such as:
  • Kafka
  • Flink
  • Spark
• Databricks experience is a plus
• Experience implementing:
  • Data Lakes
  • Big Data Analytics platforms
• Cloud-based solutions experience
• AWS preferred

Software Engineering

• Expertise with:
  • RDBMS
  • Data Warehousing
  • Data Modelling
• Experience with:
  • Redshift
  • PostgreSQL
  • NoSQL databases

DevOps & Infrastructure

• Proficiency in:
  • DevOps practices
  • CI/CD pipeline management
  • Infrastructure as Code (IaC)

Nice-to-Have

• Hands-on experience with:
  • Data Quality
  • Data Governance techniques
• Knowledge of:
  • MLOps
  • Feature Engineering
• Exposure to data analysis and ML tools such as:
  • scikit-learn
  • pandas
  • NumPy
  • XGBoost
  • LightGBM
• Familiarity with orchestration tools:
  • Apache Oozie
  • Apache Airflow

Why you’ll love it here

We want to make Prima a happy and empowering place to work. So if you decide to join us, you can expect plenty of perks.

Enjoy full flexibility — work from home, the office, or a mix of both.

Plus, work from anywhere for up to 30 days a year.

Grow with us

We may move fast at Prima, but we move together. Get access to learning resources, mentorship, and a growth plan tailored to you.

Thrive and perform

Your best work begins when you feel your best. Enjoy private healthcare, gym discounts, wellbeing programs, and mental health support.