Data Engineer

Prima; London (KY); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

Flexible work arrangement

Learning resources

Private healthcare

Gym discounts

Wellbeing programs

Mental health support

Job summary

A leading motor insurance provider in Kentucky is seeking a Senior Data Engineer to shape the architecture of data products and lead data transformation efforts. The successful candidate will be an expert in batch processing, distributed data processing, and Python programming, working with technologies like Kafka and AWS. This role also emphasizes engagement with data scientists, a passion for learning, and offers flexible work arrangements including the option to work from home or anywhere for 30 days a year.

Qualifications

• Expert in batch, distributed data processing and near real-time streaming data pipelines.
• Experience with Data Lake/Big Data Analytics platforms, preferably cloud-based solutions.
• Proficient in Python programming and software engineering best practices.
• Expertise in RDBMS, Data Warehousing, and NoSQL databases.
• Proficiency in CI/CD pipeline management and infrastructure as Code (IaC).

Responsibilities

• Shape the architecture of data products for analytics and data science.
• Lead data transformation by establishing best practices.
• Build reusable technology for data ingestion, storage, transformation, and serving.
• Engage with data scientists to refine data requirements.
• Stay updated on emerging technologies and engage in community-building activities.

Skills

Batch processing

Distributed data processing

Near real-time streaming

Python programming

Data modeling

DevOps

SQL

Data Governance

Tools

Kafka

Flink

Spark

Databricks

AWS

Redshift

PostgreSQL

Apache Oozie

Apache Airflow

Job description

Are you looking for a new challenge?

Fancy helping us shape the future of motor insurance?

Prima could be the place for you.

Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly become the number one online motor insurance provider. In fact, we’re trusted by over 5 million drivers. And now we’re expanding to help millions more drivers in the UK and Spain.

To help fuel that growth, we need a Senior Data Engineer to join our Engineering team.

This team is the beating heart of Prima.

You’ll be joining over 350 engineers across software development, infrastructure, operations and security. Fueled by curiosity, experimentation and collaboration, you’ll help deliver scalable, impactful solutions that shape the future of insurance.

What you’ll do

• Shaping the architecture of data products designed for data analytics and data science specifically focusing on use cases like forecasting, feature engineering, customer behaviour, and integration of new data sources.
• Leading the way in data transformation by setting up best practices in areas like Data modelling, performance optimisation, Data Governance etc, ensuring that the data used within Prima is consistent, available and reliable.
• Build reusable technology that enables teams to ingest, store, transform, and serve their own data products.
• Engaging with data scientists and machine learning engineers to explore the product landscape and refine data requirements for enhanced data infrastructure.
• Embrace continuous learning and experimentation to stay updated on emerging technologies, from testing open source tools to engaging in community-building activities like Meetups. Your passion for staying at the forefront of the field will drive your journey.

What we’re looking for

• Expert in batch, distributed data processing and near real-time streaming data pipelines with technologies like Kafka, Flink, Spark etc. Experience in Databricks is a plus.
• Experience in Data Lake / Big Data Analytics platform implementation with cloud based solution; AWS preferred.
• Proficient in Python programming and software engineering best practices.
• Expertise with RDBMS, Data Warehousing, Data Modelling with relational SQL (Redshift, PostgreSQL) and NoSQL databases.
• Proficiency in DevOps, CI/CD pipeline management, and expertise in infrastructure as Code (IaC) deployment industry-best practices.

Nice-to-Have

• Hands‑on experience in Data Quality and Data Governance techniques.
• Knowledge on MLOps and Feature engineering.
• Exposure to common data analysis and ML technologies such as on scikit-learn, pandas, NumPy, XGBoost, LightGBM.
• Exposure to tools like Apache Oozie, Apache Airflow.

Why you’ll love it here:

We want to make Prima a happy and empowering place to work. So if you decide to join us, you can expect plenty of perks.

🤸 Work Your Way: Enjoy full flexibility – work from home, the office or a mix of both. Plus, work from anywhere for up to 30 days a year.

🏁 Grow with us: We may move fast at Prima, but we move together. Get access to learning resources, mentorship and a growth plan tailored to you.

🌈 Thrive and perform: Your best work begins when you feel your best. Enjoy private healthcare, gym discounts, wellbeing programs and mental health support.

Think you’re a match? Apply now.

At Prima, we celebrate uniqueness. If you don’t meet every requirement but are passionate about this role, we still want to hear from you. Innovation thrives on diverse perspectives.

Prima is proud to be an equal opportunity employer. Need accommodations during the process? Email us at [e-mail]. Let’s build the future of insurance, together.