Data Engineer — Real-Time Pipelines & ML Ops

Ki; Greater London; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Competitive remuneration and benefits

Benefits package

Job summary

Ki is building a real-time commercial insights platform for algorithmic insurance. You will join a cross-functional squad to design and maintain data pipelines that feed the Ki underwriting engine and analytics. Collaborate with actuaries, data scientists, and engineers to unlock faster, reliable insights.

You will work with modern data tools, cloud platforms, and MLOps infrastructure to scale impact while staying agile and customer-focused.

Qualifications

• Strong software engineering background with Python for API development and data tasks.
• Experience with PostgreSQL, MySQL, and BigQuery storage systems.
• API development experience with FastAPI or Flask for data access.
• Hands-on with dbt or Dataform to build modular data models.
• Experience designing data pipelines with Dagster, Airflow, or Prefect.
• Solid cloud knowledge (GCP and/or AWS) to deploy scalable solutions.
• Knowledge of CI/CD and IaC to enable repeatable deployments.
• Understanding of data modeling, ETL/ELT, and data governance best practices.
• Collaborative mindset working with stakeholders across teams.

Responsibilities

• Design, build, optimise and maintain production-grade data pipelines feeding the Ki algorithm.
• Collaborate with actuaries, data scientists and engineers to leverage new data sources.
• Design data models and supporting infrastructure for growth and scale.
• Create frameworks and systems to govern Ki's data assets.
• Advance data and MLOps capability infrastructure with the Engineering community.

Skills

Python

PostgreSQL

MySQL

BigQuery

API development

dbt / Dataform

Dagster / Airflow / Prefect

GCP / AWS

CI/CD

Data modeling

ETL/ELT

Data governance

Collaborative mindset

Education

Bachelor's degree in Computer Science or related field

Tools

PostgreSQL

MySQL

BigQuery

FastAPI

Flask

dbt

Dataform

Dagster

Airflow

Prefect

GCP

AWS

CI/CD tooling

Job description

Ki is building a real-time commercial insights platform for algorithmic insurance. You will join a cross-functional squad to design and maintain data pipelines that feed the Ki underwriting engine and analytics. Collaborate with actuaries, data scientists, and engineers to unlock faster, reliable insights.

You will work with modern data tools, cloud platforms, and MLOps infrastructure to scale impact while staying agile and customer-focused.