Senior Platform Engineer - Data Platform

Permutable; Greater London; On-site; GBP 110,000 - 140,000; Full time

Job summary

Permutable is seeking a Senior Platform Engineer to build and run the data platform that powers our market intelligence. You’ll shape production pipelines, storage design and cloud infrastructure, enabling other engineers to move fast with confidence.

This role blends software and data engineering with production operations, offering opportunities to create reusable tooling, improve monitoring, and help users understand data through reliable releases.

Qualifications

• Production software engineering experience in Python/Java/Scala and SQL.
• Ability to read, reason about and modify an existing codebase, with testing, maintainability and code review.
• Experience building and running production data pipelines.

Responsibilities

• Build, maintain and improve production data pipelines, including how they recover from failures and handle reruns, backfills and changing schemas.
• Develop tested, maintainable software, contributing through code review and safe releases.
• Help shape data storage and modelling decisions around the needs of the systems and people using the data.
• Develop cloud infrastructure and deployment workflows that make changes repeatable and manageable.
• Build reusable libraries, templates or workflows that help other engineers deliver reliably.
• Improve monitoring, alerting, data quality checks and recovery procedures.
• Work with engineers and data users to understand requirements, explain trade-offs and document what you build.

Skills

Software engineering

SQL

Code review

Testing

Tools

Airflow

Dagster

Prefect

Terraform

Pulumi

CDK

Spark

Flink

Beam

Iceberg

Delta Lake

Hudi

Job description

Build the data foundations behind twice award-winning market intelligence.

At Permutable, we turn global reporting into structured, explainable intelligence across macroeconomics, commodities and geopolitics for institutional investors.

Our work has earned two innovation awards in 2026: AI Innovation of the Year: Europe at the Euromoney Markets Awards and Technology Provider of the Year: Innovation at the Hedgeweek European Awards.

We’re looking for a Senior Platform Engineer to help build and run the data platform behind that work: reliable pipelines, well-designed storage and infrastructure that other engineers can build on with confidence.

This role brings together software engineering, data engineering and production operations. It suits someone who enjoys understanding how a system fits together, making practical design decisions and following those decisions through into production.

Why join Permutable?

The opportunity is to work on the foundations of a business where data is the product.

The engineering has a clear purpose: helping investment teams investigate changing market conditions using structured, traceable information. Pipeline reliability, data quality and safe releases directly affect the intelligence they can use.

You’ll have scope across the path from data processing and storage to infrastructure and production reliability. You’ll also help make other engineers more effective through reusable tooling, clearer workflows and dependable platform capabilities.

If you enjoy building systems and understanding what happens after they are deployed, there is substantial engineering work here to get involved in.

What you’ll do

Build the data foundations behind twice award-winning market intelligence.

At Permutable, we turn global reporting into structured, explainable intelligence across macroeconomics, commodities and geopolitics for institutional investors.

Our work has earned two innovation awards in 2026: AI Innovation of the Year: Europe at the Euromoney Markets Awards and Technology Provider of the Year: Innovation at the Hedgeweek European Awards.

We’re looking for a Senior Platform Engineer to help build and run the data platform behind that work: reliable pipelines, well-designed storage and infrastructure that other engineers can build on with confidence.

This role brings together software engineering, data engineering and production operations. It suits someone who enjoys understanding how a system fits together, making practical design decisions and following those decisions through into production.

• Build, maintain and improve production data pipelines, including how they recover from failures and handle reruns, backfills and changing schemas.
• Develop tested, maintainable software, contributing through code review and safe releases.
• Help shape data storage and modelling decisions around the needs of the systems and people using the data.
• Develop cloud infrastructure and deployment workflows that make changes repeatable and manageable.
• Build reusable libraries, templates or workflows that help other engineers deliver reliably.
• Improve monitoring, alerting, data quality checks and recovery procedures.
• Work with engineers and data users to understand requirements, explain trade-offs and document what you build.

What you’ll bring

You must have:

• Production software engineering experience in a general-purpose language used for data work, such as Python, Java or Scala, alongside SQL or a similar query language.
• The ability to read, reason about and change an existing codebase, with experience of testing, maintainability, code review and safe releases.
• Experience building and running production data pipelines.

Beyond those essentials, we’re looking for hands-on experience in at least one data area and one platform area below.

Data experience

• Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes.
• Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits.
• Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results.

Platform experience

• Cloud and infrastructure as code: building infrastructure with tools such as Terraform, Pulumi or CDK, including environments, CI/CD and safe releases.
• Platform tooling: creating libraries, templates or workflows that other engineers have used.
• Production operations: keeping data systems healthy through monitoring, alerting, data quality checks and recovery from failures.

Useful additional experience

These are welcome, rather than requirements:

• Python, our main language.
• Understanding how Spark runs on the JVM.
• Backend services and APIs.
• Change data capture or database replication.
• Open table formats such as Iceberg, Delta or Hudi.
• AWS data services, including Glue, Athena, DMS, MWAA or RDS.
• Cloud security and networking, including IAM, VPCs and secrets management.

Our recruitment process

Our process gives us time to understand your experience and gives you a clear view of the role, the team and how we work.

• Initial conversation: We’ll discuss your background, motivation and relevant experience, alongside the role, working environment and your interest in Permutable.
• Technical deep dive: We’ll explore previous projects, your technical expertise and how you approach engineering decisions and problem-solving.
• Systems discussion and workshop: You’ll present your approach to a clearly scoped problem shared in advance, followed by a collaborative discussion with members of our technical team covering system design and implementation.
• Offer discussion: If there’s a strong fit on both sides, we’ll discuss an offer and next steps.

There will be opportunities to ask questions throughout.

If your experience covers the essentials and the combination of data and platform work described above, we’d like to hear from you.