Senior Data Platform Engineer - AWS Databricks (Hybrid, London)

Alto Software Group; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work in London HQ

Career development opportunities

Flexible working arrangements

25 days annual leave (+ extra)

Job summary

Alto Software Group is hiring a Senior Data Platform Engineer in London. You will scale and operate a data lakehouse powering internal analytics and data products, migrating from legacy systems and building reusable data pipelines.

You will design templates, lead ETL and data modelling efforts, and collaborate with product/commercial teams to turn data into revenue, while advancing infrastructure as code and modern cloud practices.

Qualifications

• Deep, hands‑on experience building and running production data platforms and products.
• A good level of experience in Python (particularly pyspark) for building data pipelines.
• Strong AWS and Terraform experience, with infrastructure‑as‑code as your default way of working.
• Substantial experience with a modern lakehouse or warehouse platform — Databricks ideally, or Snowflake/BigQuery.
• Real production experience with Fivetran, dbt, or equivalent ingestion and transformation tooling.
• Kafka or similar streaming systems in production, and the judgement to know when event‑driven is the right answer and when it isn’t.
• Strong SQL and sound data modelling instincts, plus experience working with large legacy relational estates and the constraints they bring.
• Comfort with container orchestration (ECS, Kubernetes) and how data workloads actually behave in production.
• A platform mindset — you take as much satisfaction from the paved road as from the pipeline that runs on it.

Responsibilities

• Own the reliability and performance of our data lakehouse as it scales, taking the lead on the operational problems that don't have an obvious answer.
• Build the infrastructure and business logic behind our data commercialisation products, partnering with product and commercial teams to turn data into revenue.
• Design the abstractions, blueprints and reusable templates that let service and analytics teams work with data safely and consistently, from ingestion through to storage and access — and make them good enough that teams choose them.
• Lead the data side of modernising our legacy monolithic SQL Server database: extracting into the lakehouse and parallel data stores, introducing retention policies, and migrating to modern SQL frameworks.
• Write and optimise ETL processes and contribute to data modelling for both internal analytics and external‑facing data products.
• Take work from ambiguous problem statements through design, build and deployment, and stay accountable for it in production.
• Raise the technical bar on how we build — reviewing designs, challenging decisions, and improving our engineering practices as you go.

Skills

Python

pyspark

AWS

Terraform

Databricks

Snowflake/BigQuery

Fivetran

dbt

Kafka

SQL

ECS

Kubernetes

data modelling

infrastructure as code

Tools

Databricks

dbt

Fivetran

Kafka

Snowflake

BigQuery

AWS

Terraform

SQL Server

S3/storage

Job description

Alto Software Group is hiring a Senior Data Platform Engineer in London. You will scale and operate a data lakehouse powering internal analytics and data products, migrating from legacy systems and building reusable data pipelines.

You will design templates, lead ETL and data modelling efforts, and collaborate with product/commercial teams to turn data into revenue, while advancing infrastructure as code and modern cloud practices.