Senior Data Platform Engineer (AWS, Databricks)

Alto Software Group; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work in London HQ

Career development opportunities

Flexible working arrangements

25 days annual leave (+ extra)

Job summary

Alto Software Group is hiring a Senior Data Platform Engineer in London. You will scale and operate a data lakehouse powering internal analytics and data products, migrating from legacy systems and building reusable data pipelines.

You will design templates, lead ETL and data modelling efforts, and collaborate with product/commercial teams to turn data into revenue, while advancing infrastructure as code and modern cloud practices.

Qualifications

• Deep, hands‑on experience building and running production data platforms and products.
• A good level of experience in Python (particularly pyspark) for building data pipelines.
• Strong AWS and Terraform experience, with infrastructure‑as‑code as your default way of working.
• Substantial experience with a modern lakehouse or warehouse platform — Databricks ideally, or Snowflake/BigQuery.
• Real production experience with Fivetran, dbt, or equivalent ingestion and transformation tooling.
• Kafka or similar streaming systems in production, and the judgement to know when event‑driven is the right answer and when it isn’t.
• Strong SQL and sound data modelling instincts, plus experience working with large legacy relational estates and the constraints they bring.
• Comfort with container orchestration (ECS, Kubernetes) and how data workloads actually behave in production.
• A platform mindset — you take as much satisfaction from the paved road as from the pipeline that runs on it.

Responsibilities

• Own the reliability and performance of our data lakehouse as it scales, taking the lead on the operational problems that don't have an obvious answer.
• Build the infrastructure and business logic behind our data commercialisation products, partnering with product and commercial teams to turn data into revenue.
• Design the abstractions, blueprints and reusable templates that let service and analytics teams work with data safely and consistently, from ingestion through to storage and access — and make them good enough that teams choose them.
• Lead the data side of modernising our legacy monolithic SQL Server database: extracting into the lakehouse and parallel data stores, introducing retention policies, and migrating to modern SQL frameworks.
• Write and optimise ETL processes and contribute to data modelling for both internal analytics and external‑facing data products.
• Take work from ambiguous problem statements through design, build and deployment, and stay accountable for it in production.
• Raise the technical bar on how we build — reviewing designs, challenging decisions, and improving our engineering practices as you go.

Skills

Python

pyspark

AWS

Terraform

Databricks

Snowflake/BigQuery

Fivetran

dbt

Kafka

SQL

ECS

Kubernetes

data modelling

infrastructure as code

Tools

Databricks

dbt

Fivetran

Kafka

Snowflake

BigQuery

AWS

Terraform

SQL Server

S3/storage

Job description

London | Hybrid — 2 days per week in our London HQ | Full-time

Alto Software Group is a B2B SaaS company that powers more than half of all UK housing transactions each year. We create software solutions that connect businesses and consumers, delivering a one-stop shop for estate agents and home builders. Our goal is to drive efficiency, speed up transactions, reduce risk, and improve the end‑customer experience. While we're not a start‑up, we have a start‑up mindset and want our people to operate with this mindset so that we can achieve our ambitions.

The Role

We are looking for a Senior Data Platform Engineer to take on the hardest parts of scaling our data platform which powers both internal and external analytics solutions, agentic AI workflows and wider engineering systems. We’re investing heavily in migrating workloads and services away from legacy infrastructure, as well as building repeatable and resilient data processing pipelines for these use cases.

What You'll Do

• Own the reliability and performance of our data lakehouse as it scales, taking the lead on the operational problems that don't have an obvious answer.
• Build the infrastructure and business logic behind our data commercialisation products, partnering with product and commercial teams to turn data into revenue.
• Design the abstractions, blueprints and reusable templates that let service and analytics teams work with data safely and consistently, from ingestion through to storage and access — and make them good enough that teams choose them.
• Lead the data side of modernising our legacy monolithic SQL Server database: extracting into the lakehouse and parallel data stores, introducing retention policies, and migrating to modern SQL frameworks.
• Write and optimise ETL processes and contribute to data modelling for both internal analytics and external‑facing data products.
• Take work from ambiguous problem statements through design, build and deployment, and stay accountable for it in production.
• Raise the technical bar on how we build — reviewing designs, challenging decisions, and improving our engineering practices as you go.

What You Need to Be Successful

• Deep, hands‑on experience building and running production data platforms and products
• A good level of experience in Python (particularly pyspark) for building data pipelines
• Strong AWS and Terraform experience, with infrastructure‑as‑code as your default way of working rather than something you've picked up.
• Substantial experience with a modern lakehouse or warehouse platform — Databricks ideally, or Snowflake/BigQuery — including the performance, cost and governance decisions that come with running one at scale.
• Real production experience with Fivetran, dbt, or equivalent ingestion and transformation tooling.
• Kafka or similar streaming systems in production, and the judgement to know when event‑driven is the right answer and when it isn’t.
• Strong SQL and sound data modelling instincts, plus experience working with large legacy relational estates and the constraints they bring.
• Comfort with container orchestration (ECS, Kubernetes) and how data workloads actually behave in production.
• A platform mindset — you take as much satisfaction from the paved road as from the pipeline that runs on it.

There's always room to grow and learn with our roles — please don't be put off if you don't have all of these. It's more important that you're passionate about improving the home moving and owning experience for everyone.

Our Technology Stack

We believe in using the right tool for the job. Our current stack includes:

Data Platform: Databricks, dbt, Fivetran

Languages: Python, SQL

Databases: SQL Server (legacy, being modernised), plus lakehouse storage on S3

Cloud & Infrastructure: AWS (EventBridge, Kinesis, Lambda, S3, EC2), Terraform (Infrastructure as Code)

Streaming: Kafka

Containers & Orchestration: ECS, Kubernetes

Our Behaviours:

• Explore Boldly: We value engineers who are eager to learn new technologies and stay current with industry trends.
• Bounce Back Stronger: A pragmatic problem‑solver who can navigate ambiguity and find simple solutions to complex challenges.
• Own It Together: A collaborative team member who is willing to share early‑stage work and both give and receive constructive feedback.
• Make It Happen: A person who takes pride in their delivery and is passionate about creating high‑quality software at pace.
• Know Our Customers: You're a platform engineer who is genuinely interested in your internal customers' perspective. You strive to understand the purpose of your work so you can deliver the most impactful solutions.

Why Join Alto?

This role offers genuine ownership of a platform at the point where it stops being a project and starts being critical infrastructure — your decisions on architecture, tooling and standards will hold for years. You will have the autonomy to shape how data is built and consumed across the business, and direct visibility with the product and commercial teams turning that data into revenue. With the Databricks migration in flight and data products moving from idea to roadmap, this is the moment where the hardest and most interesting work sits.

• Hybrid - 2 days per week in our London HQ for team collaboration
• Opportunities for career development and advancement within a growing organisation.
• Everyday Flex - greater flexibility over where and when you work

• 25 days annual leave + extra days for years of service
• Day off for volunteering & Digital detox day
• Festive Closure - business closed for period between Christmas and New Year
• Cycle to work and electric car schemes
• Free Calm App membership
• Enhanced Parental leave
• Fertility Treatment Financial Support
• Group Income Protection and private medical insurance
• Gym on‑site in London
• 7.5% pension contribution by the company
• Discretionary annual bonus up to 10% of base salary
• Talent referral bonus up to £5K

We want to make ASG more welcoming, fair and representative every day. We’ll consider everyone who applies for this role in the same way, regardless of your ethnicity, colour, national origin, religion, sexual orientation, gender, gender identity, age, physical disability, neurodiversity status, family or parental status, or how long you’ve spent unemployed.