Senior Data Platform Engineer: Lakehouse, AWS & Databricks

Houseful; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid - 2 days per week in London HQ

25 days annual leave

Cycle to work scheme

Private medical insurance

Job summary

Alto Software Group is seeking a Senior Data Platform Engineer to scale our data platform powering analytics and data products. You will lead lakehouse evolution, migrate from legacy SQL Server, and build reusable data abstractions to enable safe, scalable access for internal and external users.

You’ll collaborate with product and commercial teams, implement IaC with AWS/Terraform, and drive engineering excellence across data pipelines using Databricks, dbt, and Kafka.

Qualifications

• Extensive experience building and operating production data platforms.
• Strong skills in Python for data pipelines (pyspark).
• Hands-on AWS and Terraform, with IaC mindset.
• Experience with lakehouse/warehouse platforms (Databricks preferred).
• Production use of Fivetran, dbt or equivalent tools.
• Experience with Kafka or similar streaming systems.
• Strong SQL and data modelling familiarity.

Responsibilities

• Own reliability and performance of the data lakehouse at scale.
• Build infrastructure and logic for data products to enable revenue.
• Design reusable templates and abstractions for safe data access.
• Lead migration from legacy SQL Server to lakehouse/modern stores.
• Develop and optimise ETL processes and data models.
• Take ambiguous problems through design, build and production rollout.
• Raise the bar on engineering practices and design reviews.

Skills

Data lakehouse

Python (pyspark)

AWS

Terraform

Databricks

dbt

Fivetran

Kafka

SQL

Kubernetes/ECS

Tools

Databricks

Snowflake

BigQuery

AWS

Terraform

dbt

Fivetran

Job description

Alto Software Group is seeking a Senior Data Platform Engineer to scale our data platform powering analytics and data products. You will lead lakehouse evolution, migrate from legacy SQL Server, and build reusable data abstractions to enable safe, scalable access for internal and external users.

You’ll collaborate with product and commercial teams, implement IaC with AWS/Terraform, and drive engineering excellence across data pipelines using Databricks, dbt, and Kafka.