Senior Data Engineer London

Greenhouse Software, Inc.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

Indicium AI, a global AI-native consultancy, is seeking a Senior Data Engineer to design, build, and scale cloud-native data platforms enabling advanced analytics and AI-driven decision making. You’ll architect pipelines end-to-end, modernising clients’ data estates and delivering scalable solutions across multiple cloud environments.

You will work with Data Scientists, Platform Engineers, and business stakeholders, applying DataOps, CI/CD, and best practices, while mentoring engineers and

Qualifications

• Experience building modern data platforms for enterprise environments.
• Experience with AWS, Azure, or Google Cloud at scale.
• Databricks and Snowflake design, implementation and optimization.
• Strong SQL and Python coding skills.
• Orchestrating data pipelines with DBT, Spark, Airflow, Kafka, or similar.
• Knowledge of data lakehouse patterns.
• CI/CD, automated testing, monitoring and release management experience.
• Infrastructure as Code: Terraform, Pulumi, CloudFormation or Bicep.
• Understanding of distributed systems, data modelling, governance, security.
• Ability to explain complex concepts to technical and non-technical stakeholders.

Responsibilities

• Design and implement modern data platforms, data products, and scalable pipelines across cloud environments.
• Build, optimise, and maintain batch and real-time data processing solutions for analytics and AI use cases.
• Translate client requirements into robust technical solutions.
• Contribute to solution architecture and technology selection decisions.
• Apply DataOps and DevOps practices including CI/CD, testing, monitoring, observability, and release management.
• Develop and optimise data models, transformations, and storage layers for performance and scalability.
• Collaborate with Data Scientists, AI Engineers, Platform Engineers, Architects, and stakeholders.
• Support clients through discovery, design, delivery, and adoption phases of data transformation programmes.
• Mentor engineers and contribute to capability development across project teams.
• Contribute to accelerators, technical communities, blogs, thought leadership, and capability development.

Skills

Cloud platforms

Databricks

Snowflake

SQL

Python

Data pipelines

Airflow

CI/CD

Terraform

Data modeling

Distributed systems

Stakeholder comms

Consulting

Tools

DBT

Spark

Airflow

Dagster

Kafka

Flink

Terraform

Pulumi

CloudFormation

Bicep

Job description

Indicium AI is trusted by the world's leading enterprises to deliver AI and data into production at scale. We are a global AI-native consultancy with proven experience across Financial Services, Energy & Utilities, Healthcare & Life Sciences, Retail & CPG, and Manufacturing. From strategy, to build, to business outcomes, we unlock value from data and AI with unmatched clarity, speed, and capability.

Powered by 600+ data, engineering, and AI experts serving 50+ enterprise clients from 5 global locations, we work side-by-side with top partners including Databricks, Snowflake, AWS, Microsoft, Google Cloud, Anthropic, and OpenAI to deliver transformative data and AI solutions that drive measurable business impact.

Overview

We're seeking an experienced Senior Data Engineer to design, build, and scale modern cloud-native data platforms that enable advanced analytics, AI, and business-critical decision making.

This role is ideal for someone who enjoys solving complex data challenges end-to-end, from architecting platforms and pipelines through to enabling AI-ready data products. You'll work closely with clients to modernise their data estates, implement best-in-class engineering practices, and deliver scalable data solutions across a variety of cloud environments and technologies.

As a consultant, you'll combine deep technical expertise with a pragmatic, outcome-focused mindset, helping enterprise organisations turn their data strategies into reality while influencing engineering best practices across delivery teams.

Responsibilities

• Design and implement modern data platforms, data products, and scalable data pipelines across cloud environments.
• Build, optimise, and maintain batch and real-time data processing solutions to support analytics, reporting, machine learning, and AI use cases.
• Work with clients to understand business requirements and translate them into robust technical solutions.
• Contribute to solution architecture, platform design, and technology selection decisions.
• Implement software engineering and DataOps best practices including testing, observability, CI/CD, version control, and infrastructure automation.
• Develop and optimise data models, transformations, and storage layers to ensure performance, reliability, and scalability.
• Collaborate with cross-functional teams including Data Scientists, AI Engineers, Platform Engineers, Architects, and business stakeholders.
• Support clients through discovery, design, delivery, and adoption phases of data transformation programmes.
• Mentor engineers and contribute to the growth of engineering capability across project teams.
• Contribute to internal initiatives including accelerators, technical communities, blogs, thought leadership, and capability development.

Required Skills & Experience

• Strong hands-on experience building modern data platforms and data products in enterprise environments.
• Proven experience with one or more major cloud platforms including AWS, Azure, or Google Cloud Platform.
• Proven commercial experience with Databricks and/or Snowflake, including the design, implementation, and optimization of data platforms at scale
• Strong SQL expertise and software engineering experience using Python and/or other modern programming languages.
• Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling.
• Solid understanding of data lakehouse, warehouse, and medallion architecture patterns.
• Experience applying DevOps and DataOps best practices including CI/CD, automated testing, monitoring, observability, and release management.
• Experience with Infrastructure as Code technologies such as Terraform, Pulumi, CloudFormation, or Bicep.
• Strong understanding of distributed systems, data modelling, data governance, security, and performance optimisation.
• Ability to engage with technical and non-technical stakeholders, communicating complex concepts in a clear and pragmatic way.
• Experience working within consulting, professional services, or client-facing delivery environments.

Nice to Have

• Experience building AI-ready data platforms and supporting GenAI, ML, or advanced analytics workloads.
• Experience with real-time streaming architectures and event-driven systems.
• Experience with data mesh, data product operating models, or modern data governance frameworks.
• Exposure to Data Quality and Observability platforms such as Great Expectations, Monte Carlo, or Soda.
• Industry experience within Financial Services, Energy & Utilities, Healthcare, Manufacturing, or Retail.
• Cloud provider and/or platform certifications across AWS, Azure, GCP, Databricks, or Snowflake.

Why Indicium AI

• Fast-growing global AI and Data consultancy with significant opportunities for career progression.
• Work on high-impact transformation programmes with some of the world's leading enterprises.
• Competitive salary and performance-based bonus structure.
• Access to leading technologies and strategic partnerships across the AI and Data ecosystem.
• Collaborative, low-ego culture where expertise, curiosity, and innovation are valued.
• Choose your own equipment, including MacBook, PC, and accessories.
• Dedicated learning and development budget to support certifications and continuous growth.
• Opportunity to shape the future of a rapidly growing AI-native consultancy.