Software Engineer (Data Platforms)

Squid; Greater London; On-site; GBP 75,000 - 200,000; Full time

Job summary

Squid is hiring a Data Engineer in London to help build the data foundations of our grid-focused platform. You will work with founders and early engineers to ingest, transform, validate, and serve large, complex datasets for grid operators.

The role blends data engineering, software engineering, infrastructure and applied AI, with high ownership and opportunities to shape architecture and engineering practices from an early stage.

Qualifications

• Production data pipelines experience.
• Strong Python and SQL skills; PostgreSQL experience.
• Experience designing data models and transformation layers.

Responsibilities

• Build production data pipelines for ingesting, transforming, validating and serving complex datasets.
• Design scalable data models, schemas and storage for structured, semi-structured and geospatial data.
• Build pipeline orchestration with DAGs to manage dependencies, retries, scheduling and observability.
• Develop systems for data quality testing, lineage, versioning and change detection.
• Create tools for combining datasets from different systems while preserving provenance and auditability.
• Build APIs and services to expose processed data to products, customers and AI systems.
• Develop workflows for batch, event-driven and long-running computations.
• Create monitoring and alerting for pipeline failures and data quality issues.
• Work directly with customers and domain experts to understand data problems.
• Use AI tools to accelerate data mapping and pipeline development.

Skills

Python

SQL

Data pipelines

Data modelling

Tools

PostgreSQL

Job description

About Squid

AI and data centres are booming, electrification is accelerating, and trillions in generation, storage, and connection projects are queued - but the real bottleneck is the grid.

Grid planning and operations are becoming a national-scale systems problem: complex network models, messy legacy data, strict governance, overloaded teams, and high-stakes decisions that affect real infrastructure.

Squid is building the agentic modelling platform for power grids: a versioned, auditable source of truth where network models, data, changes, assumptions, and decisions can be tracked – and where humans and AI agents can safely work together.

We unify legacy planning models, operational data, and grid workflows into software that helps teams run checks, compare models, explain changes, validate assumptions, and move faster without losing engineering rigour.

Based in London, Squid is backed by premier investors like Y Combinator and partners with industry leaders including National Grid and Northern Powergrid.

About the role

Pay Range: £75k-£200k (salary + equity), based in London, UK.

We are hiring a Data Engineer to join Squid as one of our first engineers.

You will work closely with the founders and the early engineering team to build the data foundations of our platform for grid operators. The role combines data engineering, software engineering, infrastructure and applied AI.

You will work with large, complex, and often inconsistent technical datasets, building reliable systems to ingest, transform, validate, connect and serve them. This is a high‑ownership role based in our central London office, with the opportunity to shape our data architecture, engineering practices and product from an early stage.

What you’ll do

• Build production data pipelines for ingesting, transforming, validating and serving complex datasets.
• Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data.
• Build pipeline orchestration using directed acyclic graphs (DAGs) to manage dependencies, retries, scheduling and observability.
• Develop systems for data quality testing, lineage, versioning, reconciliation and change detection.
• Create tools for combining datasets from different systems while preserving provenance and auditability.
• Build APIs and services that make processed data available to products, customers and AI systems.
• Develop workflows for batch processing, event-driven processing and long-running computational jobs.
• Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions.
• Work directly with customers and domain experts to understand source systems and data problems.
• Use modern AI development tools to accelerate data mapping, validation and pipeline development.

Qualifications

You do not need to meet every requirement. We are looking for strong data engineers who enjoy making difficult, messy datasets reliable and usable.

• Professional experience building and maintaining production data pipelines.
• Strong Python and SQL skills, with experience working with Postgres or similar databases.
• Experience designing data models, schemas and transformation layers for complex datasets.
• Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems.
• Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure.
• Experience with data quality testing, lineage, observability, versioning or change‑data capture.
• The ability to work with incomplete, inconsistent or poorly documented source data.
• Strong software engineering fundamentals, including testing, code review and maintainable system design.
• An interest in applied AI, data evaluation and building reliable data foundations for AI systems.
• High ownership, clear communication and a willingness to work directly with technical customers.

Experience with geospatial data, graph data, time‑series data, scientific computing, energy data or other complex engineering datasets would be valuable, but is not required.