Lead Data Platform Engineer - Cloud DW on AWS

Cognify Search; England; On-site; GBP 90,000 - 120,000; Full time

Job summary

Cognify Search is seeking a Senior Data Engineer to lead the design and build of a modern cloud data platform in a high-growth HealthTech environment. You’ll own architecture, strategy and long‑term direction, and act as technical lead for Data Engineering across analytics, product and engineering teams.

The role combines hands‑on pipeline work with strategic design, governance, and observability, primarily on AWS with dbt, Airflow and IaC tooling, to support scale, reliability and secure data

Qualifications

• Strong Python and SQL skills and production-grade data pipelines experience.
• Experience with AWS or another major cloud platform.
• Familiarity with modern data warehouses or lakehouse tech (Redshift, Snowflake, Databricks, BigQuery).
• Experience with dbt, orchestration tools (Airflow, Dagster) and IaC (Terraform, CloudFormation, CDK).
• Experience designing data architecture, governance, security and access controls.

Responsibilities

• Design and build a modern cloud-based data platform.
• Lead Data Engineering technically.
• Define architecture and long-term data strategy.
• Build scalable pipelines and ingestion frameworks using Python.
• Design and evolve warehouse/lakehouse architecture.
• Work in AWS and cloud environments.
• Build robust transformation workflows with dbt.
• Improve orchestration, testing, deployment, developer experience.
• Introduce data quality, monitoring and observability.
• Apply infrastructure-as-code and treat data infra as software.
• Implement governance, security and access controls.
• Collaborate with Engineering, Product and Analytics teams.
• Provide technical leadership and mentorship.

Skills

Python

SQL

Data pipelines

Data architecture

Data governance

Data quality

Observability

Infrastructure as Code

Tools

AWS

Redshift

Snowflake

Databricks

BigQuery

dbt

Airflow

Dagster

Terraform

CloudFormation

CDK

Job description

Cognify Search is seeking a Senior Data Engineer to lead the design and build of a modern cloud data platform in a high-growth HealthTech environment. You’ll own architecture, strategy and long‑term direction, and act as technical lead for Data Engineering across analytics, product and engineering teams.

The role combines hands‑on pipeline work with strategic design, governance, and observability, primarily on AWS with dbt, Airflow and IaC tooling, to support scale, reliability and secure data