Senior Data Engineer: AI-Ready Lakehouse Architect

myenergi; Grimsby; On-site; GBP 70,000 - 105,000; Full time

Benefits offered by this job

Free on-site EV charging

Private Medical Insurance

Cycle to Work Scheme

25 days’ holiday + bank holidays

Life Assurance

Enhanced employer pension

Career development support

On-site parking

Job summary

myenergi, a rising clean‑tech manufacturer, seeks a Senior Data Engineer to lead our AWS data lake build and adoption. You will shape the medallion lakehouse on Apache Iceberg, pipelines feeding BI and AI tools, and a defensible framework for safe, cost‑aware automation.

This hands‑on role reports to the Head of Software & Cybersecurity and partners with DevOps to set data standards. You will design ingestion, model data, and ensure guardrails for quality, cost and privacy while enabling

Qualifications

• Extensive experience building and operating AWS data platforms in production.
• Hands‑on Spark or Glue, Iceberg and Redshift for analytics workloads.
• Strong Python and SQL with maintainable pipeline code.
• CDC/replication and API-based data integration from SaaS/ERP.
• Data modelling for BI and analytics consumers; IaC and CI/CD.
• Governance, data protection, least privilege and PII minimisation.

Responsibilities

• Lead data lake architecture and roadmap with Bronze/Silver/Gold layers on S3 and Iceberg.
• Design ingestion pipelines from Aurora/RDS, DMS, APIs and telemetry.
• Evaluate Redshift, Iceberg, and ClickHouse for workloads and cost.
• Set modelling standards and ensure traceability from gold metrics to sources.
• Build and maintain Glue/PySpark jobs, Lambdas and orchestration with quality gates.
• Own performance, reliability, cost, partitioning, tuning and alerts.
• Protect data by design, classify sources, minimise PII and maintain lineage.
• Create a framework for business users to prototype pipelines safely.
• Collaborate with finance, sales, service and product to deliver reusable datasets.
• Prepare data for AI: governance, access controls and audit trails.
• Use AI coding agents to build, test and document pipelines; define patterns.
• Establish data engineering standards: Terraform, CircleCI, CI/CD, reviews.
• Support and mentor DevOps engineers delivering data extracts and pipelines.

Skills

AWS data platform

Python

SQL

Spark/Glue

CI/CD practices

Data modelling

Tools

Apache Iceberg

Redshift

Glue

DMS

Terraform

Job description

myenergi, a rising clean‑tech manufacturer, seeks a Senior Data Engineer to lead our AWS data lake build and adoption. You will shape the medallion lakehouse on Apache Iceberg, pipelines feeding BI and AI tools, and a defensible framework for safe, cost‑aware automation.

This hands‑on role reports to the Head of Software & Cybersecurity and partners with DevOps to set data standards. You will design ingestion, model data, and ensure guardrails for quality, cost and privacy while enabling