Senior Data Engineer

myenergi; Grimsby; On-site; GBP 70,000 - 105,000; Full time

Benefits offered by this job

Free on-site EV charging

Private Medical Insurance

Cycle to Work Scheme

25 days’ holiday + bank holidays

Life Assurance

Enhanced employer pension

Career development support

On-site parking

Job summary

myenergi, a rising clean‑tech manufacturer, seeks a Senior Data Engineer to lead our AWS data lake build and adoption. You will shape the medallion lakehouse on Apache Iceberg, pipelines feeding BI and AI tools, and a defensible framework for safe, cost‑aware automation.

This hands‑on role reports to the Head of Software & Cybersecurity and partners with DevOps to set data standards. You will design ingestion, model data, and ensure guardrails for quality, cost and privacy while enabling

Qualifications

• Extensive experience building and operating AWS data platforms in production.
• Hands‑on Spark or Glue, Iceberg and Redshift for analytics workloads.
• Strong Python and SQL with maintainable pipeline code.
• CDC/replication and API-based data integration from SaaS/ERP.
• Data modelling for BI and analytics consumers; IaC and CI/CD.
• Governance, data protection, least privilege and PII minimisation.

Responsibilities

• Lead data lake architecture and roadmap with Bronze/Silver/Gold layers on S3 and Iceberg.
• Design ingestion pipelines from Aurora/RDS, DMS, APIs and telemetry.
• Evaluate Redshift, Iceberg, and ClickHouse for workloads and cost.
• Set modelling standards and ensure traceability from gold metrics to sources.
• Build and maintain Glue/PySpark jobs, Lambdas and orchestration with quality gates.
• Own performance, reliability, cost, partitioning, tuning and alerts.
• Protect data by design, classify sources, minimise PII and maintain lineage.
• Create a framework for business users to prototype pipelines safely.
• Collaborate with finance, sales, service and product to deliver reusable datasets.
• Prepare data for AI: governance, access controls and audit trails.
• Use AI coding agents to build, test and document pipelines; define patterns.
• Establish data engineering standards: Terraform, CircleCI, CI/CD, reviews.
• Support and mentor DevOps engineers delivering data extracts and pipelines.

Skills

AWS data platform

Python

SQL

Spark/Glue

CI/CD practices

Data modelling

Tools

Apache Iceberg

Redshift

Glue

DMS

Terraform

Job description

Putting the ‘i’ into British Innovation.

Putting the ‘i’ into Inventing the Future.

Putting the ‘i’ into Inspiring Change.

myenergi is a growing global clean‑tech manufacturer dedicated to removing the barriers to a greener future. Known for our award‑winning zappi EV charger and our intelligent home energy management ecosystem, we empower customers to control, store, and optimise their self‑generated energy.

With an expanding international presence and ambitious plans for continued global growth, we’re shaping the future of smart, flexible homes, leading innovation in solar, EV, and battery technology to create a cleaner, more sustainable future for all.

Role Summary:

A Senior Data Engineer to lead the build‑out and adoption of our AWS data lake and help define how the business gets value from it.

You will lead the design and delivery of our medallion lakehouse on Apache Iceberg, the pipelines that feed it and the datasets our BI users and AI tools consume.

You will build the framework that lets business users prototype pipelines and automations safely, with guardrails on quality, cost and data protection. A hands‑on senior role reporting to the Head of Software & Cybersecurity and working alongside the DevOps team: you set the data engineering standards, support the DevOps engineers who serve data today, use AI tools daily and make the platform something AI agents can safely consume, with scope to take on more ownership as the data function grows.

Key Responsibilities:

• Lead the data lake architecture and roadmap, agreed with the Head of Software: bronze/silver/gold on S3 Tables with Apache Iceberg, Glue Catalog, Lake Formation.
• Design ingestion per source: Zero-ETL (Aurora/RDS to Redshift), DMS, APIs (HubSpot, ERP) and device telemetry.
• Recommend how Redshift, Iceberg and ClickHouse each fit our analytical workloads, cost-aware.
• Set modelling standards: silver stays use‑case agnostic; every gold metric is traceable to source.
• Build and maintain Glue/PySpark jobs, Lambdas and orchestration with quality gates and tested code.
• Own pipeline performance, reliability and cost: partitioning, compaction, tuning, monitoring, alerts.
• Data protection by design: classify sources, minimise PII at source, mask lower environments; keep lineage docs current.
• Build and run the framework for business users to prototype pipelines and automations safely, with clear promotion paths to production.
• Partner with finance, sales, service and product to turn questions into reusable, well‑modelled gold datasets; measure time from question to trusted answer.
• Make the platform AI‑ready: governed, well‑described datasets exposed to AI agents (e.g. via MCP) with least‑privilege access and audit trails; help define the guardrails.
• Use AI coding agents daily to build, test and document pipelines; set the patterns the team follows.
• Set data engineering standards: Terraform, CircleCI CI/CD, code review, testing and documentation.
• Support and mentor the DevOps engineers delivering data extracts and pipelines; pair and review designs.
• Work with the backend team (TypeScript, Lambda, DynamoDB, Postgres) so application data is consumable by the platform.

Required Qualifications and Experience:

• Significant experience building and operating AWS data platforms, ideally with a lakehouse or warehouse in production.
• Strong hands‑on Spark or Glue, Apache Iceberg or equivalent table format, and a warehouse such as Redshift.
• Strong Python and SQL with a record of tested, maintainable pipeline code.
• CDC and replication (DMS, Zero‑ETL) and integrating SaaS/ERP data via APIs.
• Solid data modelling and experience serving BI and analytics consumers.
• Infrastructure as code and CI/CD, ideally Terraform with CircleCI or GitHub Actions.
• Good grasp of data protection and governance: classification, least privilege, PII minimisation.
• Daily use of AI coding agents; interest or experience in exposing data to AI tools (e.g. MCP, semantic layers) with governance.
• Clear communication with technical and business audiences; experience supporting or mentoring other engineers.

Desirable:

• Experience leading platform architecture or a small data workstream end to end; ready to grow into broader ownership.
• Amazon Quick (QuickSight) experience; ClickHouse or other columnar engines; Lake Formation, S3 Tables and Glue 5.
• Power BI is nice to have but not part of the day‑to‑day role; energy, IoT or time‑series data.
• Building self‑service or low‑code data tooling for business users; TypeScript and serverless experience.
• Personal attributes: hands‑on with the credibility to set standards; pragmatic about cost and complexity; curious about the business; calm, methodical and data‑driven; advocates for privacy, quality and sustainability.

Our Values:

At myenergi, our values guide how we work every day.

Bold – Push for better

• Challenge the norm and set new standards
• Try new ideas and learn fast
• Focus on progress, not perfection
• Speak up, even when it's hard

Empowered – Own the outcome

• Take responsibility for your work and results
• Make informed decisions
• Welcome challenge and give it respectfully
• Put customers first

United – Work as one

• Collaborate and share openly
• Communicate clearly and honestly
• Support each other
• Think beyond your own team

Purposeful – Do work that matters

• Consider the impact of your decisions
• Help customers save money and cut carbon
• Build technology that is made to last
• Deliver value through continuous improvement

What Myenergi Offers You

• Free on‑site EV charging
• Private Medical Insurance
• Cycle to Work Scheme
• 25 days’ holiday (increasing with service) + Bank Holidays
• Mental Health First Aiders across the business
• Enhanced employer pension contributions
• Career development and ongoing support
• Employee empowerment and autonomy
• Free on‑site parking
• A positive, purpose‑driven working environment
• EV salary sacrifice scheme
• Birthday leave – because everyone deserves a day off for their birthday
• Life Assurance - death in service
• Long service awards
• Enhanced maternity and paternity pay
• Life Celebrations – vouchers for birth and marriage
• Employee Assistance Programme – a free, 24/7 UK‑based counselling helpline
• Enhanced employer pension contributions

myenergi is committed to being an equal opportunity, diverse and inclusive employer. We want a supportive and inclusive environment where our colleagues can reach their full potential without prejudice and discrimination. We are committed to a culture where respect and understanding is fostered, and the diversity of people’s backgrounds and circumstances will be positively valued.