Senior Data Engineer – AI-Driven Lakehouse & Data Platform

Myenergi Ltd; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Free on-site EV charging

Private Medical Insurance

Cycle to Work Scheme

25 days holiday + bank holidays

Mental Health First Aiders

Job summary

myenergi is seeking a Senior Data Engineer to lead the build-out of our AWS data lake and guide the Bay Lakehouse governance. You will shape data pipelines feeding BI and AI tools, ensure guardrails on quality, cost and privacy, and collaborate with DevOps to raise data platform standards.

You will work with a cross-functional team, own data modeling standards, and drive data extraction with modern CI/CD and IaC practices while enabling AI agents to safely access datasets.

Qualifications

• Significant experience building and operating AWS data platforms.
• Strong hands-on Spark or Glue and Apache Iceberg or equivalent table format.
• Strong Python and SQL with maintainable pipeline code.
• CDC and replication (DMS, Zero-ETL) and integrating SaaS/ERP data via APIs.
• Infrastructure as code and CI/CD, Terraform with CircleCI or GitHub Actions.
• Good grasp of data protection and governance.

Responsibilities

• Lead the data lake architecture and roadmap with bronze/silver/gold on S3 Tables and Apache Iceberg.
• Design ingestion per source (Zero-ETL, DMS, APIs) and device telemetry.
• Recommend how Redshift, Iceberg and ClickHouse fit workloads.
• Set modelling standards and ensure traceability to source.
• Build and maintain Glue/PySpark jobs, Lambdas, and orchestration with quality gates.
• Own pipeline performance, cost, and reliability.

Skills

AWS data platforms

Apache Iceberg

Python

SQL

Spark/Glue

Redshift

DMS/ETL

Terraform

CI/CD (CircleCI/GitHub Actions)

data governance

AI coding agents

Tools

Glue

Redshift

Iceberg

DMS

Terraform

CircleCI

GitHub Actions

Job description

myenergi is seeking a Senior Data Engineer to lead the build-out of our AWS data lake and guide the Bay Lakehouse governance. You will shape data pipelines feeding BI and AI tools, ensure guardrails on quality, cost and privacy, and collaborate with DevOps to raise data platform standards.

You will work with a cross-functional team, own data modeling standards, and drive data extraction with modern CI/CD and IaC practices while enabling AI agents to safely access datasets.