Lead Data Engineer - Real-Time Streaming for Enterprise

Aker Systems Limited; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

25 days holiday

Medical insurance

Life assurance

Pension scheme

Training allowance

Wellbeing allowance

Virtual GP

Employee Assistance Plan

Job summary

Aker Systems Limited seeks a lead Data Engineer to design, build and evolve secure, scalable cloud-based data platforms for UK and international clients. You will lead real-time pipelines, establish engineering best practices, and collaborate with architects, engineers and stakeholders to deliver high-performance data solutions.

The role combines technical leadership with hands-on development across batch and streaming workflows, ensuring security, governance and reliability in regulated

Qualifications

• Real-Time Streaming and Data Engineering expertise.
• Hands-on with Apache Kafka, AWS Kinesis, Apache Flink, Spark Streaming, Apache Pulsar or similar.
• Experience building high-volume, low-latency data pipelines in production.
• Strong SQL and data modeling skills for analytical and operational workloads.
• Proficiency in Python or similar languages for data engineering.
• Experience with Terraform, Docker and Kubernetes.
• Experience delivering data platforms in regulated environments.

Responsibilities

• Lead design, development and deployment of secure, scalable data pipelines and platform components.
• Design batch and real-time streaming solutions using modern event-driven architectures.
• Own technical design decisions across projects focusing on scalability, security and performance.
• Lead workshops and architecture discussions with client stakeholders.
• Assess client data platforms and plan modernisation, migration and integration.
• Build data ingestion, transformation and integration across multiple sources.
• Develop cloud-native data platforms using AWS services and open-source tech.
• Ensure data quality, governance, lineage and security across lifecycles.
• Drive best practices including CI/CD, testing and IaC.
• Mentor engineers and maintain engineering standards across projects.
• Perform data modelling and performance tuning to resolve complex issues.

Skills

Real-Time Streaming

Kafka

AWS Kinesis

Flink

Spark Streaming

Pulsar

Python

SQL

NoSQL

Terraform

Docker

Kubernetes

Git

Education

Bachelor's degree in computer science or related field

Tools

Terraform

Docker

Kubernetes

Ansible

Packer

Job description

Aker Systems Limited seeks a lead Data Engineer to design, build and evolve secure, scalable cloud-based data platforms for UK and international clients. You will lead real-time pipelines, establish engineering best practices, and collaborate with architects, engineers and stakeholders to deliver high-performance data solutions.

The role combines technical leadership with hands-on development across batch and streaming workflows, ensuring security, governance and reliability in regulated