Data Platform Lead - AI/ML & AWS

Adelphi Group; Leeds; Hybrid; GBP 84,000 - 100,000; Full time

Benefits offered by this job

Competitive salary

Comprehensive benefits package

Job summary

Credera is seeking a Lead Engineer to drive data engineering delivery across client projects in a fast-growing technology and engineering organisation. You will build data platforms on AWS, with DevOps and MLOps practices, and mentor engineers and client teams.

The role is based in the UK with a flexible hybrid model, requiring three days on-site per week. You will lead complex data pipelines using Spark, Python, and SQL, work with SageMaker and other AWS services, and shape data governance and

Qualifications

• Experience leading data engineering delivery to time, cost and quality with minimal direction.
• Proven ability to manage teams and escalate decisions affecting delivery.
• Experience building data pipelines using Spark, Python or SQL.

Responsibilities

• Lead multiple data engineering workstreams across client projects.
• Build data platforms on AWS incorporating data lakes, lakehouses or similar architectures.
• Collaborate with architects, technologists and stakeholders to drive outcomes.
• Mentor engineers and client counterparts to raise capability and delivery.

Skills

Spark

Python

SQL

AWS

SageMaker

Data pipelines

Leadership

Data governance

AI/ML

Tools

Databricks

Snowflake

EMR

LangChain

Terraform

CloudFormation

GitHub Actions

Job description

Credera is seeking a Lead Engineer to drive data engineering delivery across client projects in a fast-growing technology and engineering organisation. You will build data platforms on AWS, with DevOps and MLOps practices, and mentor engineers and client teams.

The role is based in the UK with a flexible hybrid model, requiring three days on-site per week. You will lead complex data pipelines using Spark, Python, and SQL, work with SageMaker and other AWS services, and shape data governance and