Lead Data Engineer, Technology Consulting

Momentum Worldwide; Greater London; Hybrid; GBP 60,000 - 100,000; Full time

Benefits offered by this job

Comprehensive benefits

Development opportunities

Job summary

Credera UK is seeking a Lead Engineer to drive delivery of AI-enabled data platforms on AWS, coordinating multi-area data engineering across client projects and internal initiatives.

You will lead teams, influence senior stakeholders, and push for innovative data and AI solutions while mentoring engineers and fostering development opportunities across the firm.

Qualifications

• Lead delivery of complex data engineering work across multiple areas to time, cost and quality.
• Experience managing teams delivering agreed scope and acting as escalation point for decisions.
• Experience building data pipelines using Spark, Python or SQL.
• Experience with AWS data services and AI/ML offerings (SageMaker).
• Experience with big data and lakehouse platforms on AWS (EMR, Databricks, Snowflake).
• Experience building data platforms (Data Lakes, Lakehouses, Data Meshes) for analytics/AI workloads.
• Understanding of data security, governance and responsible AI principles.
• Ability to partner with senior stakeholders and build trust across groups.
• Proven track record of coordinating multidisciplinary teams to resolve issues.
• Subject matter expertise; drive innovation across multiple clients/industries.
• Commitment to learning new programming languages and pragmatic problem-solving.
• Experience productionising data/AI/ML solutions including Generative AI/LLMs.
• Coaching/mentoring engineers and creating development opportunities.

Responsibilities

• Lead delivery of complex data engineering work across multiple areas, ensuring delivery to agreed time, cost and quality.
• Build modern, AI-enabled data platforms on AWS, including distributed workloads and ML foundations.
• Collaborate with architects and client stakeholders to help customers make use of their data.
• Manage teams delivering agreed scope and act as escalation point for decisions.
• Partner with senior stakeholders to build trust and drive outcomes.
• Anticipate project risks and coordinate multidisciplinary teams to resolve issues.
• Drive innovation and market-leading practices across client work.
• Coach and mentor engineers, creating development opportunities for junior team members and client counterparts.

Skills

Data engineering leadership

Team management

AWS data services

Spark

Python

SQL

Generative AI / LLM

Stakeholder influence

Tools

AWS

SageMaker

EMR

Databricks

Snowflake

Terraform

CloudFormation

Power BI

Tableau

Qlik

Job description

Salary: £60,000 - 100,000 per year

Requirements:

• Demonstrated ability to lead multiple complex areas of data engineering delivery to time, cost and quality with minimal direction.
• Experience managing teams inclusively, delivering agreed scope and acting as an escalation point for decisions affecting your work.
• Experience building data pipelines using Spark, Python or SQL.
• Experience with AWS and its data and AI/ML services, such as SageMaker.
• Experience with big data and lakehouse platforms on AWS, such as EMR, Databricks or Snowflake.
• Experience building data platforms, including Data Lakes, Lakehouses or Data Meshes, to support analytics and AI workloads.
• Understanding of data security, data governance and responsible AI principles.
• Ability to partner with and influence senior stakeholders and build trust across stakeholder groups.
• Track record of anticipating project risks and bringing multidisciplinary subject matter experts together to analyse and resolve issues.
• Recognised subject matter expertise, with the ability to drive innovation and bring experience from multiple clients and industries.
• Commitment to self‑improvement and learning, including learning new programming languages.
• Pragmatic problem‑solving skills and the ability to create clarity and structure in ambiguous situations.
• Experience productionising and operating data and AI/ML solutions, including Generative AI or LLM‑based applications.
• Experience coaching and mentoring engineers and creating structured development opportunities for junior team members and client counterparts.
• Active SC clearance is required.
• Desirable: Experience building automated data quality checks and metrics.
• Desirable: Experience creating or maintaining production software delivery pipelines using CI/CD tools such as GitHub Actions, Azure DevOps, Jenkins or CircleCI.
• Desirable: Experience building LLM or foundation‑model applications using frameworks such as LangChain, vector databases or agentic AI approaches.
• Desirable: Experience with MLOps and Infrastructure as Code, such as Terraform or CloudFormation, for data, analytics and AI services.
• Desirable: Experience with data reporting and visualisation tools such as Power BI, Tableau or Qlik.
• Desirable: Experience applying AI or agentic techniques in your work using GitHub Copilot, Claude Code or equivalent.

Responsibilities:

• Lead delivery of complex data engineering work across multiple areas, ensuring delivery to agreed time, cost and quality.
• Build modern, AI-enabled data platforms on AWS, including distributed workloads, batch and streaming pipelines, and data foundations for machine learning, Generative AI and LLM solutions.
• Work with architects, technology consultants and public sector client stakeholders to help customers make use of their data.
• Manage teams delivering agreed scope and serve as a key escalation point for decisions affecting your areas of work.
• Partner with and influence senior stakeholders to build trust and drive delivery outcomes.
• Anticipate project risks and coordinate multidisciplinary teams of subject matter experts to analyse and resolve issues.
• Drive innovation and market‑leading practices across client work.
• Coach and mentor engineers, creating development opportunities for junior team members and client counterparts.

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• Big Data
• CI/CD
• Claude Code
• Copilot
• Databricks
• DevOps
• GitHub
• Support
• Jenkins
• LLM
• Machine Learning
• MLOps
• Power BI
• Python
• Qlik
• SQL
• Security
• Snowflake
• Spark
• Tableau
• Terraform
• Cloud
• Data Warehouse
• Matrix

More:

We are Credera, a global consulting firm combining transformational consulting, industry knowledge, and AI and technology expertise to deliver customer experiences and growth. We provide tailored solutions that can scale globally and work with clients from strategy through execution. This permanent Lead Engineer role is within our Data Function, based from any of our UK offices in London, Manchester, Leeds or Newcastle. We use a flexible hybrid model requiring three days per week onsite, at a client site as needed or in a local Credera office. The role includes varied client projects as well as internal projects, training and development. We offer a salary of £84,000–£100,000, a comprehensive benefits plan, personalised development opportunities, experienced colleagues around the globe and opportunities for career progression. We value collaboration, inclusion, learning and making a positive impact on our clients, people and community.

last updated 40 week of 2026