Lead Data Engineer

CRU; Greater London; On-site; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Flexible benefits

Global growth opportunities

Collaborative environment

Job summary

CRU International is seeking a Lead Data Engineer to own a business domain within its modern Snowflake, Airflow, and dbt data platform. The role blends hands-on technical leadership with team coordination to ensure stable platform operations, data quality, and timely delivery of the product roadmap.

You will shape how data products are designed, built, and improved, delivering reliable analytics for the metals, mining, and fertilizer industries.

Qualifications

• Degree-level education in a technology-focused subject such as Computer Science, Information Technology, or equivalent experience.
• 10+ years of experience in data-related roles, with the majority in data engineering.
• Strong hands-on experience with Snowflake and dbt (3+ years).

Responsibilities

• Lead a small team of data engineers responsible for a specific business domain within the data platform.
• Own the design, development, and ongoing maintenance of scalable data pipelines that support new and existing data products.
• Work closely with internal stakeholders to translate data requirements into technical solutions and communicate delivery plans.
• Ensure data quality, consistency, and reliability through testing, validation, and monitoring.
• Design and implement new pipelines using Airflow, dbt, and Snowflake.
• Contribute to cloud infrastructure on Azure with Terraform.

Skills

Team leadership

Data engineering

Communication

Education

Degree in CS/IT or equivalent

Tools

Snowflake

dbt

Azure

Airflow

Kubernetes

GitHub

Terraform

Job description

Lead Data Engineer

About CRU:

CRU International is a leading provider of business intelligence and consulting services in the metals, mining, and fertilizer industries. With over 50 years of experience, we offer valuable insights and analysis that help our clients make informed decisions in an ever-changing global market.

About the role:

We are looking for a Lead Data Engineer to take ownership of a business domain within our modern Snowflake, Airflow, and dbt data platform. This role will combine hands‑on technical leadership with team coordination, helping ensure stable platform operations, strong data quality, and efficient delivery of the product roadmap.

You will play a key part in shaping how data products are designed, built, and improved, supporting the delivery of reliable analytics for the commodity industry.

Job Requirements

Qualifications:

• Degree‑level education in a technology‑focused subject such as Computer Science, Information Technology, or equivalent experience through professional qualifications and industry background.
• Strong academic or professional track record in a relevant technical discipline.

Skills & Experience:

• 10+ years of experience in data‑related roles, with the majority in data engineering.
• Strong hands‑on experience with Snowflake, ideally 3+ years.
• Strong hands‑on experience with dbt, ideally 3+ years.
• Experience leading small data engineering teams, ideally 2-3 engineers.
• Experience designing, building, and maintaining data processing systems at scale.
• Experience with Azure cloud services, Airflow, dbt, Kubernetes, GitHub, and Terraform.
• Experience working in fast‑moving, high‑growth, or startup‑like environments is preferred.
• Strong communication skills with the ability to explain data warehouse plans and technical decisions to internal clients and stakeholders.
• A curious, delivery‑focused mindset with a strong commitment to quality, innovation, and continuous improvement.
• Hands‑on problem‑solving ability and a practical approach to getting things working reliably.
• Contributions to open‑source software or an active GitHub profile would be an advantage.

Job Responsibilities

Key Responsibilities:

• Lead a small team of data engineers responsible for a specific business domain within the data platform.
• Own the design, development, and ongoing maintenance of scalable data pipelines that support new and existing data products.
• Work closely with internal stakeholders to understand data requirements, translate needs into technical solutions, and communicate delivery plans clearly.
• Ensure data quality, consistency, and reliability through the use of modern testing, validation, and monitoring tools.
• Design and implement new pipelines using best‑in‑class tools such as Airflow, dbt, and Snowflake.
• Contribute to the development of scalable cloud infrastructure on Azure, including infrastructure as code using Terraform.
• Promote engineering best practices, including clean code, maintainability, testing, and strong documentation.
• Support continuous improvement across the team by identifying opportunities to improve delivery, reliability, and operational efficiency.
• Stay current with emerging data engineering tools, techniques, and approaches, bringing fresh ideas and a continuous improvement mindset.
• Encourage a collaborative, delivery‑focused team culture that values quality, innovation, and accountability.

Job Benefits

What We Offer:

• Competitive salary and flexible benefits package.
• Opportunities for professional growth and development as part of a global company.
• A collaborative and supportive work environment.
• The chance to work with industry‑leading experts and over a diverse range of topics and projects.