Lead Data Engineer

CRU; Greater London; On-site; GBP 110,000 - 150,000; Full time

Benefits offered by this job

Competitive salary

Flexible benefits

Global company growth

Collaborative environment

Job summary

CRU is seeking a Lead Data Engineer to own a business domain within a modern Snowflake, Airflow, and dbt data platform, combining hands-on technical leadership with team coordination in Greater London.

You will shape how data products are designed, built, and improved, ensuring stable platform operations, high data quality, and reliable analytics for the commodity industry by partnering with internal stakeholders.

Qualifications

• Degree-level education in technology such as Computer Science or IT.
• Strong academic or professional track record in a relevant technical discipline.

Responsibilities

• Lead a small data engineering team.
• Own scalable data pipelines for data products.
• Translate data requirements into technical solutions.
• Ensure data quality and reliability via testing and monitoring.
• Design pipelines with Airflow, dbt, and Snowflake.
• Contribute to Azure cloud infrastructure using Terraform.
• Promote engineering best practices and maintainable code.
• Foster delivery-focused, collaborative team culture.
• Stay updated on new data engineering tools.
• Provide continuous improvement across delivery and reliability.

Skills

Data engineering

Snowflake

dbt

Team leadership

Data pipelines

Azure

Airflow

Kubernetes

GitHub

Terraform

Startup experience

Communication

Problem solving

Open source

Education

Bachelor's degree in CS/IT

Relevant discipline

Tools

Snowflake

dbt

Azure

Airflow

Kubernetes

GitHub

Terraform

Job description

Lead Data Engineer

About CRU

CRU International is a leading provider of business intelligence and consulting services in the metals, mining, and fertilizer industries. With over 50 years of experience, we offer valuable insights and analysis that help our clients make informed decisions in an ever-changing global market.

About the role

We are looking for a Lead Data Engineer to take ownership of a business domain within our modern Snowflake, Airflow, and dbt data platform. This role will combine hands-on technical leadership with team coordination, helping ensure stable platform operations, strong data quality, and efficient delivery of the product roadmap.

You will play a key part in shaping how data products are designed, built, and improved, supporting the delivery of reliable analytics for the commodity industry.

Job Requirements

Qualifications

• Degree-level education in a technology-focused subject such as Computer Science, Information Technology, or equivalent experience through professional qualifications and industry background.
• Strong academic or professional track record in a relevant technical discipline.

Skills & Experience

• 10+ years of experience in data-related roles, with the majority in data engineering.
• Strong hands-on experience with Snowflake, ideally 3+ years.
• Strong hands-on experience with dbt, ideally 3+ years.
• Experience leading small data engineering teams, ideally 2–3 engineers.
• Experience designing, building, and maintaining data processing systems at scale.
• Experience with Azure cloud services, Airflow, dbt, Kubernetes, GitHub, and Terraform.
• Experience working in fast-moving, high-growth, or startup-like environments is preferred.
• Strong communication skills with the ability to explain data warehouse plans and technical decisions to internal clients and stakeholders.
• A curious, delivery-focused mindset with a strong commitment to quality, innovation, and continuous improvement.
• Hands-on problem-solving ability and a practical approach to getting things working reliably.
• Contributions to open-source software or an active GitHub profile would be an advantage.

Job Responsibilities

Key Responsibilities

• Lead a small team of data engineers responsible for a specific business domain within the data platform.
• Own the design, development, and ongoing maintenance of scalable data pipelines that support new and existing data products.
• Work closely with internal stakeholders to understand data requirements, translate needs into technical solutions, and communicate delivery plans clearly.
• Ensure data quality, consistency, and reliability through the use of modern testing, validation, and monitoring tools.
• Design and implement new pipelines using best-in-class tools such as Airflow, dbt, and Snowflake.
• Contribute to the development of scalable cloud infrastructure on Azure, including infrastructure as code using Terraform.
• Promote engineering best practices, including clean code, maintainability, testing, and strong documentation.
• Support continuous improvement across the team by identifying opportunities to improve delivery, reliability, and operational efficiency.
• Stay current with emerging data engineering tools, techniques, and approaches, bringing fresh ideas and a continuous improvement mindset.
• Encourage a collaborative, delivery-focused team culture that values quality, innovation, and accountability.

Job Benefits

What We Offer

• Competitive salary and flexible benefits package.
• Opportunities for professional growth and development as part of a global company.
• A collaborative and supportive work environment.
• The chance to work with industry-leading experts and over a diverse range of topics and projects.