Lead Data Engineer

Kinetic Investments; London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A dynamic investment firm in London is seeking a Lead Data Engineer to modernize their data infrastructure with a focus on AWS cloud technologies. The role involves leading teams, delivering data solutions, and ensuring compliance with governance policies. This opportunity offers a hybrid work model, allowing flexibility in your work approach while focusing on innovation and collaboration.

Benefits

Hybrid work model

Focus on personal growth and self-organization

Qualifications

• Strong data engineering background with experience in AWS cloud solutions.
• Leadership experience in technical projects and teams.
• Excellent communication skills with the ability to influence decision-making.

Responsibilities

• Design, develop, test, and support data-driven solutions.
• Lead technical planning and deliver high-quality data products.
• Establish development best practices and mentor team members.

Skills

Data engineering

AWS cloud data lakes

BI tools (Power BI, AWS Quicksight)

Software development best practices

Automation and CI/CD pipelines

Tools

AWS (S3, Redshift, Lambda)

Open-source data-stack tools (Airflow, DBT, Airbyte)

Job description

The role

We are looking for a Lead Data Engineer to modernise our Corporate – Player Sustainability, Finance, Legal, and Regulatory data infrastructure, focusing on cloud technologies, next-generation data warehousing, and Self-Serve Analytics.

This role requires expertise in working with data warehouse platforms, managing data pipelines, and delivering end-to-end data engineering projects. You will work closely with cross-functional teams, designing and implementing scalable cloud solutions that seamlessly integrate and optimise business operations.

What you will do

• Design, develop, test, and support data-driven solutions while providing technical and design expertise.
• Lead and contribute to technical planning, requirements gathering, and the delivery of high-quality data products.
• Establish and enforce development best practices, mentor team members, and drive data governance policies.
• Solve complex architectural challenges by working collaboratively with architects and developing solutions that span multiple teams and business domains.
• Stay current with emerging technologies and industry trends to keep our data infrastructure cutting-edge.
• Innovate in automation testing methods and tools to enhance data platform quality.
• Support and maintain data products, including on-call support, incident management, and long-term performance measurement.
• Build strong relationships with your team and stakeholders, working in an Agile environment with open communication.
• Act as a consultant for new data projects and initiatives, collaborating across technical teams and architects.
• Support Engineering Managers by identifying skill gaps, upskilling team members, and developing training materials.
• Conduct proof of concept (POC) evaluations of tools and technologies, presenting findings to leadership.
• Adhere to Governance, Risk & Compliance (GRC) obligations, promptly raising any non-compliance incidents.
• Challenge processes, policies, and projects that may impact compliance negatively.
• Complete all mandatory compliance training and consult with Compliance Teams when needed.

Your experience

• Strong data engineering background with experience in designing and building AWS cloud data lakes, data pipelines, data warehouses, and self-service solutions.
• Experience delivering large-scale transformation projects focused on end-to-end data architecture.
• Extensive experience with AWS services (S3, Redshift, Lambda) including data storage, computation, and security.
• Experience with BI tools such as Power BI and AWS Quicksight.
• Familiarity with open-source data-stack tools (Airflow, DBT, Airbyte).
• Good understanding of software development best practices, CI/CD pipelines.
• Experience in performance tuning and optimization.
• Strong automation, testing, and CI/CD pipeline skills in data engineering.
• Excellent communication skills and the ability to influence decision-making across teams and stakeholders.
• Previous leadership experience in technical projects, with a track record of leading teams effectively.

Our Way Of Working

Our world is hybrid.

A career is not a sprint. It’s a marathon. One of the perks of joining us is that we value you as a person first. Our hybrid model allows you to focus on your goals and responsibilities, self-organise, and improve your deliveries in your own way.