Lead Data Engineer

TN United Kingdom; United Kingdom; Remote; GBP 60,000 - 100,000; Full time

Job summary

Join a forward-thinking company as a Lead Data Engineer and take charge of transforming the data landscape. This dynamic role involves providing technical leadership, mentoring a talented team, and optimizing cloud-based data solutions. You’ll be at the forefront of innovation, leveraging your expertise in data architecture and big data technologies to drive impactful projects. With a focus on collaboration and continuous improvement, you’ll inspire your team to achieve technical excellence while enjoying a supportive environment that values your contributions. If you’re ready to make a significant impact, this is the opportunity for you.

Benefits

Generous Holiday Allowance

Annual Lifestyle Allowance

Pension Scheme

Private Health Insurance

Group Income Protection Scheme

Charitable Fundraising

Cycle to Work Scheme

Internal Coaching and Mentoring

Training and Career Progression

Free Parking

Qualifications

• Hands-on experience in data engineering with leadership skills.
• Proven track record of leading complex data initiatives.
• Expertise in data technologies and transformation tools.

Responsibilities

• Lead the design and optimization of data software and infrastructure.
• Guide a team of data engineers to deliver innovative solutions.
• Own the technical roadmap and align engineering efforts with business goals.

Skills

Data Engineering

Cloud Technologies

ETL Pipelines

Big Data Solutions

Programming Languages (Spark, Java, Python)

Analytical Skills

Problem-Solving

Communication Skills

Education

Degree in Computer Science

Degree in Software Engineering

Tools

AWS

Azure

Hadoop

Spark

Kafka

Azure Data Fabric (ADF)

Databricks

Job description

Social network you want to login/join with:

Are you ready to make a significant impact on the future of data and engineering? We have an excitingLead position in our Data Engineering team, perfect for experienced, hands-on professionals in leading and innovating. As a 100% data-driven company, we pride ourselves on employing the best engineering practices across our products and solutions.

As direct report to the Head of Data Engineering, you will play a crucial role in driving the team’s vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions.

This is an exciting opportunity for highly skilled and motivated Senior Lead Data Engineers with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions who are looking to keep crafting their technical leadership responsibilities and shape the future of data engineering within our organisation.

In this role, you will:

• Technical Leadership: Assist the Head of Data Engineering in overseeing the design, development, and optimisation of data software, data infrastructure and pipelines.
• Team Technical Leadership: Guide a team of talented data engineers to deliver cutting-edge solutions, mentor and coach them, ensuring that best practices in data engineering and software development are followed. Lead by example. Be hands-on.
• Lead by Example: We value leaders with exceptional technical expertise and hands-on coding skills. As a Senior Lead, you’ll set the standard by being directly involved and actively contributing to technical challenges. Be ready to roll up your sleeves when necessary and engage in real, impactful work alongside the team.
• Data Strategy & Solutions: Own the technical roadmap, aligning engineering efforts with broader business goals and ensuring timely delivery, quality control, and that architectural decisions are forward-thinking and scalable. Inspire the team by providing a clear vision for technical excellence and innovation in the data engineering strategy.
• Cloud: Optimise cloud-based data solutions, storage and processing systems, with hands-on experience in AWS or Azure.
• Technical Excellence: Lead the pursuit of technical excellence by championing best practices in coding, architecture, and performance. Foster a team culture focused on continuous improvement, where learning is encouraged.
• Leverage Big Data Technologies: Utilise tools such as Hadoop, Spark, and Kafka to design and manage large-scale on-prem data processing systems.
• Collaboration: Collaborate with cross-functional teams and stakeholders to deliver high-impact solutions that align with business objectives.
• Assemble Large, Complex Data Sets: Craft and manage data sets that meet both functional and non-functional business requirements.
• Monitoring & Troubleshooting: Ensure data quality, integrity, and availability by developing systems and solutions to monitor performance, quality and troubleshoot issues as they arise.
• Build Advanced Data Solutions: Develop the software and infrastructure for optimal data extraction, transformation, and loading using leading cloud technologies like Azure and AWS or Big Data ones.
• Ensure Cost Efficiency: Keep the Data Lakes and Data solutions within agreed cost models and budgets.
• Data Engineering Empowerment: Empower a high-performing engineering team to deliver innovative software while fostering a collaborative environment where ideas are valued. Act as a mentor, helping team members overcome technical challenges and grow in their roles.

About You

TheLead Data Engineer will be a passionate leader with hands-on seniority in engineer with the ability to inspire, mentor, and bring a team along on the journey. The ideal candidate will possess:

• Depth of Expertise: seasoned hands-on experience in data engineering, with extensive experience in a leadership or mentoring role. Demonstrated track record of leading complex data engineering initiatives at scale. Extensive experience in designing, implementing, and optimizing data solutions, supported by a history of successfully managing technical teams and projects.
• Exceptional coding skills.
• Degree in Computer Science, Software Engineering, or similar (applied to Data. Data Specialisation).
• Extensive experience in data engineering, in both Cloud & On-prem Big Data and Data Lake environments
• Expert knowledge in data technologies, data transformation tools, data governance techniques.
• Strong analytical and problem-solving abilities.
• Good understanding of Quality and Information Security principles.
• Effective communication, ability to explain technical concepts to a range of audiences
• Able to provide coaching and training to less experienced members of the team
• Essential skills:
• Programming Languages such as Spark, Java, Python, PySpark, Scala, etc (minimum 2)
• Extensive Big Data hands-on experience (coding/configuration/automation/monitoring/security/etc) is a must
• Significant AWS or Azure hands-on experience (coding/configuration/automation/monitoring/security)
• ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones
• Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse
• Certifications AWS, Azure, or Cloudera certifications are a plus.
• Nice to have skills:
• Advanced Database and SQL skills
• SQL or Data warehousing design patterns and implementation

Join us and lead the charge in transforming the data landscape at Landmark, while advancing your career in a dynamic and forward-thinking environment.

What it's like to work at Landmark:

At Landmark, you'll find a friendly, dynamic, and supportive team that values bold ideas, big dreams, and active curiosity. We foster a culture of innovation, encouraging everyone to contribute to the development and direction of our products and services, while continuously seeking new and efficient ways to work.

Collaboration and sociability are at the heart of what we do, and we take pride in coming together to achieve great things.

We offer a range of benefits to support your well-being and career growth, including:

• Generous Holiday Allowance: 25 days' holiday plus bank holidays, with the option of adding up to 5 additional unpaid leave days per year
• Annual Lifestyle Allowance: £300 to spend on an activity of your choice
• Pension Scheme: Matched up to 6% for the first 3 years, and up to 10% thereafter
• Private Health Insurance: Provided by Vitality
• Group Income Protection Scheme
• Charitable Fundraising: Matched funding for your efforts
• Cycle to Work and Gym Flex Schemes
• Internal Coaching and Mentoring: Available throughout your time with us
• Training and Career Progression: A strong focus on your development
• Family-Friendly Policies
• Free Parking

Join us at Landmark and be part of a team that supports your ambitions and growth, both personally and professionally.