Lead Data Engineer

LGBT Great

United Kingdom

Remote

GBP 75,000 - 85,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote UK
Competitive salary 75k–85k
Comprehensive benefits package

Job summary

LGBT Great is seeking a Lead Data Engineer to own and shape the data engineering capability. This hands‑on technical leadership role focuses on scalable cloud data platforms and production pipelines across Databricks, Snowflake, dbt and Airflow.

You will mentor engineers, collaborate with stakeholders, and drive architectural decisions while delivering robust data solutions for reporting and analytics.

Qualifications

  • 5+ years' commercial experience in Data Engineering or closely related role.
  • Proven experience providing technical leadership to Data Engineers within a modern data environment.
  • Strong SQL skills, including writing, optimising and troubleshooting complex queries.
  • Strong Python skills for data engineering and production data pipelines.
  • Hands‑on experience with Databricks in production environments.
  • Experience with dbt development and transformation models.
  • Experience with data orchestration tools (Airflow / Azure Data Factory).
  • Experience with Snowflake, ideally alongside Databricks and dbt.
  • Understanding of ETL/ELT, data modelling, warehousing and data quality.

Responsibilities

  • Lead design, development and optimisation of scalable data pipelines and cloud data platforms.
  • Own data engineering solutions and contribute to platform strategy.
  • Work hands-on with Databricks and Snowflake to build production data solutions.
  • Develop and maintain data transformation frameworks using dbt.
  • Design and manage data orchestration workflows (Airflow, Azure Data Factory).
  • Write and optimise complex SQL for reliable, scalable data solutions.
  • Drive improvements in data quality, performance and standards.
  • Make architectural decisions around data platforms, pipelines and tooling.
  • Lead data engineering projects from requirements to deployment and optimisation.
  • Provide technical leadership and mentoring to other Data Engineers.
  • Collaborate with stakeholders to translate requirements into data solutions.
  • Identify opportunities to improve automation and scalability.

Skills

SQL
Python
Databricks
Snowflake
dbt
Airflow
Azure Data Factory
Data modelling
ETL/ELT
Data pipelines
Data quality
Technical leadership

Tools

Databricks
Snowflake
dbt
Airflow
Azure Data Factory

Job description

Lead Data Engineer

Location: Fully Remote (UK)

Salary: 75,000 - 85,000

Contract: Permanent, Full-Time


We're partnering with an established UK organisation to appoint a Lead Data Engineer as part of the continued development of its data engineering capability.

This is a hands-on technical leadership role for an experienced Data Engineer who wants genuine ownership of modern data engineering solutions. You'll play a key role in shaping technical direction, improving engineering standards and designing scalable data platforms and pipelines that support reporting, analytics and wider business requirements.

The role is genuinely hands-on, so we're looking for someone with strong commercial production experience across technologies including Databricks, Snowflake, dbt, Airflow, Python and SQL.

You’ll work closely with technical and non-technical stakeholders, provide technical leadership and mentoring to other engineers, and remain heavily involved in the technology and delivery.


Key Responsibilities
  • Lead the design, development and optimisation of scalable data pipelines and cloud-based data platforms
  • Take technical ownership of data engineering solutions and contribute to longer-term platform strategy
  • Work hands-on with Databricks and Snowflake to build, optimise and maintain production data solutions
  • Develop and maintain robust data transformation frameworks using dbt
  • Design and manage data orchestration workflows using Apache Airflow, Azure Data Factory or similar
  • Write, optimise and troubleshoot complex SQL, ensuring data solutions are efficient, reliable and scalable
  • Drive improvements in data quality, performance, monitoring and engineering standards
  • Make informed technical and architectural decisions around data platforms, pipelines and tooling
  • Lead data engineering projects from initial requirements through to deployment and ongoing optimisation
  • Provide technical leadership, mentoring and guidance to other Data Engineers
  • Work closely with business and technical stakeholders to translate requirements into effective data solutions
  • Identify opportunities to improve automation, scalability and the overall data engineering approach

Required Experience
  • 5+ years' commercial experience within Data Engineering or a closely related role
  • Proven experience providing technical leadership to Data Engineers within a modern data environment
  • Strong, confident SQL skills, including writing, optimising and troubleshooting complex queries
  • Strong Python skills for data engineering and production data pipelines
  • Significant hands‑on commercial experience with Databricks in a production environment
  • Strong hands‑on experience with dbt, including developing and maintaining transformation models and frameworks
  • Proven experience with data orchestration tools such as Apache Airflow, Azure Data Factory or equivalent
  • Strong experience with Snowflake, ideally alongside Databricks and dbt
  • Strong understanding of modern ETL/ELT, data modelling, data warehousing and data quality principles
  • Experience designing, building and maintaining scalable cloud-based data platforms and pipelines
  • Experience contributing to data architecture and technical design decisions
  • Strong understanding of Data Engineering best practice, with the ability to establish standards and improve existing approaches
  • Experience working across a modern data stack including Databricks, Snowflake, dbt, Airflow, Python and SQL
  • Excellent problem‑solving, communication and stakeholder management skills

What's on Offer
  • Fully remote working within the UK
  • 75,000 - 85,000 salary
  • Comprehensive benefits package
  • Genuine ownership of data engineering architecture and delivery
  • Opportunity to influence technical direction and engineering standards
  • Exposure to modern cloud technologies and complex data projects
  • Flexible working environment
  • Excellent opportunities for professional development and progression

This is an excellent opportunity for an experienced Lead Data Engineer who wants to combine hands‑on engineering with genuine technical leadership. You'll have the opportunity to influence architecture, establish best practice and take real ownership of data engineering solutions while remaining close to the technology.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Station • United Kingdom

Remote
GBP 90,000 - 120,000
Fully UK remote
Ownership of data architecture
Professional development opportunities
Lead Data Engineer
Lead Data Engineer

Tria • City Of London

Hybrid
GBP 86,000 - 105,000
Bonus
Excellent benefits
Lead Data Engineer
Lead Data Engineer

TRIA • Greater London

Hybrid
GBP 86,000 - 105,000
Bonus
Excellent Benefits
Lead Data Engineer
Lead Data Engineer

Xcede • England

Hybrid
GBP 90,000 - 130,000
Flexible hybrid working approach
Opportunity for leadership responsibilities with technical delivery
Influence over next-generation data and AI capabilities
Lead Data Engineer - London
Lead Data Engineer - London

Datatech Analytics • City Of London

Hybrid
GBP 85,000 - 95,000
Data Engineering Lead
Data Engineering Lead

Artis Recruitment • West of England

Hybrid
GBP 77,000 - 94,000
Hybrid working
Excellent career development
Healthcare and wellbeing
+2
Lead Data Engineer
Lead Data Engineer

Royal Bank of Scotland • Greater London

Hybrid
GBP 90,000 - 130,000
Hybrid work
London office
Lead Data Engineer
Lead Data Engineer

Anson McCade Pty • Greater London

On-site
GBP 110,000 - 150,000
Data Engineering Lead
Data Engineering Lead

Tria • Greater London

On-site
GBP 70,000 - 86,000
Benefits
Lead Data Engineer - Remote UK, Own Technical Direction
Lead Data Engineer - Remote UK, Own Technical Direction

Station • United Kingdom

Remote
GBP 90,000 - 120,000
Fully UK remote
Ownership of data architecture
Professional development opportunities