Data Engineer

Leonard Curtis Ltd

United Kingdom

Hybrid

GBP 60,000 - 90,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

27 days holiday
Birthday leave
Giving back days
Professional working environment
Enhanced family policies

Job summary

Leonard Curtis Ltd. is seeking a Data Engineer to design and optimise robust data pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows. You will deliver clean, production-ready data for enterprise analytics and support real-time Power BI reporting.

The role requires strong PySpark, Databricks SQL, T-SQL, and Delta Lake expertise with hands-on Databricks and Fabric experience. A UK-based, enterprise-scale environment offers challenging projects and growth opportunities.

Qualifications

  • Proficient in PySpark, Databricks SQL, and T-SQL with Delta Lake formats.
  • Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities.
  • Experience with Parquet, JSON, and CSV data formats is essential.
  • Familiarity with orchestration tools, scheduling dependencies, and error handling in cloud environments.
  • Experience with data quality checks and unit testing of data pipelines.

Responsibilities

  • Construct scalable data ingestion pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows.
  • Implement Delta Live Tables to automate batch and real-time data processing.
  • Build and maintain the Medallion Architecture silver & gold layers across shared storage.
  • Write optimized transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL.
  • Configure data access, masking, and governance within Unity Catalog.
  • Optimize Lakehouse table performance with Z-Order indexing and clustering techniques.
  • Deploy data pipelines using CI/CD, Git integration, and Databricks Asset Bundles (DABs).
  • Prepare finalized gold layer datasets to support real-time Power BI Direct Lake reporting.

Skills

PySpark
Databricks SQL
T-SQL
Delta Lake
Fabric Data Factory
Dataflow Gen2
Databricks Workflows
Notebooks/SQL optimization

Tools

Databricks
Fabric
Datas Fabric Notebooks
CI/CD / Git integration
Databricks Unity Catalog

Job description

We're currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics.

Job Requirements
  • Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats.
  • Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities.
  • Practical knowledge of structural data formats including Parquet, JSON, and CSV.
  • Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment.
  • Familiarity with unit testing data pipelines and implementing automated data quality checks.
Job Responsibilities
  • Construct scalable data ingestion pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows.
  • Implement Delta Live Tables (DLT) to automate batch and real-time streaming data processing.
  • Build and maintain the Medallion Architecture silver & gold layer across shared storage.
  • Write optimized transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL.
  • Configure data access, masking, and governance policies within Databricks Unity Catalog.
  • Optimize Lakehouse table performance using Z-Order indexing, liquid clustering, and file compaction techniques.
  • Deploy data pipelines using CI/CD frameworks, Git integration, and Databricks Asset Bundles (DABs).
  • Prepare finalized gold layer datasets to support real-time Power BI Direct Lake reporting model.
  • Salary aligned with your skills and expertise
  • 27 days holiday allowance plus statutory public holidays and the option to purchase more
  • Birthday leave
  • 2 giving back days per year. We encourage our team to support the wider community by providing paid leave to work with local charities or good causes
  • A hard working, fun and professional working environment
  • Enhanced family friendly policies, including enhanced Maternity pay

Leonard Curtis is a market leading professional services provider operating across the UK and offshore. Since our formation we’ve supported business owners and advisors by listening and offering practical solutions and tailored advice. Our expert team of specialists deliver positive strategic advice across restructuring and insolvency, funding, legal, business services and M&A advisory across 30 offices. A career with Leonard Curtis will open the door to varied career pathways.

We have built an environment that empowers you to express yourself to have confidence in who you are and what you’re capable of and develop the career you want.

Learning and Development

Leonard Curtis has a wealth of resources available to help you develop your career from the moment you join. Activities range from on-line learning modules to external training and qualifications.

Diversity and Inclusion

Diversity is a core business imperative of the Group. We are an equal opportunities employer which promotes inclusiveness and always employ the best professional for the job. Having a diverse workforce allows the Group to draw upon a range of different ideas and experiences which supports our business’s growth and creates an environment where everyone has an equal opportunity for success.

Express yourself

Be yourself every day, in everything you do. Have confidence in what you’re capable of and what you bring to the team.

Be the difference

Care about the work you do and the people we do it for. Treat people with compassion and strive to get the best outcomes.

Inspire each other

Bring positivity to your work and your working relationships. Collaborate with an open mind and a commitment to achieve great things together.

LCBSG Limited Registered in England No. 09209265. Registered office: Leonard Curtis House, Elms Square, Bury New Road, Whitefield, M45 7TA
Leonard Curtis is a trading style of Reach Commercial Finance Limited, registered at Leonard Curtis House, Elms Square, Bury New Road, Whitefield, M45 7TA. Company Register number is 09056450. Reach Commercial Finance Limited is authorised and regulated by the Financial Conduct Authority, FRN: 753686. Reach Commercial Finance Limited is an authorised credit broker and not a lender. We work with an unrestricted number of lenders to find a potentially suitable arrangement for your consideration. ICO registration ZA069234 and you can check via www.ico.org.uk. We will receive commission from lenders. Different lenders pay different amounts depending on different commission models. Fixed fee, fixed rate of commission, percentage of the amount you borrow and rate for risk (this is based on the risk profile of the business). Further details of the commission model, calculation and amount will be disclosed to you throughout your customer journey. Privacy notice .
Leonard Curtis Legal Limited is a limited company, registered in England and Wales with registered number 09820186. Registered office: Leonard Curtis House, Elms Square, Bury New Road, Whitefield, M45 7TA. Leonard Curtis Legal Limited is registered with the Solicitors Regulation Authority with number 626004.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Warehouse Architect
Data Warehouse Architect

Leonard Curtis Ltd • Manchester

On-site
GBP 90,000 - 120,000
27 days holiday
Birthday leave
Giving back days
+2
Business Advisory Manager - National
Business Advisory Manager - National

Leonard Curtis Ltd • South Kiscadale

Remote
GBP 60,000 - 90,000
Birthday leave
25 days holiday
2 giving back days per year
+2
Receptionist
Receptionist

Leonard Curtis Ltd • Salford

On-site
GBP 21,000 - 28,000
25 days holiday
Public holidays
LTIP
+4
Lifecycle Business Development Manager - South Coast
Lifecycle Business Development Manager - South Coast

Leonard Curtis Ltd • South Kiscadale

On-site
GBP 70,000 - 95,000
27 days holiday
Birthday leave
Giving back days
+2
Assistant Manager - Insolvency
Assistant Manager - Insolvency

Leonard Curtis Ltd • Birmingham

On-site
GBP 40,000 - 56,000
25 days holiday
Birthday leave
Giving back days
+1
L&D Manager
L&D Manager

Leonard Curtis Ltd • United Kingdom

Hybrid
GBP 42,000 - 64,000
27 days holiday
Birthday leave
Giving back days
+1
Corporate Senior Associate/Associate Director
Corporate Senior Associate/Associate Director

Leonard Curtis Ltd • Manchester

Hybrid
GBP 75,000 - 110,000
27 days holiday
Private medical insurance
Birthday leave
+2
Restructuring and Insolvency Assistant Manager
Restructuring and Insolvency Assistant Manager

Leonard Curtis Ltd • Manchester

Hybrid
GBP 55,000 - 75,000
Birthday leave
Giving back days
Flexible benefit schemes
+2
Junior Insolvency Administrator
Junior Insolvency Administrator

Leonard Curtis • Fareham

Hybrid
GBP 25,000 - 35,000
25 days holiday allowance
Birthday leave
2 giving back days
+1
Lead Data Platform Engineer
Lead Data Platform Engineer

CF • Greater London

Hybrid
GBP 90,000 - 130,000
Holiday entitlement 25 days
Employer pension 7%
Flexible benefits programme
+8