Data Engineer

Harnham; City Of London; On-site; GBP 120,000 - 180,000; Full time

Job summary

A rapid growth investment firm based in London is seeking a Data Engineer for a 6-month contract. You will play a pivotal role in designing robust data pipelines, migrating systems to Databricks, and enhancing the firm's data capabilities. This hybrid role offers the chance to work with a skilled team focused on advanced analytics and AI integration.

Qualifications

• Strong experience with Azure and Databricks environments.
• Advanced Python skills for data engineering (pandas, PySpark).
• Proficiency in designing and maintaining ETL pipelines.

Responsibilities

• Develop and maintain ETL pipelines, including manual and semi-manual data loads.
• Support data migration efforts from Azure to Databricks.
• Collaborate with analytics and design teams to create bespoke data solutions.

Skills

Azure

Databricks

Python

ETL pipelines

Terraform

cloud migration

problem-solving

Job description

Harnham City Of London, England, United Kingdom

Harnham City Of London, England, United Kingdom

Get AI-powered advice on this job and more exclusive features.

This range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

DATA ENGINEER - INVESTMENT FIRM

6-MONTH CONTRACT

£600 PER DAY INSIDE IR35

HYBRID

ABOUT THE COMPANY

A rapidly growing investment firm headquartered in London, which has doubled its team over the past 2.5 years and continues to attract strong investor backing. With 230+ employees and ongoing expansion, the company is now focused on becoming more AI- and data-enabled, modernising its infrastructure to support more advanced analytics and automation.

THE TEAM

You'll join a skilled and collaborative analytics team of eight, working closely with senior leadership. The team has already laid the foundations for a modern data platform using Azure and Databricks and is now focused on building out scalable ETL processes, integrating AI tools, and delivering bespoke analytics solutions across the organisation.

THE ROLE

As a Data Engineer, you'll play a pivotal role in designing and implementing robust data pipelines, supporting the migration from legacy Azure systems to Databricks, and working closely with stakeholders to deliver tailored data solutions. This role combines hands-on development with collaborative architecture design, and offers the opportunity to contribute to AI readiness within a fast-paced business.

KEY RESPONSIBILITIES

• Develop and maintain ETL pipelines, including manual and semi-manual data loads

• Connect and integrate diverse data sources across cloud platforms

• Collaborate with analytics and design teams to create bespoke, scalable data solutions

• Support data migration efforts from Azure to Databricks

• Use Terraform to manage and deploy cloud infrastructure

• Build robust data workflows in Python (e.g., pandas, PySpark)

• Ensure the platform is scalable, efficient, and ready for future AI use cases
  
  

REQUIRED SKILLS & EXPERIENCE

• Strong experience with Azure and Databricks environments

• Advanced Python skills for data engineering (pandas, PySpark)

• Proficiency in designing and maintaining ETL pipelines

• Experience with Terraform for infrastructure automation

• Track record of working on cloud migration projects, especially Azure to Databricks

• Comfortable working onsite in London 2 days/week and engaging cross-functionally

• Strong communication and problem-solving abilities
  
  

NICE TO HAVES

• Experience with Qlik or other data visualisation tools

• Exposure to AI product integration or readiness projects

Seniority level

• Seniority level

  Entry level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  Data Infrastructure and Analytics

Referrals increase your chances of interviewing at Harnham by 2x

Sign in to set job alerts for “Data Engineer” roles.

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 3 days ago

London, England, United Kingdom 4 weeks ago

London, England, United Kingdom 2 months ago

London, England, United Kingdom 3 weeks ago

Staines-Upon-Thames, England, United Kingdom 4 days ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 year ago

Graduate Software Engineer 2025 - RegTech

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 5 months ago

London, England, United Kingdom 1 month ago

London Area, United Kingdom £35,000.00-£40,000.00 1 month ago

London, England, United Kingdom 7 months ago

London, England, United Kingdom 2 weeks ago

Graduate Software Engineer 2025 - RegTech

London, England, United Kingdom 1 week ago

Newsroom Front-End Developer (12 Month FTC/Secondment)

Isleworth, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 6 months ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 years ago

London, England, United Kingdom 2 days ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.