Freelance Azure Data Engineer - Freelance

Collective Work; Greater London; On-site; GBP 111,000 - 175,000; Full time

Job summary

Collective.work is seeking a freelance Data Engineer in London to design, build and maintain scalable data pipelines for large-scale ingestion and enrichment. You will develop and optimise data infrastructure within the Azure ecosystem, improving data quality and performance.

The role requires hands-on experience with Azure Data Factory, Databricks, PySpark, and Azure Data Lake Storage, plus strong SQL and Python skills. Start date ASAP; day rate to be agreed, on-site in London.

Qualifications

• Strong experience in data engineering and production-grade ETL/ELT pipelines.
• Hands-on expertise with Microsoft Azure data services.
• Excellent SQL skills and experience with Python.
• Experience processing large datasets and optimising data workflows.
• Autonomy, problem-solving mindset, and ability to deliver in a fast-moving environment.

Responsibilities

• Design, build, and maintain scalable data pipelines for large-scale data ingestion, transformation, and enrichment.
• Develop and optimise data infrastructure within the Microsoft Azure ecosystem.
• Improve data quality, reliability, and processing performance.
• Make high-quality data accessible to AI agents and product features.
• Collaborate with engineering and product teams to deliver robust, production-ready solutions.

Skills

Data engineering

ETL/ELT pipelines

SQL

Python

Azure data services

Autonomy

Education

Bachelor's degree in a related field

Tools

Azure Data Factory

Databricks

PySpark

Azure Data Lake Storage

SQL

Job description

Job description

Context

Collective.work is building the next generation of AI-powered recruitment. The company supports over 20,000 recruiters and headhunters across France, Belgium, Spain, and EMEA, and is expanding its product and distribution in the UK. Their platform combines a suite of AI agents — from sourcing and outreach to job posting and ATS integrations — with a database of 800M+ professional profiles and a network of 1M+ active candidates.

Missions

• Design, build, and maintain scalable data pipelines for large-scale data ingestion, transformation, and enrichment.
• Develop and optimise data infrastructure within the Microsoft Azure ecosystem.
• Improve data quality, reliability, and processing performance.
• Make high-quality data accessible to AI agents and product features.
• Collaborate with engineering and product teams to deliver robust, production-ready solutions.

Tools & Environment

• Microsoft Azure data services
• Azure Data Factory
• Databricks
• PySpark
• Azure Data Lake Storage
• SQL
• Python

Working Conditions

• Location: London, UK
• Type: Freelance / Contract
• Start date: ASAP
• Duration and day rate: To be agreed

Requirements

1. Strong experience in data engineering and production-grade ETL/ELT pipelines
2. Hands-on expertise with Microsoft Azure data services
3. Excellent SQL skills and experience with Python
4. Experience processing large datasets and optimising data workflows
5. Autonomy, a problem-solving mindset, and the ability to deliver in a fast-moving environment
6. Experience with Azure Data Factory, Databricks, PySpark, and Azure Data Lake Storage is a plus