Azure Data Engineer - Gen AI

Square One Resources Limited; London; On-site; NOK 893,000 - 1,403,000; Full time

Job summary

Square One Resources Limited in London is seeking an experienced Azure AI Data Engineer to lead the design and delivery of Azure-native data platforms and AI-ready pipelines.

You will build scalable pipelines with ADF, Synapse, and Fabric, manage data across lakehouse architectures, and transform data into actionable insights for AI use cases such as RAG and vector search, collaborating with business stakeholders throughout the project lifecycle.

Qualifications

• Strong experience as an Azure Data Engineer.
• Hands-on with ADF, Synapse, Fabric and ADLS Gen2.
• Experience with Cosmos DB and NoSQL data modelling.
• Exposure to AI/GenAI data pipelines (RAG, embeddings, vector search).
• Strong Python and SQL development skills.
• Experience with data profiling and data quality frameworks.
• Knowledge of CI/CD and Azure DevOps practices.

Responsibilities

• Design and build scalable Azure data pipelines using ADF, Synapse and Fabric.
• Develop Lakehouse architectures and AI-ready data platforms.
• Engineer solutions for structured, semi-structured and unstructured data.
• Work with Azure Data Lake, Cosmos DB and Azure SQL/Synapse.
• Support AI use cases including RAG, vector search and Azure AI Search.
• Collaborate with stakeholders to translate requirements into data solutions.
• Deliver production-ready, high-performance data engineering solutions.

Skills

Python

SQL

Data modeling

Data quality

CI/CD

DevOps practices

Stakeholder collaboration

Tools

ADF

Synapse

Microsoft Fabric

ADLS Gen2

Cosmos DB

AI pipelines

Job description

Job Title: Azure AI Data Engineer Location: London 1x a week Start Date: October - Initial 6 month contract Job Type: Contract - Inside IR35

We are seeking an experienced Azure AI Data Engineer to support the delivery of cutting-edge AI, data and analytics solutions within a large-scale digital transformation programme.

This hands-on role will focus on designing and building Azure-native data platforms, developing AI-ready data pipelines, and transforming structured and unstructured data into high-value business insights.

Key responsibilities

• Design and build scalable Azure data pipelines using ADF, Synapse and Microsoft Fabric
• Develop modern Lakehouse architectures and AI-ready data platforms
• Engineer solutions for structured, semi-structured and unstructured data
• Work with Azure Data Lake, Cosmos DB and Azure SQL/Synapse
• Support AI use cases including RAG, vector search and Azure AI Search
• Collaborate with business stakeholders to translate requirements into data solutions
• Deliver production-ready, high-performance data engineering solutions

Key experience required

• Strong experience as an Azure Data Engineer
• Hands-on expertise with ADF, Synapse, Microsoft Fabric and ADLS Gen2
• Experience with Azure Cosmos DB and NoSQL data modelling
• Exposure to AI/GenAI data pipelines, including RAG, embeddings or vector search
• Strong Python and SQL development skills
• Experience with data discovery, profiling and data quality frameworks
• Knowledge of CI/CD and Azure DevOps practices

Disclaimer Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement