Principal Data Engineering Consultant

iO Associates; City Of London; Remote; GBP 80,000 - 100,000; Part time

Job summary

A technology consulting firm in London is seeking a contract Principal Data Engineering Consultant to lead the delivery of data solutions leveraging Azure and Databricks in an agile environment. The ideal candidate must have strong technical expertise and client-facing experience. This remote role also requires occasional travel to client sites and is outside of IR35.

Qualifications

• Strong technical expertise in data engineering.
• Experience with Databricks in a client-facing role.
• Ability to lead delivery of data solutions in agile environments.

Responsibilities

• Implement modern data solutions leveraging Azure and Databricks.
• Engage with stakeholders to gather requirements.
• Ensure agile delivery across multiple projects.

Skills

Azure

Databricks

Apache Spark

Python

SQL

Unity Catalog/Purview

Terraform

Azure DevOps

Tools

Power BI

Tableau

Azure Functions (Python/C#)

CI/CD

Job description

Principal Data Engineering Consultant

We are seeking a contract Principal Data Consultant with strong technical expertise, in particular with Databricks experience and client-facing experience. The ideal candidate will lead the delivery of modern data solutions across multiple projects, leveraging Azure and Databricks technologies in an agile environment.

Core Requirements

• Cloud & Data Engineering: Azure, Databricks, Apache Spark, Azure Data Factory, Delta Lake
• Programming & Querying: Python, SQL (complex, high-performance queries)
• Data Governance & DevOps: Unity Catalog/Purview, Terraform, Azure DevOps
• Consulting: Requirements gathering, stakeholder engagement, agile delivery

Desirable Experience

• Power BI / Tableau
• Azure Functions (Python/C#)
• Streaming (Event Hubs, Stream Analytics)
• CI/CD, SDLC, ETL best practices

Please only apply if you have full right to work in the UK. This is remote with occasional travel as required to client sites and falls outside of IR35.