Principal Data Engineer - Azure Databricks (Unity Catalog) - Contract

Datatech; Cwmsyfiog; Hybrid; GBP 100,000 - 125,000; Full time

Job summary

A leading analytics firm in the UK is seeking a Principal Data Engineer to design and implement data pipelines using Azure Databricks, responsible for deploying AI models and mentoring teams. The ideal candidate will have experience with ELT workflows, Python, and strong collaboration skills in a hybrid working environment.

Benefits

Gift/voucher scheme

Participation in Women in Data UK event

Qualifications

• Essential experience with Azure Databricks and Unity Catalog.
• Practical knowledge of ELT workflows focusing on Extract and Load stages.
• Experience working with both technical and non-technical teams.

Responsibilities

• Build and maintain scalable data pipelines for analytics and AI use cases.
• Lead the deployment of production-ready AI models with monitoring.
• Support development of Python coding standards and best practices.

Skills

Azure Databricks

Python (PySpark preferred)

SQL

Modern ELT workflows

Collaborative problem-solving

Job description

Your shortlisted jobs will appear here. To view your shortlist: Login Or Register

Date Added: YESTERDAY

Principal Data Engineer - Azure Databricks (Unity Catalog) - Contract

Location: Bristol - Hybrid (2 days a week in the office)

Contract Length: 12 Months

Day Rate: Negotiable

Job Ref: J12998

We are a data-driven organization in the early stages of building a modern Analytics and Data Engineering function. We are looking to hire a Principal Data Engineer to support and lead key elements of this transformation.

This is a fantastic opportunity for someone who enjoys building data platforms from scratch, mentoring teams, and deploying cutting-edge solutions in a collaborative environment.

In this role, the successful candidate will be responsible for designing and implementing scalable, reusable data pipelines to support analytics and AI projects. The organization is transitioning to Azure and Databricks, and the Principal Data Engineer will play a crucial role in shaping this platform, upskilling the data team, and embedding best practices across the function. They will also lead the deployment of AI models into production, ensuring monitoring, alerting, and data pipeline reliability for long-term success.

Key Responsibilities:

• Build and maintain scalable data pipelines for analytics and AI use cases.
• Lead the deployment of production-ready AI models with end-to-end monitoring.
• Support the development of Python coding standards and engineering best practices.
• Collaborate closely with IT and data teams to enhance the platform and unlock new capabilities.

Additionally, this role involves improving data governance and quality processes, supporting the development of data models, and fostering a culture of innovation and evidence-led decision-making.

Experience Required:

• Essential experience with Azure Databricks, including Unity Catalog, Python (PySpark preferred), and SQL.
• Practical knowledge of modern ELT workflows, focusing on Extract and Load stages.
• Experience working with both technical and non-technical teams, with the ability to explain complex data concepts clearly.
• Adaptable, collaborative, with a problem-solving mindset and a focus on process improvement.

Note: Candidates must have the right to live and work in the UK; sponsorship is not available.

This high-impact role offers the opportunity to shape a new team, influence long-term data strategy, and deliver tangible outcomes that support the organization. If you're a capable Senior Data Engineer ready for a meaningful challenge, get in touch today.

Feel free to refer a friend or colleague via our referral schemes. For each successful placement, you will be entitled to a gift/voucher scheme.

We are part of one of the UK's leading analytics recruitment agencies and host the Women in Data UK event. For more information, visit our website.