Senior Data Engineer Technology - IT · Putney HQ ·

Clarion Events; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

25 days holiday

Private Medical Insurance

Pension Scheme

Health Cash Plan

Cycle to Work Scheme

Free on-site gym

Season Ticket Loan

Wellbeing Library

Mentoring Programme

End of year wellbeing shutdown

Job summary

Clarion Events is seeking a Senior Data Engineer to design, build, and scale robust data pipelines on the Azure Databricks platform. You will shape data models, governance, and orchestration across APIs, SQL sources, and SaaS feeds, enabling analytics and AI initiatives globally.

You will implement best-practice CI/CD for data, collaborate with analytics teams, and mentor junior engineers while maintaining strong security and production readiness. London-based role with strong engineering focus.

Qualifications

• 5+ years in data engineering across cloud-native environments.
• Expert knowledge of Databricks, Delta Lake, Unity Catalog, ADF, Synapse, Event Hub, and wider Azure Data Services.
• Highly proficient in Python and SQL, with experience building production-grade data pipelines.
• Strong understanding of Lakehouse design patterns, Medallion modelling, and performance optimisation.
• Hands-on experience with CI/CD for data (Azure DevOps, YAML pipelines, Terraform, Databricks CLI/Repos).
• Solid grasp of data governance, security principles, and operational best practices.

Responsibilities

• Design, build, and optimise scalable data pipelines using Databricks, Delta Live Tables, Synapse, and Delta Lake.
• Develop ingestion, transformation, and orchestration workflows across diverse sources (APIs, SQL, SFTP, SaaS platforms).
• Implement strong data quality, lineage, and governance standards aligned to Medallion Architecture (Bronze/Silver/Gold).
• Build and optimise Lakehouse data models to support analytics, reporting, operational workloads, and downstream product teams.
• Develop reusable frameworks for ingestion, validation, schema evolution, and monitoring.
• Ensure all solutions follow Databricks best practices around Unity Catalog, cluster policies, permissions, and environment separation.
• Work with architects to evolve Databricks platform patterns, security, and performance optimisation.
• Implement monitoring, logging, and observability across pipelines and clusters.
• Contribute to standards for versioning, DevOps, CI/CD, and testing for Databricks notebooks, workflows, and SQL assets.
• Support the rollout of Delta Sharing, Unity Catalog governance, and Iceberg/Delta interoperability where required.
• Partner with analysts and data scientists to ensure high-quality, well-modelled data for analytics and AI use cases.
• Assist with productionising ML pipelines where needed, ensuring they run reliably within Databricks.
• Support feature engineering and experiment environments as part of the wider platform.
• Work cross-functionally with product, marketing, operations, and technology teams to understand data needs and accelerate delivery.
• Mentor junior engineers and promote engineering best practices.
• Champion DevOps for data: CI/CD pipelines, testing automation, IaC, and environment management.

Skills

Python

SQL

Databricks

Delta Lake

Unity Catalog

Synapse

Azure Data Factory

Event Hub

Azure Data Services

CI/CD for data

Tools

Databricks

Delta Lake

Unity Catalog

ADF

Synapse

Event Hub

Azure

Job description

At Clarion, our people are at the absolute heart of what we do. We’re proud that our core values of PASSION, CARE, IMAGINATION, and TRUST define the way we carry out our work across all of our teams.

If you share our values and want to be a part of a successful, dynamic, and creative global business then we want to hear from you.

The Opportunity:

We’re looking for a Senior Data Engineer with deep expertise in Azure and Databricks to help build, optimise, and scale Clarion’s modern data platform. You’ll be central to delivering a robust, high-performing engineering foundation that powers analytics, operational data flows, and future AI capabilities across our global events and digital products.

This role is primarily focused on engineering excellence, developing high-quality pipelines, modelling data in line with our Medallion Architecture, and ensuring our Databricks platform is secure, governed, and production ready.

Key Responsibilities:

• Design, build, and optimise scalable data pipelines using Databricks, Delta Live Tables, Synapse, and Delta Lake.
• Develop ingestion, transformation, and orchestration workflows across diverse sources (APIs, SQL, SFTP, SaaS platforms).
• Implement strong data quality, lineage, and governance standards aligned to Clarion’s Medallion Architecture (Bronze/Silver/Gold).
• Build and optimise Lakehouse data models to support analytics, reporting, operational workloads, and downstream product teams.
• Develop reusable frameworks for ingestion, validation, schema evolution, and monitoring.
• Ensure all solutions follow Databricks best practices around Unity Catalog, cluster policies, permissions, and environment separation.
• Work with architects to evolve Databricks platform patterns, security, and performance optimisation.
• Implement monitoring, logging, and observability across pipelines and clusters.
• Contribute to standards for versioning, DevOps, CI/CD, and testing for Databricks notebooks, workflows, and SQL assets.
• Support the rollout of Delta Sharing, Unity Catalog governance, and Iceberg/Delta interoperability where required.
• Partner with analysts and data scientists to ensure that high-quality, well-modelled data is available for analytics and future AI use cases.
• Assist with productionising ML pipelines where needed, ensuring they run reliably within Databricks.
• Support feature engineering and experiment environments as part of the wider platform.
• Work cross-functionally with product, marketing, operations, and technology teams to understand data needs and accelerate delivery.
• Mentor junior engineers and help foster a culture of engineering best practice.
• Champion DevOps for data: CI/CD pipelines, testing automation, IaC, and environment management.

Knowledge, Skills & Behaviours:

• 5+ years in data engineering across cloud-native environments.
• Expert knowledge of Databricks, Delta Lake, Unity Catalog, ADF, Synapse, Event Hub, and wider Azure Data Services.
• Highly proficient in Python and SQL, with experience building production-grade data pipelines.
• Strong understanding of Lakehouse design patterns, Medallion modelling, and performance optimisation.
• Hands-on experience with CI/CD for data (Azure DevOps, YAML pipelines, Terraform, Databricks CLI/Repos).
• Solid grasp of data governance, security principles, and operational best practices.
  

About Clarion Events

Clarion Events is one of the world’s leading event organisers, producing and delivering innovative and market‑leading events since 1947. (https://clarionevents.com/welcome)

Clarion Events embrace diversity and equal opportunities in all that we do. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills. The more inclusive we are, the better our work will be.

Clarion is private equity backed and owned by Blackstone. Blackstone is one of the world’s leading global investment funds, investing capital for the long term in order to build successful, resilient businesses. (https://www.blackstone.com/)

Our purpose is to deliver exceptional customer outcomes and experiences, by making every connection count.

Our vision is we want every one of our products to be a market leader in customer satisfaction and delight.

Benefits

• 25 days’ holiday plus bank holidays
• End of year wellbeing shutdown (closed for the last week of the year)
• Employees on a permanent or fixed-term contract are gifted an extra day of leave that can be used for a celebration of your choosing, e.g. birthday, Eid, Diwali, etc.
• Summer Hours in August (3pm finish on Fridays)
• Helping Our World (HOW) Days – one paid day per quarter to carry out charity work
• Pension Scheme
• Private Medical Insurance
• Health Cash Plan
• Wellbeing Library (MYNDUP)
• Mentoring Programme
• Season Ticket Loan
• Cycle to Work Schemes
• Free on-site gym and shower facilities
• Free eyesight tests
• Free flu vaccination – offered on site once a year for all employees

Our Values

PASSION

We deliver all our events with passion for people, the environment and businesses. We form connections with those who are just as passionate about what they do as we are. We always strive to exceed expectations and celebrate success. We love what we do, and it shows.

CARE

We care about our people and our products and work tirelessly to achieve lasting connections and satisfaction for ourselves, our customers and the businesses they support. We really get people - everyone is welcome.

IMAGINATION

Everything is possible. We constantly challenge the status quo and create amazing experiences and opportunities. We take huge satisfaction in solving problems. As open-minded and fun-loving people, the sky is our limit.

TRUST

We trust our skills, people and partners to deliver extraordinary events our customers have come to rely on. We support everyone around us and always learn through our experiences. We are honest and straight forward. You can always rely on us.

Equal Opportunities

We encourage employees to be open and confident and recognise that every member of the team makes a vital contribution.

Clarion embraces equality, diversity and inclusion and seeks to promote these principles in all of our business activities.

When recruiting new employees or providing opportunities for promotion, we will:

• Recruit, develop and retain the most talented people, regardless of background, and make the best use of their talents;
• Ensure that no person is unlawfully discriminated against;
• Select the best person for the role based on their skills, qualifications and abilities.

This statement sets out our commitment to equal opportunities and to preventing discrimination in the workplace.