Consultant Data Engineer

Dataintellect; Belfast City District; On-site; GBP 70,000 - 120,000; Full time

Job summary

Data Intellect is expanding its data engineering and ClickHouse capability. We are seeking experienced Consultants / Data Engineers who design scalable, high-performance data platforms and pipelines for financial services clients.

The role emphasizes production experience with ClickHouse, strong Python/SQL skills, and collaboration with client teams. Join a growing specialist team shaping our ClickHouse practice, with opportunities to influence technical direction and work across market data,

Qualifications

• Experience with ClickHouse in production environments.
• Strong data engineering fundamentals and large-scale time series datasets.
• Excellent Python and SQL skills.
• Experience with financial services datasets or trading data is a plus.

Responsibilities

• Design and implement scalable data engineering solutions.
• Build high-performance data pipelines using Python and SQL.
• Work with large-scale financial/time-series datasets.
• Design efficient data models and optimize analytical workloads.
• Implement ClickHouse across client environments.
• Collaborate with client teams to understand challenges and deliver solutions.
• Support cloud-based data platforms and distributed architectures.
• Contribute to engineering best practices and growth of ClickHouse capability.

Skills

Python

SQL

Data engineering

Google Cloud Platform

AWS

Azure

Go

Communication

Tools

ClickHouse

Kubernetes

Docker

Terraform

Ansible

Puppet

Cloud platforms

Job description

At Data Intellect, we solve some of the most complex data engineering challenges in global financial markets.

For over two decades, we've partnered with many of the world's leading investment banks, hedge funds and exchanges, helping them build high-performance data platforms that power trading, analytics and market surveillance.

We're recognised as one of the world's leading consultancies specialising in time series data and capital markets technology.

As our clients continue to adopt modern data platforms, we're investing in a new capability centred around ClickHouse. This is an exciting opportunity to join at the beginning of that journey, helping us build a new consulting practice while working on challenging projects with some of the biggest names in financial services.

The Opportunity

We're looking for experienced Consultants / Data Engineers who are passionate about building scalable, high-performance data platforms.

Previous ClickHouse experience is desired. We're looking for people with strong data engineering fundamentals, excellent Python and SQL skills, and experience working with large-scale financial or time series datasets.

As part of a growing specialist team, you'll have the opportunity to shape our ClickHouse capability from the ground up, influence technical direction and work closely with both clients and internal engineering teams.

Because we're a consultancy, no two projects are the same. You'll work directly with our clients, helping solve complex engineering challenges across market data, trading systems, analytics platforms and cloud-native architectures.

What You'll Be Doing

• Designing and implementing scalable data engineering solutions
• Building high-performance data pipelines using Python and SQL
• Working with large-scale financial and time series datasets
• Designing efficient data models and optimising analytical workloads
• Implementing ClickHouse across client environments
• Collaborating directly with client engineering teams to understand technical challenges and deliver solutions
• Supporting cloud-based data platforms and distributed architectures
• Contributing to technical design discussions and engineering best practice
• Helping grow Data Intellect's ClickHouse capability

What We're Looking For

• Previous experience using ClickHouse in production
• Hands on experience with Go and/or Python
• Strong knowledge of cloud computing platforms such as AWS, Azure, or Google Cloud Platform
• Excellent understanding of distributed databases and SQL
• Hands on experience with container orchestration tools such as Kubernetes or Docker Swarm
• Strong experience with automation and configuration management tools such as Ansible, Terraform, or Puppet
• Strong commercial Data Engineering experience
• Experience designing and maintaining large-scale data pipelines
• Experience working with high-volume or high-performance data platforms
• Experience within Capital Markets or Financial Services
• Strong understanding of modern data engineering principles
• Excellent problem-solving and analytical skills
• Strong communication skills and experience working with technical stakeholders

A little background on DI

Simply put - we turn big data problems into smart data solutions

At our core, Data Intellect is a data and technology consultancy firm. Our key area of expertise is financial and capital markets technology solutions. However, the utility of these solutions allow us to apply fintech data expertise to other industries such as smart energy and healthcare.

This proprietary offering is complemented by a wealth of experience in data engineering, electronic trading systems, data capture applications, regulatory and compliance systems and middle and back-office enterprise web solutions.

Fair employment and equal opportunities

Data Intellect is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Accommodations are available on request throughout the assessment and selection process.

Welcome to Data Intellect.

#ChallengeAccepted