Data Engineer

VanRath; Belfast City District; Hybrid; GBP 55,000 - 75,000; Full time

Benefits offered by this job

Flexible working

Hybrid/remote options

Pension

Healthcare

Job summary

VanRath in Belfast is seeking a Data Engineer to join the Data & Analytics team. The role is hybrid, focusing on building scalable data pipelines on Databricks and AWS, with Python/PySpark expertise.

You will design data architectures, work with data warehousing concepts and contribute to analytics and AI initiatives, while collaborating with stakeholders in a large-scale environment.

Qualifications

• 2+ years' experience in a Data Engineering or similar role.
• Strong experience with Python, PySpark and/or Databricks.
• Good understanding of Delta Lake, data warehousing and big data concepts.

Responsibilities

• Develop and maintain scalable ETL processes using Databricks and AWS Glue.
• Build automated data pipelines across cloud, on-premise, API and streaming sources.
• Develop data architectures aligned with business requirements.
• Build and maintain data models for BI and analytics.
• Work with Delta Lake and modern data warehousing technologies.
• Maintain Databricks notebooks, jobs and workflows.
• Optimise Spark jobs and data workflows for performance and scalability.
• Monitor, troubleshoot and improve data pipeline performance.
• Ensure data quality, integrity, security and compliance.
• Support wider analytics, AI and machine learning initiatives.
• Contribute to continuous improvement and knowledge sharing across the Data team.

Skills

Python

PySpark

Databricks

AWS

Data Warehousing

Education

Relevant degree or technical qualification

Tools

Delta Lake

Spark

Job description

Data Engineer - Belfast (Hybrid) | Databricks & AWS

A well-established, large-scale organisation is looking for an experienced Data Engineer to join its growing Data & Analytics team in Belfast. This is a fantastic opportunity for a Data Engineer with experience in Databricks, AWS, Python and/or PySpark to join an organisation investing heavily in its data engineering, analytics and AI capabilities.

The successful Data Engineer will play a key role in designing, building and maintaining scalable data pipelines, ETL processes and cloud data infrastructure, with a particular focus on Databricks and AWS. You'll work across cloud, on-premise, API and streaming data sources, helping to develop modern data architectures and deliver high-quality data solutions for analytics and AI.

This is a hybrid Data Engineer role based in Belfast, offering the opportunity to work with modern cloud technologies including Databricks, AWS Glue, Delta Lake and Spark, while contributing to a wider programme of data transformation and continuous improvement.

Key requirements include 2+ years' Data Engineering experience, strong Python/PySpark and/or Databricks experience, and a good understanding of data warehousing and big data concepts.

Right to Work

Applicants must have the existing and unrestricted right to work in the UK/Northern Ireland. This role does not offer visa sponsorship.

The Role

As a Data Engineer, you will be responsible for designing, building and maintaining reliable data infrastructure and ETL pipelines, with a particular focus on Databricks and AWS.

You'll work closely with technical and business stakeholders to deliver scalable data solutions and support the development of modern analytics and AI-driven insights.

This is an excellent opportunity for a Data Engineer in Belfast who is keen to work with modern cloud data technologies and contribute to a significant data transformation programme.

Key Responsibilities

• Develop and maintain scalable ETL processes using Databricks and AWS Glue
• Build automated data pipelines across cloud, on-premise, API and streaming sources
• Develop data architectures aligned with business requirements
• Build and maintain data models for BI and analytics
• Work with Delta Lake and modern data warehousing technologies
• Maintain Databricks notebooks, jobs and workflows
• Optimise Spark jobs and data workflows for performance and scalability
• Monitor, troubleshoot and improve data pipeline performance
• Ensure data quality, integrity, security and compliance
• Support wider analytics, AI and machine learning initiatives
• Contribute to continuous improvement and knowledge sharing across the Data team

What We're Looking For

We're looking for a Data Engineer with:

• 2+ years' experience in a Data Engineering or similar role
• Strong experience with Python, PySpark and/or Databricks
• Good understanding of Delta Lake, data warehousing and big data concepts
• Experience working with cloud-based data platforms
• Strong analytical and problem-solving skills
• Excellent communication skills and the ability to work with both technical and non-technical stakeholders
• A collaborative and proactive approach

Desirable Experience

It would be advantageous for the Data Engineer to have experience with:

• AWS Glue
• API integrations
• Retail or other high-volume data environments
• Advanced analytics, AI or machine learning
• Agile/Scrum environments
• Relevant degree or technical qualification

What's On Offer?

• Competitive salary and benefits package
• Flexible working, hybrid/remote
• Contributory pension
• Healthcare and life assurance
• Employee assistance programme
• Employee discounts and rewards
• Strong opportunities for learning, development and progression

This is a great opportunity for a Data Engineer looking to join an established organisation in Belfast that is undergoing significant investment and transformation across its Data & Analytics function.