Senior Data Engineer: Lead Large-Scale Data Pipelines & AI

Kainos; Belfast; On-site; GBP 60,000 - 80,000; Full time

Job summary

A technology solutions company seeks a Senior Data Engineer responsible for designing and developing data processing solutions on a large scale. You will lead development in agile teams, ensuring code quality and mentoring peers. The ideal candidate has software development experience in Java, Scala, or Python, alongside expertise in SQL and cloud platforms like AWS or Azure. This role promotes a people-first culture, where innovation and diversity are celebrated.

Qualifications

• Strong software development experience in Java, Scala, or Python.
• Experience with data-processing platforms from vendors like AWS, Azure, GCP.
• Proficient in SQL for analytical queries.

Responsibilities

• Develop data processing software for Big Data technologies.
• Collaborate to resolve implementation challenges and ensure high code quality.
• Coach and mentor team members.

Skills

Strong software development experience in one of Java, Scala, or Python

Proficient in SQL and SQL extensions for analytical queries

Solid understanding of ETL/ELT data processing pipelines

Able to write quality, testable code

Experience with Continuous Integration and Continuous Deployment techniques

Keen interest in AI Technologies

Tools

AWS

Azure

GCP

Databricks

Kafka

Job description

A technology solutions company seeks a Senior Data Engineer responsible for designing and developing data processing solutions on a large scale. You will lead development in agile teams, ensuring code quality and mentoring peers. The ideal candidate has software development experience in Java, Scala, or Python, alongside expertise in SQL and cloud platforms like AWS or Azure. This role promotes a people-first culture, where innovation and diversity are celebrated.