Senior Data Engineer

Cpl Group; Connacht; On-site; EUR 90,000 - 120,000; Full time

Job summary

Cpl Group is seeking a Senior Data Engineer in Galway, Ireland, to join a large financial services firm and drive analytics from diverse datasets. The role emphasizes enterprise development, strong coding and data skills, and collaboration within an accelerated development team.

The candidate will engage in design, leadership and hands-on work, with exposure to AI/ML workflow deployment and prompt engineering for LLMs in production environments.

Qualifications

• Bachelor’s or Master’s Degree in a technology related field is required.
• Strong Python experience with Java/C# cross-training is welcomed.
• Experience with AWS, RDBMS and data pipelines is essential.

Responsibilities

• Design, lead and execute technical solutions and improvements.
• Develop and maintain data pipelines for structured and unstructured data.
• Work in a fast-paced team with on-call responsibilities.
• Explore AI/ML workflows and prompt engineering for LLMs in production.

Skills

Python

Java

C#

Object Oriented Programming

RDBMS

AWS

CI/CD

Data Pipelines

REST APIs

Linux

Education

Bachelor’s or Master’s Degree in a technology related field

Tools

Snowflake

Oracle

S3

PL/SQL

Pandas

Numpy

Job description

We are currently seeking a Senior Data Engineer to join a large financial services firm based in Galway,

The role is ideal for someone with an enterprise development background, with a strong technology, coding and data skills, looking to operate in a less constrained environment, as part of an accelerated development team.

We're looking for a skilled technical leader with strong design, teamwork and influencing skills.

Ideally the candidate is a full stack, but this role will be primarily focused on processing and generating Analytics from structured and unstructured datasets with the ability of parallel processing potentially in the cloud.

The successful candidate will have the opportunity to get exposure to prompt engineering for Large Language Models (LLMs) such as OpenAI’s GPT-4 (ChatGPT), Google Gemini, and Anthropic Claude, with practical experience in designing, optimizing, and deploying AI/ML workflows in production environments to drive business value and innovation.

The ideal candidate will quickly adapt to new technologies and a go-getter/hands-on engineer, with quantitative concepts and data. Willing to be in the on-call rotation.

The Expertise We’re Looking For

• Bachelor’s or Master’s Degree in a technology related field (e.g. Engineering, Computer Science, etc.) required.
• The role is primarily Python based however we are very open to a strong Java or C# Engineer who is willing to cross-train and work with Python
• Strong Experience in RDBMS and AWS
• Experience with object orientated programming principles and Data Structures
• Knowledge of Cloud computing concepts (AWS) and using CI/CD tools
• 6+ years of enterprise development and a desire to work on a fast-paced development team.
• Ability to balance multiple tasks concurrently is required
• Experience in planning, designing, leading, and executing technical solutions and improvements.
• Strong problem-solving and troubleshooting skills with on call responsibilities.

The Skills You Bring

• You have a track record of engineering experience by processing large datasets and building scalable applications and Rapid Prototyping
• You have a background with enterprise development and a consistent record rapidly bring projects from inception to delivery in ambitious timeframes.
• You have solid experience in Object Oriented Programming
• You have solid experience in developing custom Data Pipelines to extract data, map data, transform data, and to load data in various data stores like Oracle, Snowflake, S3, PL/SQL, and / or shared drives.
• You have solid experience in Python or Java or C#, ideally also with experience of data structure libraries such as Pandas / Numpy
• You are familiar with extracting data from REST APIs
• Your demonstrable experience developing scripting in Linux and Windows
• Experience with migrating applications to AWS (Cloud) will be an added advantage.