Senior Data Engineer

SOLAS IT RECRUITMENT; Shankill; On-site; EUR 60,000 - 80,000; Part time

Job summary

A leading technology recruitment firm in Leinster is seeking an experienced Senior Data Engineer for a daily rate contract. The role involves developing scalable data pipelines, leveraging big data frameworks, and collaborating with teams to enhance data solutions. Expertise in SQL, cloud services, and programming languages is essential. This is an excellent opportunity to work on innovative projects in a dynamic environment.

Qualifications

• Strong expertise in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data frameworks such as Hadoop, Spark, Hive.
• Strong programming skills in Java, Python, or similar languages.

Responsibilities

• Develop and maintain high-performance data pipelines.
• Assemble and process large, complex data sets.
• Design and implement process improvements for data flow.

Skills

SQL

NoSQL databases

Hadoop

Spark

AWS

Java

Python

Tools

Docker

Snowflake

Job description

Senior Data Engineer – Daily Rate Contract

We are seeking a Senior Data Engineer to join our dynamic team of Software Engineers as part of our Security Innovation program. If you’re passionate about building scalable data solutions, leveraging AI and Machine Learning to combat financial fraud, and working with cutting‑edge technologies, this opportunity is for you.

What You’ll Do:

• Develop and maintain high-performance data pipelines to support business intelligence, analytics, and AI-driven applications.
• Assemble and process large, complex data sets to meet both functional and non-functional business needs.
• Design and implement process improvements to optimize data flow, automate workflows, and enhance scalability.
• Build robust infrastructure for data extraction, transformation, and loading (ETL) using modern cloud‑based solutions.
• Work closely with Software Engineers, Data Scientists, and Architects to ensure seamless data integration and optimal performance.
• Take ownership of clarifying requirements and proposing scalable solutions before implementation.

What You Bring:

• Strong expertise in SQL and experience working with relational and NoSQL databases (e.g., Postgres, Oracle, CosmosDB).
• Experience with batch-oriented data pipelines and maintaining historical datasets.
• Hands‑on experience with big data frameworks such as Hadoop, Spark, Hive, or Cloudera.
• Proficiency in cloud services (preferably AWS) and experience working with Snowflake or similar data‑warehousing solutions.
• Strong understanding of distributed data processing, message queuing, and stream processing (e.g., Kafka, Storm, Spark Streaming).
• Solid programming skills in Java, Python, or similar object‑oriented languages.
• Experience with CI/CD, containerization (Docker), and workflow management tools.
• Strong problem‑solving skills with the ability to analyze and extract value from large datasets.
• Comfortable working in an Agile environment (Scrum, SAFe) and collaborating across cross‑functional teams.