Senior Data Engineer - Oct

8 West Consulting; Cork; On-site; EUR 80,000 - 100,000; Full time

Job summary

A leading software development organization in Cork is seeking a Senior Data Engineer to develop and maintain scalable data solutions. The ideal candidate will have over 10 years of experience in data engineering, with a strong focus on cloud data platforms such as Snowflake and SQL Server. Proficiency in Python and experience in ETL pipeline development are crucial. This role offers a dynamic work environment with opportunities for collaboration across teams.

Qualifications

• Minimum 10 years' experience in data engineering focused on cloud platforms.
• Strong proficiency in Python for automation and development.
• Experience with building and maintaining ETL processes.

Responsibilities

• Design and maintain ETL/ELT processes and data pipelines.
• Collaborate with teams to ensure data quality and integrity.
• Deliver data solutions across the full agile lifecycle.

Skills

Cloud data platforms

Snowflake

SQL Server

Python

ETL development

Git workflows

Data analysis

Tools

SSIS

Visual Studio

SSMS

Job description

Overview

8 West Consulting is one of the country’s largest software development organisations. Formerly named DeCare Systems Ireland, the company has been operating successfully in Cork city since 1998. 8 West Consulting employ a wide range of technologies including Mobile (iOS, Android, Windows), Java SE/Java EE (WebLogic, WebSphere, Spring, Akka, Hibernate, GWT, etc.), Microsoft .NET (ASP.NET, C#, etc.), JavaScript (AngularJS, JQuery, dojo, etc.), various database management systems (MongoDB, Oracle, SQL Server, MySql, etc.). 8 West Consulting provides consultancy and leading-edge software solutions for a wide variety of US, EU and UK based clients in the insurance, healthcare, retail and public sector markets.

Position Summary

The Senior Data Engineer is responsible for designing, developing, and maintaining scalable data solutions across both legacy and modern cloud platforms. The role requires deep expertise in cloud-based data warehousing, strong hands-on skills in Python and ETL pipeline development, and the ability to work in dynamic, agile environments.

The successful candidate must demonstrate excellent verbal and written English communication skills and be able to collaborate effectively with stakeholders across the business.

Key Responsibilities

• Design, develop, and maintain robust ETL/ELT processes, including pipelines for extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from diverse sources
• Develop, enhance, and maintain ETL solutions
• Deliver across the full agile lifecycle, including design, coding, testing, and deployment of iterative data solutions
• Collaborate with cross-functional teams to ensure data quality, integrity, availability, and auditability

Qualifications & Experience

• Minimum 10 years’ experience in data engineering with a strong focus on cloud data platforms
• Deep expertise in Snowflake and SQL Server, including cloud-based data warehousing, ELT/ETL pipeline development, and performance tuning
• Demonstrated experience building and maintaining ETL processes, ideally using SSIS and Snowflake
• Strong proficiency in Python for scripting, automation, and data pipeline development
• Strong background in Git-based workflows (branching strategies, pull requests, CI/CD pipelines)
• Experience in Visual Studio/VS Code or SSMS (SQL Server Management Studio) an advantage
• Excellent verbal and written English communication skills

Skills & Competencies

• Strong analytical and problem-solving skills
• Ability to complete analysis of large data sets
• Ability to design scalable, reliable, and high-performance data solutions
• Clear communicator, capable of presenting complex technical concepts to varied audiences
• Excellent documentation and technical writing skills
• Proactive, adaptable, and able to deliver results in fast-paced environments