Senior Data Engineer

emagine; Dublin; On-site; EUR 90,000 - 130,000; Full time

Job summary

emagine seeks a Senior Data Engineer with extensive data engineering experience, focusing on data migration, testing, validation and reconciliation in insurance-related environments. You will design and implement data pipelines and data marts, work with SQL and Python, and collaborate with technical teams to migrate to a new data platform.

Strong analytical and communication skills are essential, along with ability to manage competing priorities and deliver reliable data solutions in cloud-based

Qualifications

• Must have strong understanding of data pipelines, ETL/ELT, and data warehousing concepts.
• Experience with SQL and Python for data ingestion, transformation, and validation.
• Excellent communication and analytical/problem-solving abilities.
• Able to manage competing priorities and work in cloud-based environments.

Responsibilities

• Define and document requirements for the pricing data mart during transformation.
• Ensure data is fed back into pricing data marts during and after migration.
• Ingest data files into the Pricing Datamart.
• Validate incoming data for completeness, accuracy, and conformance.
• Identify, investigate, and resolve data quality issues.
• Clean and transform raw source data to meet Datamart standards.
• Write, maintain, and optimize SQL and Python scripts to support workflows.
• Support design and implementation of data pipelines and integrations.
• Contribute to long-term strategy for migrating to a new target data platform.
• Collaborate with technical teams on data architecture decisions.

Skills

Data pipelines

ETL/ELT processes

Data warehousing

SQL

Python

Cloud data services

Analytical skills

Problem-solving

Communication

Prioritization

Tools

Databricks

Snowflake

AWS

Azure

Job description

Introduction & Summary

The role of Senior Data Engineer involves extensive experience in data engineering, particularly in data migration, testing, validation, and reconciliation. The ideal candidate will possess a strong foundation in data engineering concepts and skills required for effective operation in relevant environments.

Introduction & Summary

The role of Senior Data Engineer involves extensive experience in data engineering, particularly in data migration, testing, validation, and reconciliation. The ideal candidate will possess a strong foundation in data engineering concepts and skills required for effective operation in relevant environments.

Main Responsibilities

Key responsibilities include:

• Define and document the requirements for the current pricing data mart as part of the application transformation.
• Ensure data is successfully fed back into the pricing data marts during and after the migration.
• Ingest data files into the Pricing Datamart.
• Validate incoming data upon delivery for completeness, accuracy, and conformance.
• Identify, investigate, and resolve data quality issues.
• Clean and transform raw source data to meet Pricing Datamart standards.
• Write, maintain, and optimize SQL and Python scripts to support workflows.
• Support the design and implementation of data pipelines and integrations.
• Contribute to the longer-term strategy for migrating the Pricing team to a new target data platform.
• Work with technical teams on data architecture decisions.

Key Requirements

• Strong understanding of data engineering concepts, including data pipelines, data marts, ETL/ELT processes, and data warehousing.
• Experience working with SQL and Python for data ingestion, transformation, and validation.
• Excellent communication skills.
• Strong analytical and problem-solving skills.
• Ability to manage competing priorities effectively.
• Experience with cloud-based data services and platforms.

Nice to Have

• Experience in the insurance or health insurance sector.
• Experience in Pricing and Underwriting departments.
• Familiarity with modern data platforms (e.g., Databricks, Snowflake, AWS, Azure or similar).
• Experience with project management methodologies (Agile, Waterfall or hybrid).
• Knowledge of data governance frameworks and data quality management.
• Experience with application migration or platform consolidation programmes.

Other Details

This role is aimed at professionals with significant expertise in data engineering, particularly in insurance-related environments, focusing more on technical data skills than project management capabilities.