Senior Data Engineer — Hybrid (Dublin): Real-Time Pipelines

Xtremepush; Dublin; Hybrid; EUR 90,000 - 120,000; Full time

Job summary

Based in Dublin with a hybrid work model, you will collaborate with data analysts, data modellers and client tech leads to land data in an optimal shape, while mentoring junior team members and defining robust integration standards.

Qualifications

• 5+ years' experience in data engineering or data integration, ideally in a senior or lead role.
• Degree in computer science, software engineering, data engineering or a related field, or equivalent experience.
• Experience working directly with client technical teams and stakeholders, ideally in regulated sectors.
• Strong ETL/ELT and pipeline design skills across batch and streaming, including idempotent loads, backfills and failure recovery.
• Strong Python and SQL, including production-quality tested code, REST API integrations and query performance tuning.
• Experience with relational and columnar databases, such as MySQL and ClickHouse.
• Experience with event streaming, such as Kafka, and file-based integrations, such as SFTP.
• Experience orchestrating pipelines with a tool such as Dagster or Airflow.
• Hands-on AWS experience, including storage, access management and secrets management.
• Experience with Snowflake or another cloud data warehouse is desirable.
• Experience with Kubernetes, Linux and CI/CD tooling, such as Bitbucket Pipelines, is desirable.
• Experience setting up monitoring and alerting in Datadog or a similar tool is desirable.
• Experience with a CDP, CRM or marketing automation platform is desirable.

Responsibilities

• Design, build and maintain ETL/ELT and ingestion pipelines that bring new client data sources into the Xtremepush platform.
• Define integration patterns and standards for batch, file-based, API and event-driven ingestion.
• Ensure data lands in the structure and at the latency the Data Analyst and Data Modeller require.
• Work with client technical and data teams on secure source access, data contracts and data quality.
• Orchestrate, monitor and troubleshoot pipelines, leading triage and root cause analysis when failures occur.
• Document integrations, data flows and dependencies, and advise on integration scope and effort during use case planning.
• Provide mentorship and support to associate team members

Skills

Leadership

Stakeholder management

ETL/ELT design

Python

SQL

Education

Bachelor's degree in CS/SE/Data Eng

Tools

MySQL

ClickHouse

Kafka

SFTP

Dagster

Airflow

AWS

Snowflake

Kubernetes

Linux

Bitbucket Pipelines

Datadog

REST APIs

Job description

Based in Dublin with a hybrid work model, you will collaborate with data analysts, data modellers and client tech leads to land data in an optimal shape, while mentoring junior team members and defining robust integration standards.