Senior Data Engineer - Dublin

Xtremepush Limited; Dublin; Hybrid; EUR 90.000 - 120.000; Vollzeit

Zusammenfassung

Xtremepush Limited is seeking a Senior Data Engineer to own data ingestion for client marketing and personalisation use cases. You will design, build and maintain ETL/ELT jobs, work with client data teams, and ensure data lands with required latency.

Hybrid role based in Dublin, with strong emphasis on data quality, scalability, and documentation. You will leverage Snowflake, Databricks, Kafka and Airflow/Dagster to deliver robust data pipelines, mentor junior engineers, and collaborate across

Qualifikationen

• 5+ years’ experience in data engineering or data integration, ideally in a lead or senior role.
• Degree in computer science, software engineering, data engineering or related field.
• Experience in financial services, gaming or another regulated sector, including consent and data protection requirements.
• Experience working directly with client technical teams and managing key stakeholders.
• Strong ETL/ELT and pipeline design across batch and streaming, including idempotent loads, backfills and failure recovery.
• Strong Python programming with production ETL, testing and maintainable code.
• Advanced SQL with query performance tuning.
• Experience with MySQL including schema design and data extraction.
• Experience with columnar databases (ClickHouse or similar).
• Hands-on experience with Snowflake and/or Databricks.
• Experience with Kafka (producers/consumers, offsets, partitions).
• Experience orchestrating pipelines with Dagster or Airflow.
• Hands-on AWS including S3, IAM, KMS, Secrets Manager and CloudWatch.
• Experience running and debugging jobs on Kubernetes (EKS).
• Experience designing monitoring and alerts in Datadog or similar.
• Strong incident handling, including root cause analysis and clear write-ups.

Aufgaben

• Design, build and maintain custom ETL/ELT and ingestion jobs that bring new client data sources into the Xtremepush platform.
• Define integration patterns for batch, API and event-driven ingestion.
• Ensure data lands in the structure and latency required by Data Analysts and Data Modellers.
• Work with client technical and data teams on source access, data contracts and data quality.
• Orchestrate, monitor and troubleshoot pipelines, resolving failures quickly.
• Document integrations, data flows and dependencies for the wider team.
• Advise on integration scope and effort during use case planning.
• Mentor associate data engineers.

Kenntnisse

Data engineering

ETL/ELT design

Python

SQL

Data integration

Stakeholder management

Monitoring & incident handling

Cloud data platforms

Ausbildung

Bachelors degree in CS/SE or related field

Tools

Snowflake

Databricks

Kafka

Dagster

Airflow

AWS (S3, IAM, KMS)

Kubernetes (EKS)

Datadog

Jobbeschreibung

About the Role

Xtremepush is a global leader in customer engagement, providing a cutting-edge platform that empowers brands to understand, engage, and influence their customers across multiple channels. Specialising in the Sports Betting & Gaming (SBG) industry, Xtremepush enables businesses to drive growth and enhance customer experiences through data-driven insights, personalisation, and omni-channel marketing. We also partner with organisations in financial services and other regulated sectors. Our innovative Customer Data Platform and engagement tools help organisations create highly targeted campaigns, optimise conversions, and maximise revenue. Xtremepush is the only platform that combines real-time CDP, Omnichannel Activation, AI Optimisation, Gamification Engine, and Advanced Intelligence in a single platform.

We are seeking an experienced Senior Data Engineer to own the ingestion of new data sources into the Xtremepush platform for our clients’ marketing and personalisation use cases. Working across a number of clients, you will design and build custom jobs, working directly with their technical and data teams to secure access, resolve data quality issues and land data in the right shape and at the right latency. This role requires the successful candidate to have strong data engineering, integration and key stakeholder management experience.

This is a hybrid role based in Dublin. #LI-Hybrid

Key Responsibilities

• Design, build and maintain custom ETL/ELT and ingestion jobs that bring new client data sources into the Xtremepush platform.

• Define integration patterns and standards for batch, API and event-driven ingestion.

• Ensure data lands in the structure and at the latency the Data Analyst and Data Modeller require.

• Work with client technical and data teams on source access, data contracts and data quality.

• Orchestrate, monitor and troubleshoot pipelines, resolving failures quickly.

• Document integrations, data flows and dependencies for the wider team.

• Advise on integration scope and effort during use case planning.

• Experience mentoring associate data engineers.

Your Experience and Qualifications

• 5+ years’ experience in data engineering or data integration, ideally including a lead or senior role.

• A degree in computer science, software engineering, data engineering or a related field,

• Experience in financial services, gaming or another regulated sector, including consent and data protection requirements.

• Experience working directly with client technical teams and managing key stakeholders.

• Strong ETL/ELT and pipeline design skills across batch and streaming, including idempotent loads, backfills and failure recovery, and knowledge of common integration patterns.

• Strong Python, including production ETL, testing and maintainable code, and experience with APIs and REST integrations.

• Advanced SQL, including query performance tuning.

• Experience with MySQL, including schema design, query tuning and extracting data from operational databases.

• Experience with ClickHouse or another columnar database, including ingestion, table engines, and troubleshooting memory and insert performance.

• Hands-on experience with Snowflake and/or Databricks.

• Experience with Kafka, including producers and consumers, offsets, partitions, retention, replay and deduplication.

• Experience orchestrating pipelines with Dagster or Airflow.

• Hands-on AWS experience, including S3, IAM, KMS, Secrets Manager and CloudWatch.

• Experience running and debugging jobs and CronJobs on Kubernetes (EKS or similar), and comfortable working in Linux environments.

• Experience designing monitoring and alerts in Datadog or a similar tool.

• Strong incident handling, including triage, root cause analysis and clear write-ups.

Desirable

• Experience with a CDP, CRM or marketing automation platform.

• Experience with file-based integrations, including SFTP, file validation and reprocessing.

• Experience with CI/CD, ideally Bitbucket Pipelines.

Location

This is a hybrid role based in Dublin.