Senior Data Engineer: Build Scalable Pipelines & Lead Teams

United States Digital Space LLC; Dublin; Hybrid; EUR 100,000 - 140,000; Full time

Benefits offered by this job

International projects

In-office, hybrid, or remote flexibil

Medical healthcare

Recognition program

Ongoing learning & reimbursement

Well-being program

Team events & local benefits

Sports compensation

Referral bonuses

Top-tier equipment provision

Job summary

United States Digital Space LLC in Ireland is seeking a senior Data Engineer to design and build scalable data ingestion pipelines across AWS and GCP. You will lead and mentor engineers, collaborate with ML, analytics, and software teams, and help shape data architecture for high-volume workloads.

The role emphasizes performance, reliability, and data quality, with opportunities to work on varied global projects and cutting-edge platforms.

Qualifications

• Experience building high-volume batch and streaming data pipelines.
• Strong understanding of distributed systems and data engineering.
• Proficiency in Python, Java or Scala with good coding practices.
• Experience with AWS or GCP data processing at scale.
• Ability to lead junior engineers and collaborate with cross-functional teams.
• Knowledge of CI/CD and testing methodologies.
• Experience with ETL, data lineage and data quality issues.

Responsibilities

• Design and develop high-volume batch / streaming data ingestion pipelines and frameworks spanning AWS and GCP data platforms
• Conceive, code, and launch the next-generation data ingestion and curation platforms
• Participate in defining the requirements, system, and data architectural discussions
• Technically lead and mentor junior engineers for best practices in software development and data engineering lifecycle
• Collaborate with cross-functional agile teams of software engineers, data engineers, ML experts, Data Analysts, and others in building new product features

Skills

Distributed systems

Data engineering

Software engineering

Performance optimization

Python

Java

Scala

SQL

NoSQL

Big data

Airflow

GCP/AWS data processing

Tools

BigQuery

Teradata

MySQL

Postgres

Cassandra

Elasticsearch

Wavefront

Spark

Hadoop

Dataproc

Delta lake

Job description

United States Digital Space LLC in Ireland is seeking a senior Data Engineer to design and build scalable data ingestion pipelines across AWS and GCP. You will lead and mentor engineers, collaborate with ML, analytics, and software teams, and help shape data architecture for high-volume workloads.

The role emphasizes performance, reliability, and data quality, with opportunities to work on varied global projects and cutting-edge platforms.