Senior Data Engineer

United States Digital Space LLC; Dublin; Hybrid; EUR 100,000 - 140,000; Full time

Benefits offered by this job

International projects

In-office, hybrid, or remote flexibil

Medical healthcare

Recognition program

Ongoing learning & reimbursement

Well-being program

Team events & local benefits

Sports compensation

Referral bonuses

Top-tier equipment provision

Job summary

United States Digital Space LLC in Ireland is seeking a senior Data Engineer to design and build scalable data ingestion pipelines across AWS and GCP. You will lead and mentor engineers, collaborate with ML, analytics, and software teams, and help shape data architecture for high-volume workloads.

The role emphasizes performance, reliability, and data quality, with opportunities to work on varied global projects and cutting-edge platforms.

Qualifications

• Experience building high-volume batch and streaming data pipelines.
• Strong understanding of distributed systems and data engineering.
• Proficiency in Python, Java or Scala with good coding practices.
• Experience with AWS or GCP data processing at scale.
• Ability to lead junior engineers and collaborate with cross-functional teams.
• Knowledge of CI/CD and testing methodologies.
• Experience with ETL, data lineage and data quality issues.

Responsibilities

• Design and develop high-volume batch / streaming data ingestion pipelines and frameworks spanning AWS and GCP data platforms
• Conceive, code, and launch the next-generation data ingestion and curation platforms
• Participate in defining the requirements, system, and data architectural discussions
• Technically lead and mentor junior engineers for best practices in software development and data engineering lifecycle
• Collaborate with cross-functional agile teams of software engineers, data engineers, ML experts, Data Analysts, and others in building new product features

Skills

Distributed systems

Data engineering

Software engineering

Performance optimization

Python

Java

Scala

SQL

NoSQL

Big data

Airflow

GCP/AWS data processing

Tools

BigQuery

Teradata

MySQL

Postgres

Cassandra

Elasticsearch

Wavefront

Spark

Hadoop

Dataproc

Delta lake

Job description

Why Join the company

We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.

From AI platforms to digital transformation, we partner with enterprise leaders to build what’s next.

What powers it all? Our people are ambitious, collaborative, and constantly evolving.

About the Client

Our client is a marketplace platform that connects people with local experiences, events, and travel options, helping them discover new and familiar activities that enrich everyday life. It also supports local businesses by strengthening customer relationships and contributing to vibrant communities.Despite operating at global scale, the culture remains fast-moving, innovative, and impact-driven — combining the resources of a large organization with the autonomy and ownership of a smaller one.

What You’ll Do

• Design and develop high-volume batch / streaming data ingestion pipelines and frameworks spanning AWS and GCP data platforms
• Conceive, code, and launch the next-generation data ingestion and curation platforms
• Participate in defining the requirements, system, and data architectural discussions
• Technically lead and mentor junior engineers for best practices in software development and data engineering lifecycle
• Collaborate with cross-functional agile teams of software engineers, data engineers, ML experts, Data Analysts, and others in building new product features

What You Bring

• Strong experience in distributed systems, data engineering, software engineering, or similar fields
• Rigor and robustness in coding and design, with a thorough understanding of performance trade-offs
• Strong coding skills in a language such as Python, Java and Scala
• A passion for building data platforms, a desire to go into uncharted territory with bold new ideas, and a willingness to go the last mile on execution
• Experience with SQL and NoSQL databases (BigQuery, Teradata, MySql, Postgres, Cassandra etc.)
• Experience in big data technologies like Hadoop, Hive, Apache Spark, etc.
• Experience with Airflow or any other orchestration tool
• In-depth experience in dealing with, and understanding, and troubleshooting ETL, data lineage, data leaking, overall data quality issues, backfills, etc. Can drive and lead independent resolution, communication, and follow-ups
• Experience in batch and streaming data pipelines
• Experience in both software development and data engineering
• Experience in GCP or AWS Cloud technologies , specially related to data processing at scale
• Designing, implementing, and supporting production services with tight SLAs
• Experience developing distributed applications with central logging, metrics, monitoring, and alerting tools such as Elasticsearch and Wavefront
• A clear understanding of testing methodologies, CI/CD, and other industry best practices

Nice to Have

• Strong coding skills in Python
• Experience in Google Data Streams, Google Dataproc
• Experience with change data capture(CDC) technologies
• Modern data warehouse technology like Delta lake is nice to have

English level

Upper-Intermediate

Legal & Hiring Information

• the company is proud to be an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more.
• Reasonable accommodations are available to enable individuals with disabilities to perform essential functions.
• Please note: this job description is not exhaustive. Duties and responsibilities may evolve based on business needs.
• Compensation details are shared with candidates at the early stage of the recruitment process.
• The offer is not binding until a signed contract is in place.

Your Benefits at the company

the company benefits vary by location and contract type. Your recruiter will fill you in on the details.

• International projects
• In-office, hybrid, or remote flexibility
• Medical healthcare
• Recognition program
• Ongoing learning & reimbursement
• Well-being program
• Team events & local benefits
• Sports compensation
• Referral bonuses
• Top-tier equipment provision

the company Culture

We lead with trust, respect, and purpose. We believe in open dialogue, creative freedom, and mentorship that helps you grow, lead, and make a real difference. Ours is a culture where ideas are challenged, voices are heard, and your impact matters.