Remote Data Engineer III: Scalable Pipelines & Analytics

Primer; Ireland; Remote; EUR 85,000 - 120,000; Full time

Benefits offered by this job

Remote-first

25 days minimum holiday

Workations & Company Retreat

£500 home office setup

Generous learning budget

Competitive share options

Best equipment for your role

Job summary

Primer is building the unified data infrastructure for global payments. We seek a software engineer who thrives at the intersection of data, software and infrastructure, designing clean, scalable systems that move and transform data at scale.

You will work on internal tools, pipelines, and APIs that support analytics, product features, and ML applications. You’ll collaborate with product and engineering teams to make data infrastructure seamless, efficient, and delightful to use.

Qualifications

• Strong software engineering fundamentals: tested, reviewed code with clean abstractions.
• Proficiency in Python and SQL.
• Hands-on experience building and running batch or streaming data pipelines in production.
• Comfort across cloud-native infrastructure, ideally AWS, Kubernetes and Terraform.
• Clear written and verbal communication, and a habit of sharing what you learn.

Responsibilities

• Own batch and streaming pipelines, including CDC feeds from operational databases into Snowflake, and make them reliable enough that other teams stop thinking about them.
• Design the internal tools and APIs that make data usable for analytics, product features and machine learning.
• Model and transform data in dbt so the warehouse is a source of truth people trust, not a pile of tables nobody can explain.
• Decide how data should be stored and moved across CockroachDB, DynamoDB, Elasticsearch and Snowflake, and build the path between them.
• Ship pipelines with the same standards as any production service: tests, CI/CD, containers, and observability through OpenTelemetry and Datadog.
• Take a multi-component data project from scoping through to rollout, bringing other engineers into the design along the way.

Skills

Python

SQL

Data pipelines

Cloud-native infra

AWS

Kubernetes

Terraform

Communication

Tools

Snowflake

dbt

OpenTelemetry

Datadog

Job description

Primer is building the unified data infrastructure for global payments. We seek a software engineer who thrives at the intersection of data, software and infrastructure, designing clean, scalable systems that move and transform data at scale.

You will work on internal tools, pipelines, and APIs that support analytics, product features, and ML applications. You’ll collaborate with product and engineering teams to make data infrastructure seamless, efficient, and delightful to use.