Senior Data Platform Engineer: AI-Driven Lakehouse

Sword

Portugal

On-site

EUR 53,000 - 83,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sword is building a truly AI-native data platform to power healthcare innovation. This Data Platform Engineer role focuses on designing a streaming lakehouse, building robust pipelines, and delivering self-service APIs for data consumers across clinical, operations, AI, and product teams.

You will own durable workflows, shape the API surface, and collaborate with data engineers and analysts on governance and lineage, while ensuring compliance in a regulated domain.

Qualifications

  • Proven experience designing and operating data platforms at scale in production.
  • Hands-on experience with Iceberg; Delta Lake or Hudi welcome for lakehouse formats.
  • Clear mental model of data catalogs (REST, Polaris, Glue, Unity, Hive).
  • Exposure to vendor lakehouses (Snowflake, Starburst, Databricks).
  • Strong experience with a distributed processing engine (Flink preferred; Spark acceptable).
  • Familiarity with durable execution concepts (Temporal, Restate).
  • Production experience building and operating REST or gRPC APIs at scale.
  • Solid understanding of Kafka and event-driven architectures.
  • Comfortable in regulated environments (healthcare/fintech/gov).
  • Platform mindset: API-first, self-service for humans, systems, and agents.

Responsibilities

  • Design and evolve Sword's streaming lakehouse as the foundation for data consumers.
  • Build and operate distributed streaming pipelines with low latency and high reliability.
  • Own durable workflows coordinating complex data movement across systems.
  • Shape the platform's API surface for producers and consumers without infra context.
  • Drive evaluations and integrations with vendor data platforms within architectural trade-offs.
  • Contribute to self-service and agentic layers for humans, systems, and AI agents.
  • Partner with data engineers and analysts on contracts, governance, and lineage.
  • Build and maintain AI-ready data infrastructure powering ML and AI-driven products.
  • Leverage AI coding assistants to accelerate development, documentation, and code quality.
  • Work in a regulated environment where audit and governance are integral to design.

Skills

Data platforms
Lakehouse formats
Data catalogs
Lakehouse platforms
Flink
Spark
APIs (REST/gRPC)
Kafka
Regulated environments
API-first/self-service

Tools

Iceberg
Delta Lake
Hudi
Kafka
Flink
Spark

Job description

Sword is building a truly AI-native data platform to power healthcare innovation. This Data Platform Engineer role focuses on designing a streaming lakehouse, building robust pipelines, and delivering self-service APIs for data consumers across clinical, operations, AI, and product teams.

You will own durable workflows, shape the API surface, and collaborate with data engineers and analysts on governance and lineage, while ensuring compliance in a regulated domain.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer — AI-Ready Lakehouse
Senior Data Platform Engineer — AI-Ready Lakehouse

SheCodes company • Portugal

Remote
EUR 53,000 - 83,000
Senior Data Engineer - Databricks & AI Lakehouse
Senior Data Engineer - Databricks & AI Lakehouse

C&W Services (S) • Lisboa

On-site
EUR 75,000 - 105,000
Senior Data Platform Engineer — Lakehouse & Analytics
Senior Data Platform Engineer — Lakehouse & Analytics

Icligo • Vila Nova de Gaia

On-site
EUR 55,000 - 75,000
Senior Data Engineer: End-to-End Lakehouse Architect
Senior Data Engineer: End-to-End Lakehouse Architect

Amgen Inc. • Portugal

On-site
EUR 90,000 - 120,000
Senior Data Engineer: Cloud Lakehouse & Data Pipelines Lead
Senior Data Engineer: Cloud Lakehouse & Data Pipelines Lead

Amgen Inc. • Lisboa

On-site
EUR 75,000 - 115,000
Senior Data Platform Engineer (Azure Lakehouse)
Senior Data Platform Engineer (Azure Lakehouse)

Capitole • Porto

On-site
EUR 80,000 - 110,000
Permanent contract
Professional development budget
Health insurance
+4
Data Engineer: Build AI-Ready Lakehouse & Pipelines
Data Engineer: Build AI-Ready Lakehouse & Pipelines

AUMOVIO • Vila Real

On-site
EUR 42,000 - 66,000
Senior Data Architect – Lakehouse & Cloud Analytics Lead
Senior Data Architect – Lakehouse & Cloud Analytics Lead

Link | Linkroad • Lisboa

On-site
EUR 90,000 - 120,000
Health insurance
Training & development
Work-life balance
Senior Data Engineer - Cloud Lakehouse & Pipelines
Senior Data Engineer - Cloud Lakehouse & Pipelines

Amgen Inc. • Lisboa

Hybrid
EUR 90,000 - 120,000
Lead Cloud Data Engineer: Scale AI-Ready Data Platforms
Lead Cloud Data Engineer: Scale AI-Ready Data Platforms

Mastercard Inc. • Lisboa

On-site
EUR 90,000 - 130,000
Top locations