Senior Data Platform Engineer

Chain IQ; Lisboa; Presencial; EUR 70 000 - 110 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Great Place to Work-certified

Global team environment

Resumo da oferta

Chain IQ is seeking a Senior Data Platform Engineer to design and evolve a modular Databricks-based platform, enabling trusted data access across ingestion, governance, and data products.

You will build reusable ingestion patterns for batch, API, and streaming sources, implement data governance, quality contracts, and privacy controls, and mentor engineers across a globally distributed team.

Qualificações

• 6+ years in data engineering with 2+ years on Databricks Lakehouse in production.
• Hands-on Spark and Delta Lake experience; Delta Live Tables a plus.
• Unity Catalog for access control, lineage, cataloguing.
• Experience implementing data anonymisation in regulated environments.
• Canonical/conformed data modelling (data vault, dimensional modelling).
• APIs (REST/GraphQL) exposure of data; schemas and versioning.

Responsabilidades

• Design and evolve Databricks-based data pipelines across Bronze-Silver-Gold.
• Build modular ingestion patterns for batch, API, and streaming sources.
• Implement data governance—access controls, lineage, cataloging, auditing.
• Define data quality standards, data contracts, monitoring, and alerting.
• Develop and own data products aligned to a canonical data model.
• Collaborate with domain teams to integrate source data into the model.
• Champion Data as a Product with self-service and versioning.
• Drive CI/CD, IaC, testing, observability, and cost optimization.
• Mentor engineers and coordinate with governance, security, architecture, stakeholders.

Conhecimentos

Databricks

Spark

Delta Lake

Python

SQL

Terraform

Unity Catalog

Data Governance

REST/GraphQL

Cloud Platforms

Ferramentas

Delta Live Tables

Descrição da oferta de emprego

Select how often (in days) to receive an alert:

Location: Lisbon, PT

Date: Aug 21, 2026

At Chain IQ, your ideas move fast.

Chain IQ is a global AI-driven Procurement Service Partner, headquartered in Baar, Switzerland, with operations across main centers and 16 offices worldwide. We provide tailored, end-to-end procurement solutions that enable transformation, drive scalability, and deliver substantial reductions in our clients' indirect spend. Our culture is built on innovation, entrepreneurship, ownership, and impact. Here, your voice matters - bold thinking is encouraged, and action follows ambition.

We are building a modular, enterprise-grade data platform powered by Databricks, designed to deliver trusted, governed data through multiple consumption channels, including analytics, APIs, streaming, and knowledge graph solutions. The platform is built on a shared canonical data model and emphasizes scalability, governance, privacy, and a Data as a Product mindset.

As a Senior Data Platform Engineer, you will play a key role in designing and evolving the platform across ingestion, governance, data modeling, and data products. This is a hands‑on, high‑ownership role focused on building reusable platform capabilities, enabling trusted data access at scale, and driving engineering best practices across the data ecosystem.

Responsibilities

• Develop and maintain modular ingestion patterns supporting batch, API-based, and event-driven data sources (e.g., JDBC, SaaS/ERP connectors, Kafka, CDC).
• Establish reusable ingestion frameworks (metadata-driven when possible) that enable rapid and consistent onboarding of new data sources.
• Build and optimize Databricks-based data pipelines (Spark, Delta Live Tables/Lakeflow) across the medallion architecture (Bronze, Silver, Gold).
• Implement and evolve data governance capabilities, including access controls, lineage, cataloging, auditing, data classification, and privacy compliance.
• Define and enforce data quality standards, data contracts, monitoring, and alerting across ingestion and transformation layers.
• Implement data protection and privacy solutions, including masking, tokenization, pseudonymization, and other appropriate anonymization techniques to meet regulatory requirements (e.g. GDPR).
• Build, own, and evolve data products aligned to a canonical data model, ensuring clear ownership, SLAs and documentation.
• Collaborate with domain teams to integrate source data into the canonical model while preserving domain-specific nuance.
• Champion a Data as a Product approach: discoverability, self-service, versioning, and consumer-facing contracts.

Build and maintain data consumption and serving layers, including BI/analytics datasets, APIs (REST/GraphQL), and use case‑driven extensions such as streaming outputs or knowledge graph representations.

• Drive technical standards and platform direction across CI/CD, Infrastructure as Code, testing, observability, and cost optimization
• Mentor engineers and partner with governance, security, architecture, and business stakeholders.

Requirements

• Around 6+ years in data engineering, with 2+ years designing/operating Databricks-based Lakehouse platforms at production scale.
• Hands‑on expertise with Apache Spark and Delta Lake; experience with Delta Live Tables/Lakeflow Declarative Pipelines is a strong plus.
• Practical experience with Unity Catalog (or equivalent) for access control, lineage, and cataloguing.
• Demonstrated experience implementing data anonymisation/pseudonymisation techniques in a regulated environment.
• Solid understanding of canonical/conformed data modelling (e.g., data vault, dimensional modelling, domain‑driven design for data).
• Track record exposing data via APIs (REST/GraphQL) - designing schemas, contracts, and versioning for external/internal consumers.
• Proficient in Python and/or Scala, SQL, and infrastructure-as-code (Terraform preferred).
• Strong grasp of data governance frameworks, data privacy regulation (GDPR/CCPA), and data security practices.
• Experience with cloud platforms (Azure, AWS, or GCP) and their native data/event services.

Nice to have

• Exposure to Structured Streaming or event‑driven ingestion (Kafka, CDC tools such as Debezium) - not a core requirement, but useful as the platform matures.
• Familiarity with knowledge graph concepts (e.g., RDF/property graphs, Neo4j, graph layers on Spark) - a plus rather than an expectation.
• Experience with data mesh or federated data product architectures.
• Experience with metadata management/catalog tools beyond Unity Catalog (e.g., OpenMetadata, Collibra, Purview).
• Exposure to MLOps or feature store patterns on Databricks.
• Relevant certifications (Databricks Data Engineer Professional, cloud architecture certs).

Join a truly global team.

We offer a dynamic and international environment where high performance meets real purpose. We're proud to be Great Place to Work-certified and even prouder of the people who make that possible. Let’s shape the future of procurement - together.

Chain IQ – Create. Lead. Make an impact.

Information for agencies: Applications sent or uploaded by placement agencies or similar are not desired, will therefore not be considered and will be deleted.