Data Engineer (Platform) | Relocation to Barcelona

Capitole

Porto

On-site

EUR 80,000 - 110,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Permanent contract
Professional development budget
Health insurance
Career development
Wellhub membership
Payflow benefits
Tech communities and team events

Job summary

Capitole is seeking a Senior Data Platform Engineer to shape a modern Azure-based data platform. You will own the Airflow platform, migrate workloads from ADF, and build metadata-driven orchestration on a scalable Lakehouse architecture.

This hands-on role blends Data Engineering, Cloud Platform Engineering and DevOps. You will collaborate with data engineers, architects and product owners to deliver reliable data products, optimize pipelines and enforce governance across environments.

Qualifications

  • 6+ years in Data/Cloud Engineering or Data Platform roles.
  • Strong Python/SQL skills with PySpark experience.
  • Hands-on Airflow in production and Terraform/IaC experience.
  • Knowledge of Azure services including ADLS, ADF and Databricks.
  • Experience with data catalog, governance or metadata-driven frameworks.

Responsibilities

  • Own and evolve the Airflow platform across environments with reliability.
  • Migrate components from ADF to Airflow and build reusable DAGs.
  • Develop metadata-driven orchestration frameworks and operators.
  • Manage Azure resources using Terraform and IaC practices.
  • Work with Key Vault, Managed Identities, Entra ID, RBAC.
  • Oversee CI/CD pipelines with Azure DevOps and multi-environment deployments.
  • Operate Databricks, Unity Catalog, Delta Lake and Data Lake Storage.
  • Improve observability, performance and cost efficiency of the platform.
  • Contribute to data catalog, data quality and data lineage efforts.
  • Participate in architecture decisions and collaborate across teams.

Skills

Python
SQL
PySpark
Apache Airflow
Cloud platforms
Terraform
Data governance

Tools

Azure Databricks
Delta Lake
Unity Catalog
Azure Data Factory
Azure Data Lake Storage

Job description

Capitole is growing, and we're looking for a Senior Data Platform Engineer to join our team and help shape the future of a modern Azure-based Data Platform!

We are looking for an experienced engineer who enjoys building, evolving and operating data platforms, with a strong focus on cloud infrastructure, orchestration, automation and governance.

You will play a key role in the evolution of a Lakehouse architecture, working on platform foundations that enable data engineering teams to build and deliver reliable, scalable and efficient data products.

This is a hands-on engineering role combining Data Engineering, Cloud Platform Engineering and DevOps.

What will you do?
  • Own and evolve the Apache Airflow platform, including environments, deployments, DAG standards, monitoring and reliability.
  • Contribute to the migration from Azure Data Factory (ADF) to Apache Airflow.
  • Develop metadata-driven orchestration frameworks, reusable operators and automated DAG generation.
  • Manage Azure resources using Terraform and Infrastructure as Code.
  • Work with Azure Key Vault, Managed Identities, Service Principals, Entra ID and RBAC.
  • Manage CI/CD pipelines and multi-environment deployments using Azure DevOps.
  • Operate and optimize Azure Databricks, Unity Catalog, Delta Lake and Data Lake Storage.
  • Improve platform observability, monitoring, alerting, performance and cost efficiency.
  • Contribute to Data Catalog, Data Quality and data lineage initiatives.
  • Participate in architecture decisions, technical reviews and engineering standards.
  • Collaborate with Data Engineers, Architects and Product Owners to continuously improve the platform.
What are we looking for?
  • 6+ years of experience in Data Engineering, Data Platform Engineering or Cloud Engineering.
  • Strong knowledge of Python, SQL and PySpark.
  • Hands-on experience with Apache Airflow in production environments.
  • Experience with Azure services, especially:
  • Azure Data Factory and Azure Data Lake Storage (ADLS).
  • Azure Key Vault and identity management.
  • Azure RBAC and Entra ID.
  • Azure DevOps and CI/CD pipelines.
  • Strong experience with Terraform and Infrastructure as Code.
  • Hands-on experience with Azure Databricks, Delta Lake and Unity Catalog.
  • Knowledge of Lakehouse architecture, Medallion architecture and metadata-driven frameworks.
  • Experience with monitoring, observability and production troubleshooting.
  • Good communication skills and the ability to collaborate with different technical teams.
Nice to have
  • Experience migrating orchestration workloads from ADF to Airflow.
  • Experience building reusable orchestration frameworks and metadata-driven DAGs.
  • Airflow deployments on Kubernetes or experience with AKS.
  • Knowledge of FinOps practices and Azure/Databricks cost optimization.
  • Experience with AI-assisted engineering workflows, MCP, AI agents or automated code reviews.
Why join Capitole?
  • Permanent contract from day one.
  • €1,200 annual budget for professional development and certifications.
  • Private health insurance fully covered by Capitole.
  • Monthly feedback and continuous career development.
  • Wellhub membership and Payflow benefits.
  • Tech communities, team events and an international environment.

At Capitole, we believe in people, technical excellence and building strong teams. You'll have the opportunity to work on challenging projects, influence technical decisions and grow alongside talented professionals.

Interested in taking your Data Platform Engineering career to the next level?

#Capitole #Hiring #DataEngineering #DataPlatform #Azure #Databricks #ApacheAirflow #Terraform #PySpark #CloudEngineering #BarcelonaJobs

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer (Azure Lakehouse)
Senior Data Platform Engineer (Azure Lakehouse)

Capitole • Porto

On-site
EUR 80,000 - 110,000
Permanent contract
Professional development budget
Health insurance
+4
Data Engineer
Data Engineer

Intellias • Portugal

On-site
EUR 70,000 - 100,000
Health Insurance
Annual Leave 22 days
Paid Sick Leave
+4
Data Engineer
Data Engineer

Adecco Recruitment • Lisboa

Hybrid
EUR 60,000 - 100,000
Senior Data Engineer (Azure & Databricks)
Senior Data Engineer (Azure & Databricks)

TP • Lisboa

On-site
EUR 70,000 - 90,000
Data & AI Senior Engineer
Data & AI Senior Engineer

Capgemini Engineering • Fundão

Hybrid
EUR 90,000 - 120,000
Hybrid work
Health and life insurance
Referral program
Azure Data Engineer
Azure Data Engineer

Afyld • Viseu

On-site
EUR 40,000 - 70,000
Data Engineer (Azure)
Data Engineer (Azure)

Caixa Mágica Software • Lisboa

On-site
EUR 30,000 - 50,000
Health and Life Insurance
Tech equipment and SIM card
Training in the latest technologies
+1
Senior Data Engineer (Databricks/PySpark/SQL) - Portugal or Spain Full Remote
Senior Data Engineer (Databricks/PySpark/SQL) - Portugal or Spain Full Remote

HumanIT Digital Consulting • Lisboa

Remote
EUR 26,000 - 34,000
15th month salary
Health insurance for family
Birthday off
+2
Distributed Cloud | Azure Data Engineer
Distributed Cloud | Azure Data Engineer

Devoteam • Lisboa

On-site
EUR 40,000 - 60,000
Distributed Cloud | Azure Data Engineer
Distributed Cloud | Azure Data Engineer

Devoteam • Porto

On-site
EUR 40,000 - 60,000
Top locations