Senior Data Engineer – Remote from Portugal, Selected EU Countries

FCamara Consulting & Training

United States

Remote

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote

Job summary

FCamara Consulting & Training is seeking a senior Data Engineer to act as the technical reference for client Databricks platforms, designing and optimizing both batch and streaming pipelines using PySpark, Spark SQL, Delta Lake, and Delta Live Tables. You will evolve Lakehouse architectures, implement CI/CD for data workloads, and ensure governance with Unity Catalog while adhering to LGPD/GDPR.

This is a fully remote role with international collaboration and required work authorization in

Qualifications

Responsibilities

  • Act as the technical reference for the Client’s Databricks data platform
  • Design, build, and optimise batch and streaming data pipelines on Databricks using PySpark, Spark SQL, Delta Lake, and Delta Live Tables
  • Evolve the Lakehouse architecture (bronze, silver, and gold layers) to ingest and transform operational, behavioural, and HSE data from multiple clients and sources
  • Implement and maintain CI/CD pipelines for data workloads using Databricks Asset Bundles, Git, Azure DevOps, or GitHub Actions
  • Automate data testing, quality checks, and promotion across development, staging, and production environments
  • Implement and manage Unity Catalog, including catalogs, permissions, lineage, auditing, and data access policies
  • Define and enforce data governance standards, security controls, data masking, and per-client data isolation to ensure compliance with LGPD and GDPR
  • Monitor pipeline performance, define SLAs, set up alerts, and lead incident reviews
  • Provision infrastructure as code using Terraform and standardise pipeline templates and best practices
  • Review code, mentor mid-level and junior engineers, and collaborate with product, data science, and consulting teams
  • Document architecture decisions, technical standards, and data engineering best practices

Job description

  • Act as the technical reference for the Client’s Databricks data platform
  • Design, build, and optimise batch and streaming data pipelines on Databricks using PySpark, Spark SQL, Delta Lake, and Delta Live Tables
  • Evolve the Lakehouse architecture (bronze, silver, and gold layers) to ingest and transform operational, behavioural, and HSE data from multiple clients and sources
  • Implement and maintain CI/CD pipelines for data workloads using Databricks Asset Bundles, Git, Azure DevOps, or GitHub Actions
  • Automate data testing, quality checks, and promotion across development, staging, and production environments
  • Implement and manage Unity Catalog, including catalogs, permissions, lineage, auditing, and data access policies
  • Define and enforce data governance standards, security controls, data masking, and per-client data isolation to ensure compliance with LGPD and GDPR
  • Monitor pipeline performance, define SLAs, set up alerts, and lead incident reviews
  • Provision infrastructure as code using Terraform and standardise pipeline templates and best practices
  • Review code, mentor mid-level and junior engineers, and collaborate with product, data science, and consulting teams
  • Document architecture decisions, technical standards, and data engineering best practices
  • At least 6+ years of experience in similar roles
  • 3+ years working with Databricks in production environments
  • Strong hands‑on experience with Databricks in production, including PySpark, Spark SQL, Delta Lake, and Delta Live Tables / Lakeflow
  • Solid experience designing and optimising batch and streaming pipelines and evolving Lakehouse architectures (bronze, silver, gold layers)
  • Proven experience implementing CI/CD for data workloads using Git, Azure DevOps or GitHub Actions, and Databricks Asset Bundles
  • Practical DataOps experience, including automated testing, pipeline versioning, observability, and monitoring
  • Hands‑on experience with data governance, ideally using Unity Catalog (access control, lineage, and auditing)
  • Experience with Infrastructure as Code using Terraform
  • Strong proficiency in Python, PySpark, and advanced SQL
  • Cloud experience, preferably on Azure (ADLS, Data Factory, Key Vault, Entra ID)
  • Experience with agentic coding
  • Fluent English; minimum B2+ level (professional working proficiency)
  • Databricks Data Engineer Professional certification or Azure certifications (DP-203 / DP-700) appreciated
  • Experience with multi‑tenant SaaS platforms and per-client data isolation appreciated
  • Knowledge of MLOps practices (MLflow, Feature Store, Model Serving) and building data pipelines for generative AI / RAG appreciated
  • Experience with Microsoft Purview appreciated
  • Experience with data quality tools (Great Expectations, Lakehouse Monitoring, dbt) appreciated
  • Experience with streaming technologies (Kafka, Event Hubs, or Structured Streaming) appreciated
  • Domain knowledge in HSE, industrial operations, or risk management data appreciated
  • Ability to understand requirements and technical solutions
  • Strong communication skills
  • Critical thinking and a focus on continuous improvement
  • Strong delivery mindset and commitment to deadlines and goals
  • Must currently and lawfully reside with a work permit in Portugal, Bulgaria, Croatia, Estonia, Hungary, Latvia, Lithuania, Slovakia, or Romania
  • No visa sponsorship or relocation support available
  • Fully remote position with occasional, pre-planned visits to Client or FCamara sites in Portugal or Central Europe; regular office visits are not anticipated
  • No visa sponsorship or relocation support
  • Long-term project
  • Contract model options: employment contract, independent contractor, or B2B
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer (Databricks/PySpark/SQL) - Portugal or Spain Full Remote
Senior Data Engineer (Databricks/PySpark/SQL) - Portugal or Spain Full Remote

HumanIT Digital Consulting • United States

Remote
USD 28,000 - 37,000
15th month salary
Health insurance for family
Birthday off
+3
Senior Data Engineer - Remote First
Senior Data Engineer - Remote First

EPI Company • United States

Remote
USD 150,000 - 190,000
Performance bonus
Benefits package
€5,000 learning budget
1178 - Sr. Data Architect
1178 - Sr. Data Architect

GoFasti • United States

Remote
USD 78,000 - 98,000
Senior Data Architect
Senior Data Architect

Sowelo Consulting sp. z o.o. sp. k. • United States

Remote
USD 45,000 - 87,000
Senior Data Engineering Consultant
Senior Data Engineering Consultant

Advancing Analytics • United States

Hybrid
USD 61,000 - 83,000
Data Engineer (Databricks & Treasury Data Lake), Remote (EU) – International Client
Data Engineer (Databricks & Treasury Data Lake), Remote (EU) – International Client

The White Team • United States

Remote
USD 54,000 - 71,000
Senior Azure Data Engineer | Remote
Senior Azure Data Engineer | Remote

DCV Technologies • United States

Remote
USD 96,000 - 152,000
Stable long-term cooperation with 100%
Modern technologies in an Intl. team
Professional growth
+1
DATA Tech Lead, Brazil
DATA Tech Lead, Brazil

CI&T • United States

Remote
USD 160,000 - 230,000
Data Engineering Manager
Data Engineering Manager

Datapao • United States

Remote
USD 132,000 - 177,000
Fully remote within Spain
Senior Data Engineer with Databricks
Senior Data Engineer with Databricks

xebiacee • United States

Remote
USD 100,000 - 150,000