Senior Data Engineer (remote from Portugal or selected EU countries)

FCamara; Portugal; Teletrabalho; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

FCamara is seeking a Senior Data Engineer with strong English to join a Europe-based client in a fully remote role. You will design and operate data pipelines on Databricks, implement DataOps, and ensure data governance across platforms.

From Portugal or other approved EU countries, you will collaborate with cross-functional teams across the client and FCamara, mentoring juniors, reviewing code, and delivering scalable data solutions with LGPD/GDPR compliance.

Qualificações

• 6+ years of experience in data engineering roles.
• 6+ years including 3+ years with Databricks in production.
• Proficient with PySpark, Spark SQL, Delta Lake, and Delta Live Tables.
• Experience designing batch and streaming data pipelines and Lakehouse architectures.
• CI/CD for data workloads using Git, Azure DevOps, or GitHub Actions and Databricks Asset Bundles.
• Data governance with Unity Catalog, data security, and LGPD/GDPR compliance.
• Fluent English for global collaboration.

Responsabilidades

• Design, build, and optimise batch and streaming data pipelines on Databricks.
• Evolve Lakehouse architecture (bronze to gold) across multiple data sources.
• Implement and maintain CI/CD pipelines for data workloads.
• Automate data testing, quality checks, and promotions across environments.
• Define and enforce data governance standards and access control.
• Mentor mid-level and junior engineers and document architecture decisions.

Conhecimentos

Databricks

PySpark

Spark SQL

Delta Lake

Delta Live Tables

CI/CD

Git

Azure DevOps

GitHub Actions

Python

SQL

Azure

DataOps

Data governance

Terraform

Observability

MLOps

Unity Catalog

Databricks Asset Bundles

Ferramentas

Databricks Asset Bundles

dbt

Great Expectations

Lakehouse Monitoring

Purview

Kafka

Event Hubs

Descrição da oferta de emprego

Job description

We are looking for Senior Data Engineer with strong English skills to join us in a project with a Europe-based company. This is a remote position, and we will consider candidates from Portugal and a limited set of EU countries.

Our Client is a global player in the field of operations, risk, and sustainability services and solutions for companies and industries across the world. As they provide both services and technology for their clients, the Senior Data Engineer we are looking for will support the delivery of value across client's operations and technology ecosystem.

In this position, you are hired by FCamara Europe, the European division of one of the largest and fast-growing tech and cognitive services group in Brazil, with +1500 specialists and engineers. From Portugal we deliver services to the EU, UK, US and MENA, bringing together multicultural, diverse and creative teams through projects, managed services, squads, and staff augmentation.

Main responsibilities

In this role, you will be primarily responsible for acting as the technical reference for our Client’s Databricks data platform, designing and operating reliable data pipelines, implementing DataOps and CI/CD practices, and establishing strong data governance to ensure secure, traceable, and AI-ready datasets.

In a typical week you will:

• Design, build, and optimise batch and streaming data pipelines on Databricks using PySpark, Spark SQL, Delta Lake, and Delta Live Tables.
• Evolve the Lakehouse architecture (bronze, silver, and gold layers) to ingest and transform operational, behavioural, and HSE data from multiple clients and sources.
• Implement and maintain CI/CD pipelines for data workloads using Databricks Asset Bundles, Git, Azure DevOps, or GitHub Actions.
• Automate data testing, quality checks, and promotion across development, staging, and production environments.
• Implement and manage Unity Catalog, including catalogs, permissions, lineage, auditing, and data access policies.
• Define and enforce data governance standards, security controls, data masking, and per-client data isolation to ensure compliance with LGPD and GDPR.
• Monitor pipeline performance, define SLAs, set up alerts, and lead incident reviews.
• Provision infrastructure as code using Terraform and standardise pipeline templates and best practices.
• Act as a technical reference by reviewing code, mentoring mid-level and junior engineers, and collaborating with product, data science, and consulting teams.
• Document architecture decisions, technical standards, and data engineering best practices.

Requirements and skills

Seniority: Due to the nature of the position, we are looking for someone with at least 6+ years of experience in similar roles, including 3+ years working with Databricks in production environments.

To be considered for the role, it is mandatory you to fulfill these requirements:

• Strong hands-on experience with Databricks in production, including PySpark, Spark SQL, Delta Lake, and Delta Live Tables / Lakeflow.
• Solid experience designing and optimising batch and streaming pipelines and evolving Lakehouse architectures (bronze, silver, gold layers).
• Proven experience implementing CI/CD for data workloads using Git, Azure DevOps or GitHub Actions, and Databricks Asset Bundles.
• Practical DataOps experience, including automated testing, pipeline versioning, observability, and monitoring.
• Hands-on experience with data governance, ideally using Unity Catalog (access control, lineage, and auditing).
• Experience with Infrastructure as Code using Terraform.
• Strong proficiency in Python, PySpark, and advanced SQL.
• Cloud experience, preferably on Azure (ADLS, Data Factory, Key Vault, Entra ID).
• Experience with agentic coding.
• Fluent English to work with global teams and clients.

It will be very well appreciated if you also bring:

• Databricks Data Engineer Professional certification or Azure certifications (DP-203 / DP-700).
• Experience with multi-tenant SaaS platforms and per-client data isolation.
• Knowledge of MLOps practices (MLflow, Feature Store, Model Serving) and building data pipelines for generative AI / RAG.
• Experience with Microsoft Purview.
• Experience with data quality tools (Great Expectations, Lakehouse Monitoring, dbt).
• Experience with streaming technologies (Kafka, Event Hubs, or Structured Streaming).
• Domain knowledge in HSE, industrial operations, or risk management data.

Beyond technical knowledge, we also expect you to have a collaborative and team-oriented profile:

• Ability to understand requirements and technical solutions
• Strong communication skills
• Critical thinking and a focus on continuous improvement
• Strong delivery mindset and commitment to deadlines and goals

Additional information

This is a fully remote position. You may occasionally be invited or requested to visit Client or FCamara sites in Portugal or Central Europe on an occasional, pre-planned basis. Regular office visits are not anticipated.

Accepted Countries: Please note that due to contractual and compliance requirements, this role is currently limited to individuals currently and lawfully residing with a work permit in the following countries: Portugal, Bulgaria, Croatia, Estonia, Hungary, Latvia, Lithuania, Slovakia, and Romania.

Nationality and Visa Sponsorship: We welcome you, regardless of your nationality, provided you meet the role requirements and are legally resident in one of the accepted countries. Please note that we do not provide visa sponsorship or relocation support for this role.

This role requires English at a minimum B2+ level (professional working proficiency): Please note that English is the primary language used in the project, and a minimum B2 level is required. If English is not your primary language, we may ask you to complete a fluency assessment.

Long-term project: This position is part of a long-term project.

Contract Model: The role may be offered under one of the following arrangements, depending on your location, interests and professional profile: employment contract, independent contractor, or B2B.