Senior Data Engineer

FCamara; Portugal; Remote; EUR 80,000 - 120,000; Full time

Job summary

A FCamara, empresa de tecnologia com atuação internacional, procura um Senior Data Engineer para ser referência técnica na plataforma Databricks. Irá desenhar e manter pipelines, automatizar entrega via DataOps e CI/CD, e estabelecer governança para dados seguros, rastreáveis e prontos para modelos de IA usados por clientes globais.

A posição é remota, com elegibilidade para candidatos de Portugal e alguns países da UE; trabalha-se com equipes multiculturais, com foco em Lakehouse, Delta Lake,

Qualifications

• 6+ anos em data engineering, incluindo 3+ anos com Databricks em produção.
• Forte Python, PySpark e SQL avançado.
• Experiência com Delta Lake e arquitetura Lakehouse.
• Prática DataOps: testes automatizados, observabilidade e versionamento de pipelines.
• Gestão de dados/ Unity Catalog (acesso, lineage, auditing).
• CI/CD para dados (Git, Azure DevOps ou GitHub Actions, Databricks Asset Bundles).
• Experiência em Cloud, ideal Azure.
• Inglês fluente para trabalhar com equipas globais.

Responsibilities

• Projetar, construir e otimizar pipelines em Databricks (PySpark, Spark SQL, Delta Lake).
• Evoluir a arquitetura Lakehouse com bronze/silver/gold para ingerir dados de múltiplos clientes.
• Garantir desempenho e custo-eficiência de clusters e SQL Warehouses.
• Fornecer datasets confiáveis para data science, IA e equipas de produto.
• Implementar pipelines de CI/CD para código de dados usando ferramentas indicadas.
• Monitorizar pipelines, definir SLAs e conduzir revisões de incidentes.
• Garantir conformidade com LGPD/GDPR e políticas de segurança.

Skills

Python

PySpark

SQL

DataOps

CI/CD

Databricks

Delta Lake

Azure

Inglês

Education

Degree em Ciência da Computação/Engenharia/Sistemas de Informação

Tools

Databricks Asset Bundles

Git

Azure DevOps

GitHub Actions

Terraform

Job description

Descrição da vaga

We are looking for a Senior Data Engineer to be the technical reference for our Databricks data platform. You will design and run reliable pipelines, automate delivery through DataOps and CI/CD, and establish the governance that keeps data secure, traceable and ready for AI models used by global clients.

This is a remote position, and we will consider candidates from Portugal and a limited set of EU countries.

Our Client is a global player in the field of operations, risk, and sustainability services and solutions for companies and industries across the world. As they provide both services and technology for their clients, the Senior Data Engineer we are looking for will support the delivery of value across client's operations and technology ecosystem.

In this position, you are hired by FCamara Europe, the European division of one of the largest and fastest growing tech and cognitive services group in Brazil, with +1500 specialists and engineers. From Portugal we deliver services to the EU, UK, US and MENA, bringing together multicultural, diverse and creative teams through projects, managed services, squads, and staff augmentation.

Responsabilidades e atribuições

Data engineering on Databricks

• Design, build and optimise batch and streaming pipelines on Databricks (PySpark, Spark SQL, Delta Lake, Delta Live Tables / Lakeflow).


• Evolve the Lakehouse architecture (bronze, silver and gold layers) to ingest operational, behavioural and HSE data from multiple clients and formats.


• Ensure performance and cost efficiency of clusters, jobs and SQL Warehouses.


• Deliver trusted datasets to data science, AI and product teams.

DataOps and CI/CD

• Implement CI/CD pipelines for data code using Databricks Asset Bundles, Git and Azure DevOps or GitHub Actions.


• Automate data testing (unit, integration and quality) and promotion across dev, staging and production.


• Provision infrastructure as code (Terraform) and standardise pipeline templates.


• Monitor pipelines, define SLAs and alerts, and lead incident reviews.

Governance and data quality

• Implement and administer Unity Catalog: catalogs, permissions, lineage and auditing.


• Define policies for security, access control, data masking and per-client data isolation.


• Ensure compliance with LGPD, GDPR and the contractual requirements of global clients.


• Establish metadata standards, data contracts and quality metrics.

Technical leadership

• Act as a technical reference, reviewing code and mentoring mid-level and junior engineers.


• Partner with product, data science and consultants to turn business needs into data solutions.


• Document architecture, standards and best practices.

Requisitos e qualificações

• 6+ years in data engineering, including 3+ years with Databricks in production.


• Strong Python, PySpark and advanced SQL.


• Solid experience with Delta Lake and Lakehouse (medallion) architecture.


• Practical DataOps experience: automated testing, observability and pipeline versioning.


• Data governance experience, ideally with Unity Catalog (access, lineage, auditing).


• Hands-on CI/CD for data (Git, Azure DevOps or GitHub Actions, Databricks Asset Bundles or similar).


• Cloud experience, ideally Azure (ADLS, Data Factory, Key Vault, Entra ID).


• Experience with agentic coding


• Infrastructure as code with Terraform.


• Fluent English to work with global teams and clients.


• Degree in Computer Science, Engineering, Information Systems or a related field.

Nice to have

• Databricks (Data Engineer Professional) or Azure (DP-203 / DP-700) certifications.


• Experience with multi-tenant SaaS platforms and per-client data isolation.


• MLOps knowledge (MLflow, Feature Store, Model Serving) and data pipelines for generative AI / RAG.


• Microsoft purview experience


• Data quality tools (Great Expectations, Lakehouse Monitoring, dbt).


• Streaming with Kafka, Event Hubs or Structured Streaming.


• Experience with HSE, industrial operations or risk management data.

Informações adicionais

This is a fully remote position. You may occasionally be invited or requested to visit Client or FCamara sites in Portugal or Central Europe on an occasional, pre-planned basis. Regular office visits are not anticipated.

Accepted Countries

Please note that due to contractual and compliance requirements, this role is currently limited to individuals currently and lawfully residing with a work permit in the following countries: Portugal, Bulgaria, Croatia, Estonia, Hungary, Latvia, Lithuania, Slovakia, and Romania.

Nationality and Visa Sponsorship

We welcome you, regardless of your nationality, provided you meet the role requirements and are legally resident in one of the accepted countries. Please note that we do not provide visa sponsorship or relocation support for this role.

Language Requirement

This role requires English at a minimum B2+ level (professional working proficiency). Please note that English is the primary language used in the project, and a minimum B2 level is required. If English is not your primary language, we may ask you to complete a fluency assessment.

Long-term project

This position is part of a long-term project.

Contract Model

The role may be offered under one of the following arrangements, depending on your location, interests and professional profile: employment contract, independent contractor, or B2B.

Transformamos mundos sonhados em trajetórias reais.

Aqui somos #SangueLaranja!

Estamos há 17 anos no mercado, lado a lado com nossos clientes, proporcionando experiências transformadoras.

Somos um ecossistema de tecnologia e inovação, com expansão global; Além do Brasil estamos presentes na Europa e Reino Unido com escritórios em Portugal, Londres, Dubai e Holanda.

F de Formação: acreditamos na prática da cultura do compartilhamento, no senso de comunidade, e que o conhecimento

tem o poder da transformação!

Possuímos iniciativas, e ações sociais, que promovem o desenvolvimento, como a comunidade tech Orange Juice, o Programa de Formação,

nossa escola de liderança e diversas parcerias com ONGs e Edtechs.

Na FCamara todos são bem-vindos, para nós, Diversidade, Respeito e Ética, são elementos inegociáveis e fazem parte do nosso DNA.

E aí, está pronto para fazer parte de um time incrível e ser protagonista da própria história?