Mid Data Platform Engineer (Remote from Portugal)

FOX IT; Aveiro; Presencial; EUR 42 000 - 64 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

26 days vacation

Birthday bonus 50€

Training

Career development opportunities

Resumo da oferta

A FOX IT procura um Engenheiro de Plataforma de Dados de nível médio para se juntar a um projeto internacional inovador. Será responsável por suportar e desenvolver a plataforma de dados, assegurando fluxos confiáveis, escaláveis e eficientes.

Inclui trabalhar com equipes multidisciplinares, otimizar consultas SQL, monitorizar desempenho e garantir conformidade com governança de dados, em ambiente remoto a partir de Portugal.

Qualificações

• Experiência com pipelines de dados em ambiente de produção.
• Conhecimento prático de SQL e processamento distribuído (ex.: Apache Spark).
• Proficiência em debugging de dbt, Kafka, Ignite, NiFi e AirFlow.

Responsabilidades

• Dar suporte e desenvolver a plataforma de dados em projeto internacional.
• Apoiar pipelines e processos ETL/ELT para fluxos de dados confiáveis e escaláveis.
• Colaborar com arquitetos de plataforma para garantir eficiência, segurança e alta disponibilidade.
• Melhorar processos de dados, monitorização, desempenho e eficiência da plataforma.
• Documentar mudanças, processos e melhores práticas da plataforma de dados.
• Revisar e aprovar lançamentos de produtos de dados em produção.

Conhecimentos

SQL

Spark

dbt

Kafka

AirFlow

Python/Scala

AWS

Grafana

Ferramentas

Terraform

Dremio

Collibra

Alation

Power BI

Collaboration & Git

Descrição da oferta de emprego

Descrição da Empresa

FOX IT is a Portuguese IT consulting company, ranked for the fifth consecutive year among Portugal’s top 5% SMEs and, for the first time, in the sector’s national Top 10. We promote a fairer IT market for clients and consultants. Our Happy at Work certification reinforces our commitment to people.

Descrição da Função

We’re seeking for a Mid Data Platform Engineer to join an innovative and International project.

Responsabilidades

• We're looking for a Data Engineer to support and develop a data platform within a large-scale international energy provider, Galp.
• Provide user support for the data platform, troubleshooting and fixing issues
• Support data pipelines and ETL/ELT processes to enable reliable and scalable data flows
• Collaborate with platform architects to ensure the data platform is efficient, secure, and highly available
• Improve data processes, monitoring, performance and platform efficiency
• Support data quality frameworks and monitoring to ensure accuracy, consistency, and completeness of data pipelines
• Support for data lakes, data warehouses, and data streaming solutions
• Work with stakeholders (data scientists, analysts, business users) to solve issues in the data platform
• Automate repeatable tasks and improve the data ingestion, transformation, and delivery processes
• Troubleshoot and optimize data workflows and SQL queries for performance and cost efficiency
• Document data platform changes, processes, and best practices
• Review, evaluate and approve data product releases to production.

Requisitos

• Experience with data pipelines in a production environment
• Strong hands-on knowledge of SQL and experience with distributed data processing (e.g., Apache Spark)
• Proficiency and knowledge of troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi and Apache AirFlow
• Proficiency in a programming language such as Python or Scala for data engineering tasks
• Experience with cloud data services (AWS)
• Familiarity with Grafana tools
• Knowledge of data governance, security, and compliance in a cloud environment
• Experience implementing CI/CD and testing frameworks for data workflows
• Strong problem-solving skills, communication skills, and passion for collaboration
• Fluent in written and spoken Portuguese and English.

O que é um plus:

• Familiarity with Dremio data lake warehouse architectures and concepts
• Experience with Terraform provisioning data services
• Familiarity with Power BI on-premises gateway
• Hands-on experience with data catalogue and governance tools (e.g., Collibra, Alation)
• Experience with machine learning pipelines and feature engineering

Regime

Remote from Portugal (the candidate can work remotely from any Portuguese region)

O que oferecemos:

• 26 days of vacation
• health insurance
• 50€ as a birthday bonus
• Training
• Opportunity to develop your career Take the Leap, Join Us! Localização
• Todo o país, Portugal