Data Engineer

Inetum; Ermesinde; Presencial; EUR 42 000 - 62 000; Tempo integral

Resumo da oferta

A Inetum procura um Data Engineer de nível intermédio para desenhar, otimizar e manter pipelines de dados complexos. Colaborará com equipas de Data Science para integrar modelos de ML em produção e melhorar a performance de soluções de dados.

O profissional trabalhará com PySpark, Polars e Databricks, aplicando as melhores práticas de engenharia de software, CI/CD e gestão de dados, em ambiente de larga escala.

Qualificações

• Mais de 3 anos de experiência em Data Engineering.
• Proficiência avançada em Python e SQL.
• Capacidade de desenhar soluções escaláveis para processamento de dados em grande escala.
• Experiência com bibliotecas/estruturas de dados como Polars e PySpark.
• Desenvolvimento de pipelines de ingestão de dados via REST APIs.
• Boas práticas de desenvolvimento: Git, CI/CD e testes.

Responsabilidades

• Desenhar, desenvolver e manter pipelines de dados escaláveis.
• Otimizar fluxos de processamento de dados para grandes volumes.
• Gerir ingestão de dados de várias fontes.
• Assegurar qualidade, confiabilidade e performance dos dados.
• Colaborar com Data Science para operacionalizar modelos ML.
• Contribuir para melhores práticas de engenharia de software.

Conhecimentos

Python

SQL

PySpark

Polars

Data pipelines

REST APIs

Git

CI/CD

ML deployment

Cloud

Ferramentas

PySpark

Polars

Databricks

Airflow

Git

Descrição da oferta de emprego

Descrição da empresa

Inetum is a European leader in digital services. Inetum’s team of 28,000 consultants and specialists strive every day to make a digital impact for businesses, public sector entities and society. Inetum’s solutions aim at contributing to its clients’ performance and innovation as well as the common good.

Descrição do emprego

We are looking for a

Descrição da empresa

Inetum is a European leader in digital services. Inetum’s team of 28,000 consultants and specialists strive every day to make a digital impact for businesses, public sector entities and society. Inetum’s solutions aim at contributing to its clients’ performance and innovation as well as the common good.

Descrição do emprego

We are looking for a Mid-Level Data Engineer to design, optimize, and maintain complex data pipelines, ensuring the scalability, reliability, and performance of data solutions. In this role, you will also collaborate with Data Science teams to integrate and operationalize machine learning models in production environments.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines.


• Optimize data processing workflows for large-scale datasets.


• Build and manage data ingestion solutions from multiple sources.


• Ensure data quality, reliability, and performance across platforms.


• Collaborate with Data Science and Engineering teams to deploy and operationalize ML solutions.


• Contribute to software engineering best practices and continuous improvement initiatives.

Qualificações

• Proven experience of 3+ years in Data Engineering.


• Advanced proficiency in Python and SQL.


• Demonstrated ability to design robust, maintainable, and highly scalable solutions for large-scale data processing and performance optimization.


• Hands-on experience with in-memory data processing libraries such as Polars (or equivalent).


• Solid experience with distributed data processing frameworks, particularly PySpark.


• Experience developing data ingestion pipelines leveraging REST APIs.


• Strong knowledge of software development best practices.


• Experience with Git, CI/CD pipelines, and software testing methodologies.


• Experience deploying, monitoring, and maintaining Machine Learning pipelines in production environments.

Nice To Have

• Experience with modern data platforms such as Databricks.


• Experience orchestrating workflows using tools such as Apache Airflow.


• Knowledge of cloud platforms (AWS, Azure, or GCP).