Data Engineer

Inetum; Ermesinde; Presencial; EUR 42 000 - 60 000; Tempo integral

Resumo da oferta

Inetum is seeking a Mid-Level Data Engineer in Portugal to design, optimize, and maintain scalable data pipelines and ensure performance. You will collaborate with Data Science teams to operationalize ML models in production environments.

Responsibilities include building ingestion solutions, optimizing workflows, and delivering robust data architectures with PySpark, Polars, and REST APIs, in a modern cloud ecosystem.

Qualificações

• 3+ years in Data Engineering.
• Advanced Python and SQL skills.
• Design robust, scalable data solutions for large-scale processing.
• Hands-on with Polars or equivalent in-memory processing.
• Experience with PySpark and distributed processing frameworks.
• Experience building data ingestion pipelines via REST APIs.
• Knowledge of Git, CI/CD, and testing practices.
• Experience deploying ML pipelines in production environments.

Responsabilidades

• Design, develop, and maintain scalable data pipelines.
• Optimize data processing workflows for large datasets.
• Build and manage data ingestion from multiple sources.
• Ensure data quality, reliability, and performance across platforms.
• Collaborate with Data Science and Engineering teams to deploy ML solutions.
• Contribute to software engineering best practices and CI/CD.

Conhecimentos

Python

SQL

PySpark

Polars

REST APIs

Git

CI/CD

ML pipelines

Ferramentas

Databricks

Apache Airflow

AWS

Azure

GCP

Descrição da oferta de emprego

We are looking for a Mid-Level Data Engineer to design, optimize, and maintain complex data pipelines, ensuring the scalability, reliability, and performance of data solutions. In this role, you will also collaborate with Data Science teams to integrate and operationalize machine learning models in production environments.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Optimize data processing workflows for large-scale datasets.
• Build and manage data ingestion solutions from multiple sources.
• Ensure data quality, reliability, and performance across platforms.
• Collaborate with Data Science and Engineering teams to deploy and operationalize ML solutions.
• Contribute to software engineering best practices and continuous improvement initiatives.

Profile

• Proven experience of 3+ years in Data Engineering.
• Advanced proficiency in Python and SQL.
• Demonstrated ability to design robust, maintainable, and highly scalable solutions for large-scale data processing and performance optimization.
• Hands-on experience with in-memory data processing libraries such as Polars (or equivalent).
• Solid experience with distributed data processing frameworks, particularly PySpark.
• Experience developing data ingestion pipelines leveraging REST APIs.
• Strong knowledge of software development best practices.
• Experience with Git, CI/CD pipelines, and software testing methodologies.
• Experience deploying, monitoring, and maintaining Machine Learning pipelines in production environments.

Nice to have:

• Experience with modern data platforms such as Databricks.
• Experience orchestrating workflows using tools such as Apache Airflow.
• Knowledge of cloud platforms (AWS, Azure, or GCP).

About Inetum

Inetum is a European leader in digital services. Inetum s team of 28,000 consultants and specialists strive every day to make a digital impact for businesses, public sector entities and society. Inetum s solutions aim at contributing to its clients performance and innovation as well as the common good.

Some content, images, audio, video, or interactive features on this website may be created, enhanced, or supported by Artificial Intelligence