Data Engineer: Build Scalable ML-Ready Data Pipelines

Inetum; Ermesinde; Presencial; EUR 42 000 - 60 000; Tempo integral

Resumo da oferta

Inetum is seeking a Mid-Level Data Engineer in Portugal to design, optimize, and maintain scalable data pipelines and ensure performance. You will collaborate with Data Science teams to operationalize ML models in production environments.

Responsibilities include building ingestion solutions, optimizing workflows, and delivering robust data architectures with PySpark, Polars, and REST APIs, in a modern cloud ecosystem.

Qualificações

• 3+ years in Data Engineering.
• Advanced Python and SQL skills.
• Design robust, scalable data solutions for large-scale processing.
• Hands-on with Polars or equivalent in-memory processing.
• Experience with PySpark and distributed processing frameworks.
• Experience building data ingestion pipelines via REST APIs.
• Knowledge of Git, CI/CD, and testing practices.
• Experience deploying ML pipelines in production environments.

Responsabilidades

• Design, develop, and maintain scalable data pipelines.
• Optimize data processing workflows for large datasets.
• Build and manage data ingestion from multiple sources.
• Ensure data quality, reliability, and performance across platforms.
• Collaborate with Data Science and Engineering teams to deploy ML solutions.
• Contribute to software engineering best practices and CI/CD.

Conhecimentos

Python

SQL

PySpark

Polars

REST APIs

Git

CI/CD

ML pipelines

Ferramentas

Databricks

Apache Airflow

AWS

Azure

GCP

Descrição da oferta de emprego

Inetum is seeking a Mid-Level Data Engineer in Portugal to design, optimize, and maintain scalable data pipelines and ensure performance. You will collaborate with Data Science teams to operationalize ML models in production environments.

Responsibilities include building ingestion solutions, optimizing workflows, and delivering robust data architectures with PySpark, Polars, and REST APIs, in a modern cloud ecosystem.