Hybrid ML Data Engineer — Pipelines & ML Ops

Capgemini Engineering; Lisboa; Híbrido; EUR 45 000 - 65 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid work

Health and life insurance

Referral program

Career growth programs

Training and certifications

Resumo da oferta

Capgemini Engineering seeks a data science professional to join an agile, multidisciplinary team focused on recommendation products for residential (B2C) and SME customers. You will consolidate processes into a cross-domain framework enabling ML/AI capabilities within a lean, experimentation-driven product.

You will design and maintain scalable data pipelines using Python, PySpark and SQL, orchestrate Airflow workflows, and contribute to testing, CI/CD, and data contracts.

Qualificações

• Degree in Computer Science, Engineering, Mathematics, Statistics or another quantitative discipline.
• At least 3 years of experience building and operating production-grade data pipelines.
• Strong knowledge of Python and/or PySpark, as well as SQL.
• Experience with workflow orchestration platforms such as Airflow and CI/CD practices, ideally using GitHub.
• Good understanding of distributed computing and large-scale data processing.

Responsabilidades

• Consolidate recommendation processes across B2C and SME domains into a unified data framework.
• Design, build and maintain scalable data pipelines using Python, PySpark and SQL.
• Orchestrate workflows using Airflow DAGs deployed through Astronomer.
• Implement automated testing, deployment and CI/CD processes using GitHub.
• Ensure data quality, validation, observability and compliance with SLAs.

Conhecimentos

Python

PySpark

SQL

Data quality

Analytical skills

Communication

Problem solving

Team collaboration

Adaptability

Formação académica

Bachelor's degree in CS/Engineering/Math/Stats

Ferramentas

Airflow

GitHub

Astronomer

BigQuery/Dataproc

Descrição da oferta de emprego

Capgemini Engineering seeks a data science professional to join an agile, multidisciplinary team focused on recommendation products for residential (B2C) and SME customers. You will consolidate processes into a cross-domain framework enabling ML/AI capabilities within a lean, experimentation-driven product.

You will design and maintain scalable data pipelines using Python, PySpark and SQL, orchestrate Airflow workflows, and contribute to testing, CI/CD, and data contracts.