Cloud Data Engineer: Build Scalable Pipelines & Automation

Devoteam Alegri GmbH; Portugal; Teletrabalho; EUR 45 000 - 65 000; Tempo integral

Resumo da oferta

Devoteam Alegri GmbH in Portugal is seeking an experienced Data Engineer to design and optimize scalable data architectures. You will build robust data pipelines, ensure performance, reliability, and security, and collaborate with data scientists and stakeholders.

The role emphasizes Python mastery, Pandas/PySpark, SQL, ETL/ELT, and CI/CD in an Agile environment; you will lead end-to-end release automation and own the data ecosystem.

Qualificações

• 3+ years of professional experience in Data Engineering or similar high-scale roles.
• Expert-level Python (mandatory) with Pandas and PySpark experience.
• Strong SQL skills and design of ETL/ELT transformations.
• Experience with distributed computing (Spark), cloud data warehouses, and CI/CD.
• Experience in Agile environments and collaboration with stakeholders.

Responsabilidades

• Design and build robust, high-performance data pipelines for large-scale datasets.
• Tune data processing frameworks for stability and cost-efficiency.
• Lead CI/CD automation of end-to-end release processes.
• Collaborate with Data Scientists and Architects to translate requirements.
• Contribute to engineering standards and code reviews.
• Own the data ecosystem including security and production workflows.

Conhecimentos

Python

Pandas

PySpark

SQL

ETL/ELT

Git

Unit testing

CI/CD

Spark

Snowflake

BigQuery

Redshift

Databricks

Cloud

Agile

Ferramentas

Snowflake

BigQuery

Redshift

Databricks

Spark

Descrição da oferta de emprego

Devoteam Alegri GmbH in Portugal is seeking an experienced Data Engineer to design and optimize scalable data architectures. You will build robust data pipelines, ensure performance, reliability, and security, and collaborate with data scientists and stakeholders.

The role emphasizes Python mastery, Pandas/PySpark, SQL, ETL/ELT, and CI/CD in an Agile environment; you will lead end-to-end release automation and own the data ecosystem.