Remote Data Engineer: ELT Pipelines & AWS Data Platform

Mentor Talent Acquisition; Portugal; Remoto; EUR 60.000 - 80.000; Tempo pieno

Vantaggi offerti da questo lavoro

Remote work option

Quarterly office weeks in Vienna

International team

Descrizione del lavoro

Mentor Talent Acquisition is seeking a Data Engineer to design, build, and operate scalable ELT pipelines powering analytics and core product features. You will work with Python, SQL and AWS, contributing to modern data architectures and ensuring data quality and performance.

Responsibilities include implementing data workflows on AWS, evolving the data platform, and collaborating with cross-functional teams.

Competenze

• Design and maintain scalable ELT pipelines.
• Operate data workflows using AWS (Lambda, Step Functions, S3, Batch).
• Contribute to Data Platform architecture and Medallion pattern.
• Ensure data quality, reliability and performance across pipelines.
• Collaborate with backend/frontend engineers and product teams.
• Monitor pipelines, troubleshoot issues and improve observability.
• Document data models, transformations and architecture decisions.
• Experience building ETL/ELT pipelines in production.
• Solid SQL skills and dimensional data modeling.
• Experience with structured and semi-structured data (JSON, CSV, Parquet, APIs).
• Understanding of data validation and data quality practices.
• Experience with Git and CI/CD.

Mansioni

• Design, build and maintain scalable ELT pipelines.
• Implement and operate data workflows using AWS (Lambda, Step Functions, S3, Batch).
• Contribute to evolution of Data Platform architecture (Medallion).
• Ensure data quality, consistency, and reliability across pipelines.
• Optimize data transformations for performance and cost efficiency.
• Collaborate with Backend and Frontend Engineers and Product to define data requirements.
• Monitor pipelines, troubleshoot issues and improve observability.
• Document data models, transformations and architecture decisions.
• Experience building ETL/ELT pipelines in production environments.
• Solid experience with AWS (Lambda, Step Functions, S3).
• Understanding of Medallion Architecture.
• Strong SQL skills and experience with dimensional data modeling.
• Experience working with structured and semi-structured data (JSON, CSV, Parquet, APIs).
• Understanding of data validation and data quality practices.
• Experience with Git and CI/CD.

Conoscenze

Python

SQL

AWS

ELT pipelines

Data modeling

CI/CD

Git

Strumenti

Terraform

Docker

ClickHouse

Redshift

BigQuery

Descrizione del lavoro

Mentor Talent Acquisition is seeking a Data Engineer to design, build, and operate scalable ELT pipelines powering analytics and core product features. You will work with Python, SQL and AWS, contributing to modern data architectures and ensuring data quality and performance.

Responsibilities include implementing data workflows on AWS, evolving the data platform, and collaborating with cross-functional teams.