Remote Data Engineer - ELT Architect, AWS & Data Platform

Mentor Talent Acquisition; Ancona; Ibrido; EUR 70.000 - 95.000; Tempo pieno

Descrizione del lavoro

Mentor Talent Acquisition is seeking a Data Engineer to design, build, and operate scalable ELT pipelines powering analytics, reporting, and product features. You will work with Python, SQL and AWS, shaping the data platform and ensuring data quality across pipelines.

Responsibilities include implementing AWS-based workflows, evolving the data architecture around Medallion architecture, and collaborating with Backend/Frontend teams.

Competenze

• Experience building ETL/ELT pipelines in production environments.
• Strong Python skills for data processing.
• Solid experience with AWS (Lambda, Step Functions, S3).
• Understanding of Medallion Architecture.
• Strong SQL skills and dimensional data modeling.
• Experience working with structured and semi-structured data (JSON, CSV, Parquet, APIs).
• Understanding of data validation and data quality practices.
• Experience with Git and CI/CD.

Mansioni

• Design, build and maintain scalable ELT pipelines.
• Implement and operate data workflows using AWS (Lambda, Step Functions, S3, Batch, etc.).
• Contribute to the evolution of our Data Platform architecture (Medallion architecture).
• Ensure data quality, consistency, and reliability across pipelines.
• Optimize data transformations for performance and cost efficiency.
• Collaborate with Backend and Frontend Engineers and Product to define data requirements.
• Monitor pipelines, troubleshoot issues and improve observability.
• Document data models, transformations and architecture decisions.

Conoscenze

Python

ETL/ELT pipelines

AWS

Medallion Architecture

SQL

Data formats (JSON/CSV/Parquet/APIs)

Data quality

Git & CI/CD

ClickHouse

Redshift

BigQuery

Terraform

Docker

Strumenti

Git

Terraform

Docker

Descrizione del lavoro

Mentor Talent Acquisition is seeking a Data Engineer to design, build, and operate scalable ELT pipelines powering analytics, reporting, and product features. You will work with Python, SQL and AWS, shaping the data platform and ensuring data quality across pipelines.

Responsibilities include implementing AWS-based workflows, evolving the data architecture around Medallion architecture, and collaborating with Backend/Frontend teams.