Data Engineer

emagine - Portugal; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading technology firm is seeking a Data / ETL Engineer experienced in building and operating data pipelines in AWS. Candidates should have strong SQL and Python skills, along with hands-on experience using Amazon Athena and AWS Glue. The role demands designing reliable data pipelines and collaborating with various stakeholders. Also, familiarity with Apache Iceberg and event-driven architectures using Kafka is preferred. The position requires working in the Denmark time zone.

Qualificações

• Strong experience building and operating data pipelines in AWS.
• Solid understanding of relational databases.
• Able to design scalable, reliable data pipelines.

Responsabilidades

• Collaborate with engineers, analysts, and stakeholders around data models.
• Work with modern data lake architectures in AWS.
• Comfortable working in the Denmark time zone.

Conhecimentos

SQL skills

Python development

AWS Glue

Amazon Athena

Apache Iceberg

Ferramentas

Microsoft SQL Server

Apache Flink

Kafka

Descrição da oferta de emprego

Profile: Data / ETL Engineer (AWS)

We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS.

Core skills & experience:

• Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred)
• Strong Python development skills, particularly for data processing and ETL workloads
• Hands-on experience with Amazon Athena for querying data in data lakes
• Experience with AWS Glue, including Glue Data Catalog, databases, and crawlers
• Knowledge of Apache Iceberg for table formats and data lake management
• Broad AWS knowledge, including data services, IAM, networking basics, and operational best practices

Nice-to-have / preferred experience:

• Experience building streaming data pipelines, preferably using Apache Flink
• Familiarity with Kafka (managed or self-hosted) for event-driven architectures
• Experience with non-relational datastores and/or column-oriented data stores (e.g. NoSQL, data warehouse or analytics-focused systems)

General expectations:

• Able to design scalable, reliable data pipelines
• Comfortable working with modern data lake architectures in AWS
• Experience collaborating with engineers, analysts, and stakeholders around data models and ingestion patterns
• Strong English skills

• To work in the Denmark time zone