Data Engineer

emagine - Portugal; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading technology firm in Brazil seeks a skilled Data / ETL Engineer to build and manage data pipelines in AWS. The role requires strong SQL and Python development skills, along with familiarity with data lake architectures. Applicants should be comfortable working with AWS Glue and Amazon Athena, and have experience collaborating with diverse teams on data models. Strong English communication skills are essential for this position, which also requires adapting to the Denmark time zone.

Qualificações

• Strong experience building and operating data pipelines in AWS.
• Solid understanding of relational and non-relational databases.
• Experience collaborating with stakeholders on data models.

Responsabilidades

• Design scalable and reliable data pipelines.
• Work with modern data lake architectures in AWS.
• Collaborate with teams around data ingestion patterns.

Conhecimentos

SQL skills

Python development

AWS Glue

Amazon Athena

Apache Iceberg

AWS services knowledge

Ferramentas

Microsoft SQL Server

Apache Flink

Kafka

Descrição da oferta de emprego

Profile: Data / ETL Engineer (AWS)

We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS.

Core skills & experience:

• Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred)
• Strong Python development skills, particularly for data processing and ETL workloads
• Hands-on experience with Amazon Athena for querying data in data lakes
• Experience with AWS Glue, including Glue Data Catalog, databases, and crawlers
• Knowledge of Apache Iceberg for table formats and data lake management
• Broad AWS knowledge, including data services, IAM, networking basics, and operational best practices

Nice-to-have / preferred experience:

• Experience building streaming data pipelines, preferably using Apache Flink
• Familiarity with Kafka (managed or self-hosted) for event-driven architectures
• Experience with non-relational datastores and/or column-oriented data stores (e.g. NoSQL, data warehouse or analytics-focused systems)

General expectations:

• Able to design scalable, reliable data pipelines
• Comfortable working with modern data lake architectures in AWS
• Experience collaborating with engineers, analysts, and stakeholders around data models and ingestion patterns
• Strong English skills

• To work in the Denmark time zone