Data Engineer - AWS, Spark & Big Data Impact

mainfyld; Lisboa, Porto; Presencial; EUR 40 000 - 65 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Continuous training

Certifications access

Collaborative culture

Resumo da oferta

Fyld is hiring a Data Engineer to design and implement scalable data solutions on AWS using Glue, EMR, Redshift and S3. You will work with Spark, PySpark, and Airflow to build robust data pipelines while maintaining high standards of code and CI/CD practices.

The role requires SQL and Python proficiency, experience with data lakes/warehouses, and familiarity with IaC. English fluency is essential for collaboration in a Portuguese-led company.

Qualificações

• Bachelor's degree in CS, SWE, DA or related field.
• Experience designing scalable data solutions on AWS.
• Strong knowledge of AWS Glue, EMR, Athena, Redshift, Kinesis, S3.
• Experience with Apache Spark and PySpark.
• Strong SQL and Python skills.
• Knowledge of ETL/ELT, data lakes, data warehouses and modern architectures.
• Experience with Airflow or similar workflow orchestration.
• Familiarity with AWS Lake Formation, Lambda and Infrastructure as Code is a plus.
• Experience with Git and CI/CD pipelines.
• AWS Certification credentials valued.
• Fluency in English.

Conhecimentos

SQL

Python

AWS

Spark

Airflow

CI/CD

Git

Data Lakes

Data Warehouses

ETL/ELT

Infra as Code

Formação académica

Bachelor's degree in Computer Science, Software Engineering, Data Engineering or related fields

Ferramentas

AWS Glue

AWS EMR

AWS Athena

AWS Redshift

AWS Kinesis

Amazon S3

Apache Spark

PySpark

Airflow

AWS Lake Formation

Lambda

Infrastructure as Code

Git

CI/CD pipelines

AWS Certifications

Descrição da oferta de emprego

Fyld is hiring a Data Engineer to design and implement scalable data solutions on AWS using Glue, EMR, Redshift and S3. You will work with Spark, PySpark, and Airflow to build robust data pipelines while maintaining high standards of code and CI/CD practices.

The role requires SQL and Python proficiency, experience with data lakes/warehouses, and familiarity with IaC. English fluency is essential for collaboration in a Portuguese-led company.