Cloud Data Engineer: Big Data on AWS, Hybrid Lisbon

AdvanceWorks; Lisboa; Híbrido; EUR 45 000 - 65 000; Tempo integral

Resumo da oferta

AdvanceWorks in Lisbon is seeking a Data Engineer to join a cloud-based Big Data platform initiative. You will develop data processing solutions, prototype new approaches, and deploy production-ready applications in a small, hands-on team.

You will work across the full lifecycle using Python, SQL, and AWS services, collaborating with a dynamic team to improve data pipelines and analytics capabilities in a hybrid Lisbon setup.

Qualificações

• Proven experience with Python and SQL for data processing.
• Experience building and maintaining data pipelines and analytics solutions.
• Familiarity with Big Data technologies and cloud-based platforms.
• Strong communication and teamwork skills.

Responsabilidades

• Develop end-to-end data processing and analytics functionalities on a cloud-based Big Data platform.
• Use Python and SQL to manipulate, process, analyze, and structure data.
• Collaborate on architecture, data flows, and processing techniques.
• Design and implement data processing solutions from requirements to production.
• Create proofs of concept for new approaches and technologies.
• Develop, test, deploy, and monitor production-ready data solutions across environments.
• Monitor, debug, troubleshoot, and evolve data pipelines and applications.
• Support exploratory data analysis and data extraction activities.
• Document solutions and promote continuous improvement of pipelines.

Conhecimentos

Python

SQL

Big Data

Data pipelines

Spark / PySpark

AWS

Git

Jupyter Notebooks

Communication skills

Autonomy

Ferramentas

Apache Spark

Git

Jupyter Notebooks

CloudFormation / CDK

Hadoop

Descrição da oferta de emprego

AdvanceWorks in Lisbon is seeking a Data Engineer to join a cloud-based Big Data platform initiative. You will develop data processing solutions, prototype new approaches, and deploy production-ready applications in a small, hands-on team.

You will work across the full lifecycle using Python, SQL, and AWS services, collaborating with a dynamic team to improve data pipelines and analytics capabilities in a hybrid Lisbon setup.