Senior AWS Data Engineers

Alpineo Consulting; Lisboa; Presencial; EUR 55 000 - 75 000; Tempo integral

Resumo da oferta

Alpineo Consulting is seeking a Senior Data Engineer to join a Scrum team and build cloud-native data pipelines in AWS with Snowflake. You will model data, optimize queries, and collaborate with analysts to ensure data products run smoothly within sprints.

The role requires strong SQL and Python skills, and hands-on experience with orchestration tools and data governance practices. Fluent English is expected; Lisbon-based work may be required.

Qualificações

• Degree in Engineering or related field required.
• Proven data pipeline experience on AWS (S3, ECS, Lambda, RDS, SNS/SQS, IAM, CloudWatch).
• Extensive SQL development and unstructured data/graph DB knowledge.
• Strong Python and data libraries (Pandas, Boto3).
• Experience with Snowflake development and data governance basics.
• CI/CD and orchestration tooling exposure (Airflow/Step Functions/Prefect).

Responsabilidades

• Implement cloud-based data pipelines transforming diverse sources into structured data.
• Design and deploy high-performance batch and streaming pipelines with monitoring.
• Assemble large datasets meeting functional and non-functional requirements.
• Catalogue metadata and support data governance initiatives.
• Model data and optimize queries for performance and scalability.
• Collaborate across teams, troubleshoot, and support production data products.

Conhecimentos

Data Pipelines

AWS

Snowflake

SQL

Python

DBT

CI/CD

Orchestration

Git/GitHub

Tableau

Terraform

CloudFormation

Airflow

Prefect

S3/ECS/Lambda

Boto3

RDS

CloudWatch

Formação académica

University degree in Engineering or related discipline

Ferramentas

AWS

Snowflake

DBT Core

Python

Pandas

Boto3

GitHub/GitLab

Tableau

Airflow

Prefect

S3/ECS/Lambda

SnowPro Core

Descrição da oferta de emprego

We are looking for passionate individuals eager to be part of this new chapter. You will join a dynamic and collaborative environment, contribute to meaningful projects, and help shape the future of Data Engineering, always with a long-term vision and a deep commitment to the Group's success.

Description:

We are seeking a senior Data Engineer with expertise in cloud-native data pipeline development within AWS environments and Snowflake. The ideal candidate will have a strong background in data architecture, data modelling, and the ability to implement high-performance data solutions that support our business objectives. You will join the Scrum team of one of our product as part of the development team and collaborate with data analysts and internal teams to ensure the delivery and the run of the product in line with the sprint backlog.

In this context, your role will include:

Implement cloud-based data pipelines to transform raw data from various sources (e.g. APIs, FTP, SFTP) into structured formats.

Architect and deploy high-performance (batch and streaming) data pipelines with monitoring and alerting system implemented for data analysts and business users.

Data Management:

Assemble and manage large, complex datasets that meet both functional and non-functional business requirements.

Support data governance initiatives by cataloguing and describing metadata.

Implement functional and non-functional tests on data.

Data Modelling and Analysis:

Perform data modelling and design appropriate database objects (views, tables, procedures, scripts).

Analyze and optimize queries for performance and scalability.

Collaboration and Support Production:

Participate in troubleshooting, monitoring, and user support activities.

Work closely with cross-functional teams to gather requirements and implement solutions.

Code according to established architecture guidelines and focus on improving the scalability and performance of data products.

Stay updated with the latest industry trends and technologies to enhance data engineering practices.

Mandatory skills:

• University degree in Engineering or related discipline
• Proven experience in data pipelining and related technologies on AWS (S3, ECS, Lambda, RDS, SNS/SQS, IAM, Cloudwatch)
• Extensive experience with analytical database programming (SQL) and unstructured data/graph databases
• Good skills in writing complex SQL queries, knowledge of DBT core is a plus
• Proficient in Python and data-related libraries (e.g. Pandas, Boto3)
• Strong understanding of data platform architecture and data governance principles
• Deep knowledge of developing on Snowflake is a plus
• Adoption of CI/CD practices
• Experience using orchestration tools (e.g. Step Function, Airflow, Prefect)
• Experience with version control tool such as GitHub or GitLab
• Knowledge of data visualization tools (e.g., Tableau) is a plus
• Knowledge of Infrastructure as code (e.g. CloudFormation, Terraform)
• AWS certification (e.g., Solution Architect or equivalent) is preferred
• Snowflake certification (e.g. SnowPro Core) is preferred

And also:

Fluent in English, Portuguese and/or French is a plus