Data Engineer: Cloud Pipelines & Data Platforms

Pictet Tech; Lisboa; Presencial; EUR 65 000 - 90 000; Tempo integral

Resumo da oferta

Pictet Tech in Lisbon is seeking a data engineer to build cloud-based data pipelines and transform raw data from APIs, FTP, and SFTP into structured formats. You will architect and deploy batch and streaming pipelines with monitoring for data analysts and business users.

Join a cross-functional team using AWS services (S3, Lambda, RDS, SQS, IAM) and write complex SQL with Python (Pandas). Agile, CI/CD, and collaboration are essential as we grow in Lisbon.

Qualificações

• University degree in Engineering or related discipline.
• Proven experience in data pipelining and AWS (S3, ECS, Lambda, RDS, SNS/SQS, IAM, Cloudwatch).
• Extensive experience with analytical database programming (SQL).
• Good skills in writing complex SQL queries.
• Proficient in Python and data-related libraries (Pandas, Boto3).
• Strong understanding of data platform architecture and data governance principles.
• Adoption of CI/CD practices.
• Experience using orchestration tools (Airflow/Step Function/Prefect).
• Version control with GitHub or GitLab.
• Knowledge of Infrastructure as code (CloudFormation, Terraform).
• Agile mindset; collaboration and continuous learning.
• Proven ability to deliver against deadlines with strong analytical skills.
• Detail-oriented with focus on quality and performance.
• Proficient in Jira and teamwork.
• Portuguese work permit is required.

Responsabilidades

• Implement cloud-based data pipelines transforming raw data from APIs, FTP, SFTP into structured formats.
• Architect and deploy high-performance batch and streaming pipelines with monitoring and alerts.
• Assemble and manage large, complex datasets to meet requirements.
• Support data governance by cataloguing metadata.
• Implement functional and non-functional tests on data.
• Perform data modelling and design DB objects (views, tables, procedures, scripts).
• Analyze and optimize queries for performance and scalability.
• Participate in troubleshooting, monitoring, and user support.
• Collaborate with cross-functional teams to gather requirements and implement solutions.
• Code according to architecture guidelines to improve scalability and performance of data products.
• Stay updated with industry trends to enhance data engineering practices.

Conhecimentos

SQL

Python

AWS

ETL pipelines

Airflow

CI/CD

Git

Terraform

CloudFormation

Pandas

Data modeling

Jira

English

Formação académica

Engineering degree

Ferramentas

Snowflake

DBT

Tableau

Descrição da oferta de emprego

Pictet Tech in Lisbon is seeking a data engineer to build cloud-based data pipelines and transform raw data from APIs, FTP, and SFTP into structured formats. You will architect and deploy batch and streaming pipelines with monitoring for data analysts and business users.

Join a cross-functional team using AWS services (S3, Lambda, RDS, SQS, IAM) and write complex SQL with Python (Pandas). Agile, CI/CD, and collaboration are essential as we grow in Lisbon.