Data engineer

Pictet Tech; Lisboa; Presencial; EUR 65 000 - 90 000; Tempo integral

Resumo da oferta

Pictet Tech in Lisbon is seeking a data engineer to build cloud-based data pipelines and transform raw data from APIs, FTP, and SFTP into structured formats. You will architect and deploy batch and streaming pipelines with monitoring for data analysts and business users.

Join a cross-functional team using AWS services (S3, Lambda, RDS, SQS, IAM) and write complex SQL with Python (Pandas). Agile, CI/CD, and collaboration are essential as we grow in Lisbon.

Qualificações

• University degree in Engineering or related discipline.
• Proven experience in data pipelining and AWS (S3, ECS, Lambda, RDS, SNS/SQS, IAM, Cloudwatch).
• Extensive experience with analytical database programming (SQL).
• Good skills in writing complex SQL queries.
• Proficient in Python and data-related libraries (Pandas, Boto3).
• Strong understanding of data platform architecture and data governance principles.
• Adoption of CI/CD practices.
• Experience using orchestration tools (Airflow/Step Function/Prefect).
• Version control with GitHub or GitLab.
• Knowledge of Infrastructure as code (CloudFormation, Terraform).
• Agile mindset; collaboration and continuous learning.
• Proven ability to deliver against deadlines with strong analytical skills.
• Detail-oriented with focus on quality and performance.
• Proficient in Jira and teamwork.
• Portuguese work permit is required.

Responsabilidades

• Implement cloud-based data pipelines transforming raw data from APIs, FTP, SFTP into structured formats.
• Architect and deploy high-performance batch and streaming pipelines with monitoring and alerts.
• Assemble and manage large, complex datasets to meet requirements.
• Support data governance by cataloguing metadata.
• Implement functional and non-functional tests on data.
• Perform data modelling and design DB objects (views, tables, procedures, scripts).
• Analyze and optimize queries for performance and scalability.
• Participate in troubleshooting, monitoring, and user support.
• Collaborate with cross-functional teams to gather requirements and implement solutions.
• Code according to architecture guidelines to improve scalability and performance of data products.
• Stay updated with industry trends to enhance data engineering practices.

Conhecimentos

SQL

Python

AWS

ETL pipelines

Airflow

CI/CD

Git

Terraform

CloudFormation

Pandas

Data modeling

Jira

English

Formação académica

Engineering degree

Ferramentas

Snowflake

DBT

Tableau

Descrição da oferta de emprego

Описание

Recognized as a Great Place to Work for eight years, we first established ourselves in Luxembourg before expanding to Lisbon in 2022. Today, we are entering a new phase with the kick-off of our Java & AWS development team in Lisbon. Our ambition is clear: to grow a strong team of experts and build a thriving community of specialists across locations. We are looking for passionate individuals eager to be part of this new chapter.

Задачи

• Implement cloud-based data pipelines to transform raw data from various sources (e.g. APIs, FTP, SFTP) into structured formats.
• Architect and deploy high-performance (batch and streaming) data pipelines with monitoring and alerting system implemented for data analysts and business users.
• Assemble and manage large, complex datasets that meet both functional and non-functional business requirements.
• Support data governance initiatives by cataloguing and describing metadata.
• Implement functional and non-functional tests on data.
• Perform data modelling and design appropriate database objects (views, tables, procedures, scripts).
• Analyze and optimize queries for performance and scalability.
• Participate in troubleshooting, monitoring, and user support activities.
• Work closely with cross-functional teams to gather requirements and implement solutions.
• Code according to established architecture guidelines and focus on improving the scalability and performance of data products.
• Stay updated with the latest industry trends and technologies to enhance data engineering practices.

Требования

• University degree in Engineering or related discipline
• Proven experience in data pipelining and related technologies such as AWS (S3, ECS, Lambda, RDS, SNS/SQS, IAM, Cloudwatch)
• Extensive experience with analytical database programming (SQL)
• Good skills in writing complex SQL queries
• Proficient in Python and data-related libraries (e.g. Pandas, Boto3)
• Strong understanding of data platform architecture and data governance principles
• Adoption of CI/CD practices
• Experience using orchestration tools (e.g. Step Function, Airflow, Prefect)
• Experience with version control tool such as GitHub or GitLab
• Knowledge of Infrastructure as code (e.g. CloudFormation, Terraform)
• An agile mind-set. It’s not a buzz word: agility is about collaboration, growing together, supporting more junior team members, intellectual humility and strong desire to learn
• Proven ability to deliver against deadlines with a strong analytical and problem-solving skills
• Detail-oriented with a focus on quality and performance
• Ability to work effectively in an Agile environment using tools like Jira
• Excellent communication skills
• Team player with a proactive approach to challenges and continuous improvement.
• Please note that a Portuguese valid work permit is required.

Будет плюсом

• Experience with AWS, Snowflake and DBT is a plus, but we also welcome candidates with relevant experience on Azure, Databricks, Redshift, or similar modern data platforms; knowledge of DBT core is a plus; Knowledge of Snowflake is a plus; Knowledge of data visualization tools (e.g., Tableau) is a plus; AWS certification (e.g., Solution Architect or equivalent) is preferred; Snowflake certification (e.g. SnowPro Core) is preferred

Условия

• An innovative and supportive working culture fostering collaboration, professional development and learning opportunities
• Top-notch technologies and premium hardware
• An opportunity to work and grow alongside inspiring individuals
• A room for open and meaningful discussions across the organization and locations
• A safe place to share and promote your ideas and vision
• Lifestyle in line with the tech world: flexitime, state of the art facilities, dynamic organization
• Non-negotiable values: excellence, integrity, respect, fun
• Limited travel required.