Senior Data Engineer

planet; Porto; Híbrido; EUR 70 000 - 100 000; Tempo integral

Resumo da oferta

Planet is seeking a Senior Data Engineer to design, build and optimize data pipelines on the Snowflake platform. You will collaborate with analytics engineers, data scientists and business stakeholders to ensure reliable, scalable data for analytics and predictive models.

You will define ingestion patterns (CDC, incremental, full refresh), implement reverse ETL, monitor data quality, governance and security, and explore new tools to support growth in a hybrid work environment.

Qualificações

• Experience designing scalable data pipelines and data models.
• Hands-on with Snowflake and ELT/ETL tooling.
• Strong collaboration with cross-functional teams.

Responsabilidades

• Design and develop data pipelines for ingestion and transformation.
• Manage and optimize Snowflake data platform and governance.
• Define ingestion patterns for incremental loads, CDC and full refresh.
• Monitor data quality and troubleshoot pipeline issues.

Conhecimentos

Snowflake

ETL/ELT

Fivetran

Kafka

SQL

Data quality

Collaboration

Documentation

Security best practices

Ferramentas

Databricks

Redshift

Descrição da oferta de emprego

About Planet

Planet is a global provider of integrated technology and payments solutions for retail and hospitality customers.We create great experiences for the millions of people who use our payments, software, and tax-free solutions every minute of every day.Planet empowers its customers to deliver great customer experiences by combining payments and software in ways that drive greater loyalty, increase revenue and save time.

Founded over 35 years ago and with our headquarters in London, today we have more than 2,500 employees located across six continents serving our customers in more than 120 markets.

Role Overview

As a Senior Data Engineer, you will play a key role in building and maintaining our data infrastructure, with a focus on Snowflake and data ingestion tools. You will be responsible for designing, developing, and optimizing data pipelines that power our analytics and predictive models. The role requires you to collaborate with data analytics engineers, data analysts, data scientists, and business stakeholders to ensure data is accurate, reliable, and readily available.

What You Will Do

• Design and develop data pipelines: Build efficient and scalable data pipelines using ELT tools, such as Fivetran and event-based sources, for data ingestion, ensuring smooth integration of multiple data sources into Snowflake.
• Manage Data Platform: Oversee the administration, maintenance, and optimisation of our Snowflake data platform, ensuring data is structured for efficient querying and analysis.
• Automate ETL processes: Develop and optimise ETL/ELT processes to ensure timely and accurate data ingestion and transformation, with a focus on automation and efficiency.
• Define ingestion patterns for incremental loads, CDC, and full refresh scenarios.
• Design and operate reverse ETL pipelines to operational systems and APIs.
• Monitor data quality and performance: Implement monitoring and testing frameworks to ensure data quality, reliability, and pipeline performance.
• Implement data governance frameworks, including data contracts and schema evolution.
• Collaborate with teams: Work closely with analytics engineers, data analysts, data scientists, and business stakeholders to understand their data needs and deliver solutions that support business objectives.
• Troubleshoot and resolve Issues: Proactively identify and resolve data pipeline or infrastructure issues to ensure minimal downtime and data integrity.
• Ensure data governance: Implement data governance frameworks, including data ownership and stewardship, and drive documentation, lineage, and discoverability standards.
• Explore new tools: Continuously evaluate and recommend new tools, frameworks, and best practices to improve data pipeline efficiency and support future growth.
• Ensure data security: Ensure all data processes comply with data security and privacy regulations.

Who You Are

• Proficient with Snowflake: Demonstrated experience in managing and optimizing Snowflake as a data platform.
• ETL/ELT mastery: Solid understanding of ETL/ELT frameworks, with experience building and automating data pipelines.
• Expert in Fivetran: Hands-on experience using Fivetran for data ingestion, integrating multiple data sources seamlessly.
• Familiarity with real-time data processing tools (mainly Kafka).
• SQL Expert: Advanced SQL skills for querying, transforming, and analyzing data across databases and data warehouses.
• Problem-solver: Strong analytical skills to troubleshoot data pipeline issues and optimise workflows for performance and reliability.
• Collaboration skills: Excellent communication skills and experience working cross-functionally with technical and non-technical teams.
• Documentation focused: Ability to document data processes clearly to ensure knowledge sharing and continuity.
• Experience with cloud data platforms (Snowflake, Databricks, Redshift, etc) and their data services.
• Knowledge of data governance and security best practices.

Why Planet

Planet is an equal opportunity employer where diversity is valued, and all employment is decided based on qualifications, merit, and business need.

Come and grow your career in the most exciting, fast paced technology market, with a business that delivers feel-good connected commerce.

At Planet, we embrace a hybrid work model, with three days a week in the office.

Reasonable accommodations may be made in order to allow for an individual to perform the essential functions of this role successfully.