Data Engineer

Affinity; Portugal; On-site; EUR 35,000 - 65,000; Full time

Job summary

Affinity is hiring a data engineer to join our Portuguese-based team. You will develop and optimize ETL processes, monitor performance, and ensure high reliability of data pipelines across our Euro-focused projects.

Ideal candidates have strong Python and SQL skills, Databricks and PySpark experience, and familiarity with Azure Cloud and BI tools. Join a fast-growing company with offices in Lisbon, Porto, and Leiria.

Qualifications

• Proficiency in Python and SQL querying languages.
• Strong experience with Databricks and PySpark.
• Experience in monitoring the performance of processes and ETL pipelines.
• Ability to develop and optimize ETL processes in a fast-paced environment.

Responsibilities

• Develop and optimize ETL processes to ensure high performance and reliability.
• Troubleshooting and enhancing data processes in a fast-paced environment.
• Collaborate with cross-functional teams to deliver solutions that meet business needs.
• Continuously improve system performance and data processing pipelines.

Skills

Python

SQL

Databricks

PySpark

ETL pipelines

Tools

Azure Cloud

Power BI

Tableau

Looker

Snowflake

DBT

CI/CD

Job description

We are a Portuguese technology consulting company with a strong outward look to the rest of Europe. We have 10 years of experience in the market and reached the status of “large company” in 2018. We now have more than 350 associates and we keep growing, with offices in Lisbon, Porto, and Leiria, as well as projects in more than 20 countries. Our company is part of the national top 10, with a growth of 250% in the last years.

Work-life balance is part of our DNA. We focus on win-win-win relationships, defining every moment of interaction as an experience with unique conditions. Working with Affinity is a “Lifetime Experience” where you will have the opportunity to demonstrate all your potential and to be successful on every level.

#welcometoyourfuture

We're Hiring!

Join a dynamic team working with cutting-edge technologies! If you're passionate about data and optimization, we want to hear from you!

What you need to have/know:

• Proficiency in Python
• Strong experience with SQL Querying Languages
• Solid knowledge of Databricks and PySpark
• Experience in monitoring the performance of processes and ETL pipelines

What we expect from you:

• Ability to develop and optimize ETL processes to ensure high performance and reliability
• Troubleshooting and enhancing data processes in a fast-paced environment
• Collaborate with cross-functional teams to deliver solutions that meet business needs
• Continuously improve system performance and data processing pipelines

Language Skills:

• Experience with Azure Cloud
• Reporting knowledge with tools like Power BI, Tableau, Looker, or similar
• Familiarity with Snowflake and DBT
• Experience with CI/CD processes