Data Engineer

Aubay Portugal; Lisboa; Remote; EUR 45,000 - 65,000; Full time

Benefits offered by this job

Health insurance

Training Academy

Mental health platform

Language platform

Remote work

Job summary

Aubay Portugal is seeking a Data Engineer to design, develop, and optimize scalable data processing solutions using PySpark. You will build cloud-based pipelines with AWS services like Lambda and Glue, and work with Databricks to transform large data volumes.

Collaboration across multidisciplinary teams and a strong customer focus are essential. We offer an environment that supports continuous growth through our Training Academy, comprehensive health coverage, and remote project work.

Qualifications

• At least 4 years of professional Data Engineering experience.
• Solid experience with Cloud environments and cloud-based data solutions.
• Hands-on PySpark data processing and transformation.
• Strong experience with AWS data services, especially Lambda and Glue.
• Practical knowledge of Databricks and data workflows.
• English proficiency at least B2 for project communication.
• Align with Aubay's culture of integrity and teamwork.
• Strong customer focus and ability to work in a team.

Responsibilities

• Design, develop and maintain scalable data processing solutions using PySpark.
• Build and optimize data pipelines and ETL/ELT processes in Cloud environments.
• Develop and integrate data solutions using AWS services, including Lambda and Glue.
• Work with Databricks to process and transform large volumes of data, ensuring performance and reliability.
• Collaborate with multidisciplinary teams to design robust Cloud data solutions, troubleshoot issues and continuously improve data processing workflows.

Skills

PySpark

Cloud environments

Teamwork

Customer focus

English B2

Tools

PySpark

AWS Lambda

AWS Glue

Databricks

Job description

At Aubay Portugal, we work daily with some of the largest organisations across sectors such as banking, insurance, telecommunications and energy, helping to build and evolve critical systems that support millions of users. We have been in Portugal since 2007 and are part of an international group with a presence in several European countries. More than technology, we build close relationships and deliver real-impact projects.

What will you do?

• Design, develop and maintain scalable data processing solutions using PySpark.
• Build and optimize data pipelines and ETL/ELT processes in Cloud environments.
• Develop and integrate data solutions using AWS services, including Lambda and Glue.
• Work with Databricks to process and transform large volumes of data, ensuring performance and reliability.
• Collaborate with multidisciplinary teams to design robust Cloud data solutions, troubleshoot issues and continuously improve data processing workflows.

What are we looking for?

At Aubay, our focus is on professionals who bring both technical expertise and the right mindset:

• A minimum of 4 years of professional experience in Data Engineering or similar roles.
• Solid professional experience working with Cloud environments and Cloud-based data solutions.
• Strong hands-on experience with PySpark for data processing and transformation.
• Solid experience with AWS and its data-related services, particularly Lambda and Glue.
• Practical knowledge of Databricks and experience working with data processing and transformation workflows.
• English proficiency of at least B2 level, enabling effective communication within the project team and client environment.
• Alignment with our corporate culture and a commitment to integrity and ethics are highly valued;
• Strong customer focus, teamwork, task prioritisation, and daily commitment are highly appreciated.

What can we offer?

At Aubay, we invest in your development and well-being:

• Continuous growth through our Training Academy, with technical and soft skills training, mentoring, tech communities, workshops and in-person meetups;
• Close support with regular feedback and a structured career advancement model;
• Comprehensive health insurance, including dental coverage, as well as access to a mental health platform and well-being initiatives;
• Team-oriented environment, including events and initiatives to promote connection and team spirit;
• Personal and family life support, from the moment your children are born and throughout their educational path;
• Access to a language platform with conversational classes in multiple languages;
• Project-tailored work model: remote.

What will you find here?

• A close-knit and informal environment, where direct communication is preferred and people are valued;
• Recognition of your contribution, with initiatives that celebrate meaningful moments;
• Freedom to be yourself, without unnecessary formalities;
• Teams where knowledge sharing, collaboration and joint growth are a reality.

Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding the identification, contact and professional capabilities of the candidates, in the present procedure, will be processed for the application analysis, having in consideration that the processing is conducted in order to take the steps, at the request of the data subject, prior to entering into a contract; Personal data sent through the present application will be kept by Aubay during the application procedure and will remain stored whilst updated (for two years period). The collected data might be transferred or include other processing activities, as long as the data subject is informed, in the occurrence of a standard application and selection procedure, for the compliance of legal obligations for the time required by law. For any queries or request regarding personal data protection rights, the Data Subject may contact AUBAY PORTUGAL's headquarters in Avenida Duque D'Ávila, nº46 em Lisboa or use the DPO's e-mail - [e-mail]. The Data Subject also has the right to file a complaint with the National Data Protection Authority – www.cnpd.pt. (please do not include data regarding racial or ethnical origins, political opinions, religion, philosophy, biometrical data, health data, sexual life and orientation, or relating to criminal convictions and offences.)