Distributed Cloud | Data Pipeline Specialist

Devoteam; Lisboa; Presencial; EUR 40 000 - 60 000; Tempo integral

Resumo da oferta

A leading digital transformation company in Lisbon is looking for a Data Engineer with over 5 years of experience to design and optimize data pipelines. The role involves working with Big Data technologies and requires strong proficiency in SQL and Python. Ideal candidates should have experience with platforms such as Cloudera and Teradata, as well as familiarity with cloud environments. Join a diverse team committed to leveraging technology for positive impact, while promoting equal opportunities.

Qualificações

• 5+ years of proven experience as a Data Engineer, ETL Developer, or Big Data Engineer.
• Strong expertise in building data pipelines and ETL/ELT methodologies.
• Proficient in SQL and Python, Scala experience is highly valued.

Responsabilidades

• Design, build, and optimize robust ETL/ELT data pipelines for batch and real-time processing.
• Work with Big Data technologies and distributed computing frameworks like Spark.
• Manage data environments on platforms like Cloudera and Teradata.

Conhecimentos

Data pipeline building

ETL/ELT methodologies

SQL

Python programming

Big Data technologies

Cloud environments

Descrição da oferta de emprego

Overview

At Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of €1B. We believe in transforming technology to create value for our clients, partners and employees in a world where technology is developed for people. We are proud of the culture we have built together. We are proud of our people at the service of technology. We are proud of our diverse environment. Because we are #TechforPeople. Join our multidisciplinary team of Cloud experts, Designers, Business consultants, Security experts, Engineers, Developers and other extraordinary talents, spread across more than 20 EMEA countries. Become one of our +10,000 tech and business leaders on cloud, data and cyber security. Let’s fuse creativity with technology together and build innovative solutions that actively change things for the better.

Responsibilities

• Design, build, and optimize robust ETL/ELT data pipelines for batch and real-time processing.
• Work with Big Data technologies and distributed computing frameworks (e.g., Spark) to process large datasets efficiently.
• Develop, test, and deploy code primarily using Python (and ideally Scala), focusing on high performance and data integrity.
• Manage and maintain data environments built on various platforms, including Cloudera and traditional data warehouses like Teradata.
• Collaborate with Data Architects and Analysts to translate complex requirements into technical data models and solutions.

Qualifications

• 5+ years of proven experience as a Data Engineer, ETL Developer, or Big Data Engineer.
• Strong expertise in building data pipelines and extensive knowledge of ETL/ELT methodologies.
• Mandatory proficiency in SQL and strong programming skills in Python (experience with Scala is highly valued).
• Demonstrable experience with at least one Big Data ecosystem, such as Spark or the Cloudera platform.
• Experience with traditional data warehousing platforms like Teradata is a strong advantage.
• Familiarity with cloud environments (AWS, Azure, or GCP) is a plus.
• Good level of English, both written and spoken.

Additional Information

The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.