Data Engineer-Azure

Expleo; Lisboa; Presencial; EUR 45 000 - 60 000; Tempo integral

Resumo da oferta

A global engineering and consulting service provider located in Lisboa, Portugal, seeks a Data Platform Engineer with at least 5 years of experience in data management. The role includes designing scalable data platforms, ensuring data security, and collaborating with cross-functional teams. Candidates should be proficient in Python and SQL, and have a good understanding of Big Data tools and Azure cloud services.

Qualificações

• At least 5 years experience in a similar role.
• Good knowledge of Azure cloud platforms and services.
• Strong proficiency in programming languages such as Python, Java, or Scala.

Responsabilidades

• Design, build, and maintain scalable data platforms.
• Collect, process, and analyze large and complex data sets.
• Collaborate with cross-functional teams to ensure data accuracy.

Conhecimentos

Python

SQL

Big Data tools (Spark, Kafka, Hadoop, Hive)

Azure cloud platforms

Data integration and ETL tools

Java or Scala

Data security

Data processing workflows

Data accuracy and integrity

Descrição da oferta de emprego

Overview

Expleo is a trusted partner for your innovation journey. As a global engineering, technology and consulting service provider, we are ideally positioned to help you achieve your ambitions and future-proof your business. With a smart blend of bold thinking and reliable execution, we’re able to fast-track innovation through each step of your value chain.

We are strategically positioned to build value, with a global footprint across 30 countries.We are as global and local as you need us to be, with strong best-in-class pan-European technological centres and unique best-shoring capabilities.

We leverage a network of high value-adding affiliates in consulting and industrial excellence, and leading partners across multiple sectors to provide you with the most comprehensive services and solutions in an ever-changing environment.

Responsibilities

-Design, build, and maintain scalable data platforms;

-Collect, process, and analyze large and complex data sets from various sources;

-Develop and implement data processing workflows using data processing framework technologies such as Spark, and Apache Beam;

-Collaborate with cross-functional teams to ensure data accuracy and integrity;

-Ensure data security and privacy through proper implementation of access controls and data encryption;

-Extraction of data from various sources, including databases, file systems, and APIs;

-Monitor system performance and optimize for high availability and scalability.

Essential skills

- At least 5 years experience in a similar role;- Experience with Azure cloud platforms and services;- Proficiency in programming languages such as Python, Java or Scala;- Good knowledge of Big Data tools (Spark, Kafka, Hadoop, Hive);- Knowledge of data integration and ETL tools (e.g. Apache, Talend);- Strong SQL skills;- Familiarity with Azure Data Factory;- Good knowledge of English.

#LI-SC1