Senior Big Data Engineer | Hybrid Lisbon | Spark & Python

Decskill; Lisboa; Híbrido; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Decskill in Lisbon is seeking a Senior Big Data Engineer to design and optimize large-scale data platforms. You will work with Spark, Python, Hadoop, Hive and SQL to build data pipelines and APIs.

Role requires 5+ years in Big Data and software development, Linux/Kafka expertise, and experience with CI/CD tools. The position is hybrid in Lisbon (2x/week at the office) with opportunities to collaborate across international teams.

Qualificações

• 5+ years of experience in Big Data and software development.
• Proficiency with Spark, Python, Hadoop, Hive and SQL.
• Strong Linux, APIs and Kafka knowledge.
• Experience with CI/CD, Git, XL Release, XL Deploy and CTRL-M.
• Solid DevOps understanding and performance optimization.
• English level B2 or above (mandatory).
• French is a plus.

Responsabilidades

• Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop and Hive.
• Develop and maintain scalable data processing pipelines and APIs.
• Optimize application and data processing performance.
• Implement and support CI/CD pipelines and deployment processes.
• Manage source code and releases with Git, XL Release and XL Deploy.
• Schedule and monitor data workflows with CTRL-M.
• Collaborate with international teams to deliver high-quality solutions.
• Troubleshoot production issues and drive platform improvements.

Conhecimentos

Big Data

Spark

Python

Hadoop

Hive

SQL

Linux

APIs

Kafka

CI/CD

Git

XL Release

XL Deploy

CTRL-M

DevOps

English B2

French

Ferramentas

Spark

Python

Descrição da oferta de emprego

Decskill in Lisbon is seeking a Senior Big Data Engineer to design and optimize large-scale data platforms. You will work with Spark, Python, Hadoop, Hive and SQL to build data pipelines and APIs.

Role requires 5+ years in Big Data and software development, Linux/Kafka expertise, and experience with CI/CD tools. The position is hybrid in Lisbon (2x/week at the office) with opportunities to collaborate across international teams.