Senior Big Data Engineer - Hybrid in Lisbon | Spark & Python

Decskill; Lisboa; Híbrido; EUR 70 000 - 100 000; Tempo integral

Resumo da oferta

Decskill, an IT consulting company with more than 10 years of consolidated experience, is growing and seeks a Senior Big Data Engineer for a Lisbon-based project with a hybrid working model (2x per week in the office).

You will design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive, and build scalable data pipelines and APIs. You will drive performance improvements and CI/CD practices while collaborating with Paris-based stakeholders and global teams.

Qualificações

• 5+ years of experience in Big Data and software development.
• Strong experience with Spark, Python, Hadoop, Hive, and SQL.
• Proficiency in Linux, APIs, and Kafka.
• Experience with CI/CD, Git, XL Release, XL Deploy, and CTRL-M.
• Solid understanding of DevOps concepts and performance optimization.
• English level B2 or above (mandatory).
• French is a plus.

Responsabilidades

• Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive.
• Develop and maintain scalable data processing pipelines and APIs.
• Optimize application and data processing performance.
• Implement and support CI/CD pipelines and deployment processes.
• Manage source code and releases using Git, XL Release, and XL Deploy.
• Schedule and monitor data workflows with CTRL-M.
• Collaborate with international teams, including Paris-based stakeholders, to deliver high-quality solutions.
• Troubleshoot production issues and contribute to the continuous improvement of Big Data platforms.

Conhecimentos

Spark

Python

Hadoop

Hive

SQL

Linux

APIs

Kafka

CI/CD

Git

XL Release

XL Deploy

CTRL-M

DevOps

Performance

English B2

Ferramentas

Git

XL Release

XL Deploy

CTRL-M

Descrição da oferta de emprego

Decskill, an IT consulting company with more than 10 years of consolidated experience, is growing and seeks a Senior Big Data Engineer for a Lisbon-based project with a hybrid working model (2x per week in the office).

You will design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive, and build scalable data pipelines and APIs. You will drive performance improvements and CI/CD practices while collaborating with Paris-based stakeholders and global teams.