Senior Big Data Engineer

Decskill; Lisboa; Híbrido; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Decskill in Lisbon is seeking a Senior Big Data Engineer to design and optimize large-scale data platforms. You will work with Spark, Python, Hadoop, Hive and SQL to build data pipelines and APIs.

Role requires 5+ years in Big Data and software development, Linux/Kafka expertise, and experience with CI/CD tools. The position is hybrid in Lisbon (2x/week at the office) with opportunities to collaborate across international teams.

Qualificações

• 5+ years of experience in Big Data and software development.
• Proficiency with Spark, Python, Hadoop, Hive and SQL.
• Strong Linux, APIs and Kafka knowledge.
• Experience with CI/CD, Git, XL Release, XL Deploy and CTRL-M.
• Solid DevOps understanding and performance optimization.
• English level B2 or above (mandatory).
• French is a plus.

Responsabilidades

• Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop and Hive.
• Develop and maintain scalable data processing pipelines and APIs.
• Optimize application and data processing performance.
• Implement and support CI/CD pipelines and deployment processes.
• Manage source code and releases with Git, XL Release and XL Deploy.
• Schedule and monitor data workflows with CTRL-M.
• Collaborate with international teams to deliver high-quality solutions.
• Troubleshoot production issues and drive platform improvements.

Conhecimentos

Big Data

Spark

Python

Hadoop

Hive

SQL

Linux

APIs

Kafka

CI/CD

Git

XL Release

XL Deploy

CTRL-M

DevOps

English B2

French

Ferramentas

Spark

Python

Descrição da oferta de emprego

We are growing. And we are looking for talented people.

At Decskill, we believe that technological excellence is driven by human talent.

We are an IT consulting company with more than 10 years of consolidated experience in the market, focused on building long-term relationships with both our clients and our people. Today, we are a community of over 800 professionals, working from Lisbon, Porto, and Madrid, contributing to impactful technology initiatives.

As part of the Astek Group, we combine a strong local culture with a global presence, being active in around 23 countries across 4 continents. This allows us to offer an international context, diverse challenges, and long-term career opportunities, while staying close to our teams.

We would like to meet a Senior Big Data Engineer for a project with a hybrid working model in Lisbon, Portugal (2x/week at the office).

Responsibilities:

• Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive.
• Develop and maintain scalable data processing pipelines and APIs.
• Optimize application and data processing performance.
• Implement and support CI/CD pipelines and deployment processes.
• Manage source code and releases using Git, XL Release, and XL Deploy.
• Schedule and monitor data workflows with CTRL-M.
• Collaborate with international teams, including Paris-based stakeholders, to deliver high-quality solutions.
• Troubleshoot production issues and contribute to the continuous improvement of Big Data platforms.

Requirements:

• 5+ years of experience in Big Data and software development.
• Strong experience with Spark, Python, Hadoop, Hive, and SQL.
• Proficiency in Linux, APIs, and Kafka.
• Experience with CI/CD, Git, XL Release, XL Deploy, and CTRL-M.
• Solid understanding of DevOps concepts and performance optimization.
• English level B2 or above (mandatory).
• French is a plus.

Are you looking for an environment that values curiosity and commitment? Here, your contribution has real impact and individual growth is taken seriously.

Find with us the right opportunity to grow!

What you can expect from us

• Long-term projects with national and international context
• Opportunities to grow technically and professionally
• A people-first culture, focused on transparency and trust
• Teams that value ownership, collaboration and stability

Your next challenge might start here.

At Decskill, we are committed to equal opportunities and non-discrimination. We promote a culture of diversity and inclusion, where recruitment and career progression are based solely on talent, regardless of age, gender, ethnicity, race, nationality, or any other form of discrimination incompatible with human dignity.