Senior Big Data Engineer

Decskill; Lisboa; Híbrido; EUR 70 000 - 100 000; Tempo integral

Resumo da oferta

Decskill, an IT consulting company with more than 10 years of consolidated experience, is growing and seeks a Senior Big Data Engineer for a Lisbon-based project with a hybrid working model (2x per week in the office).

You will design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive, and build scalable data pipelines and APIs. You will drive performance improvements and CI/CD practices while collaborating with Paris-based stakeholders and global teams.

Qualificações

• 5+ years of experience in Big Data and software development.
• Strong experience with Spark, Python, Hadoop, Hive, and SQL.
• Proficiency in Linux, APIs, and Kafka.
• Experience with CI/CD, Git, XL Release, XL Deploy, and CTRL-M.
• Solid understanding of DevOps concepts and performance optimization.
• English level B2 or above (mandatory).
• French is a plus.

Responsabilidades

• Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive.
• Develop and maintain scalable data processing pipelines and APIs.
• Optimize application and data processing performance.
• Implement and support CI/CD pipelines and deployment processes.
• Manage source code and releases using Git, XL Release, and XL Deploy.
• Schedule and monitor data workflows with CTRL-M.
• Collaborate with international teams, including Paris-based stakeholders, to deliver high-quality solutions.
• Troubleshoot production issues and contribute to the continuous improvement of Big Data platforms.

Conhecimentos

Spark

Python

Hadoop

Hive

SQL

Linux

APIs

Kafka

CI/CD

Git

XL Release

XL Deploy

CTRL-M

DevOps

Performance

English B2

Ferramentas

Git

XL Release

XL Deploy

CTRL-M

Descrição da oferta de emprego

We are growing. And we are looking for talented people.

At Decskill, we believe that technological excellence is driven by human talent.

We are an IT consulting company with more than 10 years of consolidated experience in the market, focused on building long-term relationships with both our clients and our people. Today, we are a community of over 800 professionals, working from Lisbon, Porto, and Madrid, contributing to impactful technology initiatives.

As part of the Astek Group, we combine a strong local culture with a global presence, being active in around 23 countries across 4 continents. This allows us to offer an international context, diverse challenges, and long-term career opportunities, while staying close to our teams.

We would like to meet a Senior Big Data Engineer for a project with a hybrid working model in Lisbon, Portugal (2x/week at the office).

Responsibilities

• Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive.
• Develop and maintain scalable data processing pipelines and APIs.
• Optimize application and data processing performance.
• Implement and support CI/CD pipelines and deployment processes.
• Manage source code and releases using Git, XL Release, and XL Deploy.
• Schedule and monitor data workflows with CTRL-M.
• Collaborate with international teams, including Paris-based stakeholders, to deliver high-quality solutions.
• Troubleshoot production issues and contribute to the continuous improvement of Big Data platforms.

Requirements

• 5+ years of experience in Big Data and software development.
• Strong experience with Spark, Python, Hadoop, Hive, and SQL.
• Proficiency in Linux, APIs, and Kafka.
• Experience with CI/CD, Git, XL Release, XL Deploy, and CTRL-M.
• Solid understanding of DevOps concepts and performance optimization.
• English level B2 or above (mandatory).
• French is a plus.

Are you looking for an environment that values curiosity and commitment? Here, your contribution has real impact and individual growth is taken seriously.

Find with us the right opportunity to grow!

What you can expect from us

• Long-term projects with national and international context
• Opportunities to grow technically and professionally
• A people-first culture, focused on transparency and trust
• Teams that value ownership, collaboration and stability

Your next challenge might start here.

At Decskill, we are committed to equal opportunities and non-discrimination. We promote a culture of diversity and inclusion, where recruitment and career progression are based solely on talent, regardless of age, gender, ethnicity, race, nationality, or any other form of discrimination incompatible with human dignity.