Senior Big Data Engineer: Spark, Python & Cloud (Hybrid PT)

KCS IT; Lisboa; Híbrido; EUR 70 000 - 90 000; Tempo integral

Resumo da oferta

KCS IT in Lisbon is seeking a Senior Big Data Engineer to design, develop and maintain scalable data platforms for international projects. You will collaborate with Paris-based teams and drive data pipelines using Spark, Hadoop and related tech.

The role demands 5+ years of hands-on Big Data experience, strong CI/CD, DevOps mindset, and proficiency in English (B2). Hybrid Portugal work model with global teams and opportunities for growth are offered.

Qualificações

• Proven experience as a Big Data Engineer with large-scale data platforms.
• Strong hands-on with Spark, Python, Hadoop, Hive, SQL, Linux, APIs and Kafka.
• Solid software development and CI/CD practices.
• Experience with source control Git.
• Experience with deployment tools XL Release and XL Deploy.
• Experience with scheduling CTRL-M.
• Good understanding of Big Data ecosystems and distributed processing.
• Familiarity with DevOps concepts.
• Strong problem-solving and analytical skills.
• English level B2 required.
• Ability to work in international distributed teams.
• Autonomous, organized, able to manage priorities.
• Positive, collaborative, proactive mindset.

Responsabilidades

• Design, develop, and maintain scalable Big Data solutions.
• Work closely with Paris-based teams in an international environment.
• Develop and optimize data processing pipelines using Spark and related technologies.
• Implement and maintain robust CI/CD processes.
• Monitor and improve platform performance and reliability.
• Collaborate with cross-functional teams to deliver high-quality solutions.
• Ensure the adoption of development best practices and coding standards.
• Contribute to technical discussions and knowledge sharing across teams.
• Troubleshoot and resolve complex technical issues within Big Data environments.

Conhecimentos

Big Data

Spark

Python

Hadoop

Hive

SQL

Linux

APIs

Kafka

CI/CD

Git

XL Release

XL Deploy

CTRL-M

DevOps

English B2

International teams

Ferramentas

Git

XL Release

XL Deploy

CTRL-M

Descrição da oferta de emprego

KCS IT in Lisbon is seeking a Senior Big Data Engineer to design, develop and maintain scalable data platforms for international projects. You will collaborate with Paris-based teams and drive data pipelines using Spark, Hadoop and related tech.

The role demands 5+ years of hands-on Big Data experience, strong CI/CD, DevOps mindset, and proficiency in English (B2). Hybrid Portugal work model with global teams and opportunities for growth are offered.