Senior Big Data Engineer | Spark 3, Scala & Hadoop

act digital; Lisboa; Presencial; EUR 90 000 - 120 000; Tempo integral

Resumo da oferta

act digital seeks a Senior Big Data Engineer to design, develop, and optimize large-scale data solutions on a Cloudera Hadoop platform. You will work mainly with Apache Spark and Scala, shaping features, tuning workloads, and enhancing scalability while maintaining robust production-grade systems.

You will participate in architecture improvements, automated testing, CI/CD, security, and continuous improvement within an Agile team. Strong English (B2) is required.

Qualificações

• Strong professional experience in Big Data Engineering.
• Advanced knowledge of Apache Spark 3.
• Proven experience optimizing Spark applications.
• Strong development experience with Scala 2.
• Advanced knowledge of the Hadoop ecosystem (YARN, HDFS, Hive, Kafka).
• Experience with CI/CD pipelines and Agile/Scrum practices.

Responsabilidades

• Develop and evolve high-performance Big Data applications.
• Build and optimize distributed processing solutions using Spark and Scala.
• Improve architecture through component rationalization and reuse.
• Optimize Spark workloads for scalability, reliability, and performance.
• Work across the Hadoop ecosystem including HDFS, Hive, Kafka and YARN.
• Contribute to CI/CD, deployment, and production-readiness activities.

Conhecimentos

Big Data Engineering

Apache Spark 3

Scala 2.12

Hadoop

CI/CD

Agile/Scrum

English B2

Formação académica

Bachelor's degree in Computer Science

Ferramentas

Jenkins

XL Deploy

XL Release

Bitbucket

Jira

Confluence

Descrição da oferta de emprego

act digital seeks a Senior Big Data Engineer to design, develop, and optimize large-scale data solutions on a Cloudera Hadoop platform. You will work mainly with Apache Spark and Scala, shaping features, tuning workloads, and enhancing scalability while maintaining robust production-grade systems.

You will participate in architecture improvements, automated testing, CI/CD, security, and continuous improvement within an Agile team. Strong English (B2) is required.