Senior Big Data Engineer: Hadoop & Data Lake Ops

Aubay Portugal; Viseu; Presencial; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Inetum seeks a seasoned Big Data Engineer to join our team, supporting Hadoop-based data lake environments. The role focuses on performance, reliability, and security of the big data infrastructure, with responsibilities spanning operations, troubleshooting, and resource management.

You will work across cross-functional teams to onboard workloads, implement patches, and maintain Kerberos, Ranger/Sentry policies, and TLS encryption, while documenting cluster configurations and sharing insights.

Qualificações

• Bachelor’s degree in Computer Science or equivalent.
• Minimum 5 years of experience in a similar role.
• Strong expertise in Hadoop Ecosystem & Data Lake Operations.
• Strong expertise in Big Data Services & Query Engines.
• Security & Access Control in Distributed Environments.
• Monitoring, Automation & Platform Lifecycle Management.
• Proven ability to diagnose and resolve complex issues in Big Data environments.
• Strong communication skills to collaborate with cross-functional teams.
• English proficiency: B2-C1 level.

Responsabilidades

• Operate, monitor, and support Hadoop-based data lake platforms.
• Provide L3 incident response, deep troubleshooting, and performance tuning for big data components.
• Ensure data integrity, replication, and capacity management within HDFS clusters.
• Develop and automate monitoring and alerting for service health and node performance.
• Collaborate with platform and data teams to onboard new workloads with optimal resource allocation.
• Apply patches, upgrades, and configuration changes to maintain platform security and stability.
• Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
• Work with storage, network, and security teams to optimize throughput and access controls.
• Maintain cluster documentation and share knowledge across teams.

Conhecimentos

Hadoop Ecosystem & Data Lake Ops

Big Data Services & Query Engines

Security & Access Control in Dist. Env

Monitoring, Automation & Lifecycle Mgm

English Proficiency (B2-C1)

Formação académica

Bachelor’s degree in Computer Science or equivalent

Descrição da oferta de emprego

Inetum seeks a seasoned Big Data Engineer to join our team, supporting Hadoop-based data lake environments. The role focuses on performance, reliability, and security of the big data infrastructure, with responsibilities spanning operations, troubleshooting, and resource management.

You will work across cross-functional teams to onboard workloads, implement patches, and maintain Kerberos, Ranger/Sentry policies, and TLS encryption, while documenting cluster configurations and sharing insights.