Big Data Mid

DataSmart; Lisboa; Hybrid; EUR 45,000 - 70,000; Full time

Job summary

DataSmart in Portugal is seeking an experienced Data Platform Engineer to operate and support Hadoop-based data lake platforms. You will monitor performance, ensure data integrity, and collaborate with cross-functional teams to onboard new workloads.

The role emphasizes L3 incident management, security via Kerberos and TLS, and applying patches to keep clusters stable while maintaining clear documentation and knowledge sharing across teams. Join DataSmart for national and international projects.

Qualifications

• Extensive experience operating Hadoop-based data platforms.
• Experience in L3 support and incident management.
• Strong data integrity, security, and monitoring capabilities.

Responsibilities

• Operate, monitor, and support Hadoop-based data lake platforms.
• Provide L3 incident response and deep troubleshooting.
• Ensure data integrity, replication, and capacity management in HDFS.
• Develop and automate monitoring and alerting for services and node health.
• Collaborate with platform and data teams to onboard workloads.
• Apply patches, upgrades, and config changes to maintain stability.
• Manage authentication and security using Kerberos.
• Implement access control with Ranger/Sentry.
• Collaborate with storage, network, and security teams to optimize performance.
• Maintain cluster documentation and share knowledge across teams.

Skills

Hadoop ops

L3 support

Performance tuning

Data replication

Security & authentication

Kerberos

TLS

Monitoring

Cross-functional teams

Tools

Apache Ranger

Apache Sentry

HDFS

Job description

Tel.: [phone] - Lisboa
Tel.: [phone] - Braga
Fax: [phone]
(Chamada para a rede fixa nacional) (Call to the national fixed network)

About Us:DataSmart is a Portuguese company, positioning itself as a consulting company of excellence, with over 20 years of existence. We are specialized in Technologies and Information Systems services, for the Portuguese and International markets. We pride ourselves on fostering a culture of involvement, experience, and excellence.

WhatYou'llDo:

• Operate, monitor, and support Apache Hadoop-based data lake platforms
• Provide L3 incident response, deep troubleshooting, and performance tuning
• Ensure data integrity, replication, and capacity management within HDFS clusters
• Develop and automate monitoring and alerting for services and node health
• Work with platform and data teams to onboard new workloads and allocate resources
• Apply patches, upgrades, and configuration changes to maintain platform stability
• Manage authentication and security using Kerberos
• Implement access control policies using Apache Ranger / Apache Sentry
• Collaborate with storage, network, and security teams to optimize performance
• Maintain cluster documentation and share knowledge across teams

Qualification:

• Strong experience operating Hadoop-based data platforms
• Experience with L3 support and incident management
• Knowledge of cluster performance tuning and optimization
• Experience managing data replication and storage capacity
• Experience with security and authentication (Kerberos, TLS, access policies)
• Strong troubleshooting and monitoring skills
• Experience working with cross-functional infrastructure teams

AtDataSmart, you will have the opportunity to integrate into a solid company and participate in projects of high recognition, nationally and internationally, with an appealing technological environment and career progression.

Excellence in the way to the future!

Connect with Us: Follow us on LinkedIn for updates on career opportunities, company news, and industry insights! For further details, visit us at www.datasmart.pt

#JoinOurTeam #DataSmart #ThinkDataBeSmart #BigData

Do you accept the challenge?
We are waiting for you!