Hadoop Engineer: Real-Time Data & Cloud Platform Tuning

Veriipro; Bellevue (WA); On-site; USD 110,000 - 140,000; Full time

Job summary

Veriipro is seeking an experienced Hadoop Engineer to ensure reliable, high-performing data solutions for customers. The role includes hands-on administration of Hadoop platforms, including performance tuning, and supporting cloud-based environments.

Required skills include expertise in Big Data ecosystems such as Hadoop, Kafka, and HBase, alongside strong problem-solving abilities and experience working with customers on complex issues.

Qualifications

• Hands-on expertise in Big Data ecosystems and Hadoop.
• Experience in administration, performance tuning, and cloud-based platforms.

Responsibilities

• Perform Hadoop administration and support HDInsight product teams.
• Provide end-customer support by resolving incidents and ICMs.
• Run prototypes and migrate Big Data workloads.
• Optimize and tune performance for Spark, Hive, and Hadoop jobs.
• Troubleshoot production issues, identify root causes, and implement mitigations.
• Build tools and services to improve debuggability and supportability.
• Monitor cluster health and ensure availability for top customers.
• Collaborate with internal teams to improve processes and operational efficiency.

Skills

Big Data and Hadoop Ecosystem (HDFS, Hive, Spark, YARN)

Kafka for real-time data streaming

HBase for NoSQL data management

Cloud Era, AWS

Job description

Veriipro is seeking an experienced Hadoop Engineer to ensure reliable, high-performing data solutions for customers. The role includes hands-on administration of Hadoop platforms, including performance tuning, and supporting cloud-based environments.

Required skills include expertise in Big Data ecosystems such as Hadoop, Kafka, and HBase, alongside strong problem-solving abilities and experience working with customers on complex issues.