Hadoop Infrastructure Engineer

Talon Professional Services; New York (NY); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Talon Professional Services in New York, NY is seeking a Hadoop Infrastructure Engineer to join a hybrid team (3 days onsite) with direct hire employment. You will maintain and enhance a large-scale Hadoop ecosystem supporting millions of requests daily, working on high-performance distributed systems and open-source technologies.

The ideal candidate has strong scripting and Java experience, deep knowledge of Hadoop components (HDFS, HBase, Hive, Spark, Oozie), and a track record of automating

Qualifications

• Experience with Hadoop components such as HDFS, HBase, Hive, Spark, and Oozie.
• 4+ years hands-on Java development experience (Spring, JMX, JDBC).
• Linux OS and shell scripting proficiency.
• Experience with Jenkins, Maven, Jira.
• Strong collaboration and problem-solving in fast-paced environments.

Skills

Scripting

Java & Spring

Hadoop ecosystem

Linux & Shell

Jenkins & Maven

Jira

OS troubleshooting

Education

Bachelor's degree in CS/Engineering

Job description

Job Title: Hadoop Infrastructure Engineer

Workplace Type: Hybrid-3 Days Onsite (New York, NY)

Employment Type: Direct Hire

Join a renowned organization that thrives on managing vast amounts of data to drive critical financial insights. As a Hadoop Infrastructure Engineer, you will be a key player in maintaining and enhancing a sophisticated, large-scale Hadoop ecosystem supporting millions of requests daily. This role offers an exciting opportunity to work on high-performance distributed systems, contribute to open-source projects, and impact the way our client leverages data across various product domains. If you're passionate about large-scale data infrastructure, scripting, application development, and open-source technologies, this is your chance to make a meaningful difference.

Bring your expertise in scripting, applications, and Hadoop to help optimize infrastructure, improve scalability, and support cutting-edge data solutions. Your dedication and technical prowess will empower our client to handle their massive data footprint efficiently and securely.

Required Skills:

• Proficiency in scripting and application development
• Strong experience with Hadoop ecosystem components (HDFS, HBase, Hive 3, Spark, Oozie)
• 4+ years of hands-on experience with Java and related technologies (Spring, JMX, JDBC)
• Solid understanding of Linux OS and Shell scripting
• Familiarity with modern development tools (Jenkins, Maven, Jira)
• Ability to troubleshoot and resolve OS-level issues
• Knowledge of open-source software and community engagement (a plus)

Nice to Have Skills:

• Experience with distributed systems architecture and system design
• Familiarity with Ansible
• Automation experience with tools like Airflow or Argo

Preferred Education and Experience:

• Degree in Computer Science, Engineering, or equivalent work experience
• 3+ years working directly within Hadoop-related environments

Other Requirements:

• Ability to thrive in a collaborative, fast-paced environment
• Strong problem-solving and communication skills