Senior Big Data Engineer - Hadoop, Spark & Kafka

Oxford Global Resources; San Francisco (CA); On-site; USD 73,000 - 95,000; Full time

Benefits offered by this job

Medical benefits (supplemental)

401(k) Retirement Savings Plan

Paid holidays

Paid sick leave

Job summary

Oxford Global Resources is seeking a senior Big Data Engineer to design, develop, and maintain software solutions in a Hadoop cluster. You will lead a small team (3-5 members) and participate in design/code reviews as well as unit and integration testing.

The role requires extensive Big Data experience, strong Hadoop knowledge, and hands-on Spark/Scala, Java/Python MapReduce, and NoSQL skills. Collaboration with clients and DevOps tools experience are essential.

Qualifications

• 10-15 years IT experience with 3-5 years in Big Data

Responsibilities

• Design, develop and maintain software solutions in Hadoop cluster
• Participate in design reviews, code reviews, unit and integration testing
• Own deliverables for a small team (3-5 people)

Skills

Hadoop ecosystem

Spark & Scala

Java/Python MapReduce

NoSQL databases

Unix shell scripting

DevOps tools

Communication with clients

Mentoring team

Tools

GitHub

Jenkins

Hadoop tools (HCatalog, Sqoop, Pig, Hive QL, UDF)

Talend

Job description

Oxford Global Resources is seeking a senior Big Data Engineer to design, develop, and maintain software solutions in a Hadoop cluster. You will lead a small team (3-5 members) and participate in design/code reviews as well as unit and integration testing.

The role requires extensive Big Data experience, strong Hadoop knowledge, and hands-on Spark/Scala, Java/Python MapReduce, and NoSQL skills. Collaboration with clients and DevOps tools experience are essential.