Senior Big Data Platform Engineer - Metadata & Performance

Integrated Resources Inc.; Santa Clara (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading staffing services organization is seeking a Big Data Platform Staff Engineer to join their team in Santa Clara, CA. The role involves developing tools for big data systems, optimizing performance, and requires strong expertise in SQL, Scala, and various big data frameworks. Ideal candidates will have a proven background in software development and a passion for solving complex problems in big data environments.

Qualifications

• 5+ years of software development experience, including performance analysis.
• Hands-on experience in Big Data Components/Frameworks such as Hadoop, Spark, HBase, Hive.
• Excellent verbal and written communication skills.

Responsibilities

• Develop tools for extracting, importing, and synchronizing metadata.
• Analyze performance and scalability of the system, typically across various configurations.
• Conduct testing (and automated testing) of developed code.

Skills

SQL

Scala

Java

Scripting Languages

Hadoop

Spark

Machine Learning

Education

BS or higher degree in Computer Science or related field

Tools

Spark/SparkSQL

HBase

HDFS

Hive

NoSQL databases

Solr

Elasticsearch

Logstash

Kibana

Kafka

Job description

A leading staffing services organization is seeking a Big Data Platform Staff Engineer to join their team in Santa Clara, CA. The role involves developing tools for big data systems, optimizing performance, and requires strong expertise in SQL, Scala, and various big data frameworks. Ideal candidates will have a proven background in software development and a passion for solving complex problems in big data environments.