Big Data Platform Engineer — Spark, HDFS & Kafka Ops

Robotic Process Automation LLC

Chicago (IL)

Presencial

USD 81 000 - 115 000

Tempo integral

Há 5 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste recrutador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Robotic Technologies Automation is seeking a Big Data Platform Engineer in Chicago to own and optimize enterprise-grade data platforms. The role emphasizes Spark, HDFS, and Kafka administration with strong performance tuning and security considerations.

You'll deploy and monitor Spark/HDFS/Kafka environments, implement Kerberos and SSL/TLS, and develop automation with Python/Bash. This 8-month contract focuses on on-prem and Cloudera/CDP contexts, with on-call support in a fast-paced team.

Qualificações

  • 3–5 years of hands‑on Spark, HDFS, and Kafka administration, tuning and sizing.
  • Linux administration with command‑line proficiency.
  • Monitoring using Grafana or Splunk.
  • Kerberos/SSL/TLS IAM/LDAP security understanding.
  • Strong analytical and communication skills.
  • Bachelor’s degree in Computer Science, Information Systems, or related field.
  • Experience with Cloudera Hadoop/CDP preferred.
  • Cloudera certifications or equivalent big data.

Responsabilidades

  • Deploy, configure, monitor, tune Spark environments and workloads.
  • Manage HDFS storage: capacity, performance, replication, and security.
  • Deploy, configure, monitor, and troubleshoot Kafka clusters.
  • Monitor performance with Grafana/Splunk; identify bottlenecks.
  • Implement Kerberos, SSL/TLS, IAM/LDAP security.
  • Develop automation with Python/Bash/Perl for admin tasks.
  • Provide on‑call support and production operations.
  • Support Cloudera Hadoop/CDP installations and upgrades.

Conhecimentos

Spark
HDFS
Kafka
Linux
Monitoring
Security
Python

Formação académica

Bachelor’s degree in Computer Science/Information Systems

Ferramentas

Grafana
Splunk
Cloudera Manager
Cloudera CDP

Descrição da oferta de emprego

Robotic Technologies Automation is seeking a Big Data Platform Engineer in Chicago to own and optimize enterprise-grade data platforms. The role emphasizes Spark, HDFS, and Kafka administration with strong performance tuning and security considerations.

You'll deploy and monitor Spark/HDFS/Kafka environments, implement Kerberos and SSL/TLS, and develop automation with Python/Bash. This 8-month contract focuses on on-prem and Cloudera/CDP contexts, with on-call support in a fast-paced team.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Big Data Platform Engineer: Spark, Kafka, HDFS
Big Data Platform Engineer: Spark, Kafka, HDFS

Robotics Technologies LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Big Data Platform Engineer (Spark/HDFS/Kafka) – Chicago
Big Data Platform Engineer (Spark/HDFS/Kafka) – Chicago

Ethereum Technologies LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Senior Hadoop & Spark Data Engineer (Cloud + Kafka)
Senior Hadoop & Spark Data Engineer (Cloud + Kafka)

Robotic Technologies Automation • Arizona

Presencial
USD 120 000 - 160 000
Chicago Big Data Platform Engineer (Spark, Kafka)
Chicago Big Data Platform Engineer (Spark, Kafka)

Valiant Technologies LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Spark & Kafka Big Data Platform Engineer
Spark & Kafka Big Data Platform Engineer

Quantum Technologies LLC • Chicago (IL)

Presencial
USD 83 000 - 113 000
Big Data Platform Engineer
Big Data Platform Engineer

Robotics Technologies LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Big Data Platform Engineer
Big Data Platform Engineer

Valiant Technologies LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Big Data Platform Engineer
Big Data Platform Engineer

Ethereum Technologies LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Big Data Platform Engineer
Big Data Platform Engineer

Robotic Process Automation LLC • Chicago (IL)

Presencial
USD 81 000 - 115 000
Big Data Platform Engineer
Big Data Platform Engineer

Quantum Technologies LLC • Chicago (IL)

Presencial
USD 83 000 - 113 000