Senior Big Data Engineer - Remote ML Infra

ZipRecruiter; Palo Alto (CA); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Competitive compensation

Exceptional benefits package

Flexible Vacation & Paid Time Off

Employer-matched 401(k) plan

Job summary

A leading online employment marketplace is seeking generalist software engineers to build scalable applications and data processing systems. This role involves working with big data technologies and contributing to innovative solutions that connect job seekers with opportunities. The ideal candidate has extensive experience in software development, particularly in big data, and is familiar with modern containerization and cloud technologies.

Qualifications

• 5+ years of software development experience focused on big data technologies.
• Experience with containerization technologies like Docker and/or Kubernetes.

Responsibilities

• Build data processing and exploration pipelines along with ML infrastructure.
• Deploy cloud-based technologies for critical projects.
• Write, test, instrument, and deploy code to our Kubernetes environment.

Skills

Big Data Technologies

Coding

Object-Oriented Programming

Data Structures

Algorithms

Education

BS/MS/PhD in Mathematics

BS/MS/PhD in Computer Science

BS/MS/PhD in Physics

Tools

Hadoop

Spark

Hive

Docker

Kubernetes

Apache Kafka

Flume

NiFi

Delta Lake

HBase

Cassandra

MongoDB

Apache Hudi

Apache Beam

Apache Flink

Google Cloud Dataflow

Amazon Kinesis Data Analytics

Azure Databricks

Job description

A leading online employment marketplace is seeking generalist software engineers to build scalable applications and data processing systems. This role involves working with big data technologies and contributing to innovative solutions that connect job seekers with opportunities. The ideal candidate has extensive experience in software development, particularly in big data, and is familiar with modern containerization and cloud technologies.