Senior Big Data Engineer - Python & Spark (Remote)

HR Tech Job

Chicago (IL)

Hybrid

USD 140,000 - 200,000

Full time

6 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive pay

Benefits package

Flexible vacation

401(k) plan

Job summary

ZipRecruiter is seeking a senior data engineer to scale data processing and ML infrastructure. The role focuses on building fast data pipelines, both stream and batch, and deploying cloud-based solutions that power our AI-driven matching platform.

You will work within a distributed system, writing evolvable, well-instrumented code for Kubernetes deployments and data services used to connect millions of job seekers with opportunities.

Qualifications

5+ years of professional software development experience with a focus on Python and big data technologies.
Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies.
Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms.
Experience with containerization technologies like Docker and/or Kubernetes.

Responsibilities

Build data processing and exploration pipelines along with ML infrastructure to power our intelligence.
Deploy a range of cloud-based technologies for critical projects.
Write, test, instrument, and deploy code to our Kubernetes environment.
Help drive the innovation and evolution of ZipRecruiter.

Skills

Python

Big data

Spark

Kafka

Hadoop

Hive

Docker

Kubernetes

Education

BS/MS/PhD in Mathematics, Computer Science, Physics, or related field

Tools

Delta Lake

HBase

Cassandra

MongoDB

Apache Beam

Job description

You will work within a distributed system, writing evolvable, well-instrumented code for Kubernetes deployments and data services used to connect millions of job seekers with opportunities.

Get your free, confidential resume review.

or drag and drop your file here.