Senior Data Engineer — Big Data & ML Infra

Socket.dev; United States; On-site; USD 130,000 - 175,000; Full time

Benefits offered by this job

Competitive compensation

Exceptional benefits package

Flexible vacation & paid time off

Employer-matched 401(k)

Job summary

ZipRecruiter is seeking senior data engineers to build scalable data processing, ML infrastructure, and cloud-based systems supporting millions of job seekers and thousands of employers.

Join a team delivering data-driven intelligence in a complex distributed system, using Python and big data tech on Kubernetes deployments, with a strong focus on scalable services and robust instrumentation.

Qualifications

• 2+ years of professional software development experience with a focus on Python and big data technologies
• Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
• Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
• Experience with containerization technologies like Docker and/or Kubernetes

Responsibilities

• Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
• Deploy a range of cloud-based technologies for critical projects
• Write, test, instrument, and deploy code to our Kubernetes environment
• Help drive the innovation and evolution of ZipRecruiter

Skills

Python

Big data

Spark

Kafka

Hadoop

Hive

CS fundamentals

Education

BS/MS/PhD in Mathematics/CS/Physics or related field

Tools

Docker

Kubernetes

Flume

NiFi

Delta Lake

HBase

Cassandra

MongoDB

Apache Hudi

Apache Beam

Apache Flink

Dataflow (Google)

Kinesis

Azure Databricks

Job description

ZipRecruiter is seeking senior data engineers to build scalable data processing, ML infrastructure, and cloud-based systems supporting millions of job seekers and thousands of employers.

Join a team delivering data-driven intelligence in a complex distributed system, using Python and big data tech on Kubernetes deployments, with a strong focus on scalable services and robust instrumentation.