Software Engineer, Big Data

Remote; San Francisco (CA); Hybrid; USD 130,000 - 175,000; Full time

Benefits offered by this job

Competitive compensation

Excellent benefits package

Flexible vacation and PTO

Employer-matched 401(k)

Job summary

ZipRecruiter is seeking senior data engineers to build fast, scalable data processing, ML infrastructure, and data platforms that power our AI-driven marketplace. You will develop both streaming and batch pipelines, instrument and deploy code, and work across a distributed system.

We value strong Python and big data experience, plus hands-on work with Spark, Kafka, Hadoop, and cloud technologies. The role supports hybrid remote work in the US with competitive compensation and benefits.

Qualifications

• 2+ years of professional software development experience with a focus on Python and big data.
• Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies.
• Comprehensive CS fundamentals in coding, object-oriented programming, data structures, and algorithms.
• Experience with containerization technologies like Docker and/or Kubernetes.

Responsibilities

• Build data processing and exploration pipelines along with ML infrastructure to power our intelligence.
• Deploy a range of cloud-based technologies for critical projects.
• Write, test, instrument, and deploy code to our Kubernetes environment.
• Help drive the innovation and evolution of ZipRecruiter.

Skills

Python

Big data

Algorithms

OO programming

Education

BS in Computer Science or related field

MS/PhD in related field

Tools

Docker

Kubernetes

Apache Kafka

Spark

Hadoop

Hive

Delta Lake

MongoDB

Cassandra

Apache Hudi

Apache Beam

Apache Flink

Google Cloud Dataflow

Amazon Kinesis

Azure Databricks

Job description

We offer a hybrid work environment. Most US-based positions can alsobeperformed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:

To actively connect people to their next great opportunity.

Who We Are:

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary:

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We’re working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we’re looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We’re working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people’s lives.

Responsibilities:

• Build data processing and exploration pipelines along with ML infrastructure to power our intelligence

• Deploy a range of cloud-based technologies for critical projects

• Write, test, instrument, and deploy code to our Kubernetes environment

• Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

• 2+ years of professional software development experience with a focus on Python and big data technologies

• Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies

• Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms

• Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

• 4+ years of professional software development experience, with a focus on Python and big data technologies

• BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience

• Experience with data integration tools like Apache Kafka, Flume, and NiFi

• Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB

• Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you’ll enjoy:

• Competitive compensation

• Exceptional benefits package

• Flexible Vacation & Paid Time Off

• Employer-matched 401(k) plan

The US base salary range for this full-time position is $130,000-$175,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote