Big Data Engineer - Tech Enablement & ML Ops

ZipRecruiter, Inc.

Santa Monica (CA)

Hybrid

USD 135,000 - 185,000

Full time

3 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation

Exceptional benefits package

Flexible Vacation & Paid Time Off

Employer-matched 401(k) plan

Job summary

ZipRecruiter in Santa Monica, CA is seeking a Software Engineer, Big Data, Tech Enablement to help design and operate scalable data pipelines and ML data tooling. The role blends data infrastructure, ML enablement, and product-focused data use across the engineering org.

You will collaborate with data engineers and software teams to build reliable data systems, implement streaming/batch processing, and advance our AI-driven data exploration tools for faster, data-backed decisions.

Qualifications

2+ years of professional software development experience, with data pipelines feeding a customer product.
Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale.
Experience deploying and operating containerized services and batch jobs.
Solid computer science fundamentals: data structures, algorithms, distributed systems, and testing.
Experience building and operating data pipelines and infrastructure that feed into a customer facing product.

Responsibilities

Data Ingestion & Datalake Management: Design, build, deploy, and maintain the data pipelines and systems that make web events available in our datalake and via event streams for various downstream applications to process.
Big Data Processing: You'll tackle challenges with large, evolving datasets, using a mix of batch and streaming techniques to make critical trade-offs between speed, efficiency, and reliability.
MLOps: Design, build, deploy, and maintain frameworks and systems that accelerate ML development across teams and products at ZipRecruiter, with the goals of improving the velocity, quality, observability, and reliability of ML development and ML powered products.
Data Documentation Framework: Design, build, deploy, and maintain frameworks and systems to improve the comprehensiveness and quality of data documentation at ZipRecruiter through processes and tooling that allows both humans and automated processes to easily add, maintain, and discover documentation.
Data Analysis Agent: Design, build, deploy, and maintain an agentic data exploration and analysis tool, Sift, to democratize access to data, collaborate on insights, and accelerate data driven decision making.