Remote Senior Big Data Engineer, AI Enablement

ZipRecruiter, Inc.; United States; Hybrid; USD 190,000 - 250,000; Full time

Benefits offered by this job

Competitive compensation

Exceptional benefits package

Flexible Vacation & Paid Time Off

Employer-matched 401(k) plan

Job summary

ZipRecruiter, Inc. is seeking a Senior Software Engineer, Big Data, in a hybrid/remote US role. You will design and build scalable data pipelines and datalake infrastructure, enabling data-driven product features.

You will contribute to ML workflows, data documentation, and the Sift analytics tool to empower teams with fast, reliable data access. The role emphasizes data processing, streaming, and scalable infrastructure with collaboration across product teams and data scientists.

Qualifications

• 4+ years of professional software development experience building and operating data pipelines feeding a customer facing product.
• Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale.
• Experience deploying and operating containerized services and batch jobs.
• Solid CS fundamentals: data structures, algorithms, distributed systems, testing.
• Professional software development experience building data pipelines and infrastructure feeding a customer facing product.

Responsibilities

• Design, build, deploy, and maintain data pipelines and datalake for web events.
• Tackle challenges with large evolving datasets using batch and streaming techniques.
• Design, build, deploy, and maintain ML development frameworks and systems (MLOps).
• Develop data documentation frameworks to improve data quality and discoverability.
• Create and maintain the Sift data exploration and analysis tool to democratize data access.

Skills

Apache Spark

Data pipelines

Distributed systems

Testing

Big data

Education

BS/MS/PhD in CS/Math/Physics or related field

Tools

Docker

Kubernetes

Apache Airflow

Kafka

Job description

ZipRecruiter, Inc. is seeking a Senior Software Engineer, Big Data, in a hybrid/remote US role. You will design and build scalable data pipelines and datalake infrastructure, enabling data-driven product features.

You will contribute to ML workflows, data documentation, and the Sift analytics tool to empower teams with fast, reliable data access. The role emphasizes data processing, streaming, and scalable infrastructure with collaboration across product teams and data scientists.