Senior Big Data Engineer - Remote ML Infra & Pipelines

ziprecruiter; United States; Remote; USD 170,000 - 240,000; Full time

Benefits offered by this job

Remote work

Hybrid option

401(k) plan

Job summary

ZipRecruiter is seeking a senior data engineer to build large-scale data systems powering a high-traffic job marketplace. The role blends data engineering, ML infrastructure, and distributed systems to serve millions of users and thousands of customers.

This is a fully remote US-based position ideal for engineers who enjoy evolving data-driven platforms and scalable architectures in a fast-moving environment.

Qualifications

• 5+ years of professional software development with Python and big data.
• Hands-on experience with Spark, Kafka, Hadoop or Hive.
• Strong CS fundamentals: OOP, data structures, algorithms.
• Experience with Docker and Kubernetes.
• Proven ability to write evolvable, instrumented distributed code.

Responsibilities

• Design and build data pipelines for ML and BI workloads.
• Develop and maintain ML infrastructure at scale.
• Deploy and operate cloud-based services for high-volume projects.
• Write, test, and deploy production code in Kubernetes.
• Contribute to architecture evolution of a growing distributed system.
• Collaborate on streaming and batch data systems processing petabytes.

Skills

Python

Big data

Distributed systems

Education

BS/MS/PhD in CS/Math/Physics or related field

Tools

Docker

Kubernetes

Spark

Kafka

Hadoop

Hive

Job description

ZipRecruiter is seeking a senior data engineer to build large-scale data systems powering a high-traffic job marketplace. The role blends data engineering, ML infrastructure, and distributed systems to serve millions of users and thousands of customers.

This is a fully remote US-based position ideal for engineers who enjoy evolving data-driven platforms and scalable architectures in a fast-moving environment.