Software Engineer, Big Data, Tech Enablement (Fully Remote)

ZipRecruiter; United States; A distancia; USD 110.000 - 150.000; Jornada completa

Descripción de la vacante

ZipRecruiter, Inc. is seeking a Big Data Engineer to design and maintain data infrastructure that powers our product. The role involves data ingestion, big data processing, MLOps, and AI-driven data analysis tools.

You will design pipelines, tackle large-scale data challenges with batch/streaming approaches, and build MLOps frameworks to accelerate development across teams.

Formación

• 2+ years of professional software development experience with data pipelines.
• Hands-on Apache Spark experience with batch and streaming jobs.
• Solid CS fundamentals and experience with containerized services.

Responsabilidades

• Design and maintain data pipelines and systems that make web events available in our datalake.
• Tackle large-scale data challenges using batch and streaming techniques.
• Build frameworks for MLOps and data documentation to accelerate development across teams.

Conocimientos

Data pipelines

Spark (batch/streaming)

Containerized services

Herramientas

Apache Spark

Docker

Descripción del empleo

• As a Big Data Engineer on the Tech Enablement team, you will build and maintain data infrastructure that powers our product.
• You will work on data ingestion, big data processing, MLOps, and AI-driven data analysis tools.

Key Responsibilities:

• Design and maintain data pipelines and systems that make web events available in our datalake.
• Tackle large-scale data challenges using batch and streaming techniques.
• Build frameworks for MLOps and data documentation to accelerate development across teams.

Qualifications:

• 2+ years of professional software development experience with data pipelines.
• Hands-on Apache Spark experience with batch and streaming jobs.
• Solid CS fundamentals and experience with containerized services.