Big Data Engineer: Remote & Scalable ML Infra

ziprecruiter; Stati Uniti; Ibrido; USD 130.000 - 175.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work

Competitive compensation

Extensive benefits

Flexible vacation

Descrizione del lavoro

ZipRecruiter is seeking a Software Engineer, Big Data to build large-scale data systems and ML infrastructure for a bustling online employment marketplace.

You will develop scalable data pipelines, deploy cloud services, and produce production code in Kubernetes, enabling data-driven matching for millions.

Required: 2+ years of Python and big-data experience; Spark, Kafka, Hadoop or Hive; solid CS fundamentals; Docker/Kubernetes familiarity.

Competenze

• At least 2 years of professional software development with Python and big-data tech.
• Experience with Spark, Kafka, Hadoop, Hive, or similar data-processing systems.
• Strong CS fundamentals: coding, OOP, data structures, algorithms.
• Experience with Docker or Kubernetes for containerized services.
• Nice to have: 4+ years in Python and big-data focus; degree in CS/Math/Physics or equivalent.

Mansioni

• Build data-processing, data-exploration, and ML infrastructure for high-volume intelligent applications.
• Deploy and operate cloud technologies used by important engineering initiatives.
• Develop, test, instrument, and release production code in containerized Kubernetes environments.
• Contribute to the evolution of distributed systems, services, and processes that support marketplace functionality.
• Write efficient, maintainable code that can evolve as data volume, product needs, and system complexity grow.

Conoscenze

Python

Big-data technologies

Containerization

CS fundamentals

Spark

Kafka

Hadoop

Hive

Formazione

Bachelor's degree in a technical field

Strumenti

Docker

Kubernetes

Delta Lake

HBase

Cassandra

MongoDB

Apache Hudi

Beam

Flink

Google Cloud Dataflow

Amazon Kinesis Data Analytics

Azure Databricks

Descrizione del lavoro

ZipRecruiter is seeking a Software Engineer, Big Data to build large-scale data systems and ML infrastructure for a bustling online employment marketplace.

You will develop scalable data pipelines, deploy cloud services, and produce production code in Kubernetes, enabling data-driven matching for millions.

Required: 2+ years of Python and big-data experience; Spark, Kafka, Hadoop or Hive; solid CS fundamentals; Docker/Kubernetes familiarity.