Software Engineer, Big Data

ziprecruiter; Stati Uniti; Ibrido; USD 130.000 - 175.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work

Competitive compensation

Extensive benefits

Flexible vacation

Descrizione del lavoro

ZipRecruiter is seeking a Software Engineer, Big Data to build large-scale data systems and ML infrastructure for a bustling online employment marketplace.

You will develop scalable data pipelines, deploy cloud services, and produce production code in Kubernetes, enabling data-driven matching for millions.

Required: 2+ years of Python and big-data experience; Spark, Kafka, Hadoop or Hive; solid CS fundamentals; Docker/Kubernetes familiarity.

Competenze

• At least 2 years of professional software development with Python and big-data tech.
• Experience with Spark, Kafka, Hadoop, Hive, or similar data-processing systems.
• Strong CS fundamentals: coding, OOP, data structures, algorithms.
• Experience with Docker or Kubernetes for containerized services.
• Nice to have: 4+ years in Python and big-data focus; degree in CS/Math/Physics or equivalent.

Mansioni

• Build data-processing, data-exploration, and ML infrastructure for high-volume intelligent applications.
• Deploy and operate cloud technologies used by important engineering initiatives.
• Develop, test, instrument, and release production code in containerized Kubernetes environments.
• Contribute to the evolution of distributed systems, services, and processes that support marketplace functionality.
• Write efficient, maintainable code that can evolve as data volume, product needs, and system complexity grow.

Conoscenze

Python

Big-data technologies

Containerization

CS fundamentals

Spark

Kafka

Hadoop

Hive

Formazione

Bachelor's degree in a technical field

Strumenti

Docker

Kubernetes

Delta Lake

HBase

Cassandra

MongoDB

Apache Hudi

Beam

Flink

Google Cloud Dataflow

Amazon Kinesis Data Analytics

Azure Databricks

Descrizione del lavoro

Role overview

The Software Engineer, Big Data builds large-scale data systems and machine-learning infrastructure for an online employment marketplace serving millions of job seekers and many business customers. The role involves developing scalable processing pipelines, cloud-based services, and well-instrumented applications that support data-driven matching and other marketplace intelligence.

Responsibilities

• Build data-processing, data-exploration, and machine-learning infrastructure for high-volume intelligent applications.
• Deploy and operate cloud technologies used by important engineering initiatives.
• Develop, test, instrument, and release production code in containerized Kubernetes environments.
• Contribute to the evolution of distributed systems, services, and processes that support marketplace functionality.
• Write efficient, maintainable code that can evolve as data volume, product needs, and system complexity grow.

Requirements

• At least 2 years of professional software-development experience, particularly with Python and big-data technologies.
• Experience with one or more of Spark, Kafka, Hadoop, Hive, or comparable data-processing systems.
• Solid computer-science fundamentals, including coding, object-oriented programming, data structures, and algorithms.
• Experience with containerization technologies such as Docker or Kubernetes.

Nice to have

• Four or more years of software-development experience focused on Python and big data.
• A degree in mathematics, computer science, physics, or a related technical discipline, or equivalent practical experience.
• Experience with data-integration tools such as Kafka, Flume, or NiFi.
• Familiarity with storage technologies including Delta Lake, HBase, Cassandra, or MongoDB.
• Exposure to Apache Hudi, Beam, Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, or Azure Databricks.

Benefits and work setup

• Hybrid work is offered, and many U.S.-based positions may be performed remotely unless an exception is specified.
• Listed benefits include competitive compensation, an extensive benefits package, flexible vacation and paid time off, and an employer-matched retirement plan.
• The listed U.S. base salary range is $130,000–$175,000, with final pay influenced by location, experience, skills, education, and role-related factors. Additional compensation may include equity, bonuses, or other benefits.