Engineering Manager, Data Ingestion & Pipelines (Hybrid/Remote)

ZipRecruiter; Austin (TX); Hybrid; USD 200,000 - 265,000; Full time

Benefits offered by this job

Competitive compensation

Exceptional benefits package

Flexible Vacation & Paid Time Off

Employer-matched 401(k) plan

Job summary

ZipRecruiter is seeking an Engineering Manager to lead an experienced, high-impact engineering team. You will guide modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.

The role requires strong leadership and collaboration with Product Managers to align on roadmap priorities. You will drive real-time data processing, scale pipelines for performance and personalization, and work with Data Scientists to unlock new insights.

Qualifications

• 5+ years of professional software development experience.
• 2+ years leading a software engineering team.
• Deep experience with Spark, Hadoop and Hive.
• Experience with Kafka, Flink or Beam streaming.
• Strong CS fundamentals and coding skills.
• Experience with Docker and Kubernetes.
• Experience shipping products in B2C or B2B environments.
• Comfort dealing with messy/unreliable data from various sources.

Responsibilities

• Lead and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
• Rebuild the job ingestion pipeline and expose data to consuming engineering teams.
• Prioritize initiatives that improve data quality and handle low-structure content.
• Own and lead improvements to fraud detection and blocking mechanisms.
• Partner with Engineering, Data Scientists, and Product Manager to balance requests and roadmap priorities.
• Ensure we can act on everything we learn about jobs in a scalable real time manner.

Skills

5+ years experience

Software leadership

Big data frameworks

Streaming tech

CS fundamentals

Docker & Kubernetes

B2C/B2B product experience

Problem solving

Tools

Docker

Kubernetes

Spark

Hadoop

Hive

Kafka

Flink

Beam

Delta Lake

HBase

Hudi

Scala

Job description

ZipRecruiter is seeking an Engineering Manager to lead an experienced, high-impact engineering team. You will guide modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.

The role requires strong leadership and collaboration with Product Managers to align on roadmap priorities. You will drive real-time data processing, scale pipelines for performance and personalization, and work with Data Scientists to unlock new insights.