Engineering Manager - Data Pipelines & ML (Remote)

ZipRecruiter; United States; Hybrid; USD 200,000 - 265,000; Full time

Benefits offered by this job

Competitive compensation

Exceptional benefits package

Flexible Vacation & Paid Time Off

Employer-matched 401(k) plan

Job summary

ZipRecruiter's Recommendations Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.

We are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while

Qualifications

• 5+ years of professional software development experience.
• 2+ years leading software engineering teams.
• Deep experience with Spark, Hadoop, and Hive.
• Streaming technologies (Kafka, Flink, Beam).
• Strong CS fundamentals (data structures, algorithms) and coding skills.
• Experience with containerization technologies like Docker and Kubernetes.
• Experience working on a B2C or B2B Product
• This role is for engineers who are talking with their Product Managers about problems to solve and turning them into engineering solutions. They are naturally curious, problem solvers, and deeply understand the product they work on.
• Must have experience dealing with messy/unreliable data (third party data sets, data integrations, migrations)

Responsibilities

• Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
• Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
• Own and lead improvements to fraud detection and blocking mechanisms.
• Partner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
• Ensure we can act on everything we learn about jobs in a scalable real time manner. Scale our data pipelines both for performance and maintainability so we can be ambitious about what data we collect and where we can personalize the job seeker experience.

Skills

Software dev

Leadership

Big data

Streaming

CS fundamentals

Containerization

B2C/B2B product

Problem solving

Tools

Spark

Hadoop

Hive

Kafka

Flink

Beam

Docker

Kubernetes

Job description

ZipRecruiter's Recommendations Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.

We are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while