AI Data Pipelines Engineer - Labelling & Automation

ProducePay; United States; Hybrid; USD 127,000 - 225,000; Full time

Benefits offered by this job

Competitive compensation

Equity awards

Health benefits

Unlimited vacation

Flexible hours

Work from home support

Meals and snacks

Job summary

Waabi is hiring a Software Engineer for the Labelling and Data Automation team to build pipelines, tools, and workflows for accelerating AI-first self-driving tech. You will own data discovery, labelling at scale, and end-to-end deployment of data solutions for ML teams.

The role emphasizes designing reliable data systems, collaboration across stakeholders, and delivering high-quality, well-tested code while enabling new search and curation capabilities in production.

Qualifications

• 4+ years of industry experience.
• Bachelor's in computer science, engineering, machine learning, or related technical discipline.
• Proficient in Python programming with strong software engineering fundamentals.
• Experience with data pipelines for large-scale processing and analysis.
• Strong communication and organizational skills.
• Understanding of cloud job orchestration, monitoring, and instrumentation best-practices.

Responsibilities

• Design and implement tools, pipelines, and metrics to accelerate development of AI-first autonomy system and simulator.
• Own the process, criteria, and tooling for finding relevant data across petabytes of real-world data.
• Build high reliability systems for extracting and labelling data with vendors and integrate back into the system.
• Collaborate with internal and third-party stakeholders to define taxonomy, validation rules and success criteria.
• Design and manage end-to-end deployment of data solutions to deliver high-quality labelled data for ML teams.
• Deploy open-set/embedding models to production and enable new search and curation modalities.
• Champion engineering excellence with high-quality, well-tested code.
• Contribute to project roadmap planning, prioritization, and delivery.

Skills

Python

Data pipelines

Cloud orchestration

Communication

Team player

Learning agility

Education

Bachelor's degree in Computer Science/Engineering/ML

Tools

Apache Airflow

Apache Hadoop/Spark

Terraform

CloudFormation

Job description

Waabi is hiring a Software Engineer for the Labelling and Data Automation team to build pipelines, tools, and workflows for accelerating AI-first self-driving tech. You will own data discovery, labelling at scale, and end-to-end deployment of data solutions for ML teams.

The role emphasizes designing reliable data systems, collaboration across stakeholders, and delivering high-quality, well-tested code while enabling new search and curation capabilities in production.