Senior AI Automation Engineer - Data Annotation Autonomy

Caterpillar Brazil; Irving (TX); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical insurance

Paid time off

401(k) plan

Health Savings Account

Flexible Spending Accounts

Job summary

Caterpillar Inc. in Irving, TX seeks a Senior AI Automation Engineer to develop annotation automation for robotics, autonomy, computer vision, and VLA systems. You will build data pipelines and deploy labeling/captioning solutions in production, integrating Caterpillar data systems with external providers.

You will train and evaluate AI models, ensure quality and scalability, and work with platforms like NVIDIA Cosmos Curator and Cosmos Reason in a cross-functional scrum team.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Robotics, or a related field.
• Experience with Python-based production software and containerization (Docker, Kubernetes).
• Experience designing distributed data processing pipelines and APIs.
• Experience training, fine-tuning, or deploying ML models.
• 2+ years pro experience with camera/LiDAR datasets for perception or ML.
• 1+ years in data annotation and quality assurance for autonomous systems.

Responsibilities

• Develop and deploy automated labeling and captioning for perception and VLA datasets.
• Train, fine-tune, and evaluate AI models for auto-labeling and auto-captioning.
• Build data pipelines moving datasets through labeling, review, validation, and publication.
• Extend platforms like NVIDIA Cosmos Curator and Cosmos Reason; integrate Caterpillar data with external providers.
• Ensure reliability, scalability, observability, and observability across annotation services.

Skills

Python

Docker

Kubernetes

Distributed systems

Machine learning

Data annotation

Camera/LiDAR data pipeline

Education

Bachelor's degree in Computer Science/Engineering/AI

Tools

Labelbox

Supervisely

RoboFlow

PyTorch

TensorFlow

ONNX

Weights & Biases

MLflow

Job description

Caterpillar Inc. in Irving, TX seeks a Senior AI Automation Engineer to develop annotation automation for robotics, autonomy, computer vision, and VLA systems. You will build data pipelines and deploy labeling/captioning solutions in production, integrating Caterpillar data systems with external providers.

You will train and evaluate AI models, ensure quality and scalability, and work with platforms like NVIDIA Cosmos Curator and Cosmos Reason in a cross-functional scrum team.