Senior AI Automation Engineer — Data Annotation & Vision AI

Socket.dev; Irving (TX); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

Paid time off (Vacation, Holidays, etc

Job summary

Caterpillar Inc. in Irving, TX is seeking a Senior AI Automation Engineer to develop annotation automation solutions for robotics, autonomy, computer vision, and Vision-Language-Action systems with a scrum team.

This hands-on role combines software engineering, ML and data engineering to build automated labeling and captioning capabilities for real-world heavy equipment and construction environments, including deployment of Cosmos Curator/Reason and Caterpillar-specific AI models.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, AI, ML, Robotics or related field.
• Experience developing production-grade software using Python and containerization (Docker, Kubernetes).
• Experience designing distributed systems, APIs, and data processing pipelines.
• Experience training, fine-tuning, or deploying ML models.
• 2+ years creating and managing perception datasets (camera/LiDAR) and data collection pipelines.

Responsibilities

• Develop and deploy automated labeling and captioning solutions for perception and VLA datasets.
• Train, fine-tune, and evaluate AI models to support auto-labeling, auto-captioning and data quality automation.
• Build data pipelines and workflows moving datasets through labeling, human review, quality validation and publication.
• Extend platforms like NVIDIA Cosmos Curator and Cosmos Reason and integrate Caterpillar data systems with external providers.
• Ensure reliability, scalability, observability, and operational excellence across annotation automation services.

Skills

Python

Distributed systems

Data pipelines

Problem solving

Camera/LiDAR data

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

Labelbox

Supervisely

RoboFlow

PyTorch

TensorFlow

ONNX

Weights & Biases

MLflow

Job description

Caterpillar Inc. in Irving, TX is seeking a Senior AI Automation Engineer to develop annotation automation solutions for robotics, autonomy, computer vision, and Vision-Language-Action systems with a scrum team.

This hands-on role combines software engineering, ML and data engineering to build automated labeling and captioning capabilities for real-world heavy equipment and construction environments, including deployment of Cosmos Curator/Reason and Caterpillar-specific AI models.