AI Automation Engineer: Perception & Annotation

Caterpillar Financial Services Corporation; Irving (TX); On-site; USD 98,000 - 158,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Paid time off

Health Savings Account

Flexible Spending Accounts

Career Development

Incentive bonus

Parental leave

Tuition Reimbursement

Life Insurance

Job summary

Caterpillar Inc. seeks a talented AI/Data engineer to develop and deploy automated labeling and captioning for perception datasets. You will train models, build robust data pipelines, and extend AI automation platforms to scale annotation across multimodal data while collaborating across ecosystems.

You will work on computer vision, robotics, and multimodal AI, shaping data foundations for autonomous machines and safer, more productive performance on real jobsites.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, AI, ML, robotics or related field.
• Experience developing production-grade software using Python and containerization (Docker, Kubernetes).
• Experience designing distributed systems, APIs and data processing pipelines.
• Experience training or deploying ML models.
• Strong problem-solving and cross-disciplinary collaboration.
• Experience with camera/LiDAR datasets for perception or ML tasks.
• Experience with data annotation and quality assurance for autonomous systems.
• Experience using annotation tools such as Labelbox, Supervisely or RoboFlow.
• Experience with PyTorch, TensorFlow, ONNX, Weights & Biases or MLflow.

Responsibilities

• Develop and deploy automated labeling and captioning solutions for perception datasets.
• Train, fine-tune, and evaluate AI models for auto-labeling and annotation quality.
• Build data pipelines moving datasets through labeling, review, validation and publication.
• Extend platforms like NVIDIA Cosmos Curator and Cosmos Reason for automation.
• Integrate Caterpillar data with external annotation providers and human-in-the-loop workflows.
• Ensure reliability, scalability, observability and operational excellence of annotation services.

Skills

Python

Docker

Kubernetes

APIs

Data pipelines

ML models

Labeling

Annotation tools

PyTorch

TensorFlow

ONNX

Education

Bachelor's degree in Computer Science or related field

Tools

Labelbox

Supervisely

RoboFlow

NVIDIA Cosmos Curator

Cosmos Reason

Docker

Kubernetes

Job description

Caterpillar Inc. seeks a talented AI/Data engineer to develop and deploy automated labeling and captioning for perception datasets. You will train models, build robust data pipelines, and extend AI automation platforms to scale annotation across multimodal data while collaborating across ecosystems.

You will work on computer vision, robotics, and multimodal AI, shaping data foundations for autonomous machines and safer, more productive performance on real jobsites.