Autonomy Simulation Engineer — World Modeling & VLA AI

Caterpillar

Irving (TX)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Caterpillar is seeking a highly qualified AI researcher to develop high-fidelity digital scenes and advanced simulation capabilities. You will lead 3D scene generation with 3DGS/NeRF, build Vision-Language-Action models, and contribute to world modeling for long-horizon decisions in complex environments.

You will also develop automated data pipelines for simulating perception, planning, and control, while keeping pace with Generative AI and foundation models research.

Qualifications

  • Master's degree or higher in a relevant field (CS/AI/Automation/Robotics/Math/Electrical Engineering).
  • Strong foundation in computer vision theory and methods.
  • Familiarity with 3D reconstruction, multi-view geometry, SLAM, or neural rendering.
  • Experience with NeRF, 3DGS is a plus.
  • Understanding of world models and their use in simulation.

Responsibilities

  • Construct high-fidelity digital scenes using 3DGS and NeRF; migrate real mine/scene data to simulation.
  • Develop Vision-Language-Action models and training; explore language-driven agent behavior.
  • Contribute to World Model design and implementation for environment prediction.
  • Build and validate simulation data generation tools; support large-scale testing of perception, planning, and control.
  • Follow frontier AI research (Generative AI, Foundation Models, RL) and apply to scene generation and agent training.

Skills

Python
Computer Vision basics
Transformer
LLM
VLM
Vision-Language-Action
Embodied AI
Team collaboration
Reading English papers
English technical reading

Education

Master's degree or above in CS/AI/Automation/Robotics/Math/Electrical Engineering

Tools

PyTorch
Linux
NeRF
3DGS
SLAM

Job description

Caterpillar is seeking a highly qualified AI researcher to develop high-fidelity digital scenes and advanced simulation capabilities. You will lead 3D scene generation with 3DGS/NeRF, build Vision-Language-Action models, and contribute to world modeling for long-horizon decisions in complex environments.

You will also develop automated data pipelines for simulating perception, planning, and control, while keeping pace with Generative AI and foundation models research.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Simulation Engine Architect - Physical AI
Principal Simulation Engine Architect - Physical AI

Caterpillar • Irving (TX)

On-site
USD 159,000 - 259,000
Medical, dental, and vision benefits
401(k) and retirement benefits
Paid time off and holidays
+1
Robotics Simulation & World Models Engineer
Robotics Simulation & World Models Engineer

Maxinsights • Santa Clara (CA)

On-site
USD 140,000 - 200,000
Health insurance
Vision care
Dental coverage
+4
Autonomy Simulation Engineer (World Sim)
Autonomy Simulation Engineer (World Sim)

Caterpillar • Irving (TX)

On-site
USD 120,000 - 180,000
Senior Physical AI Engineer - Digital Twins & Autonomous Machines
Senior Physical AI Engineer - Digital Twins & Autonomous Machines

Caterpillar • Irving (TX)

On-site
USD 148,000 - 240,000
Medical benefits
401(k) plan
Health Savings Account (HSA)
+2
Senior Principal AI Scientist - AV Simulation
Senior Principal AI Scientist - AV Simulation

Here • Chicago (IL)

Remote
USD 171,000 - 250,000
Health, Dental, Vision
Retirement plans
Paid time off
VLA Algorithm Engineer - Simulation Data Generation & World Models
VLA Algorithm Engineer - Simulation Data Generation & World Models

Maxinsights • Santa Clara (CA)

On-site
USD 140,000 - 200,000
Health insurance
Vision care
Dental coverage
+4
Autonomy Simulation Architect & Orchestration Lead
Autonomy Simulation Architect & Orchestration Lead

Caterpillar • Irving (TX)

On-site
USD 128,000 - 209,000
Relocation assistance
Visa sponsorship
Medical, dental, and vision benefits
+1
Lead Simulation Engineer: Digital Twin & Autonomy
Lead Simulation Engineer: Digital Twin & Autonomy

Caterpillar • Irving (TX)

On-site
USD 128,000 - 209,000
Medical, dental, and vision benefits
401(k) savings plans
Paid time off
Senior Omniverse Sensor Simulation Engineer
Senior Omniverse Sensor Simulation Engineer

NCSL International • Irving (TX)

On-site
USD 128,000 - 209,000
Domestic relocation assistance
Visa sponsorship
Principal AI Research Engineer: World Models for Robotics
Principal AI Research Engineer: World Models for Robotics

Insight Recruitment • New York (NY)

On-site
USD 180,000 - 260,000