Autonomy Simulation Engineer (World Sim)

Caterpillar

Irving (TX)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Caterpillar is seeking a highly qualified AI researcher to develop high-fidelity digital scenes and advanced simulation capabilities. You will lead 3D scene generation with 3DGS/NeRF, build Vision-Language-Action models, and contribute to world modeling for long-horizon decisions in complex environments.

You will also develop automated data pipelines for simulating perception, planning, and control, while keeping pace with Generative AI and foundation models research.

Qualifications

  • Master's degree or higher in a relevant field (CS/AI/Automation/Robotics/Math/Electrical Engineering).
  • Strong foundation in computer vision theory and methods.
  • Familiarity with 3D reconstruction, multi-view geometry, SLAM, or neural rendering.
  • Experience with NeRF, 3DGS is a plus.
  • Understanding of world models and their use in simulation.

Responsibilities

  • Construct high-fidelity digital scenes using 3DGS and NeRF; migrate real mine/scene data to simulation.
  • Develop Vision-Language-Action models and training; explore language-driven agent behavior.
  • Contribute to World Model design and implementation for environment prediction.
  • Build and validate simulation data generation tools; support large-scale testing of perception, planning, and control.
  • Follow frontier AI research (Generative AI, Foundation Models, RL) and apply to scene generation and agent training.

Skills

Python
Computer Vision basics
Transformer
LLM
VLM
Vision-Language-Action
Embodied AI
Team collaboration
Reading English papers
English technical reading

Education

Master's degree or above in CS/AI/Automation/Robotics/Math/Electrical Engineering

Tools

PyTorch
Linux
NeRF
3DGS
SLAM

Job description

Career Area:

Technology, Digital and Data

Job Description:
Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you'rejoining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don'tjust talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

岗位职责:

1. 高保真数字场景构建

基于3D Gaussian Splatting(3DGS)、NeRF等神经渲染技术,构建高精度三维数字场景。

将真实矿山、施工现场及道路环境快速迁移至仿真平台。

优化场景重建质量、渲染效率及场景资产管理流程。

2. Vision-Language-Action(VLA)模型开发

参与VLA模型研发与训练。

探索自然语言驱动的智能体行为生成方法。

支持仿真环境中的任务理解、决策执行及行为评估。

3. World Model研发

参与世界模型(World Model)设计与实现。

构建环境动态预测能力,支持场景演化模拟与长时序决策推理。

探索基于大模型的环境理解与未来状态预测方法。

4. 仿真数据生成与验证平台建设

开发自动化数据生成工具链。

建设闭环仿真验证体系,支持感知、规划和控制算法的大规模测试验证。

参与仿真场景开发、数据管理及测试结果分析。

5. 前沿AI技术研究

跟踪并研究Generative AI、Foundation Models、Reinforcement Learning等前沿技术。

探索AI技术在场景生成、驾驶行为建模及智能体训练中的应用。

将最新研究成果快速落地到实际业务场景。

任职要求(Qualifications)

1.基本要求

2027届硕士及以上学历(优秀本科生亦可)。

计算机科学、人工智能、自动化、机器人、数学、电子工程等相关专业。

2.专业知识

(1)计算机/人工智能及相关专业

(2)熟悉计算机视觉基础理论。

(3)了解3D重建、多视图几何、SLAM或神经渲染相关技术。

(4)熟悉NeRF、3DGS等技术者优先。

(5)了解世界模型及世界模型在仿真中的应用

(6)了解Transformer、LLM、VLM等基础架构。

(7)对VLA、Embodied AI、具身智能方向有浓厚兴趣。

(8)具备仿真环境开发经验者优先。

3.编程能力

熟练掌握Python。

熟悉PyTorch深度学习框架。

具备良好的数据结构与算法基础。

具备Linux开发环境使用经验。

4.综合能力

良好的学习能力和技术钻研能力。

对前沿AI技术保持持续关注和探索热情。

良好的沟通协作能力和团队合作精神。

具备阅读英文技术文献和论文的能力。

Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Autonomy End to End development Engineer
Autonomy End to End development Engineer

Caterpillar • Irving (TX)

On-site
USD 100,000 - 180,000
Autonomy Operation Agent Engineer
Autonomy Operation Agent Engineer

Caterpillar • Irving (TX)

On-site
USD 120,000 - 190,000
Principal Architect – Simulation Engine (Physical AI)
Principal Architect – Simulation Engine (Physical AI)

Caterpillar • Irving (TX)

On-site
USD 159,000 - 259,000
Medical, dental, and vision benefits
401(k) and retirement benefits
Paid time off and holidays
+1
Autonomy Simulation Engineer — World Modeling & VLA AI
Autonomy Simulation Engineer — World Modeling & VLA AI

Caterpillar • Irving (TX)

On-site
USD 120,000 - 180,000
Principal Architect - Reinforcement Learning (Physical AI)
Principal Architect - Reinforcement Learning (Physical AI)

Caterpillar • Irving (TX)

On-site
USD 148,000 - 240,000
Medical, dental, and vision benefits
401(k) savings plans
Health Savings Account (HSA)
+5
Simulation Quality Automation Engineer
Simulation Quality Automation Engineer

Caterpillar • Irving (TX)

On-site
USD 98,000 - 158,000
Medical benefits
401(k)
HSA
+2
Principal Software Engineer - Robotics & Physical AI Simulation
Principal Software Engineer - Robotics & Physical AI Simulation

Caterpillar • Irving (TX)

On-site
USD 148,000 - 240,000
Medical benefits
Paid time off
401(k) savings
+4
Senior Data Quality Engineer, Data Quality Services
Senior Data Quality Engineer, Data Quality Services

Cat (CaterpillarCareers) • Irving (TX)

On-site
USD 113,000 - 183,000
Medical, dental, and vision benefits
401(k) savings plans
Paid time off
+7
Simulation Platform Engineering Lead
Simulation Platform Engineering Lead

Caterpillar • Irving (TX)

On-site
USD 128,000 - 209,000
Relocation assistance
Visa sponsorship
Principal Architect - Reinforcement Learning (Physical AI)
Principal Architect - Reinforcement Learning (Physical AI)

Caterpillar • Irving (TX)

On-site
USD 148,000 - 240,000
Medical benefits
401(k) savings plan
HSA
+4