Lead Perception Architect - Sensor Fusion & 3D Mapping

Caterpillar Financial Services Corporation; Irving (TX); On-site; USD 148,000 - 240,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

Paid time off

401(k) savings plans

Health Savings Account

Flexible Spending Accounts

Career Development

Incentive bonus

Tuition Reimbursement

Job summary

Caterpillar Inc. in Irving, TX, is seeking a specialist to own the architecture for modular perception ML, sensor fusion, object tracking and 3D mapping using data from camera, lidar, radar, IMU, GNSS, and machine state inputs.

The role focuses on transforming synchronized sensor data into reliable outputs for robotics, simulation, and safety analysis, enabling safer, more productive operations on global jobsites.

Qualifications

• Strong experience with modular perception ML and sensor fusion for autonomous vehicles.
• Hands-on experience with camera images, lidar and 4D radar, IMU, GNSS, and machine state data.
• Solid understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping.
• Ability to work cross-functionally with edge platform, robotics and simulation teams to turn perception algorithms into usable autonomy capabilities.

Responsibilities

• Define the modular perception ML architecture for camera-based object detection and drivable area understanding.
• Own the sensor fusion architecture across camera, lidar, 4D radar, IMU, GNSS, and machine state data.
• Define object tracking and object persistence architecture across multiple machines.
• Own 3D mapping architecture and support for persistent world representation.
• Define perception output interfaces for robotics, simulation, world model creation, validation and safety analysis.

Skills

Modular perception ML

Sensor fusion

Object detection

3D mapping

Cross-functional collaboration

Tools

Camera images

Lidar

4D radar

IMU

GNSS

Job description

Caterpillar Inc. in Irving, TX, is seeking a specialist to own the architecture for modular perception ML, sensor fusion, object tracking and 3D mapping using data from camera, lidar, radar, IMU, GNSS, and machine state inputs.

The role focuses on transforming synchronized sensor data into reliable outputs for robotics, simulation, and safety analysis, enabling safer, more productive operations on global jobsites.