Perception Autonomy Engineer

Caterpillar Inc.; Chennai District; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Caterpillar Inc. is hiring a Perception Developer to design, develop, and deploy perception software for autonomous machines used in construction.

You will work on multi-sensor perception, 3D point-cloud processing, sensor fusion, and production-quality software, combining C++/Python development with hands-on deployment from prototype to field. Collaboration with cross-functional teams is essential.

Qualifications

• Bachelor’s or master’s degree in Computer Science, Computer Engineering, Robotics, Electrical Engineering, Mechatronics, or related field.
• Strong programming skills in modern C++ and Python on Linux.
• Practical experience with computer vision, deep learning, 3D geometry, or robotic perception.
• Experience with perception tasks: detection, segmentation, classification, tracking, localization, mapping, or sensor fusion.
• Working knowledge of PyTorch or TensorFlow and OpenCV, PCL, Eigen, or similar tools.
• Understanding of sensor characteristics and data quality (camera, LiDAR, GNSS, IMU).
• Experience with ROS/ROS 2, DDS, Git, CI, and documentation.

Responsibilities

• Design and implement perception algorithms for object and personnel detection, classification, segmentation, tracking, and mapping.
• Develop multi-sensor pipelines for camera, LiDAR, radar, GNSS, and IMU processing including fusion and calibration.
• Translate research concepts into robust production-quality C++ and Python software.
• Optimize algorithms and neural-network inference for embedded CPU/GPU platforms using CUDA, TensorRT.
• Build evaluation workflows, datasets, simulations, and test tools to measure accuracy and latency.
• Debug perception issues using recorded data, simulation, and field testing.
• Collaborate with systems, autonomy, controls, and safety teams to define interfaces and deliver integrated capabilities.
• Participate in architecture/code reviews and technical documentation.

Skills

C++

Python

Linux

Computer Vision

ROS/ROS 2

Perception algorithms

Education

Bachelor's or Master's in CS/CE/Robotics/EE

Tools

OpenCV

PCL

Eigen

TensorRT

PyTorch/TensorFlow

Job description

Job Description

Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Career Area

Technology, Digital and Data

Job Description

Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Role Definition

Caterpillar’s Cat Technology team is seeking a Perception Developer to design, develop, and deploy perception software for autonomous and semi-autonomous machines used in construction. The role focuses on multi-sensor perception, computer vision, 3D point-cloud processing, sensor fusion, and production-quality software for safety-critical, resource-constrained platforms. The ideal candidate combines strong C++/Python development skills with hands‑on experience building, optimizing, and validating perception algorithms from prototype through field deployment.

Responsibilities

• Design and implement perception algorithms for object and personnel detection, classification, segmentation, tracking, terrain understanding, localization, mapping, and obstacle assessment.
• Develop camera, LiDAR, radar, GNSS, and IMU processing pipelines, including calibration, synchronization, sensor fusion, and uncertainty handling.
• Translate research concepts and state‑of‑the‑art models into robust, maintainable, production‑quality C++ and Python software.
• Optimize algorithms and neural‑network inference for embedded CPU/GPU platforms using profiling, CUDA, TensorRT, and related acceleration technologies.
• Build automated evaluation workflows, datasets, simulation scenarios, and test tools to measure accuracy, latency, robustness, and safety performance.
• Debug and resolve perception issues using recorded data, simulation, hardware‑in‑the‑loop systems, and field‑machine testing.
• Collaborate with systems, autonomy, controls, embedded software, validation, and safety teams to define interfaces and deliver integrated machine capabilities.
• Participate in architecture reviews, code reviews, technical documentation, and continuous improvement of software engineering practices.

Desired Qualifications

• Bachelor’s or master’s degree in Computer Science, Computer Engineering, Robotics, Electrical Engineering, Mechatronics, or a related field.
• Strong programming skills in modern C++ and Python, with experience developing and debugging software on Linux.
• Practical experience with computer vision, deep learning, 3D geometry, point‑cloud processing, or robotic perception.
• Experience with one or more perception tasks such as detection, segmentation, classification, tracking, localization, mapping, or sensor fusion.
• Working knowledge of PyTorch or TensorFlow and common perception libraries such as OpenCV, PCL, Eigen, or similar tools.
• Understanding of camera, LiDAR, radar, GNSS, and IMU sensor characteristics, calibration, coordinate systems, and data quality considerations.
• Experience with ROS/ROS 2, DDS, Git, unit testing, continuous integration, and software documentation practices.
• Strong analytical, problem‑solving, communication, and teamwork skills, with the ability to work across research and product‑development teams.

Preferred Qualifications

• Experience deploying perception models on embedded or edge platforms such as NVIDIA Jetson, DRIVE, or comparable hardware.
• Experience with CUDA, TensorRT, model quantization, profiling, and real‑time performance optimization.
• Knowledge of SLAM, visual or LiDAR odometry, Kalman filtering, probabilistic estimation, and graph‑based spatial data structures.
• Experience developing perception systems for autonomous vehicles, ADAS, mobile robots, mining, construction, or off‑highway equipment.
• Experience with simulation, synthetic data, dataset curation, annotation workflows, MLOps, or field validation.
• Publications, patents, or demonstrated implementation of state‑of‑the‑art perception methods are an advantage.

Be Part of What’s Next in Autonomous Construction Sites

Construction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible—intelligent machines operating in dynamic jobsites—into reality.

Our connected ecosystem brings together massive volumes of high‑quality data to create a foundation where engineers like you can build and deploy against.

Posting Dates

October 13, 2026 - October 26, 2026

Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply