Perception Autonomy Engineer

Caterpillar; Chennai; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Caterpillar seeks a Perception Developer to design, develop, and deploy perception software for autonomous and semi-autonomous machines used in construction. You will work on multi-sensor perception, 3D processing, and production-grade software for safety-critical platforms.

The role combines C++/Python development with field deployment, sensor fusion, and real-time optimization on embedded hardware such as NVIDIA Jetson. Collaboration across teams is essential.

Qualifications

• Bachelor's or master's degree in Computer Science, Computer Engineering, Robotics, Electrical Engineering, Mechatronics, or a related field.
• Strong programming skills in modern C++ and Python, with experience developing and debugging software on Linux.
• Practical experience with computer vision, deep learning, 3D geometry, point-cloud processing, or robotic perception.
• Experience with one or more perception tasks such as detection, segmentation, classification, tracking, localization, mapping, or sensor fusion.
• Working knowledge of PyTorch or TensorFlow and libraries such as OpenCV, PCL, Eigen.
• Understanding of camera, LiDAR, radar, GNSS, and IMU sensor characteristics, calibration, coordinate systems, and data quality considerations.
• Experience with ROS/ROS 2, DDS, Git, unit testing, continuous integration, and software documentation practices.

Responsibilities

• Design and implement perception algorithms for object and personnel detection, classification, segmentation, tracking, terrain understanding, localization, mapping, and obstacle assessment.
• Develop camera, LiDAR, radar, GNSS, and IMU processing pipelines, including calibration, synchronization, sensor fusion, and uncertainty handling.
• Translate research concepts and state-of-the-art models into robust, maintainable, production-quality C++ and Python software.
• Optimize algorithms and neural-network inference for embedded CPU/GPU platforms using profiling, CUDA, TensorRT, and related acceleration technologies.
• Build automated evaluation workflows, datasets, simulation scenarios, and test tools to measure accuracy, latency, robustness, and safety performance.
• Debug and resolve perception issues using recorded data, simulation, hardware-in-the-loop systems, and field-machine testing.
• Collaborate with systems, autonomy, controls, embedded software, validation, and safety teams to define interfaces and deliver integrated machine capabilities.
• Participate in architecture reviews, code reviews, technical documentation, and continuous improvement of software engineering practices.

Skills

C++

Python

Linux

Computer Vision

Deep Learning

ROS/ROS 2

Git

Unit Testing

CI/CD

Communication

Teamwork

Education

Bachelor's or Master's in CS/CE/Robotics/EE/Mechatronics

Tools

OpenCV

PCL

Eigen

PyTorch

TensorFlow

CUDA

TensorRT

Job description

Career Area: Technology, Digital and Data

Job Description: Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Role Definition

Caterpillar's Cat Technology team is seeking a Perception Developer to design, develop, and deploy perception software for autonomous and semi-autonomous machines used in construction. The role focuses on multi-sensor perception, computer vision, 3D point-cloud processing, sensor fusion, and production-quality software for safety-critical, resource-constrained platforms. The ideal candidate combines strong C++/Python development skills with hands-on experience building, optimizing, and validating perception algorithms from prototype through field deployment.

Responsibilities

• Design and implement perception algorithms for object and personnel detection, classification, segmentation, tracking, terrain understanding, localization, mapping, and obstacle assessment.
• Develop camera, LiDAR, radar, GNSS, and IMU processing pipelines, including calibration, synchronization, sensor fusion, and uncertainty handling.
• Translate research concepts and state-of-the-art models into robust, maintainable, production-quality C++ and Python software.
• Optimize algorithms and neural-network inference for embedded CPU/GPU platforms using profiling, CUDA, TensorRT, and related acceleration technologies.
• Build automated evaluation workflows, datasets, simulation scenarios, and test tools to measure accuracy, latency, robustness, and safety performance.
• Debug and resolve perception issues using recorded data, simulation, hardware-in-the-loop systems, and field-machine testing.
• Collaborate with systems, autonomy, controls, embedded software, validation, and safety teams to define interfaces and deliver integrated machine capabilities.
• Participate in architecture reviews, code reviews, technical documentation, and continuous improvement of software engineering practices.

Desired Qualifications

• Bachelor's or master's degree in Computer Science, Computer Engineering, Robotics, Electrical Engineering, Mechatronics, or a related field.
• Strong programming skills in modern C++ and Python, with experience developing and debugging software on Linux.
• Practical experience with computer vision, deep learning, 3D geometry, point-cloud processing, or robotic perception.
• Experience with one or more perception tasks such as detection, segmentation, classification, tracking, localization, mapping, or sensor fusion.
• Working knowledge of PyTorch or TensorFlow and common perception libraries such as OpenCV, PCL, Eigen, or similar tools.
• Understanding of camera, LiDAR, radar, GNSS, and IMU sensor characteristics, calibration, coordinate systems, and data quality considerations.
• Experience with ROS/ROS 2, DDS, Git, unit testing, continuous integration, and software documentation practices.
• Strong analytical, problem-solving, communication, and teamwork skills, with the ability to work across research and product-development teams.

Preferred Qualifications

• Experience deploying perception models on embedded or edge platforms such as NVIDIA Jetson, DRIVE, or comparable hardware.
• Experience with CUDA, TensorRT, model quantization, profiling, and real-time performance optimization.
• Knowledge of SLAM, visual or LiDAR odometry, Kalman filtering, probabilistic estimation, and graph-based spatial data structures.
• Experience developing perception systems for autonomous vehicles, ADAS, mobile robots, mining, construction, or off-highway equipment.
• Experience with simulation, synthetic data, dataset curation, annotation workflows, MLOps, or field validation.
• Publications, patents, or demonstrated implementation of state-of-the-art perception methods are an advantage.

Be Part Of What’s Next in Autonomous Construction Sites

Construction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible - intelligent machines operating in dynamic jobsites - into reality. Our connected ecosystem brings together massive volumes [BH1.1][LR1.2] of high-quality data to create a foundation where engineers like you can build and deploy against. If this work motivates you, we invite you to join our team. In these roles, you’ll work at the intersection of the physical and digital worlds. You’ll help design and deliver intelligent systems that enable machines to perceive their environment, make informed decisions, and support safer, more productive operations.

Posting Dates: October 13, 2026 - October 26, 2026

Caterpillar is an Equal Opportunity Employer.

Qualified applicants of any age are encouraged to apply.

There's more to work at Caterpillar than just the work itself. We hire smart, friendly people and it shows in our culture. We hold ourselves to high standards and make sure our values of integrity, excellence, teamwork, commitment and sustainability come to life in the way we work. We make sure our employees feel continuously challenged while also supported. We provide professional growth opportunities, including leadership programs. We celebrate the diversity of our team, while also working together as one Caterpillar. Our culture, like everything at our company, is made possible by each employee’s contribution. Person by person, we create the environment we work in, and we are proud of the Caterpillar we’ve built.