Autonomy Engineering Specialist - Perception

Caterpillar Financial Services Corporation

Irving (TX)

On-site

USD 128,000 - 209,000

Full time

2 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Caterpillar Inc. is seeking an Autonomy Engineering Specialist - Perception to develop and test perception modules for autonomous and operator-assisted driving on off-road platforms. You will design, implement, and validate sensor fusion, object detection, tracking, and 3D mapping within our software stack and hardware platform.

You will lead other developers, collaborate across teams, and ensure production-quality autonomy solutions while following Agile processes and engineering standards.

Qualifications

  • Experience with perception ML and sensor fusion for autonomous vehicles and robotics.
  • ,

Responsibilities

  • Lead development of perception software for off-road autonomous systems.

Skills

C++
Python
Computer vision
Machine learning
Sensor fusion
Object detection
Tracking
Leadership
Debugging
Git
CMake
ROS
OpenCV
TensorFlow
PyTorch
Docker
GoogleTest

Tools

OpenCV
TensorFlow
PyTorch
ROS
Git
CMake
Docker
GoogleTest

Job description

Career Area:

Technology, Digital and Data

Job Description:
Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

As the Autonomy Engineering Specialist - Perception, you will be responsible for developing cutting-edge autonomous and operator-assisted driving systems. You will design, implement, and test modules for sensor fusion, object detection, tracking and classification and be a technical leader on the Perception team. You will also collaborate with other tech leads to integrate your solutions into our software stack and hardware platform.

What You Will Do:
  • Solve challenging perception problems for mobile off-road machines.
  • Lead other developers in the design and development of high-quality perception software to solve our customer needs.
  • Document architecture specifications, software design, verification plans, test cases, operating procedures, and safety procedures.
  • Work with application teams to collect and analyze data on customer experience with robotic and manned platforms. Participate in the iterative ML training cycles to meet perception requirements.
  • Use appropriate tools to debug, test and maintain perception software and assist in the verification and validation process.
What You Will Have:
Problem Solving:
  • Experience with modular perception ML and sensor fusion for autonomous vehicles and robotics. Familiarity with off-road autonomy applications is a plus.
  • Hands-on experience working with camera images, lidar and 4D radar point clouds, IMU, GNSS, and machine state data in real perception systems.
  • Solid understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping.
Software Development Life Cycle:
  • Participate in Agile software development from requirements and architecture through validation and deployment.
  • Develop software design documentation, verification plans, and test procedures.
  • Collaborate with engineering teams to deliver safe, production-quality autonomy solutions
Programming:
  • Excellence in C++
  • Fluency in Python
  • Experience developing computer vision, machine learning, sensor fusion, object detection, and tracking modules.
  • Strong software engineering, debugging, and code quality practices
Technical Troubleshooting:
  • Knowledge of debugging and validation tools to analyze and resolve perception software issues.
  • Ability to analyze code, logs, sensor data, and machine performance data to troubleshoot complex problems.
  • Experience with verification and validation activities for autonomous machine systems.
Considerations For Top Candidates:
  • Experience developing perception and calibration for autonomous vehicles, robotics, or advanced operator assist systems using lidar, radar, and cameras (typically 7+ years)
  • Strong background in computer vision, machine learning, deep learning, sensor fusion, object detection, classification, and tracking.
  • Demonstrated ability to lead other developers
  • Experience developing production-quality software in C++ and Python.
  • Experience with ROS/AIS, OpenCV, TensorFlow, PyTorch, and modern software development tools including Git, CMake, Docker, and GoogleTest.
  • Experience developing, integrating, or validating complex autonomous systems with a focus on machine safety and productivity.
  • Experience working in Agile environments using Azure DevOps or Jira and leveraging AWS cloud technologies (EC2, S3, Batch) for data processing and model development.
Additional Information:
  • This position requires the candidate to work full-time at the Irving, TX office.
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is NOT available with this position.
  • This position will require up to 10% travel
Summary Pay Range:

$128,470.00 - $208,770.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees

Posting Dates:

Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

SENIOR PERCEPTION ENGINEER
SENIOR PERCEPTION ENGINEER

Caterpillar • Town of Montana (WI)

On-site
USD 113,000 - 183,000
Senior Autonomy Engineer
Senior Autonomy Engineer

Caterpillar Financial Services Corporation • Mossville (IL)

On-site
USD 113,000 - 183,000
Medical, dental, and vision benefits
401(k) savings plan
Health Savings Account
+4
Autonomy Engineering Specialist - Perception
Autonomy Engineering Specialist - Perception

Caterpillar Brazil • Irving (TX)

On-site
USD 128,000 - 209,000
Medical benefits
Dental benefits
Vision benefits
+2
Principal Perception Architect - Detection and Fusion
Principal Perception Architect - Detection and Fusion

Caterpillar Financial Services Corporation • Irving (TX)

On-site
USD 148,000 - 240,000
Medical, dental, and vision benefits
Paid time off
401(k) savings plans
+5
Principal Perception Architect - System Integration
Principal Perception Architect - System Integration

Caterpillar Inc. • Irving (TX)

On-site
USD 148,000 - 240,000
Medical, dental, and vision benefits
401(k) savings plans
Incentive bonus
+1
Principal Perception Architect - System Integration
Principal Perception Architect - System Integration

Caterpillar Brazil • Irving (TX), Northern (KY)

On-site
USD 148,000 - 240,000
Medical, dental, and vision benefits
401(k) savings plans
Health Savings Account (HSA)
+2
Autonomy and Robotics Engineer
Autonomy and Robotics Engineer

Caterpillar Financial Services Corporation • Mossville (IL)

On-site
USD 89,000 - 145,000
Medical, dental, and vision benefits
401(k) savings plans
Health Savings Account (HSA)
+4
Senior Perception Component Platform Lead
Senior Perception Component Platform Lead

Caterpillar Financial Services Corporation • Irving (TX)

On-site
USD 148,000 - 222,000
Medical, dental, and vision benefits
401(k) savings plan
Health Savings Account (HSA)
+5
Senior Embedded Software Engineer
Senior Embedded Software Engineer

Talentify • Irving (TX)

On-site
USD 113,000 - 169,000
Medical, dental, and vision benefits
401(k) savings plans
Paid time off
Senior Autonomy Engineer - Positioning
Senior Autonomy Engineer - Positioning

Caterpillar Inc. • Irving (TX)

On-site
USD 113,000 - 183,000
Medical, dental, and vision benefits
Paid time off
401(k) savings plans
+1