Senior Real-Time 3D Perception & Tracking Engineer

Allen Control Systems

Austin (TX)

On-site

USD 140,000 - 190,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Health insurance
Paid Time Off

Job summary

Allen Control Systems is seeking a Senior/Staff Perception and Tracking Engineer to advance real-time multi-target tracking for autonomous robotics. You will design and implement 3D computer vision pipelines, data association, and track maintenance for resource-constrained hardware.

Work with robotics, software, and platform engineers to deploy deep learning-based perception, optimize for low latency, and validate systems on embedded GPUs.

Qualifications

  • Bachelor’s or Master’s degree in CS, aerospace, applied math or related field.
  • 2–3 years of experience with perception algorithms, robotics, or ML, focusing on 3D CV tracking.
  • Strong experience developing vision-based tracking for real-time applications.
  • Experience implementing object detection (YOLO, SSD, R-CNN) and tracking algorithms (Kalman/particle filters, ByteTrack, DeepSORT).
  • Solid applied math foundation in linear algebra, probability, statistics, and estimation.

Responsibilities

  • Design, implement, test, and maintain core 3D computer vision based multi-object tracking algorithms and infrastructure.
  • Develop and optimize CV algorithms for real-time detection and tracking of small objects in robotics systems.
  • Implement and improve object detection and multi-object tracking pipelines using modern deep learning techniques.
  • Train, evaluate, and deploy machine learning models for perception tasks in dynamic environments.
  • Design image preprocessing and feature extraction pipelines to improve model robustness and performance.
  • Optimize tracking pipelines for low-latency, real-time performance on embedded hardware and GPUs.
  • Collaborate with robotics and software teams to integrate perception systems into autonomous platforms.
  • Participate in full software development lifecycle with testing and evaluation frameworks.
  • Define tracking-specific metrics, evaluation harnesses, and test scenarios to improve accuracy and robustness.

Skills

3D Computer Vision tracking
Python
C++
Linear algebra / math

Education

Bachelor’s or Master’s in Computer Science / Aerospace Engineering / Applied Math or related field

Tools

YOLO
SSD
R-CNN
Kalman filters
ByteTrack
DeepSORT
CUDA

Job description

Allen Control Systems is seeking a Senior/Staff Perception and Tracking Engineer to advance real-time multi-target tracking for autonomous robotics. You will design and implement 3D computer vision pipelines, data association, and track maintenance for resource-constrained hardware.

Work with robotics, software, and platform engineers to deploy deep learning-based perception, optimize for low latency, and validate systems on embedded GPUs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Real-Time Perception & Tracking Engineer for Robotics
Real-Time Perception & Tracking Engineer for Robotics

Socket.dev • Austin (TX)

On-site
USD 120,000 - 170,000
Competitive salary
Health, Dental, Vision Insurance
Paid Time Off
Senior Perception & Tracking Engineer
Senior Perception & Tracking Engineer

Allen Control Systems • Austin (TX)

On-site
USD 140,000 - 190,000
Competitive salary
Health insurance
Paid Time Off
Perception & Tracking Engineer
Perception & Tracking Engineer

Socket.dev • Austin (TX)

On-site
USD 120,000 - 170,000
Competitive salary
Health, Dental, Vision Insurance
Paid Time Off
Senior Computer Vision and ML Engineer – Real-Time Robotics
Senior Computer Vision and ML Engineer – Real-Time Robotics

Allen Control Systems • Mountain View (CA)

On-site
USD 180,000 - 240,000
Competitive salary
ACS Equity Package
Health, Dental, Vision Insurance
+1
Senior Perception Team Lead - 3D Vision for Production
Senior Perception Team Lead - 3D Vision for Production

Anyware Robotics • San Francisco (CA)

On-site
USD 180,000 - 280,000
Generous equity
Comprehensive health insurance
Flexible PTO
+2
Senior CV/ML Engineer — Real-Time Drone Detection
Senior CV/ML Engineer — Real-Time Drone Detection

Allen Control Systems • Austin (TX)

On-site
USD 140,000 - 220,000
Competitive salary
ACS Equity Package
Health Insurance
+1
Senior Real-Time Robot Perception Engineer
Senior Real-Time Robot Perception Engineer

5V Tech • California (MO)

On-site
USD 120,000 - 190,000
Competitive salary
Meaningful equity
Health, dental and vision benefits
Senior 3D AI Perception Engineer
Senior 3D AI Perception Engineer

Anyware Robotics • Fremont (CA)

On-site
USD 180,000 - 280,000
Comprehensive health insurance
Flexible PTO
Paid sick leave
+2
Real-Time Robot Perception Engineer
Real-Time Robot Perception Engineer

Relling • San Francisco (CA)

On-site
USD 140,000 - 210,000
Senior Perception Engineer III — Embedded C++
Senior Perception Engineer III — Embedded C++

Autonomous Solutions • Logan (UT)

On-site
USD 120,000 - 160,000