Senior Real-Time 3D Perception & Tracking Engineer

Allen Control Systems; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Health insurance

Paid Time Off

Job summary

Allen Control Systems is seeking a Senior/Staff Perception and Tracking Engineer to advance real-time multi-target tracking for autonomous robotics. You will design and implement 3D computer vision pipelines, data association, and track maintenance for resource-constrained hardware.

Work with robotics, software, and platform engineers to deploy deep learning-based perception, optimize for low latency, and validate systems on embedded GPUs.

Qualifications

• Bachelor’s or Master’s degree in CS, aerospace, applied math or related field.
• 2–3 years of experience with perception algorithms, robotics, or ML, focusing on 3D CV tracking.
• Strong experience developing vision-based tracking for real-time applications.
• Experience implementing object detection (YOLO, SSD, R-CNN) and tracking algorithms (Kalman/particle filters, ByteTrack, DeepSORT).
• Solid applied math foundation in linear algebra, probability, statistics, and estimation.

Responsibilities

• Design, implement, test, and maintain core 3D computer vision based multi-object tracking algorithms and infrastructure.
• Develop and optimize CV algorithms for real-time detection and tracking of small objects in robotics systems.
• Implement and improve object detection and multi-object tracking pipelines using modern deep learning techniques.
• Train, evaluate, and deploy machine learning models for perception tasks in dynamic environments.
• Design image preprocessing and feature extraction pipelines to improve model robustness and performance.
• Optimize tracking pipelines for low-latency, real-time performance on embedded hardware and GPUs.
• Collaborate with robotics and software teams to integrate perception systems into autonomous platforms.
• Participate in full software development lifecycle with testing and evaluation frameworks.
• Define tracking-specific metrics, evaluation harnesses, and test scenarios to improve accuracy and robustness.

Skills

3D Computer Vision tracking

Python

C++

Linear algebra / math

Education

Bachelor’s or Master’s in Computer Science / Aerospace Engineering / Applied Math or related field

Tools

YOLO

SSD

R-CNN

Kalman filters

ByteTrack

DeepSORT

CUDA

Job description

Allen Control Systems is seeking a Senior/Staff Perception and Tracking Engineer to advance real-time multi-target tracking for autonomous robotics. You will design and implement 3D computer vision pipelines, data association, and track maintenance for resource-constrained hardware.

Work with robotics, software, and platform engineers to deploy deep learning-based perception, optimize for low latency, and validate systems on embedded GPUs.