Staff AI Engineer (Perception)

Agility Robotics; Pittsburgh (Allegheny County); On-site; USD 170,000 - 250,000; Full time

Benefits offered by this job

Stock options

Paid parental leave

Five weeks PTO

Retirement plan

Relocation assistance

Referral program

Company-paid health, dental, vision, &

Flexible work schedules

Job summary

Agility Robotics is seeking a Staff Machine Learning Engineer to own the design and deployment of perception systems for production-use robots. You will lead object detection, tracking, and pose estimation across CPU/GPU platforms while aligning with product goals.

Ideal candidates have 5+ years deploying ML for mobile robots, strong academic foundations, and experience with MLOps and CV/ robotics publications.

Qualifications

• 5+ years deploying ML-based object detection algorithms on mobile robots.
• Experience with MLOps: data annotation, storage, evaluation tools, deployment.
• Publications in CVPR/ICCV/RSS/ICRA preferred.
• Strong math foundations in linear algebra and optimization.
• Experience with 3 or 6 DoF pose estimation and related ML models.

Responsibilities

• Own the design and development of object detection and tracking algorithms.
• Own architecture and technical roadmap for perception systems used by the robot in production.
• Design, develop, and deploy ML algorithms for multi-object detection and scene understanding.
• Evaluate and drive adoption of state-of-the-art perception models.
• Collaborate with navigation, manipulation and hardware teams to align perception with product requirements.

Skills

Object detection

Multi-object tracking

Pose estimation

ML on embedded systems

MLOps

Computer vision fundamentals

Leadership

Algorithms optimization

Python

C++

Education

Master's or Ph.D. in AI/Robotics/CS

Tools

PyTorch

OpenCV

NumPy

TensorRT

YOLO

Faster R-CNN

Mask R-CNN

Job description

• Agility Robotics is deploying humanoid robots that are solving real-world challenges in logistics and manufacturing. Perceiving and understanding the world is critical to Digit’s success in these applications
• The Perception team is looking for a staff machine learning engineer to own the design and development of object detection and tracking algorithms
• As a Staff AI Engineer, you will own the architecture and technical roadmap for object perception systems used by the robot in production
• Design, develop, and deploy machine learning algorithms for multi-object detection, scene understanding, and 6-DoF object pose estimation
• Evaluate and drive adoption of state-of-the-­art perception models
• Promote best practices in architecture, design, and testing to deliver high-quality, scalable software
• Optimize deep neural networks and associated data processing to run efficiently on embedded systems
• Collaborate with navigation, manipulation and hardware teams to align perception capabilities with product requirements

Benefits

• Stock Options (for certain roles)
• A culture that embraces individuality and authenticity
• Paid Parental Leave
• Five Weeks of Paid Time Off Annually
• Employer Matched Retirement Plan
• Relocation Assistance (for certain roles)
• Employee Referral Bonus Program
• 100% Company Paid Disability, Life, Health, Dental & Vision Insurance (for AR employees)
• A culture that encourages flexible work schedules

Experience designing and optimizing algorithms for efficient execution across CPU and GPU architecturesFamiliarity with common computer vision and machine learning libraries such as (but not limited to) PyTorch, OpenCV, NumPy, etcStrong mathematical fundamentals in linear algebra and numerical optimization and familiarity with core geometric concepts in computer vision5+ years of experience deploying machine learning-based object detection algorithms on mobile robotsMaster’s or Ph.D. in Artificial Intelligence, Robotics, Computer Science, or a related discipline, with a strong foundation in machine learning, robotics, and intelligent systemsExperience with MLOps such as (but not limited to) data annotation services, data storage, model evaluation tools, and model deploymentPublications in your field (CVPR, ICCV, RSS, ICRA preferred)Proficiency in related technical areas such as (but not limited to) deep convolutional neural networks, multi-object tracking, data association, supervised learning and pose estimationExperience developing ML models for 3 or 6 dof pose estimationExperience using YOLO, Faster/Mask R-CNNExperience in a technical leadership role