Senior Perception Engineer Engineering Seattle

AIM Intelligent Machines, Inc.; Seattle, Northern (WA, KY); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k

Life insurance

Gourmet food

Job summary

AIM Intelligent Machines, Inc. seeks a Senior Perception Machine Learning Engineer to design, develop, and deploy perception systems for its autonomous earthmoving fleet.

You will tackle scene understanding, obstacle detection, and terrain modeling, pushing perception through sensor fusion and edge‑compute deployment. You will build production ML models for object detection, depth estimation, and segmentation, and collaborate across robotics, controls, and software teams to ensure robust

Qualifications

• Experience designing, training, and evaluating machine learning models.
• Strong understanding of optimization, gradients, regularization, and bias–variance tradeoffs.
• Familiarity with training dynamics and data imbalance.
• Excellent grasp of 2D/3D perception methods (depth sensing).
• Experience with perception sensor calibration (camera, LiDAR, radar).
• Hands-on experience with real-world computer vision problems.

Responsibilities

• Architect and develop perception algorithms for scene understanding, obstacle detection, terrain modeling, and machine awareness.
• Advance perception stack with sensor fusion, environment modeling, and perception pipelines.
• Develop and deploy ML models for perception tasks including object detection, segmentation, depth estimation, and terrain understanding.
• Optimize models for real-time inference on edge compute platforms.
• Build scalable data pipelines for training, evaluation, and model iteration.
• Collaborate with robotics, controls, systems, and software teams to integrate perception outputs into planning and control systems.
• Ensure perception systems interact with localization, SLAM, mapping, and safety systems.

Skills

Production ML systems

Edge deployment

Sensor data fusion

Real-world ML validation

C++ development

Tools

TensorFlow

PyTorch

Python

C++

Job description

Everything humanity depends on is mined, dug, or grown. At AIM, we are building the autonomous linchpin of civilization. We transform heavy machinery—bulldozers, loaders, excavators—into AI-powered fleets that operate continuously, safely, and at peak performance in the world’s harshest environments.

AIM runs production mines, large scale infrastructure builds, and defense operations as a TRL9 hardened system, not a science experiment. We have been automating this massive space with embodied AI and emerged as the market choice for ground engagement autonomy.

Built by engineers from mining, construction, Waymo, SpaceX, Google and Tesla, AIM enables scalable earthmoving, turbocharging the global economy’s physical foundation. AIM is backed by some of the most sophisticated capital in the world, including General Catalyst, Khosla Ventures, Elad Gil, Human Capital, Ironspring Ventures, Mantis, DCVC. Learn more about AIM here.

About you

You’re an engineer who loves solving difficult perception problems where machine learning meets the physical world.

You have experience building production machine learning systems that operate on real hardware, not just in research environments. You understand how perception algorithms behave under real-world constraints such as sensor noise, environmental variability, limited compute, and incomplete data.

You enjoy working across the full perception stack - from sensor data ingestion and calibration, through model development and training, to deployment on edge compute and real-time inference pipelines.

You take ownership of outcomes, not just models. You debug deeply, validate rigorously, and iterate quickly using field data to continuously improve system performance.

You’re motivated by building perception systems that enable safe, reliable autonomy in environments where failure is not acceptable.

As a Senior Perception Machine Learning Engineer, you will design, develop, and deploy the perception systems that allow AIM’s autonomous machines to understand and interact with their environment.

Design & Advance Perception Systems

Architect and develop perception algorithms for scene understanding, obstacle detection, terrain modeling, and machine awareness.

Advance AIM’s perception stack including sensor fusion, environment modeling, and machine-centric perception pipelines.

Develop algorithms that operate reliably in complex, dynamic earthmoving environments.

Build Production Machine Learning Systems

Develop and deploy machine learning models for perception tasks including object detection, segmentation, depth estimation, and terrain understanding.

Optimize models for real-time inference on edge compute platforms.

Build scalable data pipelines for training, evaluation, and model iteration.

Integrate Perception with the Autonomy Stack

Collaborate with robotics, controls, systems, and software teams to integrate perception outputs into planning and control systems.

Ensure perception systems interact correctly with localization, SLAM, mapping, and safety systems.

Design perception interfaces that are robust, testable, and observableResponsibilities

Advance AIM’s perception stack and sensor fusion algorithms

This involves breaking new ground as earth moving machines don’t merely navigate on existing mapped roads – they modify and build the environment as they work which poses interesting novel challenges

Research and development of state-of-the‑art machine learning methods

Comfortable with hands‑on applications on machines deployed in the field

Apply real‑world experience with localization and SLAM state‑of‑the‑art methods

Qualifications

Experience designing, training, and evaluating machine learning models

Strong understanding of the mathematics behind training (optimization, gradients, regularization, bias–variance tradeoff)

Familiarity with training dynamics (overfitting, underfitting, convergence issues, data imbalance)

Excellent grasp of machine perception methods in 2D and 3D (depth sensing)

Experience with perception sensor calibration techniques (camera, lidar, radar, etc.)

Experience working on real‑world computer vision problems (classification, detection, segmentation, tracking, etc.)

Understanding of image representations, augmentations, and data preprocessing strategies

Awareness of common architectures and when to use them (CNNs, transformers, hybrid approaches)

Ability to reason about evaluation metrics and tradeoffs (precision/recall, mAP, IoU, etc.)Proven track record of deployed ML‑based perception systems, ideally on autonomous vehicles

Overall Engineering Skillset

Experience shipping production models

Excellent software development skills in python

Proficiency in Tensorflow, PyTorch, Python, C++

Creativity and curiosity for solving complex problems

Joining AIM, You Will

Solve a massive set of real‑world problems that require scalable earth moving

Accomplish that via deploying and expanding cutting edge tech

Run your workstreams with the largest degree of autonomy

Have an opportunity for rapid growth and a large voice on the direction of the company

• Receive company funded medical, dental, vision, 401k, life insurance, gourmet food & perks
• Experience a strong onsite collaboration (AIM offices, labs and proving grounds on the east side of the Greater Seattle area)
• Have an opportunity to travel to unique sites around the world (Americas, Australia, Africa & more)