Perception Engineer - Multimodal & Embodied AI

Shield AI

San Diego (CA)

On-site

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Bonus
Equity
Benefits

Job summary

Shield AI is seeking an engineer to translate advances in multimodal perception into autonomous aircraft and vehicles. You will work with researchers to evaluate models, build prototypes, and drive deployment of perception capabilities on edge hardware.

You will combine learned methods with classical vision techniques, tackling sensor fusion, tracking, and real-time inference. Strong Python and C++ skills, plus production-minded software experience, are essential.

Qualifications

  • PhD or equivalent research and hands-on engineering in CV/ML/robotics.
  • Strong Python and ML framework experience (PyTorch).
  • Experience building substantial research software and transitioning to production.

Responsibilities

  • Evaluate emerging models against sensor data and autonomy needs.
  • Build prototypes and experiments to reveal strengths, limitations, and deployment opportunities.
  • Combine learned and classical approaches for perception, sensing, and sensor fusion.
  • Optimize and integrate capabilities for edge deployment with Python/C++.

Skills

Python
C++
PyTorch
Research in CV/ML
Experimentation

Education

PhD in computer vision / ML / robotics

Tools

ONNX
TensorRT
CUDA

Job description

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai https://shield.ai/. Follow Shield AI on LinkedIn https://www.linkedin.com/company/shield-ai, X https://x.com/shieldaitech, Instagram https://www.instagram.com/shield_ai, and YouTube https://www.youtube.com/@Shield_AI.

JOB DESCRIPTION: Bring promising AI research into autonomous systems that operate in the real world. Shield AI’s Perception team is looking for an engineer who enjoys exploring new ideas and making them work on real hardware. You'll help turn advances in multimodal computer vision, visual foundation models, and embodied AI into useful capabilities for autonomous aircraft and vehicles. Working alongside researchers and autonomy engineers, you'll evaluate promising approaches, build prototypes, and carry successful ideas into the Hivemind product. You'll combine learned methods with established perception techniques, working through the sensor, software, and compute challenges that make edge robotics different from a benchmark.

What you'll do:
  • Evaluate emerging models and methods against representative sensor data and autonomy needs.
  • Build prototypes and experiments that reveal strengths, limitations, and practical deployment opportunities.
  • Combine learned and classical approaches to improve detection, tracking, geometric vision, or sensor fusion.
  • Optimize and integrate capabilities for edge deployment, contributing Python and C++ software with support from experienced product engineers.
  • Help deliver tested, documented capabilities and stay involved as other teams adopt them.
Required qualifications:
  • A PhD in computer vision, machine learning (ML/DL), robotics, or a related field, or an equivalent record of advanced research and hands-on engineering.
  • Research depth in an area such as multimodal vision, visual foundation models, video understanding, open-vocabulary perception, or embodied learning.
  • Strong Python skills and experience with PyTorch or a comparable ML framework.
  • A thoughtful approach to experiments, evaluation data, and understanding why models fail.
  • Experience building substantial research software, an interest in developing production-quality C++, and a collaborative approach to solving problems.
Preferred qualifications:
  • Experience bringing a research prototype into sustained use.
  • Experience with robotics, real sensors, temporal data, or multi-sensor perception.
  • Familiarity with vision-language models, vision-language-action models, or embodied AI.
  • Experience with C++, edge inference, or model optimization using tools such as ONNX, TensorRT, or CUDA.

You don't need to meet every preferred qualification or arrive as an expert C++ engineer. We welcome recent PhD graduates and early-career researchers, and we value technical depth, curiosity, and enthusiasm to transfer research to business value more than publication count alone. #LI-KC3 #LD

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Perception Engineer - Multimodal & Embodied AI (R6022)
Perception Engineer - Multimodal & Embodied AI (R6022)

SHIELD • San Diego (CA)

On-site
USD 140,000 - 190,000
Equity
Bonus
Benefits
Autonomy & Perception Software Engineer (R5911)
Autonomy & Perception Software Engineer (R5911)

Shield • San Diego (CA)

Hybrid
USD 140,000 - 210,000
Senior Software Engineer, Perception (R5420)
Senior Software Engineer, Perception (R5420)

Shield • Washington

On-site
USD 140,000 - 180,000
Bonus
Benefits
Equity
Senior Software Engineer, Perception (R5420)
Senior Software Engineer, Perception (R5420)

F7d8749a • Washington

On-site
USD 150,000 - 210,000
Bonus
Equity
Benefits
Senior Software Engineer, Perception (R5420)
Senior Software Engineer, Perception (R5420)

Shield AI • Arlington (VA)

On-site
USD 140,000 - 210,000
Bonus
Equity
Benefits
Autonomy & Perception Software Engineer (R5911)
Autonomy & Perception Software Engineer (R5911)

F7d8749a • San Diego (CA)

Hybrid
USD 120,000 - 180,000
Equity
Bonus
Benefits
+1
Staff Software Engineer, Perception (R5421)
Staff Software Engineer, Perception (R5421)

Shield AI • Arlington (VA)

On-site
USD 170,000 - 250,000
Bonus
Benefits
Equity
Senior Software Engineer, Perception
Senior Software Engineer, Perception

Shield AI • Washington

On-site
USD 150,000 - 210,000
Bonus
Benefits
Equity
Senior Staff Software Engineer, Perception (R4985)
Senior Staff Software Engineer, Perception (R4985)

F7d8749a • Washington

On-site
USD 180,000 - 240,000
Bonus
Benefits
Equity
Senior Staff Software Engineer, Perception (R4985)
Senior Staff Software Engineer, Perception (R4985)

Shield AI • Arlington (VA)

On-site
USD 180,000 - 240,000
Bonus
Benefits
Equity