Embedded Perception Engineer

HavocAI; Town of Providence (NY); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Dental and Vision

401(k) with match

Unlimited PTO

Stipends for home office

Equity

Parental leave

Job summary

HavocAI is seeking an Embedded Perception Engineer to own how our autonomous systems perceive the world in real time aboard maritime platforms. You will architect, deploy, and optimize perception pipelines on embedded edge hardware, enabling robust situational awareness across cameras, radar, and lidar.

This role collaborates with hardware and autonomy teams to deliver mission-ready solutions. Ideal candidates have 3+ years building computer vision systems in C++/Python on Linux, experience with

Qualifications

• Bachelor’s or higher in Computer Science, Electrical Engineering, Robotics, Machine Learning, or related field.
• 3+ years developing and deploying computer vision or perception systems in C++ and/or Python on Linux.
• Experience with modern deep learning frameworks (PyTorch, TensorFlow).
• Hands-on experience with large vision models (ViT, CLIP, SAM, etc.).
• Experience implementing sensor fusion across heterogeneous modalities.
• Proficiency with NVIDIA Triton, TensorRT, ONNX Runtime, or equivalent inference tooling.
• Ability to quickly navigate and understand complex codebases.
• Strong systems-thinking mindset.
• U.S. Citizenship and eligibility for U.S. security clearance.

Responsibilities

• Perception System Ownership: End-to-end perception pipelines deployed to operational systems and reliable solutions aligned with mission requirements.
• Vision Model Development: Design, train, and optimize perception models for maritime environments and object detection, classification, and tracking.
• Sensor Fusion & Integration: Fuse multi-modal sensor data and collaborate with hardware teams to integrate sensors.
• Embedded Deployment & Optimization: Deploy models using NVIDIA Triton and optimize for latency and throughput on edge hardware.
• Cross-Team Collaboration: Integrate perception outputs into autonomy stacks with mission software and platform teams.
• Field Performance & Monitoring: Define metrics and evaluation frameworks to monitor deployed system health and resolve perception failures.
• End-User Engagement: Partner with operators to translate field challenges into engineering solutions.

Skills

C++

Python

Large vision models

Sensor fusion

NVIDIA Triton

TensorRT

ONNX Runtime

ROS2

MOOS-IvP

Edge inference

Security clearance

Education

Bachelor’s degree or higher in CS/EE/Robotics/ML

Tools

PyTorch

TensorFlow

Job description

About Us:

Collaborative autonomy is how self-tasking teams of machines will solve hard human problems, and HavocAI is an unquestioned leader in collaborative autonomy. We set the standard for autonomous surface vessels for a wide range of defense and commercial maritime missions. Success requires us to grow quickly, and we’re looking for teammates who are passionate about solving hard problems, about pushing the envelope, and about preventing conflict and saving lives. Ambition is welcome to apply within.

About the Role:

As an Embedded Perception Engineer, you will own how our autonomous systems perceive and understand the world — in real time, in operational environments, and under demanding maritime conditions.

This role goes beyond model training. You will architect, deploy, and optimize perception pipelines that run reliably on embedded edge hardware. You’ll work across vision models, sensor fusion, and high-performance inference to deliver robust situational awareness to autonomous surface vessels executing real-world missions.

If you thrive in dynamic environments, enjoy squeezing maximum performance from embedded AI systems, and want to see your work field-tested and mission-proven, this role offers immediate and meaningful impact.

Key Responsibilities and Requirements:

Perception System Ownership

• Own end-to-end perception pipelines deployed to operational systems

• Deliver high-reliability solutions aligned with mission requirements

Vision Model Development

• Design, train, and optimize perception models for maritime environments

• Develop object detection, classification, and tracking systems

• Work with large vision models (ViT, CLIP, SAM, or similar)

Sensor Fusion & Integration

• Fuse multi-modal sensor data (camera, radar, lidar) into unified perception outputs

• Collaborate with hardware teams to select and integrate sensors

• Develop and validate low-level sensor drivers for high-integrity data pipelines

Embedded Deployment & Optimization

• Deploy models using NVIDIA Triton Inference Server

• Optimize inference for latency and throughput on edge hardware

• Apply quantization, pruning, and other optimization techniques

Cross-Team Collaboration

• Integrate perception outputs into autonomy stacks alongside mission software and platform teams

• Support troubleshooting of perception performance in operational environments

Field Performance & Monitoring

• Define metrics and evaluation frameworks to monitor deployed system health

• Investigate perception failures and drive resolution across teams

End-User Engagement

• Partner with operators and customers to translate field challenges into engineering solutions

Qualifications:

• Bachelor’s or higher in Computer Science, Electrical Engineering, Robotics, Machine Learning, or related field

• 3+ years developing and deploying computer vision or perception systems in C++ and/or Python on Linux

• Experience with modern deep learning frameworks (PyTorch, TensorFlow)

• Hands-on experience with large vision models (ViT, CLIP, SAM, etc.)

• Experience implementing sensor fusion across heterogeneous modalities

• Proficiency with NVIDIA Triton, TensorRT, ONNX Runtime, or equivalent inference tooling

• Ability to quickly navigate and understand complex codebases

• Strong systems-thinking mindset

• U.S. Citizenship and eligibility for U.S. security clearance

Preferred Skills:

• Experience deploying perception systems on embedded platforms (Jetson, FPGA, similar)

• Familiarity with maritime or aerial sensor environments

• Experience optimizing models for edge inference

• Knowledge of autonomy frameworks (ROS2, MOOS-IvP)

• Experience with safety-critical or real-time systems

• Familiarity with military systems and defense acquisition processes

Why This Role Matters

You won’t just build models — you will build perception systems that operate in real-world, contested environments. Your work will directly influence the reliability, safety, and mission success of autonomous platforms deployed at sea.

Benefits:

• 100% Employer paid Health, Dental and Vision Insurance for you and your families

• Life Insurance (Employer Paid)

• Ability to participate in the companies 401k program (Matching)

• Unlimited PTO policy with an enforced 2 week minimum

• Equity Package

• Work / Home Office Stipend

• Global Entry

• 16 Week Paid Parental Leave

• Monthly Health and Wellness Stipend

Our Values:

• Innovation: We are driven to break new ground. Every day presents an opportunity to challenge the status quo, think boldly, and deliver advanced solutions that transform the future of defense technology.

• Integrity: We hold ourselves to the highest ethical standards, ensuring transparency, accountability, and trust in all our actions and partnerships.

• Mission-Driven: We are focused on achieving impactful outcomes that align with our core mission—protecting lives through innovation.

• Forward-Leaning: We continuously seek out new opportunities and remain at the forefront of technological advancements. We embrace change and anticipate the challenges of tomorrow with confidence and creativity.

• Ownership of All Tasks: At HavocAI, no problem is too complex or too trivial. We believe that greatness comes from tackling the hardest challenges, but also in handling the smallest, sometimes thankless, tasks with the same level of commitment and care.

• Servant Leadership: We lead by serving others, whether it’s supporting our employees, partners, or the broader community. Empowering those around us is key to achieving long-term success and making a lasting impact.

HavocAI is an Equal Opportunity Employer and is committed to creating an inclusive and diverse workplace. We welcome applicants from all backgrounds and do not discriminate based on race, color, religion, gender, sexual orientation, age, national origin, disability, veteran status, or any other legally protected status.