Sr. Embedded Machine Learning Engineer

Allen Control Systems; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

ACS Equity Package

Health, Dental, Vision Insurance

Paid Time Off

Job summary

Allen Control Systems is seeking a Senior Embedded Machine Learning Engineer to bring trained ML models to edge devices, balancing latency, memory, and power budgets while integrating C++ code for on-device inference. You will collaborate with CVML, firmware, and product teams to ensure fast, small, and reliable performance in the field, influencing the hardware and software stack.

This role requires deep expertise in ML for embedded hardware, real-time constraints, and hands-on tuning for edge

Qualifications

• Bachelor's or Master's in CS/EE or related field or equivalent practical experience.
• 10+ years of software or systems engineering, including 2+ years deploying ML to embedded/edge devices.
• Very strong proficiency in C/C++ (Python is optional).
• Proficiency with CUDA and PyTorch; experience with edge runtimes (TensorRT, ONNX Runtime).
• Practical experience with model optimization techniques (quantization, pruning, distillation).
• Ability to profile and optimize for latency, memory, and power on constrained hardware.

Responsibilities

• Optimize models using quantization, pruning, knowledge distillation, and graph optimization.
• Convert trained models into edge-runtime formats and deploy to target hardware.
• Profile inference latency, memory footprint, and power on accelerators; drive optimizations to meet targets.
• Design, write, and maintain C++ code for on-device inference, preprocessing, and memory management.
• Build test harnesses to verify on-device accuracy and catch regressions after optimization.

Skills

C/C++ proficiency

Python (optional)

Edge ML deployment

Model optimization

Linux/RTOS familiarity

Computer vision domain experience

Education

Bachelor's or Master's in CS/EE or related, or equivalent

Tools

CUDA

PyTorch

ONNX Runtime

TensorRT

Edge runtimes

Job description

Senior Embedded Machine Learning Engineer for Autonomous Anti-Drone Systems

Company Overview

Allen Control Systems (ACS) is a cutting-edge defense startup founded by two former Navy electrical engineers with a proven track record in robotics and software. We are developing an autonomous gun turret using advanced computer vision and control systems to precisely detect, track, and neutralize enemy drones.

With an engineering-first culture, ACS values technical excellence and innovation. Backed by our founders' successful exits from two previous venture acquired for a combined $180M in 2022, we are committed to ensuring that the groundbreaking technologies we develop will have a real-world impact.

Position Summary

We are hiring a Senior Embedded Machine Learning Engineer to own the end-to-end process of taking trained machine learning models including any code supporting them and deploying them efficiently onto resource-constrained edge hardware. This person sits at the intersection of machine learning, embedded systems, and hardware engineering.

The role has two tightly linked primary responsibilities: integrating, converting, and optimizing models so they run within strict constraints on latency, memory, power, and thermal budget; and building and integrating the supporting C++ code that runs the models on device and performs any necessary pre or post processing. The role is highly cross-functional. You will partner with CVML who build the models, with embedded and firmware teams who own the device, and with product teams who define performance targets. Success means models that are not just accurate in the lab but fast, small, and dependable in the field.

What You’ll Do

• Model optimization. Apply quantization, pruning, knowledge distillation, operator fusion, and graph optimization to shrink models and reduce inference cost while protecting accuracy.
• Model conversion and deployment. Convert trained models into formats suitable for edge runtimes using ONNX and TensorRT and deploy them to target hardware.
• Hardware bring-up and benchmarking. Profile inference on accelerators such as GPUs, NPUs, DSPs, TPUs, or FPGAs. Measure latency, throughput, memory footprint, and power, then drive the changes needed to hit targets.
• C++ application integration. Design, write, and maintain the supporting C++ code that hosts inference on device. This includes the application and library code that loads and runs models, the pre- and post-processing pipelines, data and memory management, threading, and the interfaces to the rest of the embedded system. Ensure the combined model and C++ stack meets real-time constraints, fits within the device memory budget, and behaves reliably on the target platform, using Python where appropriate for tooling and validation.
• Accuracy and quality validation. Build test harnesses that verify on-device accuracy against reference results and catch regressions introduced by optimization or quantization.
• Model update pipeline. Contribute to the tooling and processes for packaging, versioning, and delivering model updates to deployed devices, including over-the-air update paths where applicable.
• Cross-functional collaboration. Work closely with research, firmware, and product teams to set realistic performance targets early and to feed hardware constraints back into model design.
• Technical leadership. Set best practices for edge deployment, review designs and code, and mentor other engineers on optimization and embedded ML techniques.

What You’ll Do

• Development and optimization of computer vision algorithms for our autonomous gun turret, focusing on real-time drone detection, tracking, and classification.
• Design and implement machine learning models that can operate in resource-constrained environments while maintaining high accuracy and reliability.
• Collaborate closely with electrical engineers to integrate computer vision systems into the turret's hardware architecture.
• Conduct extensive testing and validation of computer vision algorithms in various scenarios to ensure robustness and performance under different environmental conditions.
• Contribute to the hardening of the prototype turret into a military-grade system, and assist in developing variants for different weapon systems and engagement ranges.

What You’ll Need

• A Bachelor's or Master's Degree in Computer Science, Electrical Engineering, Computer Engineering or a related field, or equivalent practical experience.
• 10+ or more years of professional software or systems engineering experience, including at least 2 years focused on deploying ML models to embedded or edge devices.
• Very strong proficiency in C/C++ (or Python but C++ most important)
• Proficiency with CUDA
• Hands-on experience with PyTorch and with at least one edge runtime or inference format (TensorFlow Lite, ONNX Runtime, TensorRT, or similar).
• Practical experience with model optimization techniques such as quantization (post-training and quantization-aware), pruning, or distillation.
• Demonstrated ability to profile and optimize for latency, memory, and power on constrained hardware.
• Working knowledge of embedded or edge platforms (for example NVIDIA Jetson, Google Coral, Qualcomm, ARM Cortex, or comparable NPUs and SoCs) and of Linux or an RTOS.
• Solid grasp of computer architecture concepts relevant to inference, including memory hierarchy, fixed-point arithmetic, and accelerator offload.
• Domain experience in computer vision or sensor processing on device

What We Offer

• Competitive salary
• ACS Equity Package
• Health, Dental, Vision Insurance
• Paid Time Off

Allen Control Systems is an Equal Opportunity Employer, providing equal employment opportunities to all employees and applicants for employment. Allen Control Systems prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.