ML Ops Engineer - Edge AI & Model Deployment

Torc Robotics; United States; On-site; USD 139,000 - 167,000; Full time

Benefits offered by this job

Bonus and stock options

100% medical, dental, and vision for F

Job summary

Torc Robotics seeks a Software Engineer for the ML Ops Framework & Conversion team. You will own pipelines that move models from research to production on edge hardware, including model conversion, benchmarking, and release processes for autonomous trucking applications.

You will work with perception and safety teams, ensuring latency and accuracy requirements are met while collaborating across the organization to deliver reliable software at scale.

Qualifications

• Bachelor's Degree in Computer Science, Electrical Engineering, Robotics, or related field plus 4+ years of relevant experience; or Master's Degree plus 2+ years.
• Extensive experience with model conversion and compilation pipelines (ONNX, TensorRT, torch.compile) and performing rigorous latency benchmarking and quality parity validation.
• Hands-on experience deploying and testing models on edge hardware (e.g., NVIDIA Orin or similar embedded platforms).
• Experience maintaining a model release registry in a production environment.

Responsibilities

• Architect and implement model conversion and compilation pipelines using tools such as ONNX, TensorRT, and torch.compile for deployment on edge devices (e.g., NVIDIA Orin).
• Maintain and evolve the model release registry, ensuring traceability and reproducibility across model versions and target platforms.
• Perform rigorous latency benchmarking and model quality parity evaluations to validate that deployed models meet safety-critical performance requirements.
• Compare metrics across platforms to verify accuracy and latency compliance before release.
• Communicate and collaborate with model development teams and broader stakeholders, ensuring your findings translate into reliable, actionable outcomes across the organization.

Skills

Model conversion pipelines

Latency benchmarking

Edge hardware deployment

Model release registry management

Cross-team collaboration

Education

Bachelor's degree in CS/EE/Robotics or related

Master's degree

Tools

ONNX

TensorRT

torch.compile

NVIDIA Orin

Job description

Torc Robotics seeks a Software Engineer for the ML Ops Framework & Conversion team. You will own pipelines that move models from research to production on edge hardware, including model conversion, benchmarking, and release processes for autonomous trucking applications.

You will work with perception and safety teams, ensuring latency and accuracy requirements are met while collaborating across the organization to deliver reliable software at scale.