Senior VLM & VFM Field Engineer

Matroid; Palo Alto (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Gym membership reimbursement

Lunch provided

Medical, dental, vision coverage

Job summary

Matroid in Palo Alto is seeking a Senior Vision-Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to design, deploy, and optimize production‑grade multimodal AI solutions for enterprise customers.

You will own delivery from scoping to deployment, work across cloud, edge, and hybrid environments, and mentor teams while advancing our platform with real‑world feedback from deployments in manufacturing, automotive, and security sectors.

Qualifications

• Master's degree or higher in CS/CE/EE/ML.
• Strong experience with visual recognition tasks and adapting vision-language models.
• Excellent Python and software engineering practices.
• Experience with PyTorch, TensorFlow, JAX, Hugging Face, NumPy, OpenCV.
• Experience leading complex technical projects and customer-facing roles.

Responsibilities

• Build and deploy deep learning systems on Matroid using VLMs, vision-language models, and specialized models for detection, segmentation, tracking, and multimodal understanding.
• Own technical delivery from scoping through model selection, fine-tuning, and production deployment.
• Develop systems for cloud, edge, and hybrid environments with optimized latency and throughput.
• Establish evaluation datasets and benchmarks; improve model accuracy through data curation and augmentation.
• Connect Matroid to customer equipment (PLCs, SCADA, MES, video systems).
• Deliver technical workshops, training, and documentation to help customers adopt and operate AI systems.

Skills

Vision-language models

Deep learning

Python

PyTorch

TensorFlow

Model adaptation

System deployment

LLMs

Cloud/edge architectures

Communication

Education

Master's degree or higher in CS/CE/EE/ML

Tools

PyTorch

TensorFlow

JAX

Hugging Face

NumPy

OpenCV

Job description

About Matroid

Matroid helps enterprises build and operate computer vision systems through an end-to-end platform for training, evaluating, and deploying automated visual inspection. The platform supports a wide range of imagery, including EO, IR, X-Ray, CT, and OCT.

Founded in 2016 by a Stanford professor, Matroid works with customers across aerospace, automotive, manufacturing, logistics, data center infrastructure, and security.

We’re hiring a Senior Vision-Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to build and deploy production-grade deep learning systems using Matroid’s platform for a broad range of enterprise customers, such as Mercedes-Benz, Toyota, Boeing, Google, Amazon, Bosch, and many others.

You’ll work directly with customers to understand their operations and turn challenging requirements into reliable computer vision and multimodal AI solutions. As the technical owner of complex engagements, you’ll guide architecture, model adaptation, evaluation, integration, and deployment, combining Matroid’s platform with custom engineering.

Projects will cover defect inspection, anomaly detection, assembly verification, process and safety monitoring, and multimodal understanding, retrieval, and reasoning across images, videos, and operational data. Alongside delivery, you’ll use lessons from customer deployments to improve our platform and engineering practices.

This role is based at our downtown Palo Alto office, a five-minute walk from Caltrain and a nine-minute walk from Stanford University.

What you’ll be doing

• Build and deploy deep learning systems on Matroid using visual foundation models, vision-language models, and/or specialized vision-centric models for object detection, segmentation, tracking, anomaly detection, spatiotemporal reasoning, and multimodal understanding and retrieval.
• Own technical delivery from scoping and feasibility assessment through model selection, fine-tuning, prompt engineering, system architecture, and production deployment.
• Develop deep learning systems that can operate in cloud, edge, and hybrid environments, optimizing inference latency, GPU utilization, memory consumption, and throughput while balancing accuracy, cost, and maintainability.
• Establish representative evaluation datasets and task-specific benchmarks. Analyze failure modes and improve model accuracy and robustness through data curation, targeted augmentation, and DL system adaptation.
• Develop imaging and data collection systems, selecting cameras, optics, illumination, and capture configurations that support reliable visual recognition in demanding environments.
• Connect Matroid to customer equipment and software, including PLCs, manufacturing execution systems, SCADA, quality management platforms, safety alerting, and video management systems.
• Guide customers through technical decisions and troubleshoot complex issues across model behavior, inference pipelines, infrastructure, and integrations.
• Review architecture and code, and build reusable tools for model evaluation, inference, and deployment.
• Work with product and engineering colleagues to translate deployment insights into improvements in model capabilities, performance, and platform workflows.
• Deliver technical workshops, training, and documentation that help customers evaluate, adopt, and operate their AI systems successfully.

How you’ll be doing it

• Take ownership. Bring structure to ambiguous requirements, identify risks early, and drive projects through production readiness.
• Stay hands-on. Write code, adapt models, investigate data, and debug systems while providing technical direction.
• Choose models thoughtfully. Assess capabilities and limitations, and select the right combination of fine-tuning, prompting, specialized models, and orchestration for each application.
• Build deep platform expertise. Understand Matroid’s capabilities and apply its features, workflows, and integrations effectively.
• Understand customer operations. Account for production constraints and communicate clearly with engineers, operators, and business stakeholders.
• Raise the team’s technical standard. Share deployment lessons, offer practical feedback, and help other engineers develop their judgment.
• Work independently and collaboratively. Make progress with autonomy and bring in teammates when their expertise will improve the outcome.
• Keep learning. Evaluate advances in computer vision and multimodal AI and turn promising approaches into practical customer capabilities.

What you bring to the table

• A master’s degree or higher in computer science, computer engineering, electrical engineering, machine learning, artificial intelligence, robotics, or a closely related technical discipline.
• Strong experience with visual recognition tasks such as detection, segmentation, tracking, action recognition, and anomaly detection, plus hands-on work adapting and evaluating visual foundation models or vision-language models.
• Excellent Python skills and sound software engineering practices for building systems that connect models, APIs, databases, and customer infrastructure.
• Proficiency with relevant tools and frameworks, such as PyTorch, TensorFlow, JAX, Hugging Face, NumPy, and OpenCV.
• Experience developing rigorous evaluations and improving AI performance through better data, model adaptation, prompts, architecture, or workflow design.
• Demonstrated ability to make architecture decisions and resolve reliability, performance, and integration problems in deployed systems.
• Experience leading complex technical projects and collaborating across teams.
• Clear written, verbal, and presentation skills in English, including the ability to explain technical decisions and tradeoffs to both technical and business audiences.
• You have 3+ years of industry experience focused on computer vision, AI, robotics, machine learning, natural language processing, or a related discipline.
• You have experience in spatiotemporal reasoning, open-world recognition, 3D understanding or reconstruction, or agentic workflows.
• You have worked in forward-deployed engineering, field engineering, solutions engineering, or another customer-facing technical position.
• You have deployed AI in aerospace, automotive, manufacturing, logistics, security, or similarly demanding operational settings.
• You have experience at a growing technology startup.

What we offer in return

• Competitive compensation and equity.
• Challenging technical work with direct customer impact.
• Reimbursement for gym memberships.
• Daily lunch, drinks, and snacks.
• Fully paid premiums for medical, dental, and vision coverage.
• Scheduling flexibility to accommodate interests outside work.
• A budget for the hardware and software you need to succeed.
• Learning resources covering software engineering, computer vision, VLMs, LLMs, and multimodal AI.
• A downtown Palo Alto office close to Caltrain.

Matroid is an equal-opportunity employer committed to a diverse workplace. We consider qualified applicants without discrimination based on race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying disability, national origin, veteran status, or any other legally protected status.