Senior VLM & VFM Field Engineer

Matroid; Palo Alto (CA); Presencial; USD 180 000 - 240 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Equity

Direct impact

Gym reimbursement

Lunch & snacks

Med/Dental/Vision

Flexible schedule

Hardware budget

Learning resources

Palo Alto office

Resumo da oferta

Matroid is seeking a Senior Vision‑Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to design and deploy production‑grade deep learning systems using Matroid’s platform for a broad range of enterprise customers. You will work directly with customers to understand their operations and translate challenging requirements into reliable computer vision and multi‑modal AI solutions.

This role is based at our downtown Palo Alto office, near Caltrain and Stanford.

Qualificações

• Master’s degree or higher in computer science, computer engineering, electrical engineering, machine learning, artificial intelligence, robotics, or a closely related technical discipline.

Responsabilidades

• Build and deploy deep learning systems on Matroid using visual foundation models, vision–language models, and/or specialized vision-centric models for object detection, segmentation, tracking, anomaly detection, spatiotemporal reasoning, and multimodal understanding and retrieval.
• Own technical delivery from scoping and feasibility assessment through model selection, fine-tuning, prompt engineering, system architecture, and production deployment.
• Develop deep learning systems that can operate in cloud, edge, and hybrid environments, optimizing inference latency, GPU utilization, memory consumption, and throughput while balancing accuracy, cost, and maintainability.
• Establish representative evaluation datasets and task-specific benchmarks. Analyze failure modes and improve model accuracy and robustness through data curation, targeted augmentation, and DL system adaptation.
• Develop imaging and data collection systems, selecting cameras, optics, illumination, and capture configurations that support reliable visual recognition in demanding environments.
• Connect Matroid to customer equipment and software, including PLCs, manufacturing execution systems, SCADA, quality management platforms, safety alerting, and video management systems.
• Guide customers through technical decisions and troubleshoot complex issues across model behavior, inference pipelines, infrastructure, and integrations.
• Review architecture and code, and build reusable tools for model evaluation, inference, and deployment.
• Work with product and engineering colleagues to translate deployment insights into improvements in model capabilities, performance, and platform workflows.
• Deliver technical workshops, training, and documentation that help customers evaluate, adopt, and operate their AI systems successfully.

Conhecimentos

Python

Computer vision

Deep learning

PyTorch

TensorFlow

OpenCV

JAX

HuggingFace

NumPy

English communication

Formação académica

Master’s degree or higher in CS/CE/EE/ML/AI/Robotics or related field

Ferramentas

PyTorch

TensorFlow

JAX

Hugging Face

OpenCV

Descrição da oferta de emprego

About Matroid

Matroid helps enterprises build and operate computer vision systems through an end-to-end platform for training, evaluating, and deploying automated visual inspection. The platform supports a wide range of imagery, including EO, IR, X-Ray, CT, and OCT.

Founded in 2016 by a Stanford professor, Matroid works with customers across aerospace, automotive, manufacturing, logistics, data center infrastructure, and security.

We’re hiring a Senior Vision‑Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to build and deploy production‑grade deep learning systems using Matroid’s platform for a broad range of enterprise customers, such as Mercedes‑Benz, Toyota, Boeing, Google, Amazon, Bosch, and many others.

You’ll work directly with customers to understand their operations and turn challenging requirements into reliable computer vision and multimodal AI solutions. As the technical owner of complex engagements, you’ll guide architecture, model adaptation, evaluation, integration, and deployment, combining Matroid’s platform with custom engineering.

Projects will cover defect inspection, anomaly detection, assembly verification, process and safety monitoring, and multimodal understanding, retrieval, and reasoning across images, videos, and operational data. Alongside delivery, you’ll use lessons from customer deployments to improve our platform and engineering practices.

This role is based at our downtown Palo Alto office, a five-minute walk from Caltrain and a nine-minute walk from Stanford University.

What you’ll be doing

• Build and deploy deep learning systems on Matroid using visual foundation models, vision‑language models, and/or specialized vision‑centric models for object detection, segmentation, tracking, anomaly detection, spatiotemporal reasoning, and multimodal understanding and retrieval.


• Own technical delivery from scoping and feasibility assessment through model selection, fine‑tuning, prompt engineering, system architecture, and production deployment.


• Develop deep learning systems that can operate in cloud, edge, and hybrid environments, optimizing inference latency, GPU utilization, memory consumption, and throughput while balancing accuracy, cost, and maintainability.


• Establish representative evaluation datasets and task‑specific benchmarks. Analyze failure modes and improve model accuracy and robustness through data curation, targeted augmentation, and DL system adaptation.


• Develop imaging and data collection systems, selecting cameras, optics, illumination, and capture configurations that support reliable visual recognition in demanding environments.


• Connect Matroid to customer equipment and software, including PLCs, manufacturing execution systems, SCADA, quality management platforms, safety alerting, and video management systems.


• Guide customers through technical decisions and troubleshoot complex issues across model behavior, inference pipelines, infrastructure, and integrations.


• Review architecture and code, and build reusable tools for model evaluation, inference, and deployment.


• Work with product and engineering colleagues to translate deployment insights into improvements in model capabilities, performance, and platform workflows.


• Deliver technical workshops, training, and documentation that help customers evaluate, adopt, and operate their AI systems successfully.

How you’ll be doing it

• Take ownership. Bring structure to ambiguous requirements, identify risks early, and drive projects through production readiness.


• Stay hands‑on. Write code, adapt models, investigate data, and debug systems while providing technical direction.


• Choose models thoughtfully. Assess capabilities and limitations, and select the right combination of fine‑tuning, prompting, specialized models, and orchestration for each application.


• Build deep platform expertise. Understand Matroid’s capabilities and apply its features, workflows, and integrations effectively.


• Understand customer operations. Account for production constraints and communicate clearly with engineers, operators, and business stakeholders.


• Raise the team’s technical standard. Share deployment lessons, offer practical feedback, and help other engineers develop their judgment.


• Work independently and collaboratively. Make progress with autonomy and bring in teammates when their expertise will improve the outcome.


• Keep learning. Evaluate advances in computer vision and multimodal AI and turn promising approaches into practical customer capabilities.

What you bring to the table

• A master’s degree or higher in computer science, computer engineering, electrical engineering, machine learning, artificial intelligence, robotics, or a closely related technical discipline.


• Strong experience with visual recognition tasks such as detection, segmentation, tracking, action recognition, and anomaly detection, plus hands‑on work adapting and evaluating visual foundation models or vision‑language models.


• Excellent Python skills and sound software engineering practices for building systems that connect models, APIs, databases, and customer infrastructure.


• Proficiency with relevant tools and frameworks, such as PyTorch, TensorFlow, JAX, Hugging Face, NumPy, and OpenCV.


• Experience developing rigorous evaluations and improving AI performance through better data, model adaptation, prompts, architecture, or workflow design.


• Demonstrated ability to make architecture decisions and resolve reliability, performance, and integration problems in deployed systems.


• Experience leading complex technical projects and collaborating across teams.


• Clear written, verbal, and presentation skills in English, including the ability to explain technical decisions and tradeoffs to both technical and business audiences.


• You have 3+ years of industry experience focused on computer vision, AI, robotics, machine learning, natural language processing, or a related discipline.


• You have experience in spatiotemporal reasoning, open‑world recognition, 3D understanding or reconstruction, or agentic workflows.


• You have worked in forward‑deployed engineering, field engineering, solutions engineering, or another customer‑facing technical position.


• You have deployed AI in aerospace, automotive, manufacturing, logistics, security, or similarly demanding operational settings.


• You have experience at a growing technology startup.

What we offer in return

• Competitive compensation and equity.


• Challenging technical work with direct customer impact.


• Reimbursement for gym memberships.


• Daily lunch, drinks, and snacks.


• Fully paid premiums for medical, dental, and vision coverage.


• Scheduling flexibility to accommodate interests outside work.


• A budget for the hardware and software you need to succeed.


• Learning resources covering software engineering, computer vision, VLMs, LLMs, and multimodal AI.


• A downtown Palo Alto office close to Caltrain.

Matroid is an equal‑opportunity employer committed to a diverse workplace. We consider qualified applicants without discrimination based on race, religion, color, sex, gender identity, sexual orientation, age, non‑disqualifying disability, national origin, veteran status, or any other legally protected status.