Senior VLM & VFM Field Engineer

Matroid Inc.; Palo Alto (CA); Sur place; USD 190 000 - 230 000; Plein temps

Avantages offerts par ce poste

Gym membership reimbursement

Lunch provided (daily)

Medical, dental, vision insurance

Downtown Palo Alto office

Résumé du poste

Matroid Inc. is seeking a Senior Vision-Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to build and deploy production-grade multimodal AI systems for enterprise customers.

You will own technical delivery from scoping to deployment and work with customers to translate requirements into robust computer vision solutions. You will guide model adaptation, evaluation, and integration, balancing performance, latency, and cost while collaborating with product and engineering.

Qualifications

• Master's degree or higher in a relevant technical field.
• Extensive experience with visual recognition and multimodal AI.
• Strong Python skills and software engineering practices.

Responsabilités

• Build and deploy production-grade deep learning systems using Matroid's platform.
• Own technical delivery from scoping and feasibility through model selection, fine-tuning, and deployment.
• Develop DL systems for cloud, edge, and hybrid environments optimizing latency, memory, and throughput.
• Establish evaluation datasets and benchmarks; improve model accuracy and robustness through data curation and augmentation.
• Deliver technical workshops, training, and documentation to help customers evaluate and operate AI systems.

Connaissances

Visual recognition

Python

ML frameworks

Model evaluation

Architecture decisions

Project leadership

English communication

Formation

Master's degree or higher in CS/EE/ML

Outils

PyTorch

TensorFlow

JAX

Hugging Face

OpenCV

NumPy

Description du poste

Senior Vision-Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer

About Matroid

Matroid helps enterprises build and operate computer vision systems through an end-to-end platform for training, evaluating, and deploying automated visual inspection. The platform supports a wide range of imagery, including EO, IR, X-Ray, CT, and OCT.

Founded in 2016 by a Stanford professor, Matroid works with customers across aerospace, automotive, manufacturing, logistics, data center infrastructure, and security.

We're hiring a Senior Vision-Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to build and deploy production-grade deep learning systems using Matroid's platform for a broad range of enterprise customers, such as Mercedes-Benz, Toyota, Boeing, Google, Amazon, Bosch, and many others.

You'll work directly with customers to understand their operations and turn challenging requirements into reliable computer vision and multimodal AI solutions. As the technical owner of complex engagements, you'll guide architecture, model adaptation, evaluation, integration, and deployment, combining Matroid's platform with custom engineering.

Projects will cover defect inspection, anomaly detection, assembly verification, process and safety monitoring, and multimodal understanding, retrieval, and reasoning across images, videos, and operational data. Alongside delivery, you'll use lessons from customer deployments to improve our platform and engineering practices.

This role is based at our downtown Palo Alto office, a five-minute walk from Caltrain and a nine-minute walk from Stanford University.

What you'll be doing

• Build and deploy deep learning systems on Matroid using visual foundation models, vision-language models, and/or specialized vision-centric models for object detection, segmentation, tracking, anomaly detection, spatiotemporal reasoning, and multimodal understanding and retrieval.
• Own technical delivery from scoping and feasibility assessment through model selection, fine-tuning, prompt engineering, system architecture, and production deployment.
• Develop deep learning systems that can operate in cloud, edge, and hybrid environments, optimizing inference latency, GPU utilization, memory consumption, and throughput while balancing accuracy, cost, and maintainability.
• Establish representative evaluation datasets and task-specific benchmarks. Analyze failure modes and improve model accuracy and robustness through data curation, targeted augmentation, and DL system adaptation.
• Develop imaging and data collection systems, selecting cameras, optics, illumination, and capture configurations that support reliable visual recognition in demanding environments.
• Connect Matroid to customer equipment and software, including PLCs, manufacturing execution systems, SCADA, quality management platforms, safety alerting, and video management systems.
• Guide customers through technical decisions and troubleshoot complex issues across model behavior, inference pipelines, infrastructure, and integrations.
• Review architecture and code, and build reusable tools for model evaluation, inference, and deployment.
• Work with product and engineering colleagues to translate deployment insights into improvements in model capabilities, performance, and platform workflows.
• Deliver technical workshops, training, and documentation that help customers evaluate, adopt, and operate their AI systems successfully.

How you'll be doing it

• Take ownership. Bring structure to ambiguous requirements, identify risks early, and drive projects through production readiness.
• Stay hands-on. Write code, adapt models, investigate data, and debug systems while providing technical direction.
• Choose models thoughtfully. Assess capabilities and limitations, and select the right combination of fine-tuning, prompting, specialized models, and orchestration for each application.
• Build deep platform expertise. Understand Matroid's capabilities and apply its features, workflows, and integrations effectively.
• Understand customer operations. Account for production constraints and communicate clearly with engineers, operators, and business stakeholders.
• Raise the team’s technical standard. Share deployment lessons, offer practical feedback, and help other engineers develop their judgment.
• Work independently and collaboratively. Make progress with autonomy and bring in teammates when their expertise will improve the outcome.
• Keep learning. Evaluate advances in computer vision and multimodal AI and turn promising approaches into practical customer capabilities.

What you bring to the table

• A master's degree or higher in computer science, computer engineering, electrical engineering, machine learning, artificial intelligence, robotics, or a closely related technical discipline.
• Strong experience with visual recognition tasks such as detection, segmentation, tracking, action recognition, and anomaly detection, plus hands-on work adapting and evaluating visual foundation models or vision-language models.
• Excellent Python skills and sound software engineering practices for building systems that connect models, APIs, databases, and customer infrastructure.
• Proficiency with relevant tools and frameworks, such as PyTorch, TensorFlow, JAX, Hugging Face, NumPy, and OpenCV.
• Experience developing rigorous evaluations and improving AI performance through better data, model adaptation, prompts, architecture, or workflow design.
• Demonstrated ability to make architecture decisions and resolve reliability, performance, and integration problems in deployed systems.
• Experience leading complex technical projects and collaborating across teams.
• Clear written, verbal, and presentation skills in English, including the ability to explain technical decisions and tradeoffs to both technical and business audiences.

Bonus points if...

• You have 3+ years of industry experience focused on computer vision, AI, robotics, machine learning, natural language processing, or a related discipline.
• You have experience in spatiotemporal reasoning, open-world recognition, 3D understanding or reconstruction, or agentic workflows.
• You have worked in forward-deployed engineering, field engineering, solutions engineering, or another customer-facing technical position.
• You have deployed AI in aerospace, automotive, manufacturing, logistics, security, or similarly demanding operational settings.
• You have experience at a growing technology startup.

What we offer in return

• Competitive compensation and equity.
• Challenging technical work with direct customer impact.
• Reimbursement for gym memberships.
• Daily lunch, drinks, and snacks.
• Fully paid premiums for medical, dental, and vision coverage.
• Scheduling flexibility to accommodate interests outside work.
• A budget for the hardware and software you need to succeed.
• Learning resources covering software engineering, computer vision, VLMs, LLMs, and multimodal AI.
• A downtown Palo Alto office close to Caltrain.

Matroid is an equal-opportunity employer committed to a diverse workplace. We consider qualified applicants without discrimination based on race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying disability, national origin, veteran status, or any other legally protected status.