Research Engineer, Foundation Model (Multimodal Fusion & Distillation)

Laelaps

Zürich

On-site

CHF 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive equity
Zurich on-site office

Job summary

Laelaps AI is seeking a research engineer to build and deploy the LEA foundation model that fuses RGB, IR, thermal, lidar, and sensor states into a unified stream. You will work on encoders, fusion, and fast/slow heads, ensuring robust performance on real security sites and on-site appliances.

You will collaborate with a small, technically strong team to train, evaluate, and ship models, balancing open models with production-grade deployment in challenging environments.

Qualifications

  • 4+ years training and fine-tuning large vision or multimodal models.
  • Strong PyTorch and multi-GPU / multi-node training.
  • Hands-on fine-tuning of vision-language models.
  • Experience with knowledge distillation or model compression.
  • Experience with thermal, infrared, lidar, or radar sensors.
  • Solid software engineering hygiene and evaluation discipline.

Responsibilities

  • Develop encoders for sensors and fuse multi-sensor data.
  • Build a fusion layer aligning sensors in time and space.
  • Fine-tune open vision-language models.
  • Distil small models from the slow head.
  • Design and run training on on-site appliances and robots.
  • Evaluate on held-out sites, night and thermal data.

Skills

PyTorch expertise
Multi-GPU training
Fine-tuning multimodal models
Knowledge distillation
Sensor data experience
Software hygiene

Education

PhD or equivalent industry experience
4+ years ML experience

Tools

TensorRT

Job description

Our Mission

At Laelaps AI, we believe robotics is entering a transformative decade, much like the arrival of the internet. Advances in AI, cloud computing, and hardware are reshaping what autonomous systems can do. Our mission is to build the intelligent software that powers physical security in the real world - enabling robots and sensors to handle dangerous and critical tasks that humans shouldn't have to. By engineering the orchestration layer for intelligent security, we aim to create a world that is safer, more secure, and more resilient.

We're a strong founding team based in Zurich, backed by visionary investors and advisors. We are engineering the future of security today!

The Role

You will build the parts of LEA, our foundation model of the physical world, where field data is the input. LEA takes in cameras, infrared, thermal, lidar and robot state natively, around the clock, on real security sites. We stand on the best open models for the encoders and the reasoning head and do not pretrain from scratch. Your work goes where nobody else can do it: fusing every sensor into one stream, teaching an open vision-language model to reason over that stream, and distilling a fast model that sees every frame.

This is the first engineer dedicated to the model track, so you will also set how we train, evaluate and ship models. You will work with our Command Centre and Robot Autonomy teams to get what you train running on site appliances and robots, and you will see it tested at 03:00 in the rain.

What You'll Work On
  • Native encoders: adapt the best open vision and point-cloud foundation models to RGB, IR, thermal and lidar, one encoder per sensor, raw stream in.

  • Fusion: build the layer that aligns every sensor in time and space into one token stream, trained on time-aligned multi-sensor field data that exists nowhere else.

  • Slow head: fine-tune an open frontier vision-language model to reason over fused sensor tokens instead of pictures.

  • Fast head: distil a small model from the slow head's calls on our own events, so every frame is seen and only hard cases escalade.

  • Evaluation: held-out sites, night and thermal slices, regression gates. A model that is worse anywhere does not ship.

  • Training machinery: multi-GPU training, data loaders for multi-sensor clips, experiment tracking and reproducible runs.

Who We're Looking For

A research engineer who has shipped multimodal models, not only published them. You know when an open model is good enough and when to build, you measure on the slice that matters before claiming a number, and you care whether the model works on a real site, not only on a benchmark.

Your Background
  • 4+ years training and fine-tuning large vision or multimodal models, or a PhD plus industry experience.

  • Strong PyTorch, comfortable with multi-GPU and multi-node training.

  • Hands-on fine-tuning of vision-language models (instruction tuning, parameter-efficient methods, full fine-tunes).

  • Experience with knowledge distillation or model compression for deployment.

  • Work with video or non-RGB sensors: thermal, infrared, lidar or radar.

  • Evaluation discipline and solid software engineering hygiene.

Nice to Have
  • Point-cloud or 3D foundation models.

  • Self-supervised and latent-prediction methods (JEPA-style).

  • Edge deployment with TensorRT or similar.

  • Robotics or field data collection.

  • Publications at top ML, vision or robotics venues.

What We Offer
  • Ownership: you are able to ship products and deliver project end-to-end.

  • Mission: autonomous security that keeps people and critical sites safe, including in defence.

  • Career path: a ground-floor seat with real runway. Prove your value and you will not have barriers to grow.

  • Team: work directly with PhD-level co-founders in AI, Robotics, and Physics, alongside a strong (and fun) founding team.

  • Compensation: Competitive equity/salary package

  • Culture: International founding team that is serious about building but does not take itself too seriously.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer, Foundation Model (Multimodal Fusion & Distillation)
Research Engineer, Foundation Model (Multimodal Fusion & Distillation)

Laelaps AI Ltd. • Zürich

On-site
CHF 120,000 - 180,000
Research Engineer, Foundation Model (Multimodal Fusion & Distillation)
Research Engineer, Foundation Model (Multimodal Fusion & Distillation)

Startupvalleys • Zürich

Hybrid
CHF 120,000 - 190,000
Ownership of shipped products
Competitive equity/salary package
Direct collaboration with PhD founders
+1
Research Scientist, Foundation Model (World Model & Site Memory)
Research Scientist, Foundation Model (World Model & Site Memory)

Laelaps AI Ltd. • Zürich

On-site
CHF 120,000 - 150,000
Research Scientist, Foundation Model (World Model & Site Memory)
Research Scientist, Foundation Model (World Model & Site Memory)

Startupvalleys • Zürich

Hybrid
CHF 140,000 - 210,000
Equity
Salary package
Ownership of projects
+1
Full-Stack Software Engineer
Full-Stack Software Engineer

Laelaps AI Ltd. • Zürich

On-site
CHF 120,000 - 180,000
Ownership of products
Autonomous security mission
Career growth opportunities
+2
Full-Stack Software Engineer
Full-Stack Software Engineer

Laelaps • Zürich

On-site
CHF 120,000 - 180,000
Ownership of shipped products
Autonomous security mission impact
Ground-floor career with runway
+3
Software Engineer, Robot Autonomy (Multi Robot Orchestration), Intern
Software Engineer, Robot Autonomy (Multi Robot Orchestration), Intern

Coop-Gruppe • Rüti (ZH)

On-site
CHF 20,000 - 27,000
Competitive compensation
Software Engineer, Robot Autonomy (Multi Agent Orchestration), Intern
Software Engineer, Robot Autonomy (Multi Agent Orchestration), Intern

Laelaps AI • Zürich

On-site
CHF 20,000 - 33,000
Ownership of projects
Competitive equity/salary package
Strong founding team with PhD-level R
Software Engineer, Robot Autonomy (Multi Agent Orchestration), Intern
Software Engineer, Robot Autonomy (Multi Agent Orchestration), Intern

Laelaps AI Ltd. • Zürich

On-site
CHF 22,000 - 36,000
Ownership of projects
Ambitious mission in autonomous safety
Strong growth runway
+2
Software Engineer, Robot Autonomy (Multi Robot Orchestration), Intern
Software Engineer, Robot Autonomy (Multi Robot Orchestration), Intern

Laelaps AI Ltd. • Zürich

Hybrid
CHF 20,000 - 31,000
Top locations