ML Engineer (Computer Vision & ML Ops)

StellDirVor GmbH; München; Hybrid; EUR 90,000 - 125,000; Full time

Benefits offered by this job

Remote-friendly setup

Munich office option

Learning budget

Job summary

StellDirVor GmbH, Munich-based independent consulting and technology company, is seeking an ML Engineer specialized in Computer Vision and ML Ops. You will build AI capabilities for AR/AI training and assistance systems in healthcare, handling data sourcing, consent, annotation and model deployment throughout the project lifecycle.

You will benchmark models, adapt generative AI for synthetic medical imagery, and develop on-device inference pipelines.

Qualifications

• Degree in Computer Science, Data Science, Biomedical Engineering, Mathematics or related field.
• Strong Python skills and hands-on use of PyTorch, OpenCV or TensorFlow.
• Solid understanding of computer vision: classification, object detection, and segmentation.
• Hands-on knowledge of transfer learning and fine-tuning on custom datasets.
• Familiar with full ML lifecycle: data prep, training, evaluation and deployment.
• Basic knowledge of generative models (diffusion or GANs) and common libraries.
• Able to train models locally and on cloud platforms.
• Able to estimate ML compute costs and compare build vs. buy options.
• Awareness of medical imaging challenges and GDPR data privacy.
• Able to read research papers and apply pragmatically.
• Self-directed and pragmatic with initiative in a lean team.
• Fluent in English; German is a bonus.

Responsibilities

• Select and benchmark pre-trained models for medical image analysis and adapt them to domain data.
• Identify generative AI models to create realistic synthetic medical images for education.
• Evaluate small language models for on-device voice interaction with low latency.
• Research state-of-the-art ML models, XAI, cybersecurity, and deployment modes (edge vs cloud).
• Plan the ML operations pipeline: data gathering, annotation, preparation, training, testing and deployment.
• Define data collection and annotation protocols with clinical experts and consent processes.
• Identify factors affecting model performance: image quality, dataset bias, privacy and regulation.
• Define test strategies, metrics, and validate outputs against clinician assessments.
• Perform build vs. buy analyses for models, tools and services, including cost comparisons.
• Estimate compute costs and propose budgets for training and deployment.
• Choose training environments (local or cloud) based on data privacy and cost.
• Maintain clear documentation of data sources, models and experiments.
• Explore integrating additional sensors (depth, LiDAR) and fuse with RGB data.

Skills

Python

PyTorch

OpenCV

TensorFlow

Transfer learning

ML lifecycle

English (fluent)

Education

Bachelor's or higher in CS/Data Science/BIOM/Math

Tools

PyTorch

OpenCV

TensorFlow

Docker

MLflow/Weights & Biases

Job description

StellDirVor is an independent consulting, trade and technology company specializing in immersive technologies for healthcare. We support organizations in implementing digital innovations — Virtual, Augmented and Mixed Reality as well as AI — particularly for learning, training and real‑time assistance in clinical and care environments. By combining technology and healthcare, we help optimize processes, improve knowledge transfer and enhance quality of care. Supported by a Germany (ZIM) and Taiwanese (GIPIP) partnership grant, we are currently developing ARAIAS — an AR- and AI‑based hands‑free training and assistance system for chronic wound care. Using AR smart glasses, the system enables 3D capture, AI‑supported analysis, and standardized remote expertise and documentation directly at the point of care. As our ML Engineer (Computer Vision & ML Ops), you will build the AI capabilities at the core of ARAIAS: evaluating and fine‑tuning computer vision models on smart glasses data, running the ML operations behind them, and applying generative AI to create synthetic medical images for education. We're at an early stage — moving from concept to working prototype — so the near‑term focus is on validating models and building toward a proof of concept we can test in real education and clinical settings. As part of a small team, you will own the full data lifecycle end to end — from sourcing, consent and annotation to preparation — alongside model development and deployment.

We welcome candidates at different experience levels. What matters most is a solid ML foundation and genuine awareness of the medical imaging domain.

Tasks

• Select and benchmark pre‑trained models and/or validated architectures for medical image analysis and adapt them to domain‑specific data, ensuring robust performance under real‑world conditions
• Identify and adapt suitable generative AI models to create realistic synthetic medical images for education and training
• Evaluate and fine‑tune small language models (SLMs) for voice interaction — speech‑to‑text, intent understanding and text‑to‑speech — optimized for low‑latency or on‑device use with smart glasses
• Research and assess state‑of‑the‑art ML models and emerging trends, including Explainable AI (XAI), cybersecurity for ML, and deployment and distribution modes (edge vs. cloud, federated learning, model compression)
• Plan and execute the ML operations pipeline — data gathering, annotation, preparation, training, testing and deployment
• Propose a data collection strategy — research suitable public and clinical data sources, recommend patient consent and other administrative requirements for ML training (e.g., data protection agreements, ethics approval), and define collection and annotation protocols with clinical experts, including labeling guidelines and quality checks
• Identify and validate factors that affect model performance — image conditions, dataset bias, patient diversity, data privacy and regulatory requirements
• Define test strategies and metrics, and validate model outputs against clinician assessments
• Perform build vs. buy analyses for models, tools and services, including cost comparison
• Estimate compute and training costs and propose budgets for model training and deployment
• Choose and set up training environments flexibly — local hardware or cloud — based on cost, data privacy and performance
• Make pragmatic technical decisions appropriate for the current prototyping stage and document results clearly
• Maintain clear, traceable documentation of data sources, models, experiments and design decisions to support audits and quality reviews
• Evaluate and integrate additional sensors where feasible (e.g., depth, LiDAR, thermal, multispectral) and fuse them with RGB input

Requirements Must-Have

• Degree in Computer Science, Data Science, Biomedical Engineering, Mathematics or a related field — or equivalent practical background
• Strong Python skills and hands‑on use of PyTorch, OpenCV or TensorFlow
• Solid understanding of computer vision — classification, object detection and image segmentation, 3D Reconstruction and Multi‑View Geometry
• Hands‑on knowledge of transfer learning — adapting pre‑trained models and fine‑tuning them on custom datasets
• Working knowledge of the full ML lifecycle — data preparation, training, evaluation and deployment
• Basic knowledge of generative models (diffusion models or GANs) and common open‑source libraries
• Comfortable training models both locally (GPU workstation) and on cloud platforms
• Able to estimate ML compute costs and compare build vs. buy options to support budget decisions
• Awareness of medical imaging challenges — limited data, label variability between clinicians and class imbalance
• Awareness of healthcare data privacy and ethics (e.g., GDPR, patient consent, anonymization) and why explainability and bias matter in clinical AI
• Able to read research papers and apply them pragmatically
• Self‑directed and pragmatic — able to take initiative and own problems end‑to‑end in a lean team
• Fluent in English — German is a bonus

Strong Plus

• Projects or coursework in medical imaging or clinical AI
• Familiarity with semi‑supervised learning — leveraging limited or partially labeled data
• Experience with 3D data processing — depth maps, point clouds or mesh reconstruction
• Exposure to multi‑modal learning — combining RGB and depth or LiDAR data
• Edge AI or wearable deployment (e.g., TensorFlow Lite, ONNX, model quantization)
• Knowledge of explainability methods (e.g., Grad‑CAM, SHAP) or adversarial robustness
• Familiarity with MLOps tools (e.g., MLflow, Weights & Biases, DVC, Docker)
• Awareness of medical device regulation for AI software (e.g., EU MDR, IEC 62304)
• Familiarity with small language models (SLMs) and speech pipelines (e.g., Whisper, on‑device speech recognition and text‑to‑speech)

Benefits

• Meaningful work — You help shape how technology redefines education and training in healthcare, with real impact on clinical outcomes
• Ownership and creative freedom — You work autonomously, contribute your ideas directly, and have a genuine say in how the system is built
• A learning culture — We support personal and professional growth through knowledge sharing, access to innovative tools and methods, and a dedicated learning budget
• Flexible working — Remote‑friendly setup with the option to work from our Munich office
• Flat hierarchies and team spirit — A small, open, and trust‑based team where communication is direct and everyone's voice matters
• International collaboration — Work alongside a Taiwan‑based partner covering technology, hardware and research

We are only able to respond to candidates selected for further consideration. If you have not heard from us within four weeks of applying, please consider your application unsuccessful at this time.