Resaro was founded on the belief that AI will change the world in ways we cannot even imagine, but every new technology needs safeguards.
As AI adoption increases, the challenge in the next decade is to harness AI safety with the appropriate levels of governance and assurance to build trust in these advanced algorithmic systems. Most enterprises do not have the capability to do this, and we are a new AI assurance venture that provides services to validate AI systems for accuracy, robustness, explainability, fairness, privacy, and security.
We are looking for a senior/data scientist to be based in Munich, with experience in deep learning-based language models, to work with a category-defining AI assurance venture that will help companies test and audit their AI systems. You will evaluate and stress-test AI models to ensure they are fit for purpose and safe to deploy. We value strong technical ability and real-world experience, with opportunities to solve challenging problems and incorporate cutting-edge technology into business applications.
You Will
- Perform technical AI evaluations, benchmarking, and "red-team" tests on computer vision models, including assessing robustness and performance.
- Support the design, implementation, and execution of evaluation frameworks for computer vision models, including CNNs, GANs, RNNs, transformer/LSTM-based models, and other state-of-the-art architectures.
- Assess the performance of models such as object detection, image classification, segmentation, and pose estimation.
- Stay updated on advancements in computer vision, AI, and deep learning to incorporate new evaluation techniques.
- Contribute to publications, conferences, and technical presentations on model evaluation and AI performance.
- Explore innovative evaluation methods, like adversarial testing or synthetic data, to push traditional boundaries.
- Evaluate generative AI systems, including text and multi-modal models, for foundation, fine-tuned, and end-to-end systems.
- Work with clients to design custom evaluation approaches based on scientific research.
- Collaborate with product teams to develop evaluation frameworks and tools focusing on robustness, explainability, fairness, privacy, safety, and security, especially in computer vision.
You Are Able To
- Think from first principles and address challenging technical problems across disciplines such as design, engineering, and social science.
- Lead by example, regardless of managerial status, and work well with passionate, talented individuals.
- Communicate openly, frankly, and respectfully.
- Thrive in fast-paced environments.
- Navigate uncertainty by exploring while staying focused on the mission.
You Have
- 2-8 years of experience as a data scientist working with computer vision models in real-world contexts or a relevant postgraduate degree.
- A passion for applied research on the safe and responsible use of AI, especially computer vision.
- Interest in evaluating models using metrics like mAP, IoU, F1-score, precision-recall, etc.
- Experience working with large datasets such as ImageNet, COCO, or custom sets, including managing annotation quality.
- Proficiency in deep learning frameworks (TensorFlow, PyTorch, Keras) and understanding of architectures like ResNet, EfficientNet, Mask R-CNN, YOLO.
- Strong Python coding skills and experience setting up automated evaluation pipelines.
- Experience with data augmentation, synthetic data, and adversarial testing.
- Excellent communication skills to articulate technical results to diverse audiences.
Nice to Have
- Published research in computer vision.
- Knowledge of explainability techniques (Grad-CAM, LIME, SHAP).
- Experience with edge computing and real-time deployment.
- Experience with facial recognition systems.
- Familiarity with cloud platforms (AWS, GCP) for scalable evaluation and deployment.
About Us
Resaro is a leading AI Assurance company with offices in Singapore and Munich, pioneering AI safety and reliability. Our team includes AI experts, engineers, and data scientists. Our mission is to ensure AI systems are developed and deployed safely, securely, and ethically. The future depends on responsible AI adoption.
Resaro is an Equal Opportunity Employer. We support diversity in our teams.