Resaro was founded on the belief that AI will change the world in ways we cannot even imagine, but every new technology needs safeguards.
As AI adoption increases, the challenge in the next decade is to harness AI safety with the appropriate levels of governance and assurance to build trust in these advanced algorithmic systems. Most enterprises do not have the capability to do this and we are a new AI assurance venture that provides services to validate AI systems for accuracy, robustness, explainability, fairness, privacy and security.
We are looking for a senior/data scientist to be based in Munich, with experience in deep learning based language models to work with a category-defining AI assurance venture that will help companies test and audit their AI systems. You will help evaluate and stress-test AI models to make sure they are fit for purpose and safe to be deployed. We value strong technical ability and real world experience and there will be room to solve challenging problems and adopt cutting edge technology into business applications.
YOU WILL
- Perform technical AI evaluations, benchmarking and "red-team" tests on computer vision models, including assessing them for robustness and performance.
- Support the design, implementation, and execution of robust evaluation framework for computer vision models, including but not limited to convolutional neural networks, generative adversarial networks, recurrent neural networks, transformer/LSTM -based models, and other state-of-the-art architectures.
- Assess the performance of computer vision models (e.g., object detection, image classification, segmentation, pose estimation, etc.).
- Stay abreast of the latest advancements in computer vision, AI, and deep learning to incorporate cutting-edge evaluation techniques.
- Contribute to publications, conferences, and technical presentations on model evaluation and AI performance in computer vision.
- Explore innovative evaluation methods, such as adversarial testing or synthetic data, to push the boundaries of traditional model evaluation.
- Evaluate the performance of generative AI systems, including text and multi-modal models. This will be for foundation models, fine tuned models as well as end-to-end systems.
- Work with clients to design custom evaluation approaches using the latest scientific research that address the client's needs.
- Work with the product management team to develop a suite of technical and analytical AI evaluation frameworks and tools that are backed by scientific research and methods. These should assess the robustness, explainability, fairness, privacy, safety and security of AI and machine learning systems, with a strong focus on computer vision.
YOU ARE ABLE TO
- Think from first principles and want to tackle the most challenging technical problems from a multi-disciplinary approach e.g., design, engineering and social science.
- Lead by example regardless of whether you are a manager or individual contributor. You want to work with passionate and talented individuals and people want to work with you.
- Communicate in an open, frank and respectful manner.
- Thrive in a fast-paced environment.
- Navigate uncertainty by being willing to explore, while remaining laser focused on the mission at hand.
YOU HAVE
- About 2-8 years of working experience as a data scientist training or deploying computer vision models in real-world contexts or a relevant postgraduate degree building and deploying computer vision models. (We are recruiting candidates with a wide range of years of experience to fill roles at different levels.)
- A passion and interest in applied research on the safe and responsible use of AI and with computer vision models.
- Interest in evaluating computer vision models using metrics such as mAP, IoU, F1-score, precision-recall, and others relevant to the specific task.
- Interest in working with large-scale datasets such as ImageNet, COCO, or custom datasets, as well as managing annotation quality and dataset curation.
- Proficiency in deep learning frameworks such as TensorFlow, PyTorch, or Keras, with a deep understanding of computer vision architectures (e.g., ResNet, EfficientNet, Mask R-CNN, YOLO).
- Strong coding skills in Python, along with familiarity in setting up automated model evaluation pipelines.
- Experience with data augmentation, synthetic data generation, and adversarial testing.
- Strong written and verbal communication skills, with the ability to articulate technical results and collaborate effectively across teams.
- Excellent written and verbal communication skills, with the ability to clearly explain complex technical concepts to diverse audiences, including non-technical stakeholders.
- Passion and interest in applied research on the safe and responsible use of AI and with computer vision models.
NICE TO HAVE
- Published research in the field of computer vision.
- Knowledge of explainability techniques for computer vision (e.g., Grad-CAM, LIME, SHAP).
- Familiarity with edge computing environments and deploying computer vision models in real-time systems.
- Experience with facial recognition systems.
- Familiarity with cloud-based platforms (e.g., AWS, GCP) for scalable model evaluation and deployment.
ABOUT US
Resaro is a leading AI Assurance company with offices in Singapore and Munich, pioneering the field of artificial intelligence safety and reliability. We are a team of AI experts, engineers, and data scientists. Our mission is to ensure that AI systems are developed and deployed in a way that is safe, secure, and aligned with human values. The future of society, business and the world depends on responsible AI adoption.
Resaro is an Equal Opportunity Employer. We respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.