AI Quality Architect

Resaro AI; München; Vor Ort; EUR 70.000 - 90.000; Vollzeit

Zusammenfassung

A global AI Assurance company in Munich is seeking an AI Quality Architect to lead client projects on AI quality metrics, develop testing frameworks, and mentor teams. The ideal candidate will possess a strong understanding of AI trustworthiness and regulations, as well as excellent leadership and communication skills. This role is essential for fostering a trustworthy AI market.

Qualifikationen

• Deep familiarity with AI regulations and standards from multiple jurisdictions.
• Understanding of AI architectures and their strengths.
• Experience in crafting precise proposals.

Aufgaben

• Lead client projects to develop AI quality indicators.
• Create scalable advisory services for AI quality metrics.
• Guide teams in understanding AI governance.

Kenntnisse

AI trustworthiness concepts

Communication skills

Team leadership

Technical problem-solving

Multi-disciplinary approach

Jobbeschreibung

Resaro was founded on the belief that AI systems can only add value and can only be deployed responsibly if there is a clear understanding of the characteristics required of a system, and meaningful evidence to what extent those requirements are met. We build scalable frameworks to capture this clear understanding, and powerful test tools to generate this evidence.

We are looking for an AI Quality Architect attached to our Munich HQ, reporting to Resaro’s Chief Trust Officer.

Overview

Resaro is a global AI Assurance company focused on AI testing and evaluation. We are a team of AI experts, engineers, and data scientists with a mission to ensure an AI market worthy of trust. Resaro is an Equal Opportunity Employer; we respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.

YOU WILL

• Lead client projects to develop solution-level AI quality indicators with business/operational, governance and technical stakeholders across a diverse range of mission critical use cases in areas such as law enforcement, defence, health, finance, aviation and public infrastructure.
• Develop product-based approaches and scalable advisory services to enable clients to set justifiable minimum quality levels and grow the adoption of AI quality indicators within an organisation.
• Develop the AI quality indicator library that will serve as a foundation for organisations seeking to scale AI adoption and assurance.
• Work with Resaro’s technical teams to develop automated and scalable ways of testing against quality indicators within Resaro’s Approved Intelligence Platform and integrate their insights into strategic roadmaps.
• Drive the mapping of quality indicators to global as well as customer-specific governance frameworks, e.g. EU AI Act with standards, NIST RMF, AI Verify, AITA, IEEE 7000/8000 etc. and derive minimum levels supporting compliance.
• Grow the market adoption of Resaro’s quality framework (“AI Solutions Quality Index” (ASQI)), including exploring certification, scalability and product sales pathways.
• Contribute to activities that grow the acceptance of ASQI framework amongst the open source and governance communities (resaro.ai/asqi).
• Serve as the internal expert on the latest advances in AI governance and quality frameworks in the commercial as well as the non-profit sector, with certification schemes, European and international standards and related relevant developments, and condense such knowledge for Resaro’s teams.
• Mentor colleagues, guiding them in making sense of the AI governance and quality landscapes and building their capabilities in supporting the above tasks.
• Lead and write project proposals for both private and public sector calls and tenders related to AI governance and quality assessment.

YOU ARE ABLE TO

• Think from first principles and tackle the most challenging technical and business problems from a multi-disciplinary perspective, e.g., design, engineering, social sciences etc.
• Lead by example, work with passionate and talented individuals, and forge a diversity of insights and views into a strong shared approach.
• Communicate in an effective, open, frank and respectful manner across teams in multiple locations.
• Thrive in a fast-paced environment.
• Navigate uncertainty by being willing to explore, while remaining laser focused on the mission at hand.

YOU HAVE

• A deep familiarity with well-known AI trustworthiness concepts, regulations, standards and other frameworks from multiple jurisdictions, and an appreciation of their commonalities and differences.
• A deep understanding of, and recent active participation in, standardisation committees or similar structures.
• An ability to craft precise and concise language that builds bridges between operational, governance and technical teams.
• An ability to craft convincing proposals with a stringent and irresistible narrative that responds to a call/tender while making full use of available capabilities and USPs.
• A broad understanding of different types of AI architectures and their strengths and limitations, with a focus on the discriminative and generative approaches of the past decade.
• An understanding of relational database design, including the ability to create, and work with, entity relationship diagrams or similar. Advanced SQL syntax knowledge is not needed.

NICE TO HAVE

• Experience with a range of certification pathways based on various kinds of industry standards.
• Experience with non-AI quality management standards and practices in a variety of industries.
• Experience in building multi-national partnerships and coalitions, e.g. in response to major funding calls.
• Experience in hands-on development of AI systems.
• Exposure to testing of AI systems, in particular using synthetic and/or augmented test data sets.
• Publications in the area of AI trustworthiness, quality or testing.

ABOUT RESARO

Resaro is a global AI Assurance company, pioneering the field of AI testing and evaluation. We are a team of AI experts, engineers, and data scientists. Our mission is to ensure an AI market worthy of trust.

Resaro is an Equal Opportunity Employer. We respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.