AI Test Engineer (f/md)

Verwaltungssprung GmbH; Berlin; Vor Ort; EUR 70.000 - 110.000; Vollzeit

Benefits dieser Stelle

Above-average pay

ThinkTank Campus Berlin

Free snacks

Flat hierarchies

International team

Early responsibility

Buddy onboarding

Training programs

Zusammenfassung

Verwaltungssprung GmbH in Berlin is seeking an AI Test Engineer to ensure reliability, security, and quality of AI-driven public sector applications. You will design, implement, and optimize testing strategies for AI-powered solutions used by citizens and institutions.

The role requires strong analytical skills, experience with AI/ML evaluation, and collaboration with cross-functional teams to uphold high standards and responsible AI practices.

Qualifikationen

• Degree in CS/AI or related field.
• Experience in software testing or AI/ML evaluation.
• Understanding of ML concepts and AI behavior.
• Familiarity with automated testing tools and frameworks.
• Knowledge of security and privacy in AI apps.
• German language fluency; good English.

Aufgaben

• Design, implement, and maintain AI testing strategies.
• Evaluate model performance, accuracy, robustness, and reliability.
• Identify biases, edge cases, and security vulnerabilities.
• Develop automated test frameworks and QA processes.
• Collaborate with AI engineers, PMs, and software developers.
• Document methodologies and findings for stakeholders.
• Contribute to trustworthy AI practices in public administration.

Kenntnisse

Software testing

AI/ML concepts

Testing frameworks

Security & privacy

Analytical thinking

Communication skills

German language

Python

Ausbildung

BSc/MSc in CS/AI

Tools

Python

Bash

Jobbeschreibung

Verwaltungssprung is a Berlin-based GovTech company developing AI-powered software solutions to simplify and digitize administrative processes. Our platform enables citizens and public institutions to access secure, user-friendly, and fully digital public services.

To support the growth of our organization, we are looking for an AI Test Engineer (f/md) who is passionate about ensuring the reliability, security, and quality of AI-driven applications in the public sector. In this role, you will help validate and optimize AI systems that directly impact digital government services and citizen experiences.

In this role, you will design, develop, and optimize AI-powered solutions that help modernize public administration and create seamless digital experiences for citizens and institutions.

Tasks

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems
• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases
• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities
• Develop automated test frameworks and quality assurance processes for AI solutions
• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle
• Analyze datasets and outputs to ensure compliance with quality and ethical standards
• Support continuous improvement of AI systems through structured feedback and testing insights
• Document testing methodologies, findings, and recommendations for internal and external stakeholders
• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

Requirements

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field
• Experience in software testing, quality assurance, or AI/ML system evaluation
• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies
• Familiarity with automated testing tools, scripting languages, and test frameworks
• Experience analyzing model outputs, performance metrics, and potential biases
• Understanding of security, privacy, and compliance considerations in AI applications
• Strong analytical thinking and problem-solving skills
• Excellent communication skills and the ability to work in interdisciplinary teams
• Fluent in German; good English skills

Benefits

• Attractive above-average compensation package
• Centrally located offices with access to the unique ThinkTank Campus in Berlin-Wannsee
• Free snacks and beverages in our offices
• Flat hierarchies, fast decision-making, and room for your own ideas
• International team spirit with recognition of both collective and individual successes
• Early responsibility and creative freedom from day one
• Structured onboarding with a buddy and experienced mentor
• Continuous training programs and regular development discussions

Join Verwaltungssprung and become part of a mission-driven team building the future of digital public services. If you are passionate about analyzing complex administrative systems and transforming them into meaningful digital solutions with real societal impact, we would love to hear from you.