AI Test Engineer (f/md)

Verwaltungssprung; Berlin; Hybrid; Vertraulich; Vollzeit

Benefits dieser Stelle

Above-average compensation

Central Berlin office

Mentor program

Structured onboarding

Zusammenfassung

Verwaltungssprung in Berlin is seeking an AI Test Engineer to validate and optimize AI-driven government solutions. You will design testing strategies, evaluate model performance, and identify biases and security risks to ensure trustworthy public services.

The role involves collaboration with engineers, product managers, and compliance teams, focusing on responsible AI in public administration and data ethics. This position is based in Berlin with on-site work.

Qualifikationen

• Degree in Computer Science, AI, Data Science or related field.
• Experience in software testing, QA, or AI/ML evaluation.
• Strong understanding of ML concepts and testing methods.
• Familiarity with automated testing tools and test frameworks.
• Knowledge of security, privacy, and compliance considerations in AI.

Aufgaben

• Design, implement, and maintain testing strategies for AI-powered apps and ML systems.
• Evaluate model performance, accuracy, robustness across use cases.
• Identify edge cases, biases, hallucinations, and security issues.
• Develop automated test frameworks and QA processes for AI solutions.
• Collaborate with AI engineers, product managers, and software developers.
• Analyze datasets to ensure quality and ethical standards.
• Document testing methodologies and recommendations for stakeholders.
• Contribute to responsible AI best practices in public administration environments.

Kenntnisse

Software testing

AI/ML testing

Scripting languages

German language

English language

Analytical thinking

Team collaboration

Ausbildung

Degree in CS/AI/Data Science

Tools

Python

PyTest

Selenium

Jobbeschreibung

Verwaltungssprung is a Berlin-based GovTech company developing AI-powered software solutions to simplify and digitize administrative processes. Our platform enables citizens and public institutions to access secure, user-friendly, and fully digital public services.

To support the growth of our organization, we are looking for an AI Test Engineer (f/md) who is passionate about ensuring the reliability, security, and quality of AI-driven applications in the public sector. In this role, you will help validate and optimize AI systems that directly impact digital government services and citizen experiences.

In this role, you will design, develop, and optimize AI-powered solutions that help modernize public administration and create seamless digital experiences for citizens and institutions.

Tasks

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems
• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases
• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities
• Develop automated test frameworks and quality assurance processes for AI solutions
• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle
• Analyze datasets and outputs to ensure compliance with quality and ethical standards
• Support continuous improvement of AI systems through structured feedback and testing insights
• Document testing methodologies, findings, and recommendations for internal and external stakeholders
• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

Requirements

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field
• Experience in software testing, quality assurance, or AI/ML system evaluation
• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies
• Familiarity with automated testing tools, scripting languages, and test frameworks
• Experience analyzing model outputs, performance metrics, and potential biases
• Understanding of security, privacy, and compliance considerations in AI applications
• Strong analytical thinking and problem-solving skills
• Excellent communication skills and the ability to work in interdisciplinary teams
• Fluent in German; good English skills

Benefits

• Attractive above-average compensation package
• Centrally located offices with access to the unique ThinkTank Campus in Berlin-Wannsee
• Free snacks and beverages in our offices
• Flat hierarchies, fast decision-making, and room for your own ideas
• International team spirit with recognition of both collective and individual successes
• Early responsibility and creative freedom from day one
• Structured onboarding with a buddy and experienced mentor
• Continuous training programs and regular development discussions

Join Verwaltungssprung and become part of a mission-driven team building the future of digital public services. If you are passionate about analyzing complex administrative systems and transforming them into meaningful digital solutions with real societal impact, we would love to hear from you.