AI Test Engineer (f/md)

Verwaltungssprung GmbH; Berlin; Hybrid; EUR 70,000 - 90,000; Full time

Benefits offered by this job

Above-average compensation

Central Berlin office

Free snacks and beverages

Flat hierarchies

Mentor onboarding

Training programs

Job summary

Verwaltungssprung GmbH, a Berlin-based GovTech company, seeks an AI Test Engineer to ensure reliability, security, and quality of AI-driven public sector solutions. You will design, implement, and optimize testing strategies for AI-powered applications and ML systems.

The role emphasizes collaboration with AI engineers, product managers, and developers, analyzing data to verify performance, detect biases, and document testing methodologies.

Qualifications

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field.
• Experience in software testing, quality assurance, or AI/ML system evaluation.
• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies.
• Familiarity with automated testing tools, scripting languages, and test frameworks.
• Experience analyzing model outputs, performance metrics, and potential biases.
• Understanding of security, privacy, and compliance considerations in AI applications.
• Strong analytical thinking and problem-solving skills.
• Excellent communication skills and the ability to work in interdisciplinary teams.
• Fluent in German; good English skills.

Responsibilities

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems.
• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases.
• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities.
• Develop automated test frameworks and quality assurance processes for AI solutions.
• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle.
• Analyze datasets and outputs to ensure compliance with quality and ethical standards.
• Support continuous improvement of AI systems through structured feedback and testing insights.
• Document testing methodologies, findings, and recommendations for internal and external stakeholders.
• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments.

Skills

Testing strategies

ML concepts

Automated testing

Scripting languages

Test frameworks

Model evaluation

Security & privacy

Analytical thinking

Communication

Education

Degree in CS/AI/Data Science

Tools

Testing tools

Job description

Verwaltungssprung is a Berlin-based GovTech company developing AI-powered software solutions to simplify and digitize administrative processes. Our platform enables citizens and public institutions to access secure, user-friendly, and fully digital public services.

To support the growth of our organization, we are looking for an AI Test Engineer (f/md) who is passionate about ensuring the reliability, security, and quality of AI-driven applications in the public sector. In this role, you will help validate and optimize AI systems that directly impact digital government services and citizen experiences.

In this role, you will design, develop, and optimize AI-powered solutions that help modernize public administration and create seamless digital experiences for citizens and institutions.

Tasks

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems
• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases
• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities
• Develop automated test frameworks and quality assurance processes for AI solutions
• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle
• Analyze datasets and outputs to ensure compliance with quality and ethical standards
• Support continuous improvement of AI systems through structured feedback and testing insights
• Document testing methodologies, findings, and recommendations for internal and external stakeholders
• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

Requirements

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field
• Experience in software testing, quality assurance, or AI/ML system evaluation
• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies
• Familiarity with automated testing tools, scripting languages, and test frameworks
• Experience analyzing model outputs, performance metrics, and potential biases
• Understanding of security, privacy, and compliance considerations in AI applications
• Strong analytical thinking and problem-solving skills
• Excellent communication skills and the ability to work in interdisciplinary teams
• Fluent in German; good English skills

Benefits

• Attractive above-average compensation package
• Centrally located offices with access to the unique ThinkTank Campus in Berlin-Wannsee
• Free snacks and beverages in our offices
• Flat hierarchies, fast decision-making, and room for your own ideas
• International team spirit with recognition of both collective and individual successes
• Early responsibility and creative freedom from day one
• Structured onboarding with a buddy and experienced mentor
• Continuous training programs and regular development discussions

Join Verwaltungssprung and become part of a mission-driven team building the future of digital public services. If you are passionate about analyzing complex administrative systems and transforming them into meaningful digital solutions with real societal impact, we would love to hear from you.

Find more English Speaking Jobs in Germany on Arbeitnow