AI Quality Engineer - Semantic Models & Graphs

Experis (Austria); Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Experis (Austria) is seeking an experienced AI Engineer to establish and scale QA, validation, and evaluation frameworks for enterprise AI and analytics solutions in a London hybrid setup.

You will build automated testing for semantic models, knowledge graphs, and AI-powered query systems, collaborating with AI, data, and product teams to ensure accuracy, safety, and performance across SQL, Cypher, and hybrid retrieval systems.

Qualifications

• Strong experience in software testing, QA engineering, or platform validation.
• Experience developing automated testing frameworks using Python.
• Understanding of AI, LLM, RAG, semantic layer, or knowledge graph architectures.
• Experience validating SQL-based analytical systems and complex data transformations.
• Knowledge of graph databases and query languages such as Neo4j and Cypher.
• Familiarity with modern data platforms including ClickHouse, BigQuery, Snowflake, Databricks, or similar environments.
• Experience creating regression, integration, contract, and end-to-end test suites.
• CI/CD tooling familiarity (GitHub Actions, Azure DevOps, GitLab CI, Jenkins).
• Strong analytical and problem-solving capabilities.

Responsibilities

• Build and maintain golden-question datasets to benchmark AI solution quality and consistency.
• Develop automated evaluation frameworks for semantic mappings, measures, derived assets, SQL/Cypher generation, graph retrieval, hybrid search, and multi-intent question answering.
• Design and execute validation tests covering data equivalence, join integrity, graph projection accuracy, query safety, access controls, regression, performance, and concurrency.
• Create contract, integration, and end-to-end test suites across mocked services, ClickHouse, BigQuery, and Neo4j environments.
• Embed testing and evaluation processes into CI/CD pipelines to support continuous delivery and rapid feedback.
• Establish repeatable validation across changes to data, semantic models, knowledge graphs, prompts, configurations, and derived assets.
• Monitor quality metrics, identify regressions, and work with engineering teams to resolve defects and improve system reliability.
• Support AI governance by ensuring outputs are accurate, secure, auditable, and compliant with organisational standards.
• Strong experience in software testing and QA engineering.

Skills

QA engineering

Python testing

AI/LLM knowledge

SQL data validation

Graph databases

Neo4j/Cypher

Data platforms

Analytical skills

Tools

ClickHouse

BigQuery

Neo4j

Snowflake

Databricks

GitHub Actions

Azure DevOps

GitLab CI

Jenkins

Job description

Experis (Austria) is seeking an experienced AI Engineer to establish and scale QA, validation, and evaluation frameworks for enterprise AI and analytics solutions in a London hybrid setup.

You will build automated testing for semantic models, knowledge graphs, and AI-powered query systems, collaborating with AI, data, and product teams to ensure accuracy, safety, and performance across SQL, Cypher, and hybrid retrieval systems.