Senior Quality Engineer - Remote AI Chatbot Systems

Mimica; Ireland; On-site; EUR 70,000 - 90,000; Full time

Benefits offered by this job

Remote work

Stock options

Laptop + setup stipend

Learning budget

Parental leave

Health & retirement benefits

Annual learning & development budget

Social events

Work from anywhere

Job summary

Mimica is seeking a dedicated Quality Engineer to establish robust testing and release processes for our Chatbot product. You will partner with Software and ML engineers to define quality from day one, balancing hands-on testing with experimentation in a fast-moving, AI-driven environment.

You will own testing approaches, identify gaps, and help shape systems and processes that support sustainable delivery, enabling rapid progress without compromising user trust or reliability.

Qualifications

• Strong hands-on experience in software quality engineering, SDET, test automation, or a closely related engineering role.
• Experience testing chatbot, conversational AI, RAG, LLM-powered systems; practical exposure is valuable.

Responsibilities

• Develop and evolve quality practices, test strategy, and release processes for the Chatbot product.
• Establish and run an output-evaluation framework for Chatbot quality, reliability, and regressions.
• Test dynamic and non-deterministic LLM-based systems, validating behaviour beyond conventional test cases.
• Identify, test, and improve guardrails for AI-specific risks, including prompt-injection and unsafe model behaviour.
• Collaborate with engineers through code reviews and debugging to improve quality earlier in development.
• Investigate testing gaps, research methods and tools, and make evidence-based recommendations.
• Design proofs-of-concept for new testing approaches or tooling and productionise valuable solutions.
• Support evolution of release testing with clearer quality signals and readiness criteria.
• Contribute performance-testing thinking for LLM-powered workflows where relevant.
• Share knowledge and help build the Quality Chapter across the engineering org.

Skills

Software QA

SDET

Test automation

Chatbot testing

LLM testing

Job description

Mimica is seeking a dedicated Quality Engineer to establish robust testing and release processes for our Chatbot product. You will partner with Software and ML engineers to define quality from day one, balancing hands-on testing with experimentation in a fast-moving, AI-driven environment.

You will own testing approaches, identify gaps, and help shape systems and processes that support sustainable delivery, enabling rapid progress without compromising user trust or reliability.