AI Testing Analyst for Precision Finance Artifacts

Mosaic Conseil; Stockholms kommun; On-site; SEK 156,240 - 256,680; Part time

Job summary

Mosaic Conseil is a boutique consultancy that operates a fully remote, small-team workshop. We hire an AI Testing Assistant to stress test AI outputs on financial and industrial data, focusing on careful validation and transparent documentation.

This entry-level, part-time role supports our consultants and helps ensure artifacts reflect the evidence-based logic we provide. You review AI-generated summaries and data extractions, run standardized tests on internal tools, build simple test cases,

Qualifications

• Familiarity with Large Language Models and prompting for technical tasks.
• Proficiency with spreadsheets (Excel/Google Sheets) to verify calculations.
• Strong writing skills to explain technical errors clearly.
• Interest in financial services or industrial networks is a plus; logical argument orientation.

Responsibilities

• Reviewing AI-generated summaries and data extractions for accuracy against original source documents like ledgers or contracts.
• Running standardized tests on internal AI tools to identify where they fail to grasp complex financial logic or industrial constraints.
• Building simple test cases to verify that a pricing model or a business plan remains consistent when variables are changed.
• Documenting specific instances of model error or hallucination in a clear, written format.
• Assisting the challenger in our builder and challenger model by providing evidence of where an automated calculation may have deviated from the truth.
• Comparing different AI model outputs to see which one handles specific industry terminology from healthcare or industrial networks more reliably.
• Verifying that the data used for a specific business artifact has been correctly mapped by our automated scripts.

Skills

LLM familiarity

Spreadsheet proficiency

Strong writing

Logical reasoning

Education

Background in business, finance, or CS

Tools

Excel

Google Sheets

Job description

Mosaic Conseil is a boutique consultancy that operates a fully remote, small-team workshop. We hire an AI Testing Assistant to stress test AI outputs on financial and industrial data, focusing on careful validation and transparent documentation.

This entry-level, part-time role supports our consultants and helps ensure artifacts reflect the evidence-based logic we provide. You review AI-generated summaries and data extractions, run standardized tests on internal tools, build simple test cases,