Professional Services AI Training Specialist — Task Creation & Model Evaluation (Contract)

Rise Data Labs; Deutschland; On-site; EUR 55,000 - 85,000; Full time

Job summary

Rise Data Labs is seeking a Professional Services AI Training Specialist to help shape AI benchmarks for the professional services sector, with a focus on accounting and audit. You will craft realistic task scenarios, assemble reference materials, and write precise rubrics to evaluate AI-generated deliverables.

Collaboration with other experts ensures consistent scoring and improvement of training data. The role emphasizes detailed review of client-facing work, scalable benchmarking, and

Qualifications

• Hands-on experience in accounting/audit (CPA or equivalent preferred).
• Experience in management or strategy consulting.
• HR or marketing/business services background welcome.
• Comfort reviewing detailed client-facing work.
• Experience with AI model training, evaluation, or benchmark development is a plus.

Responsibilities

• Create realistic task scenarios based on real client work such as reviewing financial statements or drafting analyses.
• Provide reference materials like financial statements and engagement letters.
• Write rubrics detailing required deliverables with figures, structure and formatting.
• Grade AI outputs against rubrics in Excel, Word, or PDF formats.
• Participate in calibration sessions to ensure consistent scoring.

Skills

Accounting

Audit

Consulting

Management

Strategy

HR

Marketing/Business services

AI training

Benchmark development

Job description

About Rise Data Labs

Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including accounting, consulting, HR, marketing services, and other professional and business services. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.

Job Overview

As a Professional Services AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for the professional services domain. This role goes beyond traditional annotation and labeling - you'll author realistic, economically valuable professional services tasks and rubrics based on real client work, then grade AI-generated deliverables against them. We're especially focused on accounting and audit expertise right now, but are open to related professional service backgrounds as well.

What You'll Do

• Create realistic task scenarios based on real client or engagement work - e.g., reviewing financial statements and audit workpapers, building a consulting deliverable, preparing an HR or compliance report, or drafting a client-facing proposal or analysis
• Supply the kinds of reference materials you'd normally work from (financial statements, engagement letters, project reports, supporting schedules)
• Write detailed rubrics specifying exactly what a correct deliverable requires - accurate figures/formulas, proper file structure, professional formatting
• Grade AI-generated deliverables (often Excel workbooks, Word documents, or PDF reports) against your rubric
• Join calibration sessions with other experts to ensure consistent scoring across the benchmark

Preferred Qualifications

• Prior hands-on experience in one or more of: accounting/audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing/business services, or another professional services engagement-based role
• Comfort reviewing detailed client-facing work product line by line
• Prior experience with AI model training, evaluation, or benchmark development is a plus

What We Offer

At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in professional services work.