Professional Services AI Training Specialist — Task Creation & Model Evaluation (Contract)

Rise Data Labs

España

On-site

EUR 42,000 - 64,000

Full time

29 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rise Data Labs is seeking a Professional Services AI Training Specialist to craft realistic tasks and rubrics for AI model evaluation in the professional services domain.

You will develop scenarios based on client work, assemble reference materials, and grade AI outputs against clear rubrics, with calibration sessions to ensure consistent scoring across experts.

The role offers growth in AI applications for accounting, audit, HR and related services within a collaborative, flexible environment.

Qualifications

  • Experience in accounting/audit or consulting or HR or marketing or similar professional services.
  • Attention to detail when reviewing client-facing work line by line.
  • Experience with AI model training, evaluation, or benchmark development is a plus.

Responsibilities

  • Create realistic task scenarios based on real client work.
  • Provide reference materials for tasks (financial statements, engagement letters, reports).
  • Write rubrics detailing deliverables with figures, structure, formatting.
  • Grade AI outputs against rubrics.
  • Participate in calibration sessions to ensure consistent scoring.

Skills

Accounting/Audit
Consulting
HR
Marketing/Business services

Job description

About Rise Data Labs

Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including accounting, consulting, HR, marketing services, and other professional and business services. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.

Job Overview

As a Professional Services AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for the professional services domain. This role goes beyond traditional annotation and labeling - you'll author realistic, economically valuable professional services tasks and rubrics based on real client work, then grade AI-generated deliverables against them. We're especially focused on accounting and audit expertise right now, but are open to related professional service backgrounds as well.

What You'll Do
  • Create realistic task scenarios based on real client or engagement work - e.g., reviewing financial statements and audit workpapers, building a consulting deliverable, preparing an HR or compliance report, or drafting a client-facing proposal or analysis
  • Supply the kinds of reference materials you'd normally work from (financial statements, engagement letters, project reports, supporting schedules)
  • Write detailed rubrics specifying exactly what a correct deliverable requires - accurate figures/formulas, proper file structure, professional formatting
  • Grade AI-generated deliverables (often Excel workbooks, Word documents, or PDF reports) against your rubric
  • Join calibration sessions with other experts to ensure consistent scoring across the benchmark
Preferred Qualifications
  • Prior hands-on experience in one or more of: accounting/audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing/business services, or another professional services engagement-based role
  • Comfort reviewing detailed client-facing work product line by line
  • Prior experience with AI model training, evaluation, or benchmark development is a plus

What We Offer At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in professional services work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Training & Evaluation Specialist — Professional Services
AI Training & Evaluation Specialist — Professional Services

Rise Data Labs • Spain

On-site
EUR 42,000 - 64,000
Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation
Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation

Rise Data Labs • Spain

On-site
EUR 60,000 - 80,000
AI Training Specialist - Computer Science Expert
AI Training Specialist - Computer Science Expert

Rise Data Labs • Spain

Remote
EUR 26,000 - 38,000
AI Training Python Coding Specialist
AI Training Python Coding Specialist

Rise Data Labs • Spain

Remote
EUR 35,000 - 52,000
Remote-first
Flexible schedule
Cutting-edge AI projects
AI Training Specialist - SQL Data Expert
AI Training Specialist - SQL Data Expert

Rise Data Labs • Spain

Remote
EUR 17,000 - 28,000
Competitive hourly rates
Flexible hours
Growth opportunities
Mathematics AI Trainer and Data Specialist (Fluent in Russian)
Mathematics AI Trainer and Data Specialist (Fluent in Russian)

Rise Data Labs • Spain

Remote
EUR 19,000 - 33,000
Competitive hourly rate based on经验
Flexible working hours and remote work
Access to ongoing professional dev and
+2
AI Training Specialist - Science Expertise (Spanish Fluency Required)
AI Training Specialist - Science Expertise (Spanish Fluency Required)

Rise Data Labs • Spain

Remote
EUR 17,000 - 28,000
Competitive hourly rates
Flexible work schedules
Professional development opportunities
AI Training Specialist - Drug Discovery Expert
AI Training Specialist - Drug Discovery Expert

Rise Data Labs • Spain

Remote
EUR 34,000 - 55,000
Competitive hourly rates
Professional development
Collaborative culture
Spanish Language AI Training Specialist (Latin America)
Spanish Language AI Training Specialist (Latin America)

Rise Data Labs • Spain

Remote
EUR 21,000 - 36,000
Competitive compensation
Professional growth
Cutting-edge AI projects
Accountant
Accountant

SME Careers • Spain

Remote
EUR 83,000 - 165,000