Remote Healthcare Operations AI Evaluator

Talentify; New York (NY); Remote; USD 40,000 - 60,000; Full time

Job summary

Aston Carter is seeking a Healthcare Operations AI Trainer to apply real‑world medical coding, billing, and revenue cycle expertise in remote AI training projects. You will evaluate AI outputs, develop rubrics, and identify issues to improve accuracy and compliance across payer policies and guidelines.

You will review AI-generated workflows, collaborate with project teams, and leverage strong analytical and written communication skills to deliver high‑quality feedback while working independently

Qualifications

• 2+ years of experience in healthcare operations, medical coding, billing, clinical documentation integrity, utilization review, claims administration, health information management, or related fields.
• Certifications such as CPC, CCS, RHIA, RHIT, CDIP, CCDS are preferred but not required.

Responsibilities

• Create realistic healthcare operations scenarios based on professional experience.
• Review and evaluate AI-generated outputs related to medical coding, billing, claims processing, denials management, prior authorizations, documentation reviews, and revenue cycle functions.
• Compare multiple AI-generated responses and determine which best meets industry standards and guidelines.
• Develop detailed evaluation criteria and grading rubrics for healthcare operations workflows.
• Identify errors, omissions, compliance concerns, documentation issues, and workflow gaps in AI-generated work products.
• Collaborate with project teams to support AI training, quality assurance, and data annotation initiatives.
• Strong knowledge of healthcare operations, medical coding, billing, claims management, or revenue cycle workflows.
• Experience interpreting healthcare documentation, payer policies, reimbursement guidelines, and coding standards.
• Excellent analytical and written communication skills.
• Ability to evaluate complex information and provide detailed feedback.
• Proficiency with computer systems, data management tools, and cloud‑based applications.
• Familiarity with artificial intelligence tools and their practical applications.

Skills

Healthcare operations

Medical coding

Billing

Revenue cycle

Quality assurance

Data analysis

Education

CPC

CCS

RHIA

RHIT

CDIP

CCDS

Tools

Cloud-based applications

Job description

Aston Carter is seeking a Healthcare Operations AI Trainer to apply real‑world medical coding, billing, and revenue cycle expertise in remote AI training projects. You will evaluate AI outputs, develop rubrics, and identify issues to improve accuracy and compliance across payer policies and guidelines.

You will review AI-generated workflows, collaborate with project teams, and leverage strong analytical and written communication skills to deliver high‑quality feedback while working independently