AI Data Quality & Evaluation Specialist (Onsite)

University of Delaware; New York (NY); On-site; USD 61,200 - 74,800; Full time

Benefits offered by this job

Paid Vacation: 6 days

Medical, Dental, and Vision Insurance

401(k) Retirement Plan

Free Gourmet Food

Commuter Benefits

Job summary

Welo Data is seeking a Data Labeling Associate in New York City to evaluate AI model outputs, providing structured feedback and insights. This role demands native-level Portuguese proficiency and at least a bachelor's degree, along with strong critical thinking and communication skills.

As a full-time position, you will contribute to enhancing AI systems through detailed audits of data and model behavior. The role is strictly onsite with no remote work options available.

Qualifications

• 1-2 years of professional writing experience with structured writing skills.
• Ability to apply complex writing rules and guidelines consistently.
• Experience in data quality, QA, annotation, or analysis is helpful.

Responsibilities

• Evaluate AI model outputs and provide structured feedback.
• Perform audit-based reviews of data and model behavior.
• Contribute to improving evaluation frameworks.

Skills

Native-level Portuguese (Brazil)

B2 or superior level of English

Strong critical thinking

Attention to detail

Strong written and verbal communication skills

Professional writing experience

Education

Bachelor’s degree or higher

Job description

Welo Data is seeking a Data Labeling Associate in New York City to evaluate AI model outputs, providing structured feedback and insights. This role demands native-level Portuguese proficiency and at least a bachelor's degree, along with strong critical thinking and communication skills.

As a full-time position, you will contribute to enhancing AI systems through detailed audits of data and model behavior. The role is strictly onsite with no remote work options available.