Generative AI Data Analyst - USA (Remote)

Welo Data; Deutschland; Remote; EUR 26.603 - 37.889; Vollzeit

Zusammenfassung

Welo Data is seeking a Generative AI Analyst for a remote role focused on supporting a machine learning project. The ideal candidate will be responsible for creating diverse prompts and responses, performing data annotation tasks, and training teams on best practices for LLM development. Applicants should possess strong communication skills, a college degree, and have hands-on experience in data evaluation tasks. This full-time position offers a pay rate of $27.38/hour.

Qualifikationen

• Hands-on experience performing data annotation or evaluation tasks.
• Native or near-native English with excellent writing skills.
• Self-driven, motivated and enthusiastic about machine learning tools.

Aufgaben

• Creatively writing prompts and responses.
• Perform LLM annotation and evaluation tasks.
• Evaluate model outputs for accuracy and relevance.
• Identify and document issues like hallucinations.
• Support labeling workflows and training teams on best practices.

Kenntnisse

Data annotation

Excellent writing skills

Attention to detail

Motivation in machine learning

Ausbildung

4 year Accredited College degree or equivalent experience

Jobbeschreibung

OVERVIEW

We are seeking a Generative AI Analyst to support a high-impact machine learning project. This role focuses on creating high-quality prompts and responses across diverse topics and leading labeling initiatives with internal and external partners. The ideal candidate is a strong communicator with native-level U.S. English, experienced in working with data and comfortable training teams on best practices for LLM development. This position is fully remote and suited for someone motivated to work with cutting-edge AI technologies.

Project Details

Job Title: Generative AI Analyst
Location: Remote
Hours: 40 hours weekly
Language: English (US)
Start date: April 2026
Employment Type: Full-time W-2 employee with benefits – 5 days a week
Pay rate: $27.38/hour

If you reside in California, please apply to the California-specific posting for the applicable rate

Must have valid work authorization in the US (Welo Data does not sponsor VISAs at this time).

Key Responsibilities

• Creatively writing prompts and responses to a variety of diverse topics
• Perform LLM annotation and evaluation tasks (ranking, scoring, labeling, tagging)
• Evaluate model outputs for accuracy, relevance, and instruction-following
• Identify and document issues such as hallucinations and inconsistencies
• Participating in and/or supporting labeling workflows, including hands-on annotation and collaboration with internal or external teams
• Training teams on best practices for creating Large Language Models/Data sets

Requirements

• Hands-on experience performing data annotation or evaluation tasks (e.g., labeling, ranking, scoring, or tagging LLM outputs)
• Native or near-native English with excellent writing skills
• Strong attention to detail and ability to follow guidelines consistently
• Self-driven, motivated and enthusiastic to work on state‑of‑art machine learning tools
• 4 year Accredited College degree or equivalent experience

Ways to stand out from the crowd

• College Degree or experience in Linguistics, English Literature, Creative Writing, Journalism, and domain knowledge (Law/Medical/Math/Coding/etc.)
• Experience working in annotation platforms or structured labeling environments is a plus
• Deep understanding of Large Language Models/RLHF
• Experience in labeling/tagging of frames/tasks/prompts to prepare for DNN
• QA/testing experience

Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.