Lead Generative AI Analyst

Welocalize, Inc; San Francisco (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Welocalize, Inc. is seeking a Lead Generative AI Analyst to drive technical and writing teams in delivering NEMO products. You will liaise with customers and internal teams, track annotator metrics, and ensure world-class quality through rigorous guidelines and training.

Applicants should have a 4-year degree, native English, and a passion for state-of-the-art ML tools, RLHF, and large language models. Telemetry and content labeling experience are a plus.

Qualifications

• Native-level English with excellent written and verbal communication skills.
• 4-year college degree or equivalent experience.
• Experience delivering quality ML products on time.
• Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
• Self-driven and enthusiastic about state-of-the-art machine learning tools.

Responsibilities

• Lead technical and writing teams to deliver NEMO products.
• Liaise between customers and DataFactory/product/research teams.
• Track annotator metrics to ensure top-quality deliverables.
• Write prompts and responses across diverse topics.
• Manage labeling initiatives with third-party firms and internal customers.
• Develop and update detailed guidelines and specifications for stakeholders.
• Train teams on best practices for creating large language models and datasets.
• Handle potentially toxic or offensive content as required.

Skills

English proficiency

Leadership

Self-motivation

Python scripting

QA testing

Domain knowledge

Education

Bachelor's degree

Tools

Python

Job description

Job Responsibilities

The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

Responsibilities

• Lead technical and writing teams to deliver NEMO products.
• Act as the liaison between customers, DataFactory teams, product teams, and research teams.
• Track annotator metrics to ensure top-quality deliverables.
• Write creative prompts and responses across diverse topics.
• Manage labeling initiatives with third-party firms and internal customers.
• Develop and update detailed guidelines and specifications for stakeholders.
• Train teams on best practices for creating large language models and datasets.
• Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

Additional Job Details

Requirements

• Proven track record of delivering quality products on time.
• Native-level English proficiency with excellent written and verbal communication skills.
• Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
• Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
• 4-year accredited college degree or equivalent experience.

Ways to Stand Out

• Over 1 year of experience delivering products in the LLM space.
• College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
• Deep understanding of large language models and RLHF.
• Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
• QA/testing experience.
• Python scripting skills are a plus.

Welocalize is a leading technology-enabled provider of translation, localization, and AI-driven content solutions, helping businesses communicate, innovate, and grow globally. Specializing in complex and regulated industries, Welocalize delivers precise, scalable multilingual content through a powerful combination of advanced AI technologies and expert human talent. At the core is Welocalize’s AI-enabled OPAL platform, which transforms translation workflows by integrating machine translation (MT) and large language models (LLMs) to provide fast, accurate, and culturally relevant content in over 300 languages. With a commitment to excellence, Welocalize holds 7 ISO certifications. Welocalize is headquartered in New York with offices all over the globe.