LLM Reliability Engineer: Fuzz Testing & Production

Enboarder; San Francisco (CA); On-site; USD 150,000 - 600,000; Full time

Benefits offered by this job

Generous salary and equity

Benefits package

US visa sponsorship for exceptional candidates

Job summary

A technology company in San Francisco seeks a Research Engineer to develop their reliability platform for LLM applications. The role focuses on optimization and testing methodologies while emphasizing hands-on implementation and collaboration with clients. Ideal candidates will have a strong publication background and applied engineering experience, with an anticipated salary range from $150,000 to $600,000 annually based on expertise. This position requires a proactive approach towards experimentation and practical applications in machine learning.

Qualifications

• First-author publications in top-tier ML venues.
• Production engineering experience preferred.
• Familiarity with ideas from active learning and synthetic data.

Responsibilities

• Develop optimization and fuzzing methods for LLM systems.
• Implement automated evaluation models and systems.
• Work directly with customers to customize tools.

Skills

First-author publications

Production engineering experience

Familiarity with active learning

Synthetic data

Automated evaluation

Job description

A technology company in San Francisco seeks a Research Engineer to develop their reliability platform for LLM applications. The role focuses on optimization and testing methodologies while emphasizing hands-on implementation and collaboration with clients. Ideal candidates will have a strong publication background and applied engineering experience, with an anticipated salary range from $150,000 to $600,000 annually based on expertise. This position requires a proactive approach towards experimentation and practical applications in machine learning.