Research Engineer

Haize Labs Inc.; New York (NY); On-site; USD 150,000 - 600,000; Full time

Job summary

An innovative company is seeking Research Engineers to enhance their reliability platform for LLM applications. This role focuses on developing new algorithms and frameworks for testing and deploying AI applications safely and reliably. You'll work on cutting-edge technologies and directly influence the responsible use of LLMs in various domains. Join a high-caliber team dedicated to solving complex AI challenges, where your contributions will have a significant impact. If you're passionate about pushing boundaries in AI and eager to learn and grow, this opportunity is for you.

Benefits

Generous salary

Equity

Benefits package

US visa sponsorship for exceptional candidates

Qualifications

• Experience in developing optimization and fuzzing methods.
• Strong background in machine learning and applied engineering.

Responsibilities

• Develop optimization and fuzzing methods for LLM systems.
• Implement automated evaluation models and systems.

Skills

Machine Learning

Data-efficient alignment

Dynamic testing

Observability

Anomaly detection

Discrete optimization

Active learning

Reinforcement learning

Education

PhD in Machine Learning or related field

First-author publications in top-tier ML venues

Job description

Haize Labs gets LLM apps out of POCs and into production. We eliminate the risk and improve the reliability of LLM apps byhaizingthem -- i.e. rigorously, proactively, and continuously fuzz-testing them.

We are looking for Research Engineers to help develop our reliability platform, with a focus on:

• Data-efficient alignment of evaluation models
• Dynamic testing of AI applications
• Observability and anomaly detection
• Discrete optimization (with applications in architecture search and automated prompting)

Our work is both intellectually stimulating and practically in high demand. Your work will result in net-new primitives, frameworks, and algorithms for developing robust LLM applications. You work will directly influence how LLM apps are tested, verified, and deployed everywhere. You will directly influence how the world responsibly uses LLMs.

Responsibilities

• Develop optimization, synthetic data generation, and fuzzing methods for breaking LLM systems.
• Implement complex automated evaluation models and systems.
• Go from research idea to code within hours; and iterate quickly on experiments and data.
• Work directly with customers to adapt our tools for different domains.

Qualifications

• First-author publications in top-tier ML venues (NeurIPS, ICML, ICLR, and others).
• Bias for action & experimentation over philosophizing (though sometimes good).
• Not interested in printing papers for papers' sake.
• Some production engineering experience (e.g. ML in an applied setting). No spaghetti research code!
• Some familiarity with ideas from active learning, weak supervision, synthetic data, functional verification, reinforcement learning, reward modeling, automated evaluation. A subset of this is fine.

$150,000 – $600,000 USD

Logistics

• Location policy: In NYC.
• US visa sponsorship: If you are exceptional, we will sponsor.
• Compensation and Benefits: We provide generous salary, equity, and benefits

We're Not Here to Play Games.

We're not here to write GPT wrappers or get rich quick off the AI bubble. We're here to solve the hardest problem in AI: making it safe, reliable, and production-ready.

Since our company's inception in 2024, we've amassed amazing customers like OpenAI, Anthropic, AI21, and several others. We've developed best-in-class tooling for evaluation, dynamic testing, red-teaming, observability, and continuous robustification. And we’re backed + advised by the founders of Cognition, Hugging Face, Weights and Biases, Nous, Etched, Okta, Replit and C-suite execs from Google, Stripe, Databricks, Robinhood, and more.

Our core team is exceptionally fit for this mission. We turned down Stanford PhDs, got into & rejected Y Combinator, wrote ML-guided matchmaking for 50,000+ students, built an educational nonprofit supporting 60 countries, and did some other cool things along the way. Our early hires include an MIT PhD with 21,000+ Physics/ML/Stats citations, a Datadog engineering manager who led their GenAI observability team, a Citadel quant with a huge open-source presence, and more.

We can only serve our mission with an incredibly high talent-density team. Come here to push yourself, learn fast, experience excellence, grow with each other, and pursue your life's work.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf