AI Enterprise Engineer

bespokelabs; Mountain View (CA); On-site; USD 90,000 - 130,000; Full time

Job summary

bespokelabs in Mountain View, California is seeking an AI Enterprise Engineer to engage with Enterprise customers. This role involves defining model specifications, benchmarking models, and enhancing performance through cutting-edge techniques.

The ideal candidate should have experience in Python and machine learning, alongside a strong educational background in computer science or electrical engineering. Candidates with research interests and publications in top AI conferences are highly encouraged to apply. Bespoke Labs is committed to innovation and practical execution in AI.

Qualifications

• Experience in Python and machine learning product development.
• Strong foundation in computer science or electrical engineering.
• Experience in model evaluation, training, and production deployment.
• Interest in research and publication in top AI venues.

Responsibilities

• Work with enterprise customers to own strategy and execution.
• Define model and agent specifications based on user needs.
• Benchmark models and create datasets using Bespoke Labs tools.
• Improve model performance through context optimization and RL techniques.

Skills

Python programming

Machine Learning

Model evaluation

Fine-tuning models

Education

MS/PhD in Computer Science or Electrical Engineering

Job description

Bespoke Labs

Bespoke Labs is an applied AI research lab pioneering data and RL environment curation for training and evaluating agents.

Recently, we curated Open Thoughts, one of the best open reasoning datasets used by multiple frontier labs, trained SOTA specialized models such as Bespoke-MiniChart-7B and Bespoke-MiniCheck, and taught agents to do multi-turn tool-calling with reinforcement learning.

We are also core contributors to Terminal-bench, a leading benchmark for agents used by most frontier labs. Bespoke Labs creates RL environments for frontier labs and specialized agents for enterprises.

The Role

We are looking for AI Enterprise Engineers who are able to work directly with our Enterprise customers, owning strategy and execution. Your work will involve defining model and agent specifications, understanding user pain points and designing specialized agents.

You will benchmark models and create datasets for customer needs using Bespoke Labs tools. Further, the role requires improving model performance by context optimization, and post-training techniques like SFT and RL. Bespoke Labs contributes to core research in this space (e.g. see the latest prompt optimization techniques like GEPA). You will be able to learn and innovate on advanced recent AI techniques.

AI engineers combine research intuition with practical execution. You will need to understand agent behavior, identify reward hacking and analyze failure modes. Then, you will translate that understanding into enterprise deployed specialized agents.

Qualifications

1. Experience in Python and ML product development.
2. Strong CS or ECE Background, MS/PhD degree preferred.
3. Demonstrated experience of ML and AI fundamentals, including model evaluation, training and fine-tuning.
4. Experience on deploying models in production.

Research

Bespoke Labs is committed to research and publication. The ideal candidate is interested in research and publication. Experience and publications in Top AI venues (NeurIPS, ICML, ICLR) is a plus and continuing research curiosity is desired.