Software Engineer - LLM Tooling & Stateful Systems (Remote)

LM Studio; New York (NY); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Competitive salary

Equity grants

Medical healthcare

Vision healthcare

Dental healthcare

Catered team lunch

Expensed dinners

Flexible PTO

Flexible WFH

Job summary

LM Studio in New York is seeking a seasoned software engineer to build and optimize an agent harness for open models. You will enable interactions with codebases, files and software tools, and advance conversation handling.

You will design repeatable evaluations to improve reliability across local and cloud environments, leveraging strong TypeScript fundamentals and advanced tool-calling capabilities.

Qualifications

• Significant experience building production software with language models, developer tools, or automation.
• Strong TypeScript fundamentals and deep understanding of tool calling and stateful system design.
• Experience with evaluating agent performance and reliability across environments.

Responsibilities

• Build and optimize the agent harness for Bionic to enable open models to interact with codebases, files, and software tools.
• Manage conversation history and develop repeatable evaluations to improve agent reliability across local and cloud environments.

Skills

TypeScript

Language Models

Tool Calling

Structured Model Output

Context Construction

Streaming Inference

Stateful Systems

Software Engineering

Developer Tools

Automation

Git

Shell

Evaluation Frameworks

Diagnostics

Job description

LM Studio in New York is seeking a seasoned software engineer to build and optimize an agent harness for open models. You will enable interactions with codebases, files and software tools, and advance conversation handling.

You will design repeatable evaluations to improve reliability across local and cloud environments, leveraging strong TypeScript fundamentals and advanced tool-calling capabilities.