AI Software Engineer - Build LLM-Powered Features

Beyond Key; Michigan; On-site; USD 110,000 - 160,000; Full time

Job summary

Beyond Key in the United States is seeking a software engineer who builds full-stack product features in Node.js, Python, and Next.js, shipping AI capabilities inside them. You will own features end to end, from APIs and UI to the LLM calls, prompts, and evaluations behind them. You will work directly with the engineering team and report to the engineering lead.

This is a hands‑on individual contributor role. Development is the core of the job; prompt management is part of it.

Qualifications

• 3+ years of professional software development, shipping production features end to end.
• Strong Node.js and TypeScript; solid Python for services, scripts, and AI tooling.
• Production experience with Next.js and React.
• 1+ year building with LLM APIs (Anthropic, OpenAI, or similar) in a shipped product.
• Hands-on prompt work: dynamic prompt construction, templating, and runtime context injection, with prompts kept in version control.
• Experience testing AI output: golden sets, LLM-as-judge, or regression checks.

Responsibilities

• Build and ship features across the dashboard: backend services in Node.js and Python, frontend in Next.js and React.
• Design and maintain APIs, data models, and integrations for a multi-tenant, multi-role application.
• Build AI features on LLM APIs (Anthropic, OpenAI, or similar): tool calling, structured output, RAG, and agentic workflows.
• Design dynamic prompting that assembles context at request time: role, permissions, preferences, history, and tenant settings.
• Build and maintain prompt management in the codebase: a versioned prompt registry, templating, per-tenant and per-role variants, and rollback.
• Stand up evaluation and regression checks for AI features, so prompt and model changes ship with a measured result.
• Track cost, latency, and quality per feature and per model, and act when the numbers move.
• Own AI safety basics in your features: prompt-injection resistance, PII handling, and policy constraints across tenants.
• Write tests, review code, and keep CI/CD, observability, and documentation in good shape.

Skills

Node.js

TypeScript

Python

Next.js

React

LLM APIs

Prompt management

REST/GraphQL

Git

SQL/NoSQL

Tools

AWS

Langraph

Langfuse

Braintrust

PromptLayer

Helicone

Job description

Beyond Key in the United States is seeking a software engineer who builds full-stack product features in Node.js, Python, and Next.js, shipping AI capabilities inside them. You will own features end to end, from APIs and UI to the LLM calls, prompts, and evaluations behind them. You will work directly with the engineering team and report to the engineering lead.

This is a hands‑on individual contributor role. Development is the core of the job; prompt management is part of it.