LLM Application Engineer, Artificial Intelligence (AI) Required, Work From Home - M

Next Step Systems; United States; Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental plan

Vision plan

Savings plan

Paid time off

Job summary

Next Step Systems is seeking an LLM Application Engineer to build AI-powered applications and agent workflows from home. You will work at the intersection of LLMs, software engineering, and product design to improve model behavior and deliver reliable user experiences.

This 100% remote role requires hands-on experience with LLMs, prompts, and orchestration systems, plus strong coding skills in Python. You will collaborate with product and engineering teams, implement observability, and optimize

Qualifications

• AI experience required.
• Strong software engineering fundamentals with AI experience.
• Hands-on with LLMs, generative AI, or agent systems.
• Experience designing prompts, workflows, or AI behavior.
• Write clean, production-quality code.
• Able to work across model to system to product layers.
• Strong problem-solving in ambiguous, fast-moving environments.
• Bias toward shipping, iteration and continuous improvement.
• Tech stack includes Python, LLM APIs, agent frameworks, vector DBs, PyTorch/JAX.

Responsibilities

• Build and ship LLM-powered applications and AI agent workflows.
• Design systems for reasoning, planning, memory, tool use and multi-step execution.
• Build reliable orchestration pipelines turning model outputs into safe actions.
• Integrate LLMs with APIs, databases, search, internal services, and tools.
• Develop prompting, contexts, outputs, tool-calling.
• Build evaluation frameworks and datasets to measure AI quality.
• Debug AI systems across the stack from model to UX.
• Optimize AI systems for quality, latency, and cost.
• Collaborate with product and engineering to turn problems into AI solutions.
• Establish production practices for observability, experimentation, and improvement.

Skills

AI experience

Software engineering

Production code

Prompt design

System thinking

Problem solving

Shipping mindset

LLM APIs

ML frameworks

Tools

OpenAI-compatible APIs

Agent frameworks

Orchestration systems

Vector databases

Retrieval systems

Python

PyTorch/JAX

Job description

LLM Application Engineer, Artificial Intelligence (AI) Required, Work From Home

As an LLM Application Engineer, you will build the intelligence layer that powers the AI experiences. You will work at the intersection of Large Language Models (LLMs), software engineering, and product designing agent workflows, improving model behavior, and turning Artificial Intelligence (AI) capabilities into reliable user experiences. You will own problems end-to-end, from understanding user needs, designing Agentic workflows, integrating models and tools, building evaluation systems and continuously improving AI behavior in production. ++This position is 100% Remote.++

++MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT.++

LLM Application Engineer Responsibilities:

• Build and ship LLM-powered applications and AI agent workflows.
• Design systems for reasoning, planning, memory, tool use and multi-step execution.
• Build reliable orchestration pipelines that turn probabilistic model outputs into predictable, observable, and safe actions.
• Integrate Large Language Models (LLMs) with APIs, databases, search, internal services, and external tools.
• Develop prompting, context engineering, structured outputs, tool-calling, and other techniques to improve model behavior.
• Build evaluation frameworks and datasets to measure AI quality, reliability, and regressions.
• Debug AI systems across the entire stack from model behavior and prompts to orchestration, backend services, and product UX.
• Optimize AI systems for quality, latency, and cost.
• Work closely with product and engineering teams to turn ambiguous product problems into working AI solutions.
• Establish production practices for observability, tracing, experimentation, evaluation, and continuous improvement.

LLM Application Engineer Outcomes:

• Artificial Intelligence (AI) features reach production quickly and deliver measurable user impact.
• LLM-powered workflows are reliable, scalable, observable, and maintainable.
• Artificial Intelligence (AI) quality improves through systematic evaluation, experimentation, and iteration.
• Artificial Intelligence (AI) workflows become increasingly predictable, efficient, and cost-effective.
• Complex AI capabilities are translated into simple, intuitive user experiences.

LLM Application Engineer Qualifications:

• Artificial Intelligence (AI) experience required.
• Strong software engineering fundamentals with experience building AI-powered applications.
• Hands-on experience with Large Language Models (LLMs), generative AI, or agent-based systems.
• Experience designing prompts, workflows, evaluations, or AI behavior.
• Ability to write clean, production-quality code.
• Comfortable working across abstraction layers from model to system to product.
• Strong problem-solving skills in ambiguous, fast-moving environments.
• Bias toward shipping, iteration, and continuous improvement.
• Tech Stack: Python, LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models, Agent frameworks and orchestration systems, Vector databases and retrieval systems, Backend services, APIs, and distributed systems, and PyTorch / JAX.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords: San Francisco CA Jobs, Agent Frameworks, AI, Artificial Intelligence, AI Agent Workflows, APIs, Application Engineer, Backend, Databases, Distributed Systems, JAX, LLM, Large Language Model, LLM APIs, OpenAI-Compatible APIs, Orchestration Systems, Python, PyTorch, UX, User Experience, Vector Databases, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting