Applied AI Engineer

AItoolnavio

United States

Remote

USD 140,000 - 190,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote
Long-term role
Exposure to advanced LLM applications

Job summary

AItoolnavio is seeking an Applied AI Engineer based in the United States to design, build, and test intelligent conversational experiences and AI agents for learner-focused products. You will work across advisory tools, simulations, and coaching experiences, delivering reliable AI behavior from prototyping to production and ongoing monitoring.

You will collaborate with Product, Engineering, Content Studios, and subject-matter experts to ensure safe, accurate interactions while supporting

Qualifications

  • Expert-level prompt and context engineering, with system prompts and routing.
  • Structured outputs, JSON Schema, function calling, validation layers.
  • Experience with RAG architecture, chunking, and citation grounding.
  • Token budget management, context memory, and prompt caching.
  • Knowledge of agentic systems, tool schemas, and multi-agent orchestration.

Responsibilities

  • Translate complex learning scenarios into robust AI workflows.
  • Define interactions between AI models and apps including data sources and APIs.
  • Design prompts, outputs, and validation to prevent invalid learner responses.
  • Build conversational runtimes with controlled personas and state transitions.
  • Implement RAG and grounding from approved knowledge sources.

Skills

Prompt engineering
Agentic systems
AI safety & privacy
Cross-functional collaboration
Communication

Tools

JSON Schema
Function calling
API integrations
Git (Bitbucket)
Python
TypeScript

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Applied AI Engineer based in United States.

We are looking for an Applied AI Engineer to design, build, and test intelligent conversational experiences and AI agents embedded in learner-facing products. You will transform product and instructional requirements into reliable AI behavior across advisory tools, practice simulations, and diagnostic coaching experiences. Working closely with Product, Engineering, Content Studios, and subject-matter experts, you will help ensure AI systems deliver accurate, consistent, and safe interactions. Your work will cover the full development lifecycle, from prompt design and prototyping to evaluation, production deployment, and ongoing monitoring. You will also contribute to the technical safeguards needed to support privacy, human oversight, and accreditation requirements. This is a fully remote, long-term opportunity within an Agile-oriented environment focused on developing innovative learning technologies for regulated professional industries.

Accountabilities:

As an Applied AI Engineer, you will translate complex learning scenarios and product requirements into robust AI workflows. You will take ownership of conversational behavior, integration architecture, testing, and production readiness while collaborating with cross-functional teams to ensure that AI-powered experiences remain reliable and aligned with their intended purpose.

  • Translate scenario specifications, decision models, and assessment rubrics into prompts, application logic, and testable AI behaviors.
  • Identify missing requirements, technical constraints, and potential risks, escalating them to Product, Engineering, and subject-matter experts.
  • Define how AI models interact with application services and approved data sources, including APIs, tools, data structures, validation rules, error handling, and permitted actions.
  • Design system prompts, structured outputs, and validation mechanisms to detect and prevent invalid responses from reaching learners.
  • Build conversational runtimes with controlled personas, session state, and clearly defined state transitions.
  • Separate simulation behavior, assessment logic, and feedback mechanisms to ensure that feedback does not influence assessment outcomes.
  • Implement retrieval-augmented generation (RAG) and grounding from approved knowledge sources, including source references where required.
  • Maintain version control and documentation for code, prompts, schemas, and evaluation assets.
  • Run structured experiments with Product teams, defining clear objectives and measurable success criteria.
  • Move validated prototypes into production in collaboration with Engineering and verify that deployed behavior remains consistent.
  • Contribute to technical controls supporting accreditation and compliance requirements, including issue flagging, review workflows, disclosures, and logging.
  • Monitor and evaluate AI performance, identifying opportunities to improve quality, reliability, security, and efficiency.
Requirements:

The ideal candidate has hands-on experience developing LLM-powered applications and multi-step conversational workflows. You combine strong technical expertise in prompt engineering, agentic systems, retrieval, and evaluation with sound judgment around AI safety, privacy, and human oversight. You are comfortable collaborating with both technical and non-technical stakeholders and can communicate complex trade-offs clearly.

  • Expert-level prompt and context engineering, including system prompts, few-shot examples, prompt chaining, routing, and breaking complex tasks into manageable steps.
  • Strong experience with structured outputs, JSON Schema, function calling, validation layers, and retry and fallback mechanisms.
  • Practical knowledge of RAG architecture, including chunking, metadata filtering, hybrid search, reranking, and citation grounding.
  • Experience managing token budgets, prompt caching, context compaction, and long-session memory.
  • Expertise in agentic systems, including tool use, planner/executor patterns, multi-agent orchestration, state machines, and human-in-the-loop checkpoints.
  • Ability to define tool schemas, permission scopes, and action limits for AI agents.
  • Experience with AI evaluation methods such as golden datasets, rubric-based scoring, LLM-as-judge calibrated against human reviewers, and regression testing.
  • Familiarity with LLM observability, tracing, and performance monitoring.
  • Strong understanding of LLM security risks, including prompt injection, data leakage, jailbreaks, unsafe tool actions, and guardrails.
  • Ability to compare prompting, retrieval, and model options based on quality, latency, and cost.
  • Proficiency in Python or TypeScript, including API integrations and automated testing.
  • Experience with Git-based version control (such as Bitbucket), reproducible tests, and continuous integration.
  • Comfortable using AI coding agents as part of your standard development workflow.
  • Strong communication skills, with the ability to explain technical decisions and trade-offs to non-technical colleagues.
  • Sound judgment regarding privacy, human oversight, and the limitations of AI-generated assessments or advice.
  • Demonstrated experience building LLM applications with multi-step conversational workflows.
  • Experience collaborating with subject-matter experts to translate domain knowledge into effective AI behavior.
Preferred Qualifications:
  • Background in learning technology products, professional assessment, conversational simulations, or regulated industry content.
Benefits:
  • Fully remote working arrangement.
  • Long-term professional opportunity.
  • Opportunity to build and improve AI-powered learning experiences used in regulated professional industries.
  • Collaborative, Agile-oriented environment with cross-functional teams.
  • Exposure to advanced LLM applications, conversational agents, and applied AI development challenges.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied AI Engineer
Applied AI Engineer

Our client • United States

Remote
USD 140,000 - 200,000
Remote | AI/ML Engineer, Internal Platforms — $220,000–$300,000/year
Remote | AI/ML Engineer, Internal Platforms — $220,000–$300,000/year

24-Mag Llc • New York (NY)

Remote
USD 220,000 - 300,000
AI Agents Applied Engineer - Senior Associate
AI Agents Applied Engineer - Senior Associate

Testing Site - JPMC • New York (NY)

On-site
USD 160,000 - 240,000
Principal Engineer - Context Engineering & LLM Optimization
Principal Engineer - Context Engineering & LLM Optimization

HITEC • Charlotte (NC)

On-site
USD 130,000 - 160,000
AI Developer
AI Developer

remoting.work • United States

Remote
USD 150,000 - 190,000
AI Engineer, Multimodal LLMs
AI Engineer, Multimodal LLMs

Latitude • San Francisco (CA)

On-site
USD 140,000 - 200,000
Lead AI Engineer 2026 - US, COL, UK
Lead AI Engineer 2026 - US, COL, UK

Aimpoint Digital • Atlanta (GA)

Remote
USD 120,000 - 190,000
AI LLM Engineer - Remote in EMEA
AI LLM Engineer - Remote in EMEA

Workster Jobs • United States

Remote
USD 120,000 - 190,000
Remote EMEA region focus
Cross-team collaboration
Impactful AI product development
+1
Generative AI Engineer
Generative AI Engineer

TRUSYS, Inc. • Dallas (TX)

On-site
USD 120,000 - 170,000
AI Engineer – Generative AI & Agentic AI
AI Engineer – Generative AI & Agentic AI

KData AI • United States

Remote
USD 120,000 - 180,000