LLM Application Engineer Mid · Full-time · Remote / Hybrid →

Thewebvale; Bhopal; Hybrid; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Remote-first approach

Bhopal studio on hybrid days

Direct work with founder and senior 팀

Job summary

TheWebVale is hiring an LLM Application Engineer to build production-grade applications powered by large language models. You will create AI customer support assistants, contract summarization portals, and workflow tools for legal firms and software teams, collaborating with frontend and backend teams in short delivery cycles.

You will ensure models adhere to business schemas, handle edge cases, and deliver low-latency streaming responses.

Qualifications

• 2–4 years of software development experience with LLM application work.
• Proficiency in Python or TypeScript with asynchronous programming.
• Hands-on experience with API tool-calling from OpenAI, Anthropic, or Gemini.
• Understanding of prompt formatting, system instructions, few-shot examples, and temperature tuning.
• Disciplined Git habits, unit testing, and clean code documentation.
• Ability to communicate constraints and mitigation strategies to client managers.

Responsibilities

• Develop production-grade software applications driven by LLMs.
• Implement function-calling tools to query client databases and APIs safely.
• Build streaming response handlers using Server-Sent Events for chat interfaces.
• Design Pydantic and Zod validation schemas to enforce strict JSON structures.
• Implement token budgeting and conversation truncation for long chats.
• Write automated tests to evaluate model reliability across inputs.

Skills

Python

TypeScript

OpenAI API

FastAPI

Vercel AI SDK

Pydantic

Git

REST APIs

Job description

You will engineer production applications around language models, implementing tool use, streaming interfaces, and validation schemas.

As an LLM Application Engineer at TheWebVale, you will build applications powered by large language models for client teams. You will develop AI customer support assistants, contract summarization portals, and intelligent workflow assistants for legal firms, coaching businesses, and software teams. You will work in close coordination with frontend developers and backend architects throughout our two-to-three week delivery cycles. You will ensure models adhere strictly to business schemas, handle edge cases gracefully, and stream responses with low latency.

LLM Application Engineer

• Python
• TypeScript
• OpenAI API
• FastAPI
• Vercel AI SDK
• Pydantic
• Git
• REST APIs

Responsibilities

Your day to day.

6 things, one at a time. Keep scrolling.

• Develop production-grade software applications driven by commercial and open-source LLMs.
• Implement function-calling tools that allow models to query client databases and APIs safely.
• Build streaming response handlers with Server-Sent Events for fluid chat interfaces.
• Design Pydantic and Zod validation schemas to enforce strict JSON structure from models.
• Implement token budgeting and conversation truncation algorithms for long chat threads.
• Write comprehensive automated tests to evaluate model reliability across diverse inputs.

Requirements

6 things, one at a time. Keep scrolling.

• Possess 2–4 years of software development experience with focused LLM application work.
• Demonstrate advanced proficiency in Python or TypeScript with asynchronous programming.
• Show extensive hands-on experience with OpenAI, Anthropic, or Gemini API tool-calling.
• Understand prompt formatting, system instructions, few-shot examples, and temperature tuning.
• Exhibit disciplined Git habits, unit testing practices, and clean code documentation.
• Communicate technical constraints and mitigation strategies clearly to client managers.

What you get

• Remote-first, with a Bhopal studio for hybrid days
• Real client products across many industries
• Direct work with the founder and senior team
• Learning and tooling support
• Your work featured in our public portfolio

How we hire

1. Intro chat

   A short call about what you want to work on and how you like to work.

2. Work review

   Walk us through projects, code or designs you are proud of.

3. Paid task

   A small paid task or pairing session, so both sides see the fit.