Remote AI Engineer: LLM Applications for B2B SaaS

Itmates; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Itmates is seeking a mid-level software engineer to ship LLM-powered features for a B2B SaaS product. You will work with product engineers from prototype to production, designing and deploying retrieval-augmented generation pipelines, prompts, tools and evaluation sets.

The role emphasizes Python, LangChain/LlamaIndex or provider APIs, vector databases, API design and CI/CD, with advanced English required. Remote work with LATAM overlap and US Eastern hours is expected.

Qualifications

• 3+ years of software engineering, at least 1 building LLM applications in production.
• Strong Python; experience with an LLM framework or SDK (LangChain, LlamaIndex or direct provider APIs)
• Vector databases and embedding-based search, API design, testing and CI/CD habits

Responsibilities

• Build retrieval-augmented generation pipelines and agent workflows on top of commercial and open-source LLMs
• Write and version prompts, tools and evaluation sets
• Integrate AI features into the product's Python and TypeScript services
• Measure quality, latency and cost, and improve them release over release
• Add guardrails, logging and tracing for production use

Skills

Python

LLM applications

LangChain

Vector databases

API design

CI/CD

Advanced English

Tools

LangChain

LlamaIndex

Pinecone

Weaviate

Job description

Itmates is seeking a mid-level software engineer to ship LLM-powered features for a B2B SaaS product. You will work with product engineers from prototype to production, designing and deploying retrieval-augmented generation pipelines, prompts, tools and evaluation sets.

The role emphasizes Python, LangChain/LlamaIndex or provider APIs, vector databases, API design and CI/CD, with advanced English required. Remote work with LATAM overlap and US Eastern hours is expected.