Applied AI Engineer

Titan AI; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

Remote work (US)

Travel to client sites occasionally

Job summary

Titan AI is seeking a software engineer with 5+ years of software experience and at least 2 years building and operating production AI systems. You will own agent workflows, RAG pipelines, and LLM integration layers, delivering reliable AI solutions for banking tasks.

Strong Python fundamentals, experience with LangChain/LangGraph, and vector databases are required. The role is remote within the US, with occasional travel to client sites.

Qualifications

• 5+ years software engineering; 2+ years building and shipping production agentic AI or RAG systems.
• Agent framework experience: LangChain, LangGraph, PydanticAI, AutoGen, or Semantic Kernel.
• RAG stack proficiency: embedding models, vector DBs (Pinecone, Weaviate, Milvus, FAISS), hybrid search, retrieval evaluation.
• LLM integration depth: tool calling, structured outputs, multi‑step reasoning, behavioral regression testing.
• AI eval and observability tooling: LangSmith, RAGAS, DeepEval, Arize, Langfuse, or equivalent.
• REST APIs, async Python, microservices; Azure cloud experience preferred.

Responsibilities

• Own production AI systems across agent workflows, retrieval pipelines, and LLM integration layers.
• Develop and maintain RAG pipelines for banking documents and workflows.
• Ensure reliable, auditable inference with production monitoring and observability.
• Build backend services and APIs powering client-facing AI products with bank-grade uptime.

Skills

Python

Async APIs

LangChain

LangGraph

RAG pipelines

LLM integration

Observability tooling

Tools

Pinecone

Weaviate

Milvus

FAISS

LangSmith

Langfuse

Arize

Job description

About Titan

Titan builds AI software for banks: purpose-built small language models, a banking ontology, and AI bankers that financial institutions can trust. Our models outperform general‑purpose LLMs by 30 to 80 percent on banking tasks. We operate under the compliance, audit, and model‑risk standards that banking requires.

Why This Role Exists

Titan is growing from a handful of live banking customers to thirty, then to hundreds. This role sits across the AI Toolbelt and Product Engineering lanes, owning the production AI systems that bank employees use every day — agent workflows, retrieval pipelines, and LLM integration layers. We bring a problem and expect a working solution.

What You Own

• Agent orchestration frameworks for multi‑step reasoning, tool use, and constraint‑based problem solving across banking workflows
• RAG pipelines covering embedding generation, chunking, hybrid retrieval, and retrieval evaluation, calibrated for banking document types
• LLM integration layers connecting banking models, APIs, and knowledge bases into reliable, auditable inference workflows
• Evaluation infrastructure including behavioral contracts, regression baselines, and production observability for non‑deterministic AI outputs
• Backend services and APIs powering client‑facing AI products at bank‑tier uptime requirements

Who You Are

Background in software engineering with at least five years of experience, the last two spent building and operating production AI systems. Shipped agentic workflows, RAG pipelines, or LLM‑powered applications to real users. Strong Python fundamentals across APIs and async systems, which is the foundation the AI work sits on. Comfortable picking the practical solution over the clever one.

Fluent in LangChain, LangGraph, PydanticAI, or AutoGen, with hands‑on experience with vector databases, retrieval evaluation, and observability tooling such as LangSmith, RAGAS, Arize, or Langfuse. Prior fintech or banking experience is a genuine advantage, not a checkbox.

Required Qualifications

• 5+ years software engineering; 2+ years building and shipping production agentic AI or RAG systems
• Agent framework experience: LangChain, LangGraph, PydanticAI, AutoGen, or Semantic Kernel
• RAG stack proficiency: embedding models, vector DBs (Pinecone, Weaviate, Milvus, FAISS), hybrid search, retrieval evaluation
• LLM integration depth: tool calling, structured outputs, multi‑step reasoning, behavioral regression testing
• AI eval and observability tooling: LangSmith, RAGAS, DeepEval, Arize, Langfuse, or equivalent
• REST APIs, async Python, microservices; Azure cloud experience preferred

Strongly Preferred

• Fintech, banking, or regulated industry experience
• Graph databases (Neo4j, ArangoDB, Dgraph) and MCP / connector architecture
• Multi‑agent or planner‑based AI architectures
• Multi‑tenant SaaS with auditability and compliance requirements

What Success Looks Like

Within 90 days, ownership of at least one production AI workflow end to end with measurable improvements shipped to the retrieval or agent layer. Within six months, the go‑to person on the team for hard agent and retrieval problems, operating independently from a high‑level brief through to recommendation and implementation. At one year, a senior anchor on the AI engineering function with a track record of pulling others up and a credible path to leading other AI Engineers.

Compensation and Structure

• Competitive base and meaningful equity.
• Remote (US). Occasional travel to client sites and team offsites.