AI Agent Engineer: Build LLM Tools & RAG Pipelines

Appnovation Technologies; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Appnovation Technologies in New York seeks an experienced AI / Agent Engineer to build and evolve the agentic layer of our platform, crafting MCP servers, tools, and graph-RAG pipelines that make documents intelligible to multiple LLMs.

You will collaborate with product, data, and QA in an agile environment to raise answer quality and grounding, while writing clean, production-grade code and staying current with AI tooling trends.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or equivalent
• 5+ years of software engineering experience, 2+ years in AI/ML or LLM-based apps
• Strong Python proficiency and experience in LLM app development
• Direct experience building MCP servers, tools and skills
• Experience with RAG and graph-RAG systems, vector databases and embeddings
• Familiarity with graph stores (Neo4j) and Postgres/Supabase graph implementations
• Comfort working with multiple LLM providers (e.g., Claude, Gemini)
• Solid software engineering fundamentals: Git, testing, CI/CD
• Strong problem-solving and communication skills, ability to work independently in ambiguity

Responsibilities

• Build and evolve MCP servers, tools, and skills for LLM exposure
• Design and refine graph-RAG pipelines transforming documents into agent-friendly representations
• Implement retrieval across source documents, vector-RAG and dense graph
• Collaborate with QA on eval-driven improvements for grounding and accuracy
• Write clean, production-grade code and participate in code reviews
• Work with product, data and QA in an agile/sprint environment
• Document designs, prompts and tool interfaces for maintainability
• Monitor deployed agents/models and iterate on performance
• Stay updated with fast-moving LLM/agent tooling landscape

Skills

Python

LLM development

MCP servers

Graph-RAG

Vector databases

Neo4j

CI/CD

Testing

Git

Communication

Education

Bachelor's degree in CS or related field

Tools

Neo4j

Postgres/Supabase

Job description

Appnovation Technologies in New York seeks an experienced AI / Agent Engineer to build and evolve the agentic layer of our platform, crafting MCP servers, tools, and graph-RAG pipelines that make documents intelligible to multiple LLMs.

You will collaborate with product, data, and QA in an agile environment to raise answer quality and grounding, while writing clean, production-grade code and staying current with AI tooling trends.