GenAI Architect

Look4IT; United States; Remote; USD 140,000 - 220,000; Full time

Job summary

Look4IT is hiring a Senior AI Engineer to build and operate a production-grade LLM system used by real users. You will take LLM-powered features from idea to deployment, focusing on answer quality, performance, observability, and cost efficiency.

You will work with LangGraph, RAG, tool calling, and Azure OpenAI, Gemini and Claude, delivering end-to-end solutions in a cloud environment. This is a remote, production-focused role with significant impact.

Qualifications

• : Experience in building and operating backend services – APIs, async, testing.
• : Hands-on experience taking LLM features to production and keeping them running – not just prototypes.
• : Knowledge of agent/orchestration frameworks — LangGraph ideally.
• : Practical RAG experience.
• : Experience debugging LLM systems in production – tracing, evaluation, cost and latency.
• : Experience running services in the cloud (Azure).
• : Strong problem-solving skills, analytical thinking, and technical decision-making.
• : Fluent in English, proactive communicator, and a collaborative team player.

Responsibilities

• : Build LLM-powered features end to end. Design and implement agentic flows, retrieval, and tool calling using LangGraph – then ship them as FastAPI services with streaming, persistence and proper tests.
• : Own answer quality. Build evaluation datasets, regression suites and LLM-as-judge checks so changes don’t regress user experience.
• : Get the right context to the model by querying our search platform, orchestrating multi-step research loops and shaping context.
• : Debug production: instrument flows with tracing, manage latency and cost budgets, and route across model sizes behind an AI gateway.

Skills

Backend APIs

Async programming

Testing

Production LLM experience

Problem solving

Analytical thinking

Team collaboration

Tools

LangGraph

Azure OpenAI

FAISS

PostgreSQL

Langfuse

Azure App Insights

Bicep

Docker

FastAPI

Job description

This is a remote position. We are looking for a Senior AI Engineer to join a team building and operating a production-grade LLM system used by real users. This is not a proof-of-concept project. You will be responsible for taking LLM-powered features from idea through development and deployment to continuous improvement, with a strong focus on answer quality, performance, observability and cost efficiency. You will work with modern LLM technologies, including LangGraph, RAG, tool calling, Azure OpenAI, Gemini and Claude, and have a real impact on how AI-powered products are built and operated in production.

Responsibilities

• Build LLM-powered features end to end. Design and implement agentic flows, retrieval, and tool calling using LangGraph - then ship them as FastAPI services with streaming, persistence and proper tests.
• Own answer quality. Build evaluation datasets, regression suites and LLM-as-judge checks so we know whether a prompt or model change made things better before it reaches users.
• Get the right context to the model. Turn user questions into effective queries against our search platform, orchestrate multi-step research loops, and shape the context the model reasons over. When an answer is wrong, work out whether retrieval, the query or the prompt is at fault - and fix the right one.
• Debug production. Instrument flows with tracing (Langfuse), investigate bad answers from real traces, and manage latency, token and cost budgets - including routing across model sizes and families behind an AI gateway.

Requirements

• Experience in building and operating backend services - APIs, async, testing.
• Hands-on experience taking LLM features to production and keeping them running - not only prototypes.
• Agent / orchestration frameworks - LangGraph ideally.
• Practical RAG experience.
• Experience debugging LLM systems in production - tracing, evaluation, cost and latency.
• Experience running services in the cloud (we're on Azure).
• Strong problem-solving skills, analytical thinking, and technical decision-making.
• Fluent in English, proactive communicator, and a collaborative team player.
• Open mind, creative, and motivated to push boundaries in AI and automation.

Nice to have

• Azure OpenAI, AI Search, App Service.
• Infrastructure-as-code (Bicep).
• Mentoring or tech-lead experience.

Tech stack

• Python
• FastAPI
• LangGraph
• Azure OpenAI, Google Gemini, Anthropic Claude
• FAISS
• PostgreSQL
• Langfuse
• Azure App Insights
• Bicep
• Docker/Podman