Turn this role into an interview — a resume and cover letter built around what this employer wants.
Luxoft is seeking an expert-level engineer to design and build LLM applications and agent workflows on Azure OpenAI, setting GenAI engineering standards for the account. The role focuses on RAG pipelines, multi-agent orchestration, MCP tool integration, evaluation, guardrails and cost control, with accountability for solution quality against defined evaluation thresholds.
Strong Python, LangGraph/LangChain/Semantic Kernel expertise is required, with mentoring responsibilities and collaboration
Expert-level engineer designing and building LLM applications and agentic workflows on Azure: RAG pipelines, multi-agent orchestration, MCP tool integration, evaluation, guardrails and cost control. Sets the GenAI engineering standards for the account and is accountable for solution quality against agreed evaluation thresholds.
Build LLM applications and agent workflows with LangGraph / LangChain / Semantic Kernel on Azure OpenAI (AWS Bedrock / GCP Vertex a plus).
Design RAG pipelines: document ingestion, chunking strategies, embeddings, vector search (Azure AI Search, FAISS, Pinecone), hybrid retrieval and re-ranking.
Integrate enterprise tools and context via Model Context Protocol (MCP) servers and function / tool calling; design multi-agent systems.
Engineer, version and test prompts; run offline and online evaluations (accuracy, grounding, hallucination rate) and fine-tuning where justified.
Implement responsible-AI guardrails (content filters, PII redaction, policy checks) and LLM observability (tracing, token accounting, latency).
Optimise token and inference cost (model routing, caching, batching); report against cost budgets.
Document prompts, evaluation results and model choices; mentor engineers adopting GenAI patterns.