Azure Full-Stack AI Engineer – Agentic Solutions

Xlysi LLC.; Chicago (IL); On-site; USD 140,000 - 190,000; Full time

Job summary

Agentic Solutions in Chicago, IL, is seeking a Full-Stack AI Engineer with 6+ years of software engineering experience and 2+ years building LLM or agent solutions. You will build and deploy agentic systems, leverage coding agents for code, tests and docs, and own the delivered result.

You will work on data retrieval, document intelligence, vector search, and context engineering within Azure Foundry/Copilot Studio ecosystems; collaborate in Agile fashion and ship CI/CD-enabled software.

Qualifications

• 6+ years in software engineering, including 2+ years building LLM or agent solutions.
• Strong full-stack engineering in Python and/or C#/.NET, plus API and integration development.
• Hands-on delivery of LLM or agent applications: prompt design, function and tool calling, RAG and workflow orchestration.

Responsibilities

• Build, evaluate and deploy agentic solutions from an approved spec, using coding agents for most code, tests and documentation.
• Direct the agents, check their output and own the result.
• Deliver working software that is instrumented, evaluated, and ready for the business to accept.
• Implement agents on Copilot Studio, Azure AI Foundry Agents or Microsoft Agent Framework, including prompts, tools, connectors, workflows and integrations.
• Build the data and retrieval layer, document extraction pipelines with Azure AI Document Intelligence, including validation and confidence handling.
• Chunking, embedding, indexing and hybrid search in a vector store such as Azure AI Search.
• Calls to decision and rules APIs, with the LLM handling interpretation and drafting only.
• Apply context engineering: write and version prompts and instructions, manage context windows, memory and tool results.
• Handle LLM calls reliably: structured outputs, retries, fallbacks, caching and rate limits.
• Build evaluation sets and run evals on every release: automated metrics, LLM-as-judge and human review samples.
• Instrument every agent with OpenTelemetry. Build traces, dashboards and alerts for latency, token use, cost, errors and quality.
• Run A/B tests as the architect designs them: variant routing, metric capture and result readouts.
• Deploy through CI/CD, compile release evidence for go/no-go, and support the business through validation and handover.

Skills

Full-stack Python/C#/.NET

LLM/agent apps

Azure Copilot/Foundry

Document Intelligence

Vector store/search

Context engineering

OpenTelemetry

A/B testing/feature flags

AI coding agents

CI/CD & Git

Agile collaboration

Azure fundamentals

Clear business communication

Azure AI Certifications

Tools

Azure AI Foundry

Copilot Studio

Microsoft Agent Framework

Job description

Agentic Solutions in Chicago, IL, is seeking a Full-Stack AI Engineer with 6+ years of software engineering experience and 2+ years building LLM or agent solutions. You will build and deploy agentic systems, leverage coding agents for code, tests and docs, and own the delivered result.

You will work on data retrieval, document intelligence, vector search, and context engineering within Azure Foundry/Copilot Studio ecosystems; collaborate in Agile fashion and ship CI/CD-enabled software.