Azure AI Engineer: Enterprise LLM & Retrieval Architect

Madison-Davis, LLC; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Madison-Davis, LLC is seeking an Azure AI Engineer to design and deliver production-grade AI services across enterprise data, integrating Python applications with Azure data and ML platforms. You will own architecture, implementation, deployment, and ongoing operations of AI workloads in a professional-services setting.

The role focuses on building Azure-based LLMs, RAG solutions, and scalable retrieval pipelines using Databricks, LangChain, and governance practices, with cross-team

Qualifications

• Proven production Azure LLM application and RAG delivery.
• Strong Python software engineering.
• Azure AI Foundry and Azure Machine Learning/ML Studio experience.
• Azure Databricks and data-engineering experience.
• AKS or comparable Kubernetes deployment experience.
• LangChain, LangGraph, or DSPy experience.
• SQL, REST API integration, and Git.
• Azure Purview or comparable governance experience.
• Structured and unstructured data processing and production application support.
• Independent execution, cross-team collaboration, and Eastern Time availability.

Responsibilities

• Build and deploy Azure-based LLM applications and RAG solutions.
• Develop Python services and connect enterprise APIs, databases, and documents.
• Build AI capabilities using Azure and Databricks.
• Prepare structured and unstructured information for retrieval workflows.
• Deploy and maintain workloads using Azure Machine Learning and Kubernetes.
• Improve retrieval quality, evaluation, reliability, and scalability.
• Strengthen deployment automation, monitoring, security, and governance.
• Collaborate with data and platform teams on enterprise AI architecture.

Skills

Azure LLM

Python development

Azure ML/ML Studio

Azure Databricks

Kubernetes (AKS)

LangChain / LangGraph / DSPy

REST API integration

SQL

Git

Governance & security

Tools

Azure Databricks

AKS / Kubernetes

Git

REST API tooling

Azure Purview

Job description

Madison-Davis, LLC is seeking an Azure AI Engineer to design and deliver production-grade AI services across enterprise data, integrating Python applications with Azure data and ML platforms. You will own architecture, implementation, deployment, and ongoing operations of AI workloads in a professional-services setting.

The role focuses on building Azure-based LLMs, RAG solutions, and scalable retrieval pipelines using Databricks, LangChain, and governance practices, with cross-team