Lead Ai/Ml Engineer - R01572495

Brillio-2; United States; On-site; USD 150,000 - 230,000; Full time

Job summary

Brillio-2 is seeking a Lead AI/ML Engineer to design, build, and operationalize enterprise-scale AI platforms using Azure OpenAI, agentic frameworks, and vector search. You will develop production-grade AI agents, implement RAG pipelines, and ensure observability and governance in production environments.

The role requires expertise in Python, ML frameworks, and AI security on Azure, with a focus on scalable, secure deployments and cross-functional collaboration.

Qualifications

• Requires hands-on experience with Azure AI services and Azure OpenAI.
• Expertise in agentic frameworks (Semantic Kernel, LangChain, LangGraph, AutoGen).
• Proficient in LLM development, prompt engineering, and RAG architectures.
• Experience with vector search, semantic ranking, and Azure AI Search.
• Strong integration skills with Microsoft 365, Teams, SharePoint, Dynamics 365, Power Platform.
• Proficient in Python for AI/ML solutions.
• Experience with ML frameworks (TensorFlow, PyTorch, scikit-learn, Keras).
• Knowledge of AI security and governance on Azure.

Responsibilities

• Design, build, and deploy AI agents and multi-agent systems using Azure AI services.
• Develop agentic workflows integrating AI with Microsoft 365 and enterprise APIs.
• Implement enterprise RAG solutions for knowledge retrieval and decision-making.
• Build production-grade AI apps leveraging LLMs, RAG pipelines, and orchestration.
• Establish observability, guardrails, and responsible AI controls in production.
• Optimize latency, accuracy, reliability, and cost of AI/LLM applications.
• Collaborate with cross-functional teams to identify AI opportunities and prototype.
• Contribute to internal best practices on agent architecture, prompting, and evaluation.

Skills

Azure AI services

Agentic frameworks (Semantic Kernel, L

LLM development

RAG architectures

Python

ML frameworks (TensorFlow, PyTorch, Sc

AI workflow orchestration

Model evaluation & observability

AI security & governance on Azure

Microsoft 365 integration

Education

Bachelor's degree in Computer Science, Data Science, Statistics, Mathematics, or related field

Certification in Machine Learning or Data Science

Certification in SAS/SPSS or similar statistics tools

Tools

Azure Functions

Azure Container Apps

Azure Kubernetes Service (AKS)

Azure Storage

R

R Studio

Job description

Lead AI/ML Engineer

Job requirements

Experience Range: With at least 4 to 6 years of experience designing, building, and operationalizing enterprise-scale AI platforms, including hands-on expertise in agentic AI, LLMs, and Azure-based solutions. Key Responsibilities:

• Design, build, and deploy AI agents and multi-agent systems using Azure AI services, Azure OpenAI, and modern agentic frameworks such as Semantic Kernel, LangChain, LangGraph, and AutoGen.
• Develop and operationalize agentic workflows for business functions, integrating AI solutions with Microsoft 365, Teams, SharePoint, Dynamics 365, Power Platform, and enterprise APIs.
• Implement enterprise RAG solutions utilizing Azure AI Search, vector search, hybrid search, and semantic ranking to enhance knowledge retrieval and business decision-making.
• Build production-ready AI applications leveraging LLMs, RAG pipelines, tool/function calling, memory systems, and workflow orchestration for scalable, secure, and reliable enterprise deployment.
• Establish observability, guardrails, responsible AI controls, evaluation, security, and monitoring for AI applications in production environments.
• Optimize agent and LLM applications for latency, accuracy, reliability, scalability, security, and cost, applying advanced techniques and metrics.
• Collaborate with cross-functional teams to identify AI opportunities, rapidly prototype solutions, and iterate based on user feedback.
• Contribute to internal best practices around agent architecture, prompting, RAG, model selection, evaluation, and AI engineering standards.

Required Skills:

• Hands-on experience with Azure AI services, Azure OpenAI, and Azure AI Foundry
• Expertise in agentic frameworks (Semantic Kernel, LangChain, LangGraph, AutoGen)
• LLM application development and prompt engineering
• Enterprise RAG architectures and vector search technologies
• Integration with Microsoft 365, Teams, SharePoint, Dynamics 365, Power Platform, and APIs
• Python programming for AI/ML solutions
• ML frameworks (TensorFlow, PyTorch, Sci-Kit Learn, Keras)
• AI workflow orchestration tools (KubeFlow, BentoML)
• Model evaluation and observability tools (Evidently AI, Great Expectations)
• AI security and governance on Azure

Preferred Skills:

• Experience with Azure Functions, Azure Container Apps, Azure Kubernetes Service (AKS), and Azure Storage
• Proficiency in R and R Studio for statistical computing
• Knowledge of SAS or SPSS for advanced statistical modeling
• Familiarity with microservices, event-driven architectures, and enterprise integrations
• Expertise in developing reusable agent frameworks, prompt libraries, and deployment patterns

Desired Qualifications:

• Bachelor's degree in Computer Science, Data Science, Statistics, Mathematics, or a closely related discipline
• Certification in Machine Learning or Data Science from a recognized institution (e.g., TensorFlow Developer Certificate, AWS Certified Machine Learning Specialty, Microsoft Certified: Azure AI Engineer Associate)
• Certification in statistical analysis tools or platforms (e.g., SAS Certified Statistical Business Analyst)