Senior AI Engineer: Agentic Systems on Azure

IBM

New York (NY)

On-site

USD 140,000 - 200,000

Full time

14 days+

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

IBM Consulting is seeking a senior AI Engineer to lead hands-on development of agentic AI workflows on Azure OpenAI. You will design end-to-end RAG pipelines, implement tool calling, and work with client teams to deliver production-grade AI solutions.

Applicants should have deep expertise in responsible AI, MLOps, and cloud-native deployment. You will collaborate with data engineers, architects, and business stakeholders to ensure scalable, secure, and compliant integration across enterprise

Qualifications

7+ years designing, developing, and deploying scalable AI applications with LLMs, RAG, and agentic AI workflows.
Experience with frameworks like LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI.
Knowledge of vector databases and MLOps practices for AI deployment and lifecycle management.

Responsibilities

Design, build, and deploy agentic AI workflows and multi‑agent systems on Azure OpenAI.
Develop and optimize prompt engineering strategies to maximize model performance.
Build and maintain RAG pipelines for grounded, context‑aware responses.
Implement agent orchestration patterns including tool calling, memory management, and human‑in‑the‑loop workflows.
Engage with client stakeholders to gather requirements and demo capabilities.
Deploy and manage AI models using Azure ML and Azure AI Studio; integrate AI into enterprise apps via APIs and data pipelines.