Senior AI Engineer: RAG Pipelines on AWS

IBM; Boston (MA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

IBM Consulting is seeking an AI Engineer to build and deploy AI-powered systems, including RAG pipelines and agentic architectures. You will design backend services in Python using FastAPI and integrate with MCP tools and enterprise APIs.

Hybrid work in a delivery center supports AWS deployment and scalable operations. Required: Bachelor's in a related field; strong backend Python and API experience; knowledge of LLM orchestration and OpenSearch tools.

Qualifications

• Experience building RAG pipelines and agentic systems.
• Strong understanding of LLM orchestration frameworks (e.g. LangChain, LangGraph, Langfuse).
• Strong backend engineering experience with Python.
• Hands-on experience building APIs/services with FastAPI.
• Experience integrating with MCP tools, internal APIs, and enterprise systems.

Responsibilities

• Build and deploy AI-powered systems, including RAG pipelines and agentic systems.
• Design and implement backend services using Python and FastAPI.
• Deploy and operate services on AWS, ensuring scalability and reliability.

Skills

RAG pipelines

agentic systems

Python

FastAPI

LLM orchestration

LangChain

LangGraph

Langfuse

backend engineering

Education

Bachelor's Degree

Master's Degree

Tools

OpenSearch

Kubernetes

OpenSearch plugins

OpenTelemetry

Prometheus

Grafana

LangChain

LangGraph

Langfuse

Job description

IBM Consulting is seeking an AI Engineer to build and deploy AI-powered systems, including RAG pipelines and agentic architectures. You will design backend services in Python using FastAPI and integrate with MCP tools and enterprise APIs.

Hybrid work in a delivery center supports AWS deployment and scalable operations. Required: Bachelor's in a related field; strong backend Python and API experience; knowledge of LLM orchestration and OpenSearch tools.