AI Solutions Engineer: GenAI & LLM Apps (Remote)

International Business Machines Corporation; Raleigh (NC); Remote; USD 140,000 - 190,000; Full time

Job summary

IBM Consulting in the United States is seeking a Forward Deployed Engineer - AI to work with clients to transform complex business challenges into production-ready AI solutions, combining software engineering, data science, GenAI, agentic AI, and analytics.

You will prototype, deploy, and scale solutions, apply MLOps, and help ensure measurable business value while collaborating with clients and teams across industries.

Qualifications

• 5-7+ years of experience in AI/ML, data science, or software engineering, delivering production AI solutions.
• Strong Python and SQL skills, with hands-on experience building GenAI and agentic AI applications, including LLMs, RAG, and multi-step workflows using tools such as LangChain, LangGraph, or CrewAI.
• Hands-on experience building GenAI applications with large language models, including RAG, prompt and context engineering, embeddings and vector databases (e.g., Milvus, Elasticsearch, pgvector, Pinecone), and LLM evaluation.
• Experience designing and building agentic AI workflows using frameworks such as LangChain/LangGraph, CrewAI, AutoGen, including tool calling and multi-step orchestration.
• Experience with machine learning and data processing using tools such as scikit-learn, PyTorch, Pandas, or Spark.
• Experience integrating and deploying AI solutions using APIs (REST/FastAPI), cloud AI platforms (AWS Bedrock, Azure AI, or Google Vertex AI), and tools such as Git, Docker, or Kubernetes.
• Experience with at least one major cloud AI platform (AWS Bedrock, Azure AI Foundry, or Google Vertex AI).
• Strong client-facing skills, with the ability to translate business challenges into technical solutions and communicate with technical and non-technical audiences.
• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.

Responsibilities

• Solve Client Challenges: Partner with business and technical teams to identify opportunities, define AI use cases, and establish success metrics.
• Build and Deploy AI Solutions: Develop end-to-end GenAI, RAG, and agentic AI applications using tools such as LangGraph, CrewAI, and hyperscaler cloud AI platforms (e.g., AWS, Google, Azure).
• Engineer Agentic and GenAI Systems: Design and implement LLM-powered agents, tool use and orchestration, prompt and context engineering, and evaluation frameworks using platforms such as LangGraph, CrewAI, Vertex AI, Azure AI Foundry, or Amazon Bedrock. Apply guardrails, observability, and testing to ensure accuracy, safety, and reliability.
• Data Engineering and Integrations: Prepare structured and unstructured data and integrate AI solutions with enterprise systems, APIs, and data platforms.
• Scale and Operationalize AI: Apply MLOps/LLMOps, testing, monitoring, and responsible AI practices to ensure solutions are reliable, secure, and production-ready.
• Drive Business Impact: Present insights, demonstrate outcomes, support client adoption, and turn successful solutions into reusable assets for future engagements.

Skills

AI/ML Engineering

Python

SQL

GenAI & LLM

Cloud platforms

Communication

Education

Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field

Master’s degree

Tools

LangGraph

CrewAI

LangChain

Vertex AI

Bedrock

Docker

Kubernetes

Job description

IBM Consulting in the United States is seeking a Forward Deployed Engineer - AI to work with clients to transform complex business challenges into production-ready AI solutions, combining software engineering, data science, GenAI, agentic AI, and analytics.

You will prototype, deploy, and scale solutions, apply MLOps, and help ensure measurable business value while collaborating with clients and teams across industries.