Senior AI Platform Engineer

National Black MBA Association; Charlotte, Northern (NC, KY); Hybrid; USD 120,000 - 190,000; Full time

Job summary

National Black MBA Association is seeking an experienced AI platform engineer to design, build, and operate enterprise AI platform capabilities supporting Generative AI, RAG, and agentic workloads.

You will develop scalable data ingestion pipelines, integrate vector databases, and implement retrieval frameworks with governance controls. The role emphasizes security, observability, and cost optimization in a cloud-native environment.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical field, or equivalent practical experience.
• 5+ years of experience designing, building, and operating distributed platform technologies or cloud-native systems.
• 3+ years of experience building, operating, or supporting AI/ML platforms and services.
• Hands-on experience with Amazon Bedrock and enterprise foundation model platforms.
• Experience designing and implementing Retrieval-Augmented Generation (RAG) architectures using vector databases, embeddings, and enterprise knowledge sources.
• Experience building or operating agentic AI systems utilizing AWS AgentCore or comparable agent frameworks.
• Experience designing and implementing solutions based on Model Context Protocol (MCP).
• Experience implementing AI Gateway solutions (e.g., Kong AI Gateway or equivalent) for AI governance, traffic management, observability, and security.
• Familiarity with agent orchestration frameworks, agent-to-agent communication patterns, and multi-agent architectures.
• Strong understanding of LLM operations including prompt engineering, model evaluation, guardrails, governance, and token optimization.
• Proficiency in Python and/or other languages commonly used for AI and platform engineering.
• Experience with AWS cloud services, containerization, Kubernetes, and modern CI/CD practices.
• Understanding of observability, monitoring, and operational support for AI and agent-based systems.
• Experience implementing security, privacy, governance, and compliance controls in AI environments.

Responsibilities

• Partner with software engineers, platform engineers, architects, and product teams to deliver enterprise AI solutions.
• Consult with application teams on AI platform integration patterns and best practices.
• Create reference architectures, reusable patterns, and implementation guidance.
• Develop documentation, runbooks, architectural diagrams, and operational standards.
• Mentor team members and help promote adoption of enterprise AI platform capabilities.

Skills

Distributed platforms

AI platforms

RAG architectures

Vector databases

Agentic AI

MCP

Kong AI Gateway

Observability

Python

Kubernetes

CI/CD

Security & Compliance

Education

Bachelor’s degree in CS/Engineering/IS

Tools

Amazon Bedrock

Bedrock Knowledge Bases

Bedrock Guardrails

AWS AgentCore

Kong AI Gateway

Job description

National Black MBA Association is seeking an experienced AI platform engineer to design, build, and operate enterprise AI platform capabilities supporting Generative AI, RAG, and agentic workloads.

You will develop scalable data ingestion pipelines, integrate vector databases, and implement retrieval frameworks with governance controls. The role emphasizes security, observability, and cost optimization in a cloud-native environment.