Platform Engineer III

National Black MBA Association; Charlotte, Northern (NC, KY); Hybrid; USD 120,000 - 190,000; Full time

Job summary

National Black MBA Association is seeking an experienced AI platform engineer to design, build, and operate enterprise AI platform capabilities supporting Generative AI, RAG, and agentic workloads.

You will develop scalable data ingestion pipelines, integrate vector databases, and implement retrieval frameworks with governance controls. The role emphasizes security, observability, and cost optimization in a cloud-native environment.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical field, or equivalent practical experience.
• 5+ years of experience designing, building, and operating distributed platform technologies or cloud-native systems.
• 3+ years of experience building, operating, or supporting AI/ML platforms and services.
• Hands-on experience with Amazon Bedrock and enterprise foundation model platforms.
• Experience designing and implementing Retrieval-Augmented Generation (RAG) architectures using vector databases, embeddings, and enterprise knowledge sources.
• Experience building or operating agentic AI systems utilizing AWS AgentCore or comparable agent frameworks.
• Experience designing and implementing solutions based on Model Context Protocol (MCP).
• Experience implementing AI Gateway solutions (e.g., Kong AI Gateway or equivalent) for AI governance, traffic management, observability, and security.
• Familiarity with agent orchestration frameworks, agent-to-agent communication patterns, and multi-agent architectures.
• Strong understanding of LLM operations including prompt engineering, model evaluation, guardrails, governance, and token optimization.
• Proficiency in Python and/or other languages commonly used for AI and platform engineering.
• Experience with AWS cloud services, containerization, Kubernetes, and modern CI/CD practices.
• Understanding of observability, monitoring, and operational support for AI and agent-based systems.
• Experience implementing security, privacy, governance, and compliance controls in AI environments.

Responsibilities

• Partner with software engineers, platform engineers, architects, and product teams to deliver enterprise AI solutions.
• Consult with application teams on AI platform integration patterns and best practices.
• Create reference architectures, reusable patterns, and implementation guidance.
• Develop documentation, runbooks, architectural diagrams, and operational standards.
• Mentor team members and help promote adoption of enterprise AI platform capabilities.

Skills

Distributed platforms

AI platforms

RAG architectures

Vector databases

Agentic AI

MCP

Kong AI Gateway

Observability

Python

Kubernetes

CI/CD

Security & Compliance

Education

Bachelor’s degree in CS/Engineering/IS

Tools

Amazon Bedrock

Bedrock Knowledge Bases

Bedrock Guardrails

AWS AgentCore

Kong AI Gateway

Job description

“I am the person Capital Group is looking for”

You can build and maintain AI platform services:

• Design, build, and operate enterprise AI platform capabilities supporting Generative AI, Retrieval-Augmented Generation (RAG), and agentic workloads.
• Develop scalable data ingestion pipelines, knowledge ingestion workflows, and AI data services.
• Integrate vector databases, embeddings, knowledge graphs, and enterprise knowledge repositories with appropriate governance controls.
• Design and implement retrieval frameworks supporting enterprise search, semantic search, and RAG patterns.
• Build and operate AI services using Amazon Bedrock, including foundation model integrations, Bedrock Knowledge Bases, Guardrails, and inference capabilities.
• Design and support agentic architectures utilizing AWS AgentCore and other enterprise agent platforms.
• Implement model serving infrastructure for real-time and batch inference workloads.
• Enable secure agentic workflows through Model Context Protocol (MCP), tool orchestration frameworks, and agent-to-agent communication patterns.
• Design and implement AI Gateway capabilities using technologies such as Kong AI Gateway to provide centralized authentication, routing, governance, observability, rate limiting, and policy enforcement for AI workloads.
• Develop APIs, SDKs, reusable platform services, and self-service capabilities that accelerate AI adoption across engineering teams.

You ensure observability and responsible AI:

• Monitor model performance, application behavior, agent execution, and service reliability.
• Implement logging, tracing, alerting, rollback, and operational recovery mechanisms.
• Monitor AI usage patterns, token consumption, latency, throughput, and AI Gateway telemetry.
• Implement observability solutions that provide visibility into prompts, responses, model behavior, agent interactions, and platform health.
• Apply explainability, fairness, governance, and compliance guardrails consistent with Responsible AI principles.
• Support model evaluation, benchmarking, experimentation, and lifecycle management processes.

You have experience embedding security and compliance:

• Design and implement secure AI platform architectures using cloud-native security controls.
• Integrate encryption, IAM, secrets management, and audit logging capabilities.
• Implement secure access patterns through AI Gateway platforms including authorization, policy enforcement, prompt security controls, and data protection measures.
• Support compliance with regulatory and internal governance frameworks, including privacy, security, and Responsible AI requirements.
• Partner with Information Security, Risk, Compliance, and Data Governance teams to ensure safe and compliant use of enterprise data and AI services.
• Enable governance for models, agents, prompts, tools, and enterprise knowledge sources.

You drive operational excellence:

• Apply Site Reliability Engineering (SRE) practices to ensure reliability, scalability, and operational maturity.
• Apply FinOps principles to optimize AI platform utilization, model consumption, and cloud spending.
• Automate infrastructure provisioning and management using Infrastructure as Code (IaC).
• Establish operational standards, platform runbooks, SLA/SLO metrics, and support procedures.
• Drive continuous improvements in platform security, performance, resiliency, and developer experience.

You collaborate and enable teams:

• Partner with software engineers, platform engineers, architects, and product teams to deliver enterprise AI solutions.
• Consult with application teams on AI platform integration patterns and best practices.
• Create reference architectures, reusable patterns, and implementation guidance.
• Develop documentation, runbooks, architectural diagrams, and operational standards.
• Mentor team members and help promote adoption of enterprise AI platform capabilities.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical field, or equivalent practical experience.
• 5+ years of experience designing, building, and operating distributed platform technologies or cloud-native systems.
• 3+ years of experience building, operating, or supporting AI/ML platforms and services.
• Hands-on experience with Amazon Bedrock and enterprise foundation model platforms.
• Experience designing and implementing Retrieval-Augmented Generation (RAG) architectures using vector databases, embeddings, and enterprise knowledge sources.
• Experience building or operating agentic AI systems utilizing AWS AgentCore or comparable agent frameworks.
• Experience designing and implementing solutions based on Model Context Protocol (MCP).
• Experience implementing AI Gateway solutions (e.g., Kong AI Gateway or equivalent) for AI governance, traffic management, observability, and security.
• Familiarity with agent orchestration frameworks, agent-to-agent communication patterns, and multi-agent architectures.
• Strong understanding of LLM operations including prompt engineering, model evaluation, guardrails, governance, and token optimization.
• Proficiency in Python and/or other languages commonly used for AI and platform engineering.
• Experience with AWS cloud services, containerization, Kubernetes, and modern CI/CD practices.
• Understanding of observability, monitoring, and operational support for AI and agent-based systems.
• Experience implementing security, privacy, governance, and compliance controls in AI environments.

Preferred Qualifications

• Experience in financial services or other highly regulated industries.
• AWS certifications related to AI, Machine Learning, Cloud Architecture, or Platform Engineering.
• Experience with Amazon Bedrock Knowledge Bases, Bedrock Guardrails, Agents for Bedrock, and AWS AgentCore services.
• Experience with Kong AI Gateway or comparable API and AI Gateway technologies.
• Experience implementing MCP servers, tool catalogs, and secure tool execution frameworks.
• Experience with enterprise multi-model strategies spanning Anthropic Claude, Amazon Nova, OpenAI, Google Gemini, and other foundation models.
• Familiarity with AI-specific observability and monitoring platforms.
• Experience implementing Responsible AI frameworks, guardrails, explainability, and model governance processes.
• Experience with FinOps practices and cost optimization for Generative AI workloads.
• Familiarity with Agile, DevSecOps, and platform engineering practices.
• Experience building enterprise self-service AI platforms and developer enablement capabilities.