Senior AI Platform Architect for Enterprise GenAI

Ares Management; New York (NY); On-site; USD 300,000 - 350,000; Full time

Job summary

Ares Management in New York is seeking a Principal AI Platform Engineer to design and build an enterprise‑grade generative AI platform from the ground up. This leadership role combines deep AI systems architecture with a strategic vision to scale across the firm.

You will architect a comprehensive platform spanning model gateways, retrieval services, model registries, prompt libraries, and deployment pipelines.

Qualifications

• 10+ years of software engineering experience, with 5+ years building large‑scale distributed systems or platform infrastructure.
• 3+ years hands‑on experience with generative AI, LLMs, RAG systems, or AI infrastructure—production or applied research.
• Proficiency in one or more of Python, Go, Rust, or Java; experience in APIs and orchestration systems.
• Deep understanding of LLM architectures, prompting strategies, fine‑tuning, and RAG design patterns.
• Experience with model serving (e.g., vLLM, TensorFlow Serving), vector databases, and embedding models.
• Cloud platforms (AWS, GCP, Azure) and containerization/orchestration (Docker, Kubernetes).
• Security, governance, and compliance awareness (SOC 2, ISO 27001, GDPR).
• Track record leading technical initiatives from architecture to production deployment.
• Excellent communication skills for executives and cross‑functional teams.

Responsibilities

• Design and build a foundational, secure, scalable AI platform for enterprise use.
• Architect multi‑LLM gateway capabilities to support diverse model providers and cost optimization.
• Develop RAG retrieval services including enterprise search and semantic indexing at scale.
• Create a centralized model registry with governance, versions, and compliance tracking.
• Design prompt library with version control, testing, and evaluation capabilities.
• Implement Model Context Protocol (MCP) gateway for secure tool and data integration.
• Build FinOps infrastructure for cost tracking across models and business units.
• Design orchestration for complex AI workflows and reliable chained operations.
• Ensure secure API gateways, RBAC/ABAC, and encrypted data in transit and at rest.
• Collaborate with Data Products and AI Enablement for governance and adoption.

Skills

Python

Go

Rust

Java

LLM architectures

APIs & orchestration

Security concepts

Tools

LLM serving tools

Vector databases

Model registry

Job description

Ares Management in New York is seeking a Principal AI Platform Engineer to design and build an enterprise‑grade generative AI platform from the ground up. This leadership role combines deep AI systems architecture with a strategic vision to scale across the firm.

You will architect a comprehensive platform spanning model gateways, retrieval services, model registries, prompt libraries, and deployment pipelines.