Senior GenAI Platform Architect

Machine Learning Technologies, LLC; Illinois; On-site; USD 180,000 - 270,000; Full time

Job summary

Machine Learning Technologies, LLC seeks a senior platform engineer to define and lead an enterprise AI platform architecture. You will manage control-plane services, gateways, and GenAI runtimes, while mentoring a 3–8 person platform team and partnering with product leadership to drive AI platform roadmaps.

The role involves hands-on coding, architecture reviews, and building scalable, secure AI/machine learning platforms with strong emphasis on reliability and cost controls.

Qualifications

• 10–15+ years of software engineering, platform engineering, distributed systems, or infrastructure experience, including technical leadership.
• Hands-on experience building and operating enterprise AI/GenAI platforms or comparable production ML, data, or developer platforms.
• Deep knowledge of model gateways, RAG, agent platforms, AI evaluation, observability, traceability, and platform governance.
• Experience with Kubernetes, infrastructure-as-code, CI/CD, cloud services, secrets management, secure SDLC, and production reliability.
• Proven architecture ownership, cross-functional leadership, stakeholder communication, and engineering team development.
• Bachelor's degree in a related field or equivalent professional experience.

Responsibilities

• Define enterprise AI platform architecture, including control-plane services, SDKs, reusable templates, and developer tooling.
• Design and implement model gateways supporting multi-provider routing, failover, rate limiting, tenant isolation, and cost tracking.
• Build GenAI runtimes incorporating RAG, vector and hybrid search, context and memory stores, tool execution, and model integration.
• Develop model, agent, prompt, and tool registries with versioning, approvals, lineage, and auditability.
• Implement AI observability, distributed tracing, model evaluation, quality monitoring, latency tracking, and cost controls.
• Establish responsible AI, security, privacy, guardrails, identity management, and policy enforcement.
• Lead platform engineering using Kubernetes, infrastructure-as-code, CI/CD, cloud services, and reliability engineering.
• Remain hands-on with production code, architecture reviews, technical standards, and build-versus-buy decisions.
• Mentor and lead a team of approximately 3–8 platform engineers.
• Partner with product leadership to drive AI platform roadmaps, adoption, reliability, and measurable business outcomes.

Skills

Platform leadership

Kubernetes

CI/CD

Cloud services

Observability

Distributed systems

Security & compliance

Mentoring

Architecture ownership

Education

Bachelor's degree

Job description

Machine Learning Technologies, LLC seeks a senior platform engineer to define and lead an enterprise AI platform architecture. You will manage control-plane services, gateways, and GenAI runtimes, while mentoring a 3–8 person platform team and partnering with product leadership to drive AI platform roadmaps.

The role involves hands-on coding, architecture reviews, and building scalable, secure AI/machine learning platforms with strong emphasis on reliability and cost controls.