Senior AI Platform Engineer: Scale Cloud Infra for LLMs

Vizient, Inc.; Chicago (IL); On-site; USD 102,400 - 179,000; Full time

Job summary

Vizient, Inc. is seeking a seasoned backend engineer to design and build scalable services, APIs, and platform components powering AI/ML products.

You will work with AI/ML engineers, data scientists, and cross-functional teams to productionize LLM applications, RAG pipelines, and agentic AI workflows in a cloud-first environment. You will leverage Pulumi/Terraform to create scalable cloud infrastructure, CI/CD pipelines, and containerized deployments, while advancing observability, security, and

Qualifications

• Proven experience building production-grade backend services and APIs.
• Experience designing distributed cloud-based systems.
• Strong knowledge of infrastructure-as-code (Pulumi/Terraform) and cloud platforms.
• Familiarity with observability and production support practices.
• Experience with ML/AI systems, model serving, or LLM workflows is a plus.
• Excellent collaboration and communication skills.

Responsibilities

• Design, develop, and maintain backend services, APIs, and platform components for AI/ML applications.
• Build scalable cloud infrastructure using Pulumi and implement CI/CD pipelines.
• Support deployment of ML models, LLM apps, RAG pipelines, and agentic AI systems.
• Enhance observability with monitoring, logging, tracing, and incident management.
• Define engineering standards for testing, security, maintainability, and cost efficiency.
• Create reusable platform patterns and developer tooling for the AI/ML team.
• Collaborate with product, security, data, and platform teams on architecture.
• Mentor engineers and participate in code reviews and knowledge sharing.

Skills

Python development

Distributed systems

APIs design

Cloud-based applications

Analytical/problem-solving

Verbal/written communication

Education

Bachelor's degree preferred

Tools

Pulumi

Terraform

AWS

Azure

GCP

Docker

Kubernetes

CI/CD pipelines

Serverless architectures

Databricks

Azure AI Foundry

Job description

Vizient, Inc. is seeking a seasoned backend engineer to design and build scalable services, APIs, and platform components powering AI/ML products.

You will work with AI/ML engineers, data scientists, and cross-functional teams to productionize LLM applications, RAG pipelines, and agentic AI workflows in a cloud-first environment. You will leverage Pulumi/Terraform to create scalable cloud infrastructure, CI/CD pipelines, and containerized deployments, while advancing observability, security, and