AI Infra Engineer: Kubernetes & LLM Ops

Alignity Solutions

New York (NY)

On-site

USD 120,000 - 180,000

Part time

14 days+

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Alignity Solutions is seeking a highly skilled AI DevOps Engineer to design, build, and operate scalable, secure infrastructure for AI platforms and LLM-powered applications. The role sits at the crossroads of DevOps, Platform Engineering, SRE, and AI infrastructure, enabling high-performance systems within a regulated financial services environment.

Strong expertise in Kubernetes, Terraform, cloud infra, automation, and AI platform operations is required.

Qualifications

Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
Proven experience as a DevOps Engineer, Platform Engineer, or SRE in large-scale production environments.
Experience with Terraform and IaC methodologies.
Strong experience deploying and operating Kubernetes-based environments.
Experience supporting infrastructure for AI platforms or LLM-based applications.

Responsibilities

Design, deploy, and manage scalable infrastructure for AI and LLM-based applications.
Build and maintain IaC using Terraform for secure, auditable deployments.
Deploy, manage, and scale containerized environments using Kubernetes with high availability.
Implement DevOps, Platform Engineering, and SRE best practices to improve reliability and efficiency.
Support AI platform services for model serving, inference, and experimentation.
Deploy and maintain infrastructure supporting AI agents and LLM runtimes.
Design and manage vector database infrastructure (Pinecone, Weaviate, pgvector) for RAG and semantic search.