AI DevOps Engineer

Alignity Solutions; New York (NY); On-site; USD 120,000 - 180,000; Part time

Job summary

Alignity Solutions is seeking a highly skilled AI DevOps Engineer to design, build, and operate scalable, secure infrastructure for AI platforms and LLM-powered applications. The role sits at the crossroads of DevOps, Platform Engineering, SRE, and AI infrastructure, enabling high-performance systems within a regulated financial services environment.

Strong expertise in Kubernetes, Terraform, cloud infra, automation, and AI platform operations is required.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• Proven experience as a DevOps Engineer, Platform Engineer, or SRE in large-scale production environments.
• Experience with Terraform and IaC methodologies.
• Strong experience deploying and operating Kubernetes-based environments.
• Experience supporting infrastructure for AI platforms or LLM-based applications.

Responsibilities

• Design, deploy, and manage scalable infrastructure for AI and LLM-based applications.
• Build and maintain IaC using Terraform for secure, auditable deployments.
• Deploy, manage, and scale containerized environments using Kubernetes with high availability.
• Implement DevOps, Platform Engineering, and SRE best practices to improve reliability and efficiency.
• Support AI platform services for model serving, inference, and experimentation.
• Deploy and maintain infrastructure supporting AI agents and LLM runtimes.
• Design and manage vector database infrastructure (Pinecone, Weaviate, pgvector) for RAG and semantic search.

Skills

Kubernetes

Terraform

Cloud infrastructure

Automation

SRE

AI platform operations

LLM workloads

Vector databases

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent

Tools

Terraform

Kubernetes

pgvector

Pinecone

Weaviate

Job description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Field Service Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long-term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Location: NewYork, NY

Type: Contract

Requirements

About theRole

Our client is seekinga highly skilled AI DevOps Engineer to design, build, and operatescalable, secure, and production-grade infrastructure supporting modern AIplatforms and LLM-powered applications.

This role sitsat the intersection of DevOps, Platform Engineering, Site ReliabilityEngineering (SRE), and AI Infrastructure, enabling high-performance AIsystems, agent-based workflows, and enterprise AI platforms within a regulatedfinancial services environment.

The idealcandidate will have strong expertise in Kubernetes, Terraform, cloudinfrastructure, automation, and AI platform operations, along withexperience supporting modern AI/LLM workloads in production environments.

KeyResponsibilities

• Design, deploy, and manage scalable infrastructurefor AI and LLM-based applications in production environments.
  
• Build and maintain Infrastructure-as-Code (IaC)using tools such as Terraform for secure, repeatable, and auditabledeployments.
  
• Deploy, manage, and scale containerizedenvironments using Kubernetes with a focus on high availability andreliability.
  
• Implement DevOps, Platform Engineering, and SREbest practices to improve system reliability, scalability, and operationalefficiency.
  
• Support AI platform services for model serving,inference, experimentation, and evaluation workflows.
  
• Deploy and maintain infrastructure supporting AIagents, orchestration frameworks, and LLM runtime dependencies.
  
• Design and manage vector database infrastructureincluding Pinecone, Weaviate, or PostgreSQL with pgvector for RAG andsemantic search use cases.
  
• Enable AI developer platforms and tooling forengineering teams building AI-powered applications.
  
• Implement monitoring, alerting, logging, andincident response processes for mission-critical AI systems.
  
• Collaborate with security, compliance, andgovernance teams to ensure adherence to regulatory and enterprise securitystandards.
  
• Continuously improve automation, developerexperience, and operational processes for AI infrastructure environments.
  

RequiredQualifications

• Bachelor’s degree in Computer Science, Engineering,or equivalent practical experience.
  
• Proven experience as a DevOps Engineer, PlatformEngineer, or Site Reliability Engineer (SRE).
  
• Strong hands‑on experience managing large-scaleproduction infrastructure.
  
• Expertise with Terraform and Infrastructure-as-Code(IaC) methodologies.
  
• Strong experience deploying and operatingKubernetes-based environments.
  
• Experience supporting infrastructure for AIplatforms or LLM-based applications.
  
• Strong understanding of automation, scalability,reliability, and cloud-native architectures.
  

PreferredQualifications

• Experience supporting production-grade LLMapplications and AI agent workloads.
  
• Hands-on experience with vector databases such asPinecone, Weaviate, or pgvector.
  
• Experience building or supporting AI tooling andinternal AI developer platforms.
  
• Knowledge of observability, monitoring, capacityplanning, and reliability engineering for AI/ML systems.
  
• Experience working within financial services orother highly regulated industries.
  
• Strong communication and cross-functionalcollaboration skills.