Senior AI Platform Architect & MLOps Lead

TechWize; New York, Northern (NY, KY); Hybrid; USD 170,000 - 260,000; Full time

Job summary

TechWize in New York, NY is seeking a Sr. AI Platform Engineer to design and run a scalable AI platform supporting LLM orchestration, vector search, and multi-agent workloads.

You will build APIs and infrastructure for conversational apps, implement inference pipelines on AWS with Kubernetes, and mentor engineers while upholding security and governance standards.

This role offers a fast-paced environment with cutting-edge technologies and opportunities for professional growth.

Qualifications

• 8+ years as Platform Engineer with 3+ years in AI/ML platform development (MLOps).
• Deep expertise in Python with strong design and debugging skills.
• Ability to lead complex projects and communicate effectively.
• Proficiency with AWS, GCP, or Azure and MLOps tools (MLflow, Kubeflow).
• Experience with CI/CD, and infrastructure as code (Terraform/CloudFormation).
• Hands-on with CI/CD pipelines, model observability, and AI service incident response.

Responsibilities

• Platform Design and Architecture: build and operate a scalable AI platform for LLM orchestration, vector search, and multi-agent frameworks.
• Core Infrastructure Development: create APIs and infrastructure for conversational apps, AI agents, and analytics tools.
• LLM Operational Solutions: implement workflows for inference pipelines, fine-tuning, caching, and evaluation.
• Deployment & Performance Optimization: deploy AI services on AWS with Kubernetes (EKS), Lambda, and ECS; optimize vector DBs and runtimes.
• Collaboration, Governance, & Mentorship: partner with teams to deliver production-grade services and mentorship.

Skills

Python

Platform Engineering

AI/ML Platform Dev

Cloud Platforms

CI/CD

Infrastructure as Code

Model Observability

Incident Response

Kubernetes

Tools

Docker

Kubernetes

Helm

Terraform

MLflow

Kubeflow

Ray.io

Job description

TechWize in New York, NY is seeking a Sr. AI Platform Engineer to design and run a scalable AI platform supporting LLM orchestration, vector search, and multi-agent workloads.

You will build APIs and infrastructure for conversational apps, implement inference pipelines on AWS with Kubernetes, and mentor engineers while upholding security and governance standards.

This role offers a fast-paced environment with cutting-edge technologies and opportunities for professional growth.