Lead AI Platform Architect – Foundation & Infra

Univers; New Haven (CT); On-site; USD 180,000 - 260,000; Full time

Job summary

Univers seeks a forward-thinking AI Platform Foundation Architect to lead evolution of our core platform into an AI-native, scalable ecosystem. You will define architecture across IaaS, Middleware, Big Data, and AI Infra, and translate strategy into tangible platforms.

You will drive automated deployments, monitoring, and fault-tolerant design, embed AI gateways and lightweight models, and collaborate with product, engineering, and operations teams to accelerate innovation.

Qualifications

• AI Infra & Model Serving: Hands-on with AI Gateways, token optimization, hosting small/open-source models.
• AIOps & Smart O&M: Use LLMs/AI Agents for log analysis, RCA, and automated checks.
• Middleware & Data Engines: Deep knowledge of Kafka, Redis, and time-series platforms.
• IaaS & Cloud-Native: Experience with public/hybrid clouds, Kubernetes, and IaC tools.
• Observability & Resource Optimization: Proficient with Prometheus, Grafana, and ELK.
• Distributed Systems: Proven ability to design scalable, secure platforms.
• Communication: Aligns executives, engineers, product teams, and customers.
• Education: CS degree or equivalent.

Responsibilities

• Oversee evaluation, architecture standards, and operating frameworks for enterprise middleware.
• Architect and optimize high-throughput Big Data platforms, TSDBs, and log/metric storage engines.
• Provision scalable cloud-native and hybrid IaaS solutions using IaC.
• Design automated horizontal and vertical resource scaling to balance performance and cost.
• Establish full-stack telemetry and monitoring for critical hardware and software metrics.
• Architect multi-region, fault-tolerant systems to guarantee platform availability.
• Design unified backup workflows, automated snapshots, and rapid DR execution.
• Integrate AI agents and LLM/SLM capabilities into CI/CD pipelines and RCA tooling.
• Architect and deploy centralized AI Gateways to manage token usage, caching, rate-limiting, and cost allocation across LLMs/SLMs.
• Design low-latency hosting for small/edge models and open-source models.
• Build a unified AI Infra layer providing model serving, GPU/NPU orchestration, and MCP routing.

Skills

AI Infra & Model Serving

AIOps & Smart O&M

Middleware & Data Engines

IaaS & Cloud-Native

Observability & Resource Optimization

Distributed Systems

Communication

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Kafka

RabbitMQ

Redis

IoTDB

HBase

InfluxDB

Flink

Terraform

Ansible

Kubernetes

Prometheus

Grafana

Loki/ELK

Job description

Univers seeks a forward-thinking AI Platform Foundation Architect to lead evolution of our core platform into an AI-native, scalable ecosystem. You will define architecture across IaaS, Middleware, Big Data, and AI Infra, and translate strategy into tangible platforms.

You will drive automated deployments, monitoring, and fault-tolerant design, embed AI gateways and lightweight models, and collaborate with product, engineering, and operations teams to accelerate innovation.