Staff AI Platform Engineer: Scalable AI Infrastructure

CodeRound; Hinoba-an; On-site; PHP 1,500,000 - 2,400,000; Full time

Job summary

CodeRound is seeking a Staff AI Engineer to design and build a large-scale AI platform and infrastructure. You will own the end-to-end backend and AI services, focusing on scalable architectures, AI orchestration, and production-grade deployment of AI-powered features.

The role emphasizes collaboration with product teams, system reliability, and continuous evolution of the platform, leveraging modern AI tech and cloud-native practices.

Qualifications

• Senior individual contributor focusing on designing and building a large-scale AI platform and infrastructure.
• Design end-to-end AI platform architecture with scalable, production-grade deployment.
• Lead collaboration with product and engineering teams for AI-powered experiences.

Responsibilities

• Design and build end-to-end AI platform architecture.
• Develop scalable AI infrastructure and services with reliability.
• Evaluate emerging AI technologies and frameworks.
• Build and optimize AI agent orchestration systems.
• Implement production-grade RAG and retrieval systems.
• Architect model serving and inference infrastructure.
• Establish engineering best practices for AI-first development.
• Drive scalability, performance, and reliability initiatives.
• Create reusable AI platform components and tooling.
• Collaborate with product and engineering teams on AI-powered experiences.
• Lead technical decisions for platform evolution.

Skills

Backend

Distributed Systems

Microservices

Kubernetes

Kafka

gRPC

AI Platform

LLMs

RAG

Vector DBs

Pinecone

Milvus

vLLM

System Design

Cloud Native

Model Serving

API Design

Reliability

Performance

MLOps

LLMOps

Software Architecture

Tools

Kubernetes

Kafka

gRPC

Pinecone

Milvus

vLLM

Job description

CodeRound is seeking a Staff AI Engineer to design and build a large-scale AI platform and infrastructure. You will own the end-to-end backend and AI services, focusing on scalable architectures, AI orchestration, and production-grade deployment of AI-powered features.

The role emphasizes collaboration with product teams, system reliability, and continuous evolution of the platform, leveraging modern AI tech and cloud-native practices.