AI Platform Engineer: LLM Orchestration & Cloud-Native

Valiant Technologies LLC; Chicago (IL); On-site; USD 130,000 - 190,000; Full time

Job summary

Valiant Technologies LLC in Chicago, IL seeks an experienced backend/platform/infra engineer to lead LLM integration and AI orchestration. You will design and implement distributed, cloud-native systems on AWS, emphasizing CI/CD automation and secure governance.

The role requires strong proficiency in Python/Go/Java, experience with vector databases and retrieval techniques, and hands-on work with LangChain and related tools.

Qualifications

• Bachelor’s or Master’s in Computer Science, Machine Learning, or related field.
• 5+ years of experience in backend, platform, or infrastructure engineering.
• Hands-on experience with LLM integration, prompt/response mediation, or AI orchestration frameworks such as LangChain, LlamaIndex, or LiteLLM.
• Proficiency in Python, Go, or Java.
• Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS, pgvector, Vespa, etc.).
• Deep understanding of information retrieval: dense retrieval, semantic search, and hybrid approaches.
• Experience building distributed, cloud-native systems on AWS, with CI/CD automation and containerization.
• Strong understanding of security, compliance, and governance for enterprise systems.

Skills

Backend engineering

Platform engineering

Infrastructure engineering

LLM integration

Prompt/response mediation

AI orchestration (LangChain)

Python

Go

Java

Distributed systems

Cloud-native (AWS)

CI/CD automation

Containerization

Security/compliance governance

Education

Bachelor’s or Master’s in Computer Science / ML or related field

Tools

LangChain

LlamaIndex

LiteLLM

Pinecone

Weaviate

Milvus

FAISS

pgvector

Vespa

Job description

Valiant Technologies LLC in Chicago, IL seeks an experienced backend/platform/infra engineer to lead LLM integration and AI orchestration. You will design and implement distributed, cloud-native systems on AWS, emphasizing CI/CD automation and secure governance.

The role requires strong proficiency in Python/Go/Java, experience with vector databases and retrieval techniques, and hands-on work with LangChain and related tools.