AI/ML Platform Engineer – LLM Infra & Pipelines

Aimlroles; Lisle (IL); On-site; USD 90,000 - 190,000; Full time

Job summary

CACI is seeking an experienced AI/ML Platform Engineer to join the Lisle DevOps team. You will architect greenfield LLM-enabled technologies, deploy and monitor LLMs on local Kubernetes clusters, and design RAG pipelines to enhance document processing and retrieval workflows.

Ideal candidates bring deep IT knowledge, strong communication, and hands-on experience with Python, SQL, Java, Airflow, Spark, Iceberg, and DBT, plus Kubernetes and Terraform-based infrastructure management.

Qualifications

• IT infrastructure and software development experience in Python, SQL, and Java.
• Experience building data pipelines with Airflow, Spark, Iceberg, or DBT.
• Experience managing AI/ML infra with Kubernetes, Kserve, vLLM, LangFuse, Elasticsearch, and Terraform.
• Familiar with GitLab CI/CD pipelines.
• Knowledge of RAG, MCP servers, QLoRA, and artifact repositories like Nexus.

Responsibilities

• Architect a greenfield implementation of LLM-enabled technologies to support agentic workflows
• Deploy, operate, and monitor open-weight LLMs hosted on local Kubernetes clusters
• Design, build, and maintain RAG pipelines for document investigation, chunking, embedding, retrieval, and reranking
• Develop and maintain Model Context Protocol servers and interconnections
• Coach teams on MCP designs and usage
• Support software automated testing environments
• Collaborate to implement CI/CD pipelines
• Instrument tracing and evaluation tools to measure and improve product cycles
• Provide requirements for network infrastructure to improve model serving
• Support software development environments and change management systems

Skills

Information Technology understanding

Excellent communication skills

Python

SQL

Java

Ability to work with limited supervis

Strong organizational teamwork

Education

Bachelor's Degree in Computer Science / Information Systems / Engineering

4+ years of related experience or related Master’s

Tools

Airflow

Spark

Apache Iceberg

DBT

Kubernetes

Kserve

vLLM

LangFuse

Elasticsearch

Terraform

Gitlab CI/CD

Job description

CACI is seeking an experienced AI/ML Platform Engineer to join the Lisle DevOps team. You will architect greenfield LLM-enabled technologies, deploy and monitor LLMs on local Kubernetes clusters, and design RAG pipelines to enhance document processing and retrieval workflows.

Ideal candidates bring deep IT knowledge, strong communication, and hands-on experience with Python, SQL, Java, Airflow, Spark, Iceberg, and DBT, plus Kubernetes and Terraform-based infrastructure management.