Software Engineer 3: LLM & HPC RAG Systems

SageCor Solutions; Maryland; On-site; USD 120,000 - 180,000; Full time

Job summary

SageCor Solutions in Maryland is seeking a Software Engineer to design, develop, and deploy Retrieval‑Augmented Generation (RAG) solutions in a high‑performance computing Linux environment. Candidates will work with LLMs, orchestration frameworks, embedding models, and containerized apps.

The role requires strong Python, Kubernetes, Helm, CI/CD, and secure AI development skills to deliver scalable, production‑grade SI solutions in mission‑critical environments. TS/SCI with polygraph is required.

Qualifications

• Five years of SWE experience for MS track or seven years for BS track, per ad.
• Experience with Linux, Python, and modern software practices.
• Experience with containerization and Kubernetes ecosystem.

Responsibilities

• Design, develop, deploy, and support Retrieval‑Augmented Generation (RAG) solutions in HPC Linux environments.
• Build production-grade AI solutions with secure DevSecOps practices.
• Develop and maintain CI/CD pipelines and containerized deployments.
• Ensure scalable, observable systems using Prometheus and Grafana.

Skills

Linux CLI

Python

Containerization (Docker/Podman/ctr)

Kubernetes

Helm

CI/CD (GitLab/Flux)

Observability (Prometheus/Grafana)

Git workflows

SDLC & DevSecOps

Secure AI development

Education

Master's degree in Computer Science

Bachelor's degree in Computer Science

Tools

Docker

Podman

containerd

Helm charts

Kubernetes

GitLab CI/CD

Flux CD

Grafana

Prometheus

NVIDIA Triton / vLLM

Job description

SageCor Solutions in Maryland is seeking a Software Engineer to design, develop, and deploy Retrieval‑Augmented Generation (RAG) solutions in a high‑performance computing Linux environment. Candidates will work with LLMs, orchestration frameworks, embedding models, and containerized apps.

The role requires strong Python, Kubernetes, Helm, CI/CD, and secure AI development skills to deliver scalable, production‑grade SI solutions in mission‑critical environments. TS/SCI with polygraph is required.