Senior LLM & GenAI Engineer: Build Production Systems

Evlo AI; Chicago (IL); On-site; USD 140,000 - 210,000; Full time

Job summary

Evlo AI is seeking a hands-on engineer to build LLM-powered systems at the core of the product, including retrieval pipelines, agentic workflows, and evaluation infrastructure. You’ll own systems end‑to‑end, ship code daily, and influence architecture with production impact.

The role requires 3–7 years of software experience, strong Python, and practical GenAI deployment knowledge on cloud platforms. You will work on complex, production‑grade GenAI features with direct operational visibility.

Qualifications

• 3–7 years of software engineering experience, incl. 2+ years in production GenAI.
• Strong Python skills, experience with async programming and API design.
• Hands-on with vector DBs and embedding model stacks in real deployments.

Responsibilities

• Design and implement end‑to‑end RAG pipelines and context optimization.
• Scale vector DB integrations handling millions of documents with sub‑second latency.
• Develop agentic workflows with tool-calling and multi-step reasoning.

Skills

Python

Async programming

API design

Production‑grade software

LLM/GenAI systems

Vector database

Embedding model stack

Tokenization

Prompt engineering

Deployment on cloud

Docker

CI/CD

Education

Bachelor's degree in CS/Engineering

Tools

Pinecone

Weaviate

pgvector

Docker

FastAPI

PyTorch

Hugging Face

Job description

Evlo AI is seeking a hands-on engineer to build LLM-powered systems at the core of the product, including retrieval pipelines, agentic workflows, and evaluation infrastructure. You’ll own systems end‑to‑end, ship code daily, and influence architecture with production impact.

The role requires 3–7 years of software experience, strong Python, and practical GenAI deployment knowledge on cloud platforms. You will work on complex, production‑grade GenAI features with direct operational visibility.