LLM Engineer: Build Production-Grade AI Apps

University of North Carolina - Chapel Hill; Elkins Hills (NC); On-site; USD 90,000 - 130,000; Part time

Job summary

University of North Carolina at Chapel Hill seeks an LLM Engineer to design, build, and operate large language model–powered tools and applications across the institution. The engineer will work with the CAIO office and University Library on two flagship initiatives: PromptLab and Carolina Source.

Minimum education includes a Master’s or Bachelor’s with 0–2 years’ experience (or equivalent). Proficiency in Python, LangChain, LlamaIndex, and transformers is required, along with cloud,

Qualifications

• Bachelor's degree in CS/DS/InfoSci or related field.
• Experience building and deploying production-grade LLM-powered applications.
• Proficiency in Python and frameworks including LangChain, LlamaIndex, Transformers, or equivalent.
• Familiarity with RAG architectures, vector databases and embedding models.
• Experience with major LLM APIs (OpenAI, Anthropic, Google) and open-source options.
• Cloud platforms and containerization (Azure, AWS, GCP; Docker, Kubernetes).
• Web app development using JavaScript/TypeScript/Node.js/React.

Responsibilities

• Design, build, and operate large language model-powered tools across the institution.
• Collaborate with the CAIO office and University Library on flagship AI initiatives (PromptLab and Carolina Source).
• Contribute to architecture, deployment, monitoring, and recovery of AI systems.

Education

Bachelor's in Computer Science, Data Science, Information Science, or related field

Master's degree preferred

Tools

Python

LangChain

LlamaIndex

Hugging Face Transformers

OpenAI APIs

Azure

AWS

GCP

Docker

Kubernetes

JavaScript/TypeScript/Node.js/React

Job description

University of North Carolina at Chapel Hill seeks an LLM Engineer to design, build, and operate large language model–powered tools and applications across the institution. The engineer will work with the CAIO office and University Library on two flagship initiatives: PromptLab and Carolina Source.

Minimum education includes a Master’s or Bachelor’s with 0–2 years’ experience (or equivalent). Proficiency in Python, LangChain, LlamaIndex, and transformers is required, along with cloud,