A leading academic institution is seeking an LLM Inference & Integration Engineer Intern to contribute to developing innovative technologies in the space of defense and intelligence systems. This internship will provide opportunities for undergraduate and graduate students to work on cutting-edge LLM projects while under the supervision of experienced engineers. Candidates should have a strong background in computer science or engineering, with good communication skills and the ability to work well independently and in teams. Applications are encouraged from all qualified individuals.
Qualifications
Experience with local/open-weight models using open-source inference runtimes.
6+ months of Linux development and Bash scripting.
Ability to work independently and within a team setting.
Responsibilities
Prototyping automation workflows for LLMs.
Integrating LLM with internal tools using APIs.
Optimizing inference for speed and memory.
Skills
Running local/open-weight models
REST APIs (JSON, streaming)
Proficiency in python, C++, or C#
Linux development
Good communication skills
Education
Pursuing a degree in computer science, computer engineering, or electrical engineering
Junior, senior, or graduate student
3.0 GPA minimum
Tools
Docker
Git
CMake/Make
Job description
A leading academic institution is seeking an LLM Inference & Integration Engineer Intern to contribute to developing innovative technologies in the space of defense and intelligence systems. This internship will provide opportunities for undergraduate and graduate students to work on cutting-edge LLM projects while under the supervision of experienced engineers. Candidates should have a strong background in computer science or engineering, with good communication skills and the ability to work well independently and in teams. Applications are encouraged from all qualified individuals.