AI Infrastructure Intern — Inference at Scale

DeepInfra

Palo Alto (CA)

On-site

USD 78,120 - 89,280

Part time

14 days+

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

DeepInfra seeks talented Software Engineering Interns to join its team in Palo Alto, offering hands-on experience designing, developing, and deploying scalable AI models. You will work closely with engineers to implement inference solutions and optimize AI systems using Python, C++, CUDA, and NCCL.

The role includes monitoring live services and participating in code reviews to ensure high-quality software delivery.

Qualifications

Currently pursuing a Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field.
Proficiency in Python and knowledge of AI/ML libraries is required.
Familiarity with AI models, Transformers and Diffusers is preferred.
Experience with Git and agile development methodologies is beneficial.
Strong problem-solving and collaboration skills are essential.

Responsibilities

Collaborate with the engineering team to design, develop, and test inference solutions for top AI models.
Implement and optimize AI models using Python, C++, CUDA, NCCL.
Monitor and maintain the live service.
Participate in code reviews, feature development, and bug fixes to ensure high-quality software delivery.
Engage in daily stand-ups and design discussions to enable seamless collaboration.
Stay updated with AI/ML industry trends and advancements.