AI Infra Software Engineer Intern

Deep Infra Inc.; Palo Alto (CA); On-site; USD 937,000 - 1,071,000; Full time

Job summary

DeepInfra is seeking software engineering interns to join our team in Palo Alto, contributing to the design, development, and deployment of open AI models at scale. You will work closely with experienced engineers to build scalable systems and gain hands-on experience with cutting-edge AI models.

The internship emphasizes Python, C++, CUDA, NCCL, and live service maintenance, with participation in code reviews, feature work, and collaboration across teams.

Qualifications

• Pursuing a Bachelor's or Master's in CS, CE, or related field.
• Strong CS fundamentals: data structures and algorithms.
• Proficiency in Python; experience with AI/ML libraries (NumPy, pandas, SciPy, TensorFlow, PyTorch).
• Familiarity with AI models, Transformers and Diffusers.
• Experience with Git and agile development practices.
• Excellent problem-solving and collaboration skills.

Responsibilities

• Collaborate with the engineering team to design, develop, and test inference solutions for AI models.
• Implement and optimize AI models using Python, C++, CUDA, NCCL.
• Monitor and maintain the live service.
• Work on feature development, bug fixing, and code reviews to ensure high-quality software delivery
• Participate in daily stand-ups, code reviews, and design discussions to ensure seamless collaboration
• Stay up-to-date with industry trends and advancements in AI and machine learning
• Try new things
• Ship stuff

Skills

Python

C++

Algorithms

Data structures

Git

Agile

Communication

Teamwork

Education

Bachelor's or Master's in CS/CE or related

Tools

CUDA

NCCL

NumPy

Pandas

SciPy

TensorFlow

PyTorch

Job description

DeepInfra is seeking software engineering interns to join our team in Palo Alto, contributing to the design, development, and deployment of open AI models at scale. You will work closely with experienced engineers to build scalable systems and gain hands-on experience with cutting-edge AI models.

The internship emphasizes Python, C++, CUDA, NCCL, and live service maintenance, with participation in code reviews, feature work, and collaboration across teams.