Junior AI Infra Engineer — Build Open-Source Inference

DeepInfra; Netherlands; Remote; EUR 40,000 - 60,000; Full time

Job summary

DeepInfra is seeking early-career Software Engineers (0-2 years) to help build the infrastructure layer for AI. You will design, implement, and scale inference solutions, collaborating with seasoned engineers to ship production-grade AI systems.

Ideal candidates have a CS-related degree, strong fundamentals in data structures and algorithms, and hands-on Python with AI/ML libraries. This role offers growth in a fast-paced, high-impact environment working on real-world AI model serving.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• Strong fundamentals in data structures, algorithms, and software design.
• Proficiency in Python with AI/ML libraries (NumPy, pandas, SciPy, TensorFlow, PyTorch).
• Experience with AI/ML through coursework, research, projects, or internships.
• Familiarity with AI models, Transformers and Diffusers.
• Experience with Git and agile development methodologies.
• Excellent problem-solving and debugging skills.
• Strong communication and collaboration abilities.
• Curiosity, willingness to learn, and desire to build real systems.

Responsibilities

• Collaborate with engineers to design, develop, and test inference solutions for state-of-the-art AI models.
• Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL.
• Monitor and maintain production model-serving systems.
• Work on new features, fix bugs, and participate in code reviews.
• Participate in daily standups, design reviews, and team discussions.
• Explore new AI/ML techniques and tools, and experiment with improving model performance.

Skills

Data structures & algorithms

Python

AI/ML libraries

AI/ML coursework

Transformers & Diffusers

Git & Agile

Problem solving

Communication & collaboration

Curiosity & learning mindset

Bachelor/Master degree

Education

Bachelor’s or Master’s degree in CS/CE or related field

Tools

Python

CUDA

Git

C++

NCCL

Job description

DeepInfra is seeking early-career Software Engineers (0-2 years) to help build the infrastructure layer for AI. You will design, implement, and scale inference solutions, collaborating with seasoned engineers to ship production-grade AI systems.

Ideal candidates have a CS-related degree, strong fundamentals in data structures and algorithms, and hands-on Python with AI/ML libraries. This role offers growth in a fast-paced, high-impact environment working on real-world AI model serving.