AI Infrastructure Software Engineer

DeepInfra; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

DeepInfra is hiring Software Engineers to design, build, and scale infrastructure for serving open‑source AI models in production. You will own end‑to‑end features, optimize performance, and contribute to system design across the stack.

The role requires strong Python and C++ skills, experience with AI/ML frameworks, and a track record of shipping robust software. Join a fast‑paced team shaping AI infrastructure at scale.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• 3+ years of relevant experience.
• Strong fundamentals in data structures, algorithms, and software design.
• Proficiency in Python and experience with AI/ML frameworks (PyTorch, TensorFlow).
• Hands-on experience building, shipping, and maintaining software systems.
• Familiarity with AI models, Transformers, and Diffusers.
• Experience with version control (Git) and collaborative development workflows.

Responsibilities

• Design, develop, and test inference solutions for state‑of‑the‑art AI models.
• Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL.
• Own and operate production model-serving systems, including monitoring and debugging.
• Build new features, improve system performance, and contribute to overall system design.
• Participate in code reviews and technical discussions to maintain high engineering standards.
• Explore and apply new AI/ML techniques to improve model performance and efficiency.
• Take ideas from concept to production.

Skills

Python

C++

Git

AI/ML frameworks

Education

Bachelor’s or Master’s degree in Computer Science/Engineering

Tools

CUDA

NCCL

PyTorch

TensorFlow

Job description

DeepInfra is hiring Software Engineers to design, build, and scale infrastructure for serving open‑source AI models in production. You will own end‑to‑end features, optimize performance, and contribute to system design across the stack.

The role requires strong Python and C++ skills, experience with AI/ML frameworks, and a track record of shipping robust software. Join a fast‑paced team shaping AI infrastructure at scale.