Remote AI Infrastructure & Platform Engineer

Jobgether; United States; Remote; USD 110,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Bonus

Fully remote

Health benefits

PTO

401(k) plan

Professional development

Impactful work

Job summary

Jobgether seeks a Software Engineer, Infrastructure & Platform, to own the backend of large-scale AI evaluation systems. You will design secure, reproducible environments where models can run code and interact with tools.

The role blends cloud infrastructure, distributed systems, and AI safety, with remote U.S.-based work. You will build evaluation platforms, APIs, and tooling, ensuring reliability, observability, and security at scale while collaborating with researchers, analysts, and security

Qualifications

• 3–5+ years of professional software engineering experience in backend, infrastructure, or distributed systems.
• Strong Python programming skills and production-quality software experience.
• Experience designing and operating backend services, APIs, or distributed systems.
• Hands-on experience with Docker, Kubernetes, and virtual machines.
• Experience with AWS or GCP and cloud infrastructure concepts.
• Familiarity with Infrastructure as Code (Terraform) and automation tooling.
• Excellent debugging and troubleshooting across multicomponent systems.
• Ability to build reproducible, observable, scalable, and secure platforms.
• Comfort with ambiguity and rapid architectural changes.
• Strong collaboration with researchers, engineers, analysts, and security experts.

Responsibilities

• Design and build sandboxed evaluation environments for safe AI code execution.
• Develop backend services and infrastructure for large-scale AI evaluations.
• Create agent scaffolding and evaluation harnesses for tool-use loops and workflows.
• Provision environments using Docker, Kubernetes, VMs and cloud infrastructure.
• Implement secure networking, credentials, and secrets management.
• Develop APIs and automation to support researchers and engineers.
• Improve reliability with logging, observability, and automated tests.
• Scale platform to run thousands of evaluation tasks with telemetry capture.
• Collaborate with analysts and domain experts to translate concepts into systems.
• Investigate failures across layers to distinguish model issues from environment problems.

Skills

Python programming

Backend engineering

Distributed systems

Debugging

CI/CD

Tools

Docker

Kubernetes

Virtual machines

Terraform

Job description

Jobgether seeks a Software Engineer, Infrastructure & Platform, to own the backend of large-scale AI evaluation systems. You will design secure, reproducible environments where models can run code and interact with tools.

The role blends cloud infrastructure, distributed systems, and AI safety, with remote U.S.-based work. You will build evaluation platforms, APIs, and tooling, ensuring reliability, observability, and security at scale while collaborating with researchers, analysts, and security