Senior Software Engineer, AI Gateway Platform - Remote

Jobgether; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Jobgether is seeking backend engineers to extend the AI Gateway with new models, routing policies, and budget controls. The role involves designing and maintaining scalable APIs and self-service tools while supporting migration of LLM workloads and implementing security measures.

You will collaborate with security and SRE in a globally distributed team and work in a remote setting from Brazil with a modern cloud-container stack.

Responsibilities

• Extend the AI Gateway with new models, routing policies, and budget controls.
• Design and maintain scalable APIs and self-service tools.
• Support migration of LLM workloads and implement security measures.
• Collaborate with security and SRE in a globally distributed team.

Job description

Jobgether is seeking backend engineers to extend the AI Gateway with new models, routing policies, and budget controls. The role involves designing and maintaining scalable APIs and self-service tools while supporting migration of LLM workloads and implementing security measures.

You will collaborate with security and SRE in a globally distributed team and work in a remote setting from Brazil with a modern cloud-container stack.