Senior Software Engineer - Dev Platform

Jobgether; Brasil; Remote; BRL 180,000 - 320,000; Full time

Benefits offered by this job

Remote work from Brazil

Impactful projects

Professional growth

Job summary

Jobgether is seeking a Senior Software Engineer – Dev Platform to build and scale an internal developer platform in Brazil. You will design APIs, SDKs, and tools to enable AI model usage safely, with governance and cost controls, working across engineering, security, and operations in a remote, international environment.

You will own features end-to-end, contribute to the AI Gateway, and help teams onboard quickly while ensuring reliability and observability.

Qualifications

• Experience as a backend or platform software engineer building, deploying, and operating APIs and distributed services.
• Proficiency in at least one backend language such as Rust, Python, or TypeScript, with clean, maintainable code.
• Practical understanding of LLM APIs, including auth, streaming, token accounting, rate limits, and provider failures.
• Experience with observability, CI/CD, containerized apps, Kubernetes, and at least one cloud provider.
• Ability to design well-documented APIs and developer tools for internal customers.

Responsibilities

• Build and extend the AI Gateway by integrating models and providers and developing budget controls and usage reporting.
• Design and maintain APIs and SDKs that help engineers onboard quickly and use AI services safely.
• Migrate existing workloads to the gateway with minimal disruption.
• Implement access controls, authentication, and audit logging with security teams.
• Develop observability to monitor latency, errors, token use, and costs.
• Own features from design to deployment and monitoring.
• Collaborate with SRE to maintain availability and performance.
• Provide documentation and troubleshooting guidance to internal users.
• Contribute to code reviews, design discussions, and engineering standards.

Skills

Backend development

API design

Distributed systems

Cloud platforms

Kubernetes

CI/CD

Tools

Rust

Python

TypeScript

LLM APIs

OAuth / OIDC

Job description

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Software Engineer – Dev Platform based in Brazil.

We are seeking an experienced software engineer to help build and scale an internal developer platform that enables engineering teams to integrate and use AI models efficiently, securely, and reliably. In this role, you will contribute to the development of a company-wide AI Gateway, providing unified access to leading large language model (LLM) providers. You will design APIs, SDKs, and self-service tools that simplify adoption while ensuring strong governance, observability, and cost control. Working across engineering, security, and site reliability teams, you will own features from initial design through production deployment. This is an opportunity to shape the infrastructure behind AI-powered development in a remote, international engineering environment.

Accountabilities

• Build and extend the AI Gateway by integrating new models and providers, implementing routing policies, and developing budget controls, rate limits, and usage and cost reporting.
• Design and maintain clean, scalable APIs, SDKs, and self-service tools that help engineering teams onboard quickly and use AI services safely.
• Support the migration of existing LLM workloads to the gateway while minimizing disruption to internal users and production systems.
• Implement access controls, API key management, authentication mechanisms, and audit logging in collaboration with security stakeholders.
• Develop observability capabilities that provide teams with visibility into latency, errors, token consumption, and costs across their workloads.
• Own features throughout the software development lifecycle, from technical design and implementation to deployment, monitoring, and ongoing improvements.
• Collaborate with site reliability engineering teams to maintain service availability, performance, resilience, and operational quality.
• Provide clear documentation, troubleshooting support, and technical guidance to internal users, incorporating their feedback into platform improvements.
• Contribute to code reviews, design discussions, technical documentation, and engineering standards across the developer platform team.

Requirements

• Demonstrated experience as a backend or platform software engineer building, deploying, and operating APIs and distributed services in production environments.
• Strong proficiency in at least one backend programming language, such as Rust, Python, or TypeScript, with a commitment to writing clean, maintainable, well-tested code.
• Practical understanding of LLM APIs, including authentication, streaming responses, token accounting, rate limits, and provider failures.
• Experience with observability practices, CI/CD pipelines, and containerized applications, along with working knowledge of Kubernetes and at least one major cloud provider.
• Ability to design well-documented APIs and developer tools for internal customers, balancing technical considerations with usability and user feedback.
• Strong problem-solving skills, clear written and verbal communication, and the ability to take ownership of projects from conception through production.
• A collaborative mindset and the ability to work effectively across engineering, security, and operations teams in a distributed environment.

Nice to have:

• Experience with API gateways, reverse proxies, or traffic management systems.
• Experience building LLM-powered applications or infrastructure, including model routing, caching, evaluation, and cost-control mechanisms.
• Familiarity with authentication and authorization standards and practices, such as OAuth, OpenID Connect (OIDC), and role-based access control (RBAC).
• Contributions to open-source infrastructure, backend systems, or developer-platform projects.

Benefits

• Remote work flexibility: Work remotely from Brazil as part of a globally distributed team.
• Meaningful technical impact: Help shape the infrastructure that enables engineering teams to build and deploy AI-powered solutions.
• Modern engineering environment: Work with LLM providers, distributed services, cloud infrastructure, and developer-platform technologies.
• End-to-end ownership: Drive technical initiatives from design through implementation, deployment, and continuous improvement.
• Cross-functional collaboration: Partner with engineering, security, and reliability specialists to build secure and dependable systems.
• Professional growth: Strengthen your expertise in backend engineering, AI infrastructure, API design, and platform development.
• Inclusive culture: Join an environment that values diverse backgrounds, perspectives, skills, and contributions.