Senior Backend Engineer (Golang & LLM) - High Impact

Underdog: Verified engineers. Interview-ready. Searching confidentially. And companies apply to you; United States; On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Equity ownership

Competitive salary

Cutting-edge tech stack

A-player team

Job summary

Underdog is seeking a Software Engineer with strong Golang and Python skills to design, build, and scale backend services powering an AI-driven platform. You will work on APIs, data pipelines, and integration with a range of LLM providers, while collaborating with ML researchers to productionize models.

Join a small, fast-moving team that values ownership, clean code, and delivering production-grade features from concept to deployment in a cloud-enabled environment.

Qualifications

• 3+ years of professional software development experience with a strong focus on backend systems.
• Proven, hands-on experience shipping production-level services in Python or Golang.
• Solid understanding of computer science fundamentals: data structures, algorithms, and system design.
• Experience with cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes).
• Passion for AI/ML and Large Language Models.

Responsibilities

• Design, develop, and maintain high-performance, distributed backend services in Golang.
• Architect and implement robust APIs and data pipelines for LLM-based inference systems.
• Integrate with various LLM providers (OpenAI, Anthropic) and open-source models, optimizing latency and cost.
• Contribute to the full software lifecycle from concept to deployment and operations.
• Collaborate with ML researchers to productionize models and algorithms.
• Write clean, well-tested, maintainable code and participate in code reviews.
• Identify and address performance bottlenecks and scalability challenges.

Skills

Golang

Python

Backend systems

Cloud platforms

Docker/Kubernetes

Algorithms & data structures

Independent work

Tools

AWS

GCP

Azure

Docker

Kubernetes

OpenAI

Anthropic

LLM integration

Job description

Underdog is seeking a Software Engineer with strong Golang and Python skills to design, build, and scale backend services powering an AI-driven platform. You will work on APIs, data pipelines, and integration with a range of LLM providers, while collaborating with ML researchers to productionize models.

Join a small, fast-moving team that values ownership, clean code, and delivering production-grade features from concept to deployment in a cloud-enabled environment.