Remote Senior Go Backend Engineer for LLM Platform

EPAM Systems; Georgia; On-site; USD 130,000 - 180,000; Full time

Benefits offered by this job

We connect like-minded people

We invest in your growth

We cover it all

Job summary

EPAM Systems is seeking a Senior Software Engineer to design and build a scalable backend platform for evaluating LLM performance and providing inference endpoints for Generative AI at enterprise scale.

You will own critical backend services, integrate with external LLM providers, and drive reliability, security, and performance while collaborating with product teams. Remote work from Georgia is supported.

Qualifications

• 7+ years of professional software engineering experience with backend ownership.
• Strong Go expertise with idiomatic design, concurrency, and error handling.
• Experience building HTTP APIs, microservices, and SOA architectures.
• Deep PostgreSQL knowledge: schema design, optimization, migrations.
• Redis experience: caching, counters, rate-limiting.
• Experience with RBAC/ABAC authorization concepts.
• Strong Go testing discipline and test containers.
• Experience with observability and OpenTelemetry.
• Kubernetes and Helm deployments.
• CI/CD with GitHub Actions or equivalent.
• Ability to lead technical design and deliver independently.
• Familiarity with GenAI concepts and OpenAI APIs.
• Excellent communication and collaboration.
• English 2+ writing and speaking.

Responsibilities

• Design and implement production-grade backend features in Go.
• Build provider integration frameworks for external LLM vendors (OpenAI, Anthropic).
• Maintain backend service quality with unit/integration tests and CI/CD gates.
• Improve data access reliability and performance for PostgreSQL and Redis.
• Collaborate on architecture, scalability, security, and operations.
• Lead technical design discussions and deliver end-to-end solutions.
• Work with product teams on API requirements and issue resolution.
• Contribute to platform roadmap with technical input.

Skills

Go

Backend design

Microservices

PostgreSQL

Redis

Kubernetes

CI/CD

OpenAI APIs

RBAC/ABAC

Testing

Distributed systems

Tools

GitHub Actions

OpenTelemetry

Docker

Job description

EPAM Systems is seeking a Senior Software Engineer to design and build a scalable backend platform for evaluating LLM performance and providing inference endpoints for Generative AI at enterprise scale.

You will own critical backend services, integrate with external LLM providers, and drive reliability, security, and performance while collaborating with product teams. Remote work from Georgia is supported.