Senior Software Engineer - MCP Server

EPAM Systems; México; Sur place; MXN 900 000 - 1 300 000; Plein temps

Avantages offerts par ce poste

Healthcare benefits

Paid time off

LinkedIn Learning access

Global career opportunities

Résumé du poste

EPAM Systems is seeking a Senior Software Engineer to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable access to LLMs and agentic workflows in a SAAS environment. You will drive architecture decisions, mentor teams, and deliver high-quality, scalable software across multi-tenant deployments.

The role requires deep expertise in Golang, Python, microservices, and cloud-native practices, with strong focus on governance, security, and performance

Qualifications

• 3+ years in principal engineer or senior architect roles.
• Proven ability to design large-scale distributed systems.
• Expertise in Golang and Python with cloud-native practices.

Responsabilités

• Develop the AI Gateway platform, including MCP, agents, LLM routing, governance, and observability.
• Translate requirements into architectural designs and scalable solutions.
• Design extensible MCP server frameworks, agent orchestration, and reusable skills.
• Architect gateway capabilities: semantic caching, rate limiting, quotas, and guardrails.
• Design auth models including multiple OIDC flows and token-based access control.
• Build prototypes and reference implementations to guide teams.
• Collaborate with product teams for integration patterns and architecture guidance.
• Review designs and code to ensure quality, performance, and security.
• Define and review CI/CD practices with GitHub-based pipelines.
• Architect Kubernetes deployment models ensuring scalability and production readiness.

Connaissances

Golang

Python

Distributed systems

Microservices

Kubernetes

OAuth

PostgreSQL

Redis

Outils

GitHub Actions

Docker

Description du poste

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are seeking a Senior Software Engineer to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable, and governed access to Large Language Models (LLMs) and agentic workflows across the enterprise in a SAAS environment.

Responsibilities

• Develop the AI Gateway platform, including MCP, agents, LLM routing, governance, and observability
• Translate business and product requirements into clear problem statements, architectural designs, and scalable technical solutions
• Design extensible frameworks for MCP server capabilities and integrations, as well as agent orchestration and reusable agent skills
• Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage
• Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
• Build prototypes and reference implementations to validate architectural decisions and guide engineering teams
• Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices, and integration patterns
• Review designs and code, providing actionable feedback to ensure quality, performance, scalability, and security
• Define and review CI/CD best practices using modern GitHub-based pipelines
• Architect and review Kubernetes-based deployment models, ensure scalability, resiliency, and production readiness

Requirements

• 3+ years of software engineering experience, including significant responsibility in a principal engineer role
• Proven experience designing and delivering large-scale distributed systems or platform products
• Proficiency in Golang and Python
• Familiarity with AI centric development with strong emphasis on quality gates and architecture patterns to enforce agentic behavior in producing quality code
• Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability
• Experience with microservices and service-oriented architectures for multi-tenant SAAS environments
• Skills in PostgreSQL for transactional data and Redis for caching and distributed coordination
• Strong background in authentication and authorization systems, particularly OAuth-based approaches
• Demonstrated ability to independently drive problem definition, architecture, prototype, and execution guidance
• Experience designing platforms and frameworks used by multiple product teams

Nice to have

• Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks
• Knowledge of working with EDA software
• Prior work on LLM gateways, API gateways, or AI middleware platforms
• Experience building generic developer frameworks or SDKs adopted across teams
• Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques
• Experience operating high-throughput, low-latency systems in Kubernetes environments
• Strong written and verbal communication skills for cross-team architectural alignment

We offer

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

EPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.