We are seeking a Senior Software Engineer to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable, and governed access to Large Language Models (LLMs) and agentic workflows across the enterprise in a SAAS environment.ResponsibilitiesDevelop the AI Gateway platform, including MCP, agents, LLM routing, governance, and observabilityTranslate business and product requirements into clear problem statements, architectural designs, and scalable technical solutionsDesign extensible frameworks for MCP server capabilities and integrations, as well as agent orchestration and reusable agent skillsArchitect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usageDesign and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM trafficBuild prototypes and reference implementations to validate architectural decisions and guide engineering teamsPartner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices, and integration patternsReview designs and code, providing actionable feedback to ensure quality, performance, scalability, and securityDefine and review CI/CD best practices using modern GitHub-based pipelinesArchitect and review Kubernetes-based deployment models, ensure scalability, resiliency, and production readinessRequirements3+ years of software engineering experience, including significant responsibility in a principal engineer roleProven experience designing and delivering large-scale distributed systems or platform productsProficiency in Golang and PythonFamiliarity with AI centric development with strong emphasis on quality gates and architecture patterns to enforce agentic behavior in producing quality codeDeep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalabilityExperience with microservices and service-oriented architectures for multi-tenant SAAS environmentsSkills in PostgreSQL for transactional data and Redis for caching and distributed coordinationStrong background in authentication and authorization systems, particularly OAuth-based approachesDemonstrated ability to independently drive problem definition, architecture, prototype, and execution guidanceExperience designing platforms and frameworks used by multiple product teamsNice to haveExperience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworksKnowledge of working with EDA softwarePrior work on LLM gateways, API gateways, or AI middleware platformsExperience building generic developer frameworks or SDKs adopted across teamsFamiliarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniquesExperience operating high-throughput, low-latency systems in Kubernetes environmentsStrong written and verbal communication skills for cross-team architectural alignmentWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.