We are seeking a Lead Software Engineer to drive the design and growth of an AI Gateway that delivers secure, scalable LLM access in SAAS. You will shape MCP server and agent workflows, set governance and observability standards, and guide teams on architecture patterns and quality gates.ResponsibilitiesDevelop the AI Gateway platform across MCP, agents, LLM routing, governance, and observabilityTranslate business and product needs into crisp problem statements, architectural designs, and scalable technical solutionsDesign extensible frameworks for MCP server capabilities and integrations, plus agent orchestration and reusable agent skillsArchitect gateway features such as semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usageDefine and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM trafficBuild prototypes and reference implementations to validate architectural decisions and guide engineering teamsCollaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patternsReview designs and code, providing actionable feedback to improve quality, performance, scalability, and securityDefine and review CI/CD best practices using modern GitHub-based pipelinesArchitect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readinessRequirements5+ years of software engineering experience, including major ownership in a principal engineer roleHands-on experience designing and shipping large-scale distributed systems or platform productsStrong programming skills in Golang and PythonSolid background in AI centric development with a strong focus on quality gates and architecture patterns that enforce agentic behavior for producing quality codeDeep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalabilityDemonstrated experience with microservices and service-oriented architectures for multi-tenant SAAS environmentsPractical knowledge of PostgreSQL for transactional data and Redis for caching and distributed coordinationStrong background in authentication and authorization systems, particularly OAuth-based approachesProven ability to independently drive problem definition, architecture, prototype, and execution guidanceDemonstrated experience designing platforms and frameworks used by multiple product teamsEnglish proficiency at B2 level or higherNice to haveExperience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworksKnowledge of working with EDA softwarePrior work on LLM gateways, API gateways, or AI middleware platformsExperience building generic developer frameworks or SDKs adopted across teamsFamiliarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniquesExperience operating high-throughput, low-latency systems in Kubernetes environmentsStrong written and verbal communication skills for cross-team architectural alignmentWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.