Senior AI Platform Engineer - GenAI APIs & Scale

Google; Warszawa; On-site; PLN 640,000 - 655,000; Full time

Job summary

Google Cloud is seeking a senior software engineer to shape GenAI APIs and build scalable backend infrastructure for Vertex AI. You will develop high-performance systems powering large foundation models and collaborate with ML researchers and product managers to deliver enterprise-ready APIs.

The role involves designing API security, reliability, and observability in a fast-paced environment, with equity and great benefits. Location in Warsaw, Poland, and competitive compensation are offered.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience in systems architecture and large-scale serving infrastructure.
• Experience delivering technical solutions in a changing environment.
• Experience working in multinational or internationalised organisations on global initiatives.

Responsibilities

• Architect, develop, and maintain robust, horizontally scalable APIs and backend infrastructure tailored specifically for Generative AI workloads.
• Optimize routing, load balancing, quota management, and data plane mechanisms connecting user API requests to backend ML serving clusters across TPUs/GPUs.
• Prototype and launch new API products rapidly in a fast-paced environment to expose advancements in Google's foundation models.
• Collaborate with ML researchers, ML serving teams, and product managers to translate AI capabilities into reliable enterprise-grade APIs.
• Define and implement best practices for API security, high availability, fault tolerance, and observability across distributed systems.

Skills

Software development

Technical leadership

Systems architecture

ML infrastructure

Global initiatives

Education

Bachelor’s degree or equivalent practical experience

Master’s or PhD in Engineering/CS or related

Tools

GPUs

TPUs

ML infrastructure

Job description

Google Cloud is seeking a senior software engineer to shape GenAI APIs and build scalable backend infrastructure for Vertex AI. You will develop high-performance systems powering large foundation models and collaborate with ML researchers and product managers to deliver enterprise-ready APIs.

The role involves designing API security, reliability, and observability in a fast-paced environment, with equity and great benefits. Location in Warsaw, Poland, and competitive compensation are offered.