Senior AI Platform Engineer — Gateways & Guardrails

Indeed; Austin (TX); On-site; USD 118,000 - 248,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k plan

Open paid time off

26 weeks paid parental leave

Job summary

Indeed is seeking a Software Engineer III to join the AI Gateway & Guardrails team in Austin, Texas. In this role, you will own the development of platform services for AI-powered products, focusing on secure, scalable access to large and small language models. The ideal candidate has a Bachelor's degree in a relevant field and substantial experience with cloud infrastructure and distributed systems. Benefits include open paid time off, equity programs, and a comprehensive health package.

Qualifications

• Minimum of 5 years of related experience or advanced degrees with less experience.
• Demonstrated ownership, accountability, and a proactive mindset.

Responsibilities

• Design, implement, and maintain platform services for LLM and SLM access.
• Facilitate technical discussions and contribute to architectural decisions.
• Collaborate with cross-functional teams to deliver production-ready AI systems.

Skills

Building or operating large-scale distributed systems

Proficiency with cloud infrastructure (AWS, GCP, Azure)

Experience with AI/ML systems

Familiarity with reliability engineering practices

Solid grounding in data structures and algorithms

Education

Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering

Job description

Indeed is seeking a Software Engineer III to join the AI Gateway & Guardrails team in Austin, Texas. In this role, you will own the development of platform services for AI-powered products, focusing on secure, scalable access to large and small language models. The ideal candidate has a Bachelor's degree in a relevant field and substantial experience with cloud infrastructure and distributed systems. Benefits include open paid time off, equity programs, and a comprehensive health package.