Senior Software Engineer

Indeed; Austin (TX); On-site; USD 118,000 - 248,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k plan

Open paid time off

26 weeks paid parental leave

Job summary

Indeed is seeking a Software Engineer III to join the AI Gateway & Guardrails team in Austin, Texas. In this role, you will own the development of platform services for AI-powered products, focusing on secure, scalable access to large and small language models. The ideal candidate has a Bachelor's degree in a relevant field and substantial experience with cloud infrastructure and distributed systems. Benefits include open paid time off, equity programs, and a comprehensive health package.

Qualifications

• Minimum of 5 years of related experience or advanced degrees with less experience.
• Demonstrated ownership, accountability, and a proactive mindset.

Responsibilities

• Design, implement, and maintain platform services for LLM and SLM access.
• Facilitate technical discussions and contribute to architectural decisions.
• Collaborate with cross-functional teams to deliver production-ready AI systems.

Skills

Building or operating large-scale distributed systems

Proficiency with cloud infrastructure (AWS, GCP, Azure)

Experience with AI/ML systems

Familiarity with reliability engineering practices

Solid grounding in data structures and algorithms

Education

Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering

Job description

Day to Day

As a Software Engineer III on the AI Gateway & Guardrails team at Indeed, you will own and drive the development of platform services that connect Indeed's AI‑powered products to large and small language models (LLM and SLM), and safeguard AI actions. You will work alongside experienced engineers developing features for two core services; 1) AI Gateway, Indeed’s unified entry point for multiple model providers with built‑in best practices, and 2) AI Guardrails Platform, Indeed’s universal safety layer for language model powered products.

In this role, you’ll remove technical barriers to entry for teams all across Indeed to experiment with generative AI. This work provides an opportunity to leverage cutting‑edge technologies across multiple cloud providers, influence the product direction for a broad spectrum of client teams, and guide best practices for AI use. You will contribute to architectural decisions, drive service reliability through SLOs and operational readiness, and partner with product teams across Indeed to ensure the platform meets compliance and quality standards required for production AI deployment.

Responsibilities

• Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments.
• Contribute to multi‑provider access, failover, and rate‑limiting capabilities across cloud platforms (Azure, AWS, and GCP).
• Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction.
• Facilitate technical discussions and contribute architectural decisions at the service and system level.
• Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development.
• Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production‑ready AI systems.
• Share knowledge and provide technical guidance with teammates.

Skills/Competencies

• Requires a Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering, and a minimum of 5 years of related experience; or a Master’s degree with a minimum of 3 years of experience; or a PhD without experience.
• Experience building or operating large‑scale distributed systems, ideally within platform or infrastructure environments.
• Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations.
• Experience with or interest in AI/ML systems, including LLM‑based services, prompt engineering, or AI safety approaches.
• Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on‑call readiness.
• Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems.
• Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn.

Salary Range Transparency

Tier 1 - United States of America 118,000 - 178,000 USD per year

Tier 2 - United States of America 131,000 - 197,000 USD per year

Tier 3 - United States of America 145,000 - 217,000 USD per year

Tier 4 - N/A

Tier 5 - United States of America 166,000 - 248,000 USD per year

Salary Range Disclaimer

The salary range for this role reflects the minimum and maximum compensation for the role. Offers are typically made between the range minimum and the range midpoint. Actual compensation will be determined based on job‑related skills, experience, and expertise, as evaluated during the interview process. The range(s) listed is just one component of Indeed's total compensation package for employees. Other rewards may include quarterly bonuses, Restricted Stock Units (RSUs), a Paid Time Off policy, and many region‑specific benefits. Compensation may also vary based on where a role is performed, as work locations are grouped into geographic pay tiers to reflect cost of labor differences in different geographic markets. Candidates can view geographic pay tiers by location on our career site (https://www.indeed.com/careers/paytiers), and recruiters can confirm how location is considered for a specific role.

Benefits - Health, Work/Life Harmony, & Wellbeing

We care about what you care about. We have a multitude of benefits to support Indeedians, as well as their pets, kids, and partners including medical, dental, vision, disability and life insurance. Indeedians are able to enroll in our company’s 401k plan, as well as an equity‑based incentive program. Indeedians will also receive open paid time off, 11 paid holidays a year and up to 26 weeks of paid parental leave. For more information, select your country and learn more about our employee benefits, program, & perks at https://www.indeed.com/careers/benefits!

Equal Opportunities and Accommodations Statement

Indeed is deeply committed to building a workplace and global community where inclusion is not only valued, but prioritized. We’re proud to be an equal opportunity employer, seeking to create a welcoming and diverse environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, family status, marital status, sexual orientation, national origin, genetics, neuro‑diversity, disability, age, or veteran status, or any other non‑merit based or legally protected grounds.

Indeed provides reasonable accommodations to qualified individuals with disabilities in the employment application process. To request an accommodation, please visit https://www.indeed.com/careers/accommodations. If you are requesting accommodation for an interview, please reach out at least one week in advance of your interview.

For more information about our commitment to equal opportunity/affirmative action, please visit our Careers page (https://www.indeed.com/careers).