Senior Software Engineer

Indeed; Milwaukee (WI); On-site; USD 118,000 - 248,000; Full time

Benefits offered by this job

Medical insurance

401k

RSUs

Open PTO

Paid holidays

Parental leave

Job summary

Indeed is seeking a Senior Software Engineer for the AI Gateway & Guardrails team in Milwaukee. You will own development of platform services connecting Indeed's AI-powered products to large language models and safety layers, across cloud providers, while driving reliability and compliance from design to production.

The role focuses on removing barriers for teams to experiment with generative AI, guiding architecture, and ensuring scalable, secure access to AI services with strong collaboration

Qualifications

• Experience building or operating large-scale distributed systems
• Proficiency with major cloud providers (AWS, GCP, Azure)
• Experience with AI/ML systems, including LLM-based services
• Familiarity with reliability engineering practices and SRE concepts
• Solid CS fundamentals with problem-solving skills
• Demonstrated ownership and proactive mindset

Responsibilities

• Design and maintain platform services for LLM/SLM access across clouds
• Improve multi-provider access, failover, and rate-limiting
• Enhance AI Guardrails Platform (content moderation, PII redaction)
• Lead architectural discussions and drive reliability improvements
• Collaborate with cross-functional teams to ensure production readiness
• Share knowledge and mentor teammates

Skills

Large-scale distributed systems

Cloud infrastructure

AI/ML systems

SLOs and observability

On-call readiness

Technical leadership

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

GCP

Azure

Job description

Our Mission

As the world’s number 1 job site*, our mission is to help people get jobs. We strive to cultivate an inclusive and accessible workplace where all people feel comfortable being themselves. We're looking to grow our teams with more people who share our enthusiasm for innovation and creating the best experience for job seekers.

(*Comscore, Total Visits, March 2026)

Day to Day

As a Senior Software Engineer on the AI Gateway & Guardrails team at Indeed, you will own and drive the development of platform services that connect Indeed's AI-powered products to large and small language models (LLM and SLM), and safeguards AI actions. You will work alongside experienced engineers developing features for two core services; 1) AI Gateway, Indeed’s unified entry point for multiple model providers with built-in best practices, and 2) AI Guardrails Platform, Indeed’s universal safety layer for language model powered products.

In this role, you’d remove technical barriers to entry for teams all across Indeed to experiment with generative AI. This work provides an opportunity to leverage cutting‑edge technologies across multiple cloud providers, influence the product direction for a broad spectrum of client teams, and guide best practices for AI use. You will contribute to architectural decisions, drive service reliability through SLOs and operational readiness, and partner with product teams across Indeed to ensure the platform meets compliance and quality standards required for production AI deployment.

Responsibilities

• Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments.

• Contribute to multi-provider access, failover, and rate‑limiting capabilities across cloud platforms (Azure, AWS, and GCP).

• Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction

• Facilitate technical discussions and contribute architectural decisions at the service and system level.

• Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development.

• Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production‑ready AI systems.

• Share knowledge and provide technical guidance with teammates.

Skills/Competencies

• Requires a Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, Electrical Engineering, or related field and a minimum of 5 years of related experience; or a Master’s degree with a minimum of 3 years of experience; or a PhD without experience

• Experience building or operating large‑scale distributed systems, ideally within platform or infrastructure environments

• Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations

• Experience with or interest in AI/ML systems, including LLM‑based services, prompt engineering, or AI safety approaches

• Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on‑call readiness

• Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems

• Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn

Salary Range Transparency

Tier 1 - United States of America 118,000 - 178,000 USD per year

Tier 2 - United States of America 131,000 - 197,000 USD per year

Tier 3 - United States of America 145,000 - 217,000 USD per year

Tier 4 - United States of America N/A

Tier 5 - United States of America 166,000 - 248,000 USD per year

Salary Range Disclaimer

The salary range for this role reflects the minimum and maximum compensation for the role. Offers are typically made between the range minimum and the range midpoint. Actual compensation will be determined based on job-related skills, experience, and expertise, as evaluated during the interview process. The range(s) listed is just one component of Indeed's total compensation package for employees. Other rewards may include quarterly bonuses, Restricted Stock Units (RSUs), a Paid Time Off policy, and many region‑specific benefits. Compensation may also vary based on where a role is performed, as work locations are grouped into geographic pay tiers to reflect cost of labor differences in different geographic markets. Candidates can view geographic pay tiers by location on our career site ( https://www.indeed.com/careers/paytiers ), and recruiters can confirm how location is considered for a specific role.

Benefits - Health, Work/Life Harmony, & Wellbeing

We care about what you care about. We have a multitude of benefits to support Indeedians, as well as their pets, kids, and partners including medical, dental, vision, disability and life insurance. Indeedians are able to enroll in our company’s 401k plan, as well as an equity‑based incentive program. Indeedians will also receive open paid time off, 11 paid holidays a year and up to 26 weeks of paid parental leave. For more information, select your country and learn more about our employee benefits, program, & perks at https://www.indeed.com/careers/benefits !

Equal Opportunities and Accommodations Statement

Indeed is deeply committed to building a workplace and global community where inclusion is not only valued, but prioritized. We’re proud to be an equal opportunity employer, seeking to create a welcoming and diverse environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, family status, marital status, sexual orientation, national origin, genetics, neuro‑diversity, disability, age, or veteran status, or any other non‑merit based or legally protected grounds.

Indeed provides reasonable accommodations to qualified individuals with disabilities in the employment application process. To request an accommodation, please visit https://www.indeed.com/careers/accommodations . If you are requesting accommodation for an interview, please reach out at least one week in advance of your interview.

For more information about our commitment to equal opportunity/affirmative action, please visit our Careers page ( https://www.indeed.com/careers ).

Inclusion & Belonging

Inclusion and belonging are fundamental to our hiring practices and company culture, forming an integral part of our vision for a better world of work. At Indeed, we’re committed to the wellbeing of our employees and on a mission to make this the best place to work and thrive. We believe that fostering an inclusive environment where every employee feels respected and accepted benefits everyone, fueling innovation and creativity.

We value diverse experiences, including those who have had prior contact with the criminal legal system. We are committed to providing individuals with criminal records, including formerly incarcerated individuals, a fair chance at employment.

Those with military experience are encouraged to apply. Equivalent expertise demonstrated through a combination of work experience, training, military experience, or education is welcome.

Indeed’s Employee Recruiting Privacy Policy

Like other employers Indeed uses our own technologies to help us find and attract top talent from around the world. In addition to our site’s user and privacy policy found at https://www.indeed.com/legal , we also want to make you aware of our recruitment specific privacy policy found at https://www.indeed.com/legal/indeed-jobs .

Agency Disclaimer

Indeed does not pay placement fees for unsolicited resumes or referrals from non‑candidates, including search firms, staffing agencies, professional recruiters, fee‑based referral services, and recruiting agencies (each individually, an \"Agency\"), subject to local laws. An Agency seeking a placement fee must obtain advance written approval from Indeed's internal Talent Acquisition team and execute a fee agreement with Indeed for each job opening before making a referral or submitting a resume for that opening.

AI Notice

Indeed is committed to ensuring fairness and transparency throughout our hiring process. We use artificial intelligence (AI) tools to assist in the screening, assessment, and selection of applicants for this position by analyzing information provided in resumes and applications. Our use of AI does not replace human decision‑making.

Unless otherwise notified, Indeed does not use AI constituting an AEDT or an ADMT as those tools are defined in applicable laws.

Reference ID: 47662

The deadline to apply to this position is 9/4/2026. Job postings may be extended at the hiring team’s discretion based on applicant volume.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Reference ID: 47662