Senior Software Engineer

Indeed; New York (NY); On-site; USD 118,000 - 178,000; Full time

Benefits offered by this job

401k plan

Open paid time off

11 paid holidays

Parental leave up to 26 weeks

Medical, dental, and vision insurance

Job summary

Indeed is looking for a Software Engineer III in New York to own and develop platform services connecting AI products to language models. Responsibilities include maintaining a secure access platform, collaborating across teams for compliance and quality standards, and contributing to architectural decisions. Candidates should possess a Bachelor's degree and relevant experience in distributed systems and cloud infraestructura. Generous benefits include medical, dental, and open paid time off.

Qualifications

• 5+ years of experience for Bachelor's degree holders; 3+ for Master's; PhD candidates without experience.
• Expertise in cloud deployment, monitoring, and operations.
• Solid understanding of AI safety approaches.

Responsibilities

• Design, implement, and maintain secure platform services for LLM and SLM.
• Contribute to multi-provider access and failover mechanisms.
• Drive improvements to the AI Guardrails Platform.

Skills

Building or operating large-scale distributed systems

Cloud infrastructure proficiency (AWS, GCP, Azure)

AI/ML systems experience (LLMs, prompt engineering)

Reliability engineering practices (SLOs, observability)

Data structures and algorithms knowledge

Problem-solving skills

Proactive mindset and ownership

Education

Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering

Master’s degree in relevant field

PhD in relevant field

Job description

Day to Day

As a Software Engineer III on the AI Gateway & Guardrails team at Indeed, you will own and drive the development of platform services that connect Indeed's AI‑powered products to large and small language models (LLM and SLM), and safeguard AI actions. You will work alongside experienced engineers developing features for two core services; 1) AI Gateway, Indeed’s unified entry point for multiple model providers with built‑in best practices, and 2) AI Guardrails Platform, Indeed’s universal safety layer for language model powered products.

In this role, you’ll remove technical barriers to entry for teams all across Indeed to experiment with generative AI. This work provides an opportunity to leverage cutting‑edge technologies across multiple cloud providers, influence the product direction for a broad spectrum of client teams, and guide best practices for AI use. You will contribute to architectural decisions, drive service reliability through SLOs and operational readiness, and partner with product teams across Indeed to ensure the platform meets compliance and quality standards required for production AI deployment.

Responsibilities

• Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments.
• Contribute to multi‑provider access, failover, and rate‑limiting capabilities across cloud platforms (Azure, AWS, and GCP).
• Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction.
• Facilitate technical discussions and contribute architectural decisions at the service and system level.
• Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development.
• Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production‑ready AI systems.
• Share knowledge and provide technical guidance with teammates.

Skills/Competencies

• Requires a Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering, and a minimum of 5 years of related experience; or a Master’s degree with a minimum of 3 years of experience; or a PhD without experience.
• Experience building or operating large‑scale distributed systems, ideally within platform or infrastructure environments.
• Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations.
• Experience with or interest in AI/ML systems, including LLM‑based services, prompt engineering, or AI safety approaches.
• Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on‑call readiness.
• Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems.
• Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn.

Salary Range Transparency

Tier 1 - United States of America 118,000 - 178,000 USD per year

Tier 2 - United States of America 131,000 - 197,000 USD per year

Tier 3 - United States of America 145,000 - 217,000 USD per year

Tier 4 - N/A

Tier 5 - United States of America 166,000 - 248,000 USD per year

Salary Range Disclaimer

The salary range for this role reflects the minimum and maximum compensation for the role. Offers are typically made between the range minimum and the range midpoint. Actual compensation will be determined based on job‑related skills, experience, and expertise, as evaluated during the interview process. The range(s) listed is just one component of Indeed's total compensation package for employees. Other rewards may include quarterly bonuses, Restricted Stock Units (RSUs), a Paid Time Off policy, and many region‑specific benefits. Compensation may also vary based on where a role is performed, as work locations are grouped into geographic pay tiers to reflect cost of labor differences in different geographic markets. Candidates can view geographic pay tiers by location on our career site (https://www.indeed.com/careers/paytiers), and recruiters can confirm how location is considered for a specific role.

Benefits - Health, Work/Life Harmony, & Wellbeing

We care about what you care about. We have a multitude of benefits to support Indeedians, as well as their pets, kids, and partners including medical, dental, vision, disability and life insurance. Indeedians are able to enroll in our company’s 401k plan, as well as an equity‑based incentive program. Indeedians will also receive open paid time off, 11 paid holidays a year and up to 26 weeks of paid parental leave. For more information, select your country and learn more about our employee benefits, program, & perks at https://www.indeed.com/careers/benefits!

Equal Opportunities and Accommodations Statement

Indeed is deeply committed to building a workplace and global community where inclusion is not only valued, but prioritized. We’re proud to be an equal opportunity employer, seeking to create a welcoming and diverse environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, family status, marital status, sexual orientation, national origin, genetics, neuro‑diversity, disability, age, or veteran status, or any other non‑merit based or legally protected grounds.

Indeed provides reasonable accommodations to qualified individuals with disabilities in the employment application process. To request an accommodation, please visit https://www.indeed.com/careers/accommodations. If you are requesting accommodation for an interview, please reach out at least one week in advance of your interview.

For more information about our commitment to equal opportunity/affirmative action, please visit our Careers page (https://www.indeed.com/careers).