Staff AI Engineer: Agentic Infra & Knowledge Platform

Zoomcar; United States; On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Inclusive environment

Hybrid-friendly office spaces

Health, vision and dental coverage

Benefits from day one

Generous PTO and holidays

401(k) match

Parental leave

Wellness resources

Job summary

ShiftKey is hiring a Staff AI Engineer to own and evolve the AI infrastructure stack, including the organizational knowledge platform, cloud hosting for AI agents, and retrieval layers. You will work with the platform team and senior leadership to shape the roadmap, driving multi‑hop retrieval, tool use, and cost governance in a HIPAA-regulated environment.

You will join a fully remote role based in the United States, collaborating asynchronously across time zones and with partners in healthcare

Qualifications

• 7+ years of professional software engineering experience, with at least 2 years building and operating production AI/LLM application systems.
• Retrieval engineering beyond basics: hybrid search, re‑ranking, context window management.
• Working with agentic frameworks and multi‑step reasoning loops - tool use, cost governance, and model routing trade‑offs.
• Production‑grade software engineering fluency (strict typing, testing, async/concurrency, modern toolchain) in Go, Python, or TypeScript.
• Hands‑on experience operating AI workloads on a managed cloud AI platform (AWS Bedrock or Azure Foundry) including identity/secrets model and governance.
• Hands‑on Terraform experience - authoring and provisioning new infrastructure independently.
• Familiarity with production observability for AI systems: metrics, structured logging for model spend and latency, evaluation harnesses.
• Understanding HIPAA‑style data handling in a regulated SaaS environment; healthcare experience is a plus.

Responsibilities

• Evolving the AI knowledge platform to serve internal tools and customer‑facing capabilities.
• Architecting and operating agentic infrastructure on AWS with cost guardrails and observability from day one.
• Designing graph‑based, relationship‑aware retrieval across data sources for multi‑hop queries.
• Partnering with product engineering to define the AI platform API surface.
• Building reference agent implementations for incident triage and customer support.
• Owning the AI infrastructure cost model and monitoring spend with guardrails.

Skills

AI/LLM production systems

Retrieval engineering

Agentic frameworks

Go/Python/TypeScript

Cloud platforms (AWS Bedrock/Azure)**

Terraform

Observability for AI

HIPAA data handling

Tools

Go/Python/TypeScript codebase

Job description

ShiftKey is hiring a Staff AI Engineer to own and evolve the AI infrastructure stack, including the organizational knowledge platform, cloud hosting for AI agents, and retrieval layers. You will work with the platform team and senior leadership to shape the roadmap, driving multi‑hop retrieval, tool use, and cost governance in a HIPAA-regulated environment.

You will join a fully remote role based in the United States, collaborating asynchronously across time zones and with partners in healthcare