Principal Engineer

Sage; Bengaluru; Hybrid; INR 3,000,000 - 6,000,000; Full time

Job summary

Sage in Bengaluru is building AI-powered infrastructure to support coding and review agents with robust orchestration and memory systems.

The team delivers scalable agent tooling, observability, and SDKs to accelerate AI-driven development. You will mentor engineers, lead technical direction, and drive production readiness in a collaborative environment.

Qualifications

• 3+ years of software engineering (mid) or 6+ years (senior) with production AI systems.
• Hands-on experience in cloud environments (AWS/GCP/Azure) with containers and Kubernetes.
• Strong fundamentals in system design, data modelling, and API design.
• Proficiency with LLM tooling, prompts, RAG, and evaluation in production.
• Experience with IaC tools and observability pipelines for scalable infra.

Responsibilities

• Build and operate agent platforms, registries, and sandboxed execution.
• Develop coding/review agents that scale to large codebases and SDLC integration.
• Design context and memory management including RAG and long-term state.
• Create offline and online evaluation frameworks to measure agent quality.
• Develop SDKs and internal tooling to enable other teams to adopt the platform.
• Own observability for agent systems, including tracing, cost, and latency.
• Collaborate with engineers to identify high-value workflows and iterate on data.

Skills

System design

API design

Data modelling

Cloud platforms

AWS

GCP

Azure

Kubernetes

Infrastructure as code

LLMs

Agent frameworks

Prompt engineering

RAG

Evaluation

Observability

CI/CD

Tools

Terraform

Docker

Git

Prometheus

Grafana

Job description

AI Infrastructure Engineer (Mid / Senior)

Location: Bengaluru (Hybrid – 3 days a week in office)

About Us

Sage is a global leader in accounting and business management software, trusted by millions of businesses worldwide. Together with our Bengaluru engineering team, we are building finance, accounting, payroll and expense management solutions that simplifies how businesses track and reconcile spending.

Thousands of finance teams globally use our product to streamline expense management, integrate seamlessly with leading accounting platforms, and are recognized for its clean design, usability, and speed.

We’re investing heavily in AI — building the platform that lets AI agents and assistants do real engineering work, reliably and at scale. This team designs and runs the infrastructure behind our coding agents, review agents, and internal AI assistants: the orchestration, context and memory systems, evaluation frameworks, and feedback loops that make them better over time.

What We’re Looking For

We’re looking for someone with 3+ years of software engineering experience (mid-level) or 6+ years (senior), with hands‑on experience building LLM‑powered or agent‑based systems in production.

Technical Skills

• Solid software engineering fundamentals: system design, API design, data modelling, and clean, maintainable code.
• Experience building and running production systems in the cloud (AWS, GCP, or Azure), including containers, Kubernetes or similar, and infrastructure as code.
• Hands‑on experience with distributed systems: queues, async workflows, concurrency, reliability, and failure handling.
• Practical experience building with LLMs: tool use, agents, prompt and context engineering, RAG, and evaluation.
• Familiarity with agent protocols and ecosystems (e.g., MCP) and with using AI coding tools day to day.

Leadership & Ownership

• Comfort working independently and handling ambiguity: you can take a loosely defined problem, scope it, and drive it to production.
• Clear written and verbal communication, including explaining trade‑offs to both technical and non technical audiences.
• At the senior level, we also expect you to lead projects and set technical direction, mentor other engineers, define evaluation and quality standards, and influence architecture across teams.

Mindset & Collaboration

• Growth mindset — curious, always learning, and open to feedback.
• Works closely with the engineers who use these tools every day; you help the whole organization build software better and faster.

Nice to Have

• Experience with trace analysis or log mining to find and fix agent failure modes.
• Experience building internal platforms or SDKs that other teams adopted.
• Background in observability, CI/CD, or developer productivity tooling.
• Experience with model routing, cost optimization, or prompt caching.
• Open‑source or public contributions in agent tooling or LLM infrastructure.

What to Expect

• We value humility and collaboration — we’re looking for people who can work as part of a team, not in silos.
• We expect engineers to take ownership beyond just writing code — including tests, documentation, and long‑term system quality.

The Impact You’ll Make

• Build and operate agent platforms: orchestration, tool and skill registries, plugin frameworks, and sandboxed execution.
• Develop coding agents and review agents that work well on real, large codebases, and integrate them into the existing SDLC (IDE, CI/CD, code review, issue tracking).
• Design context and memory management: retrieval (RAG), summarization and compression, session state, long‑term memory, and repository‑aware context.
• Build evaluation frameworks — both offline (benchmarks, regression suites) and online (production quality signals) — so we can measure whether agents are improving.
• Create feedback loops: capture and mine traces, find failure patterns, and turn them into better prompts, tools, skills, and evals.
• Build developer tooling and internal SDKs that make it easy for other teams to build on and adopt the platform.
• Own observability for agent systems: tracing, cost and latency tracking, and quality monitoring.
• Work with engineers and stakeholders to identify high‑value workflows, ship quickly, and iterate on real usage data.

Product Delivery

India

Bangalore

Hybrid

Working at Sage means you’re supporting millions of small and mid‑sized businesses globally with technology to work smarter and move faster. We build software that reduces busywork so customers can spend less time on admin and more time building their business.

Our colleagues are high‑performers who prioritise growth, make bold choices, and focus and galvanise to get things done. They work on meaningful, market‑shaping initiatives that stretch their skills, sharpen their craft, and create real customer impact.

Explore our culture and benefits: sage.com/careers/working-at-sage

We celebrate individuality and welcome you to join us if you embrace all backgrounds, identities, beliefs, and ways of working. If you need support applying, contact [e-mail] .

Principal Engineer

Equal Employment Opportunity (EEO)

Sage is committed to Equal Employment Opportunity and providing reasonable accommodations to applicants with physical and/or mental disabilities.

In order to provide equal employment and advancement opportunities to all individuals, employment decisions at Sage will be based on merit, qualifications, and abilities. Sage does not discriminate in employment opportunities or practices on the basis of race, color, religion, sex, national origin, age, protected disability, veteran status, sexual orientation, gender identity, genetic information, or any other characteristic protected by applicable law.