Software Architect

Suki; Bengaluru; On-site; INR 2,500,000 - 3,500,000; Full time

Benefits offered by this job

Equal Opportunity Employer

Diversity and inclusion focus

Job summary

Suki is seeking a Software Architect to join our Engineering team in Bengaluru, India. You will be pivotal in maintaining architectural coherence across complex systems, driving the design of an efficient production architecture and bridging the gap between AI research and production infrastructure.

The ideal candidate will have over 10 years of software engineering experience, expertise in Go or Python, and a strong understanding of streaming systems. This role involves direct influence on architectural decisions, mentoring engineers, and fostering technical excellence across multiple disciplines.

Qualifications

• 10+ years of professional software engineering experience.
• Proven architectural experience at a senior level.
• Experience operating multi-TB storage systems.
• Experience with Redis Streams, Kafka, or equivalent.

Responsibilities

• Maintain architectural coherence across a complex surface area.
• Drive structural decomposition of platform and domain boundaries.
• Bridge AI research and production infrastructure.

Skills

Proficiency in Go or Python

Expertise in real-time streaming systems

Experience with GPU inference infrastructure

Familiarity with healthcare regulations

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

GCP

Kubernetes

Docker

gRPC

Job description

What we want to accomplish and why we need you.

Suki is a leading technology company that provides AI voice solutions for healthcare. Its mission is to reimagine the healthcare technology stack, making it invisible and assistive to lift the administrative burden from clinicians. Its flagship product is Suki Assistant, an AI assistant that uses generative AI to automatically create clinical documentation by ambiently listening to patient‑clinician conversations. Suki helps clinicians complete notes 72% faster on average, assists with other tasks including coding and answering questions, and generates incremental revenue for organizations, delivering a 9X ROI in year 1. Suki also offers its proprietary AI and speech platform, Suki Platform, to partners who want to create best‑in‑class ambient and voice experiences for their solutions. Clinicians that use Suki already spend over 70% less time on administrative tasks, and we’re striving to do even better. Come and join us! We are a user‑driven company and are committed to making sure every pixel of our product is in service of the doctors. We’re a team of technologists, clinicians, and industry experts working together to push the limits on technology used in medicine. We’re confident enough to move fast and talented enough not to break things.

What will you do every day?

We are looking for a Software Architect to join our Engineering team. Suki's architecture practice is at an inflection point. We have sustained significant CCU growth, completed a demanding OLTP Database scaling journey, leveraged Redis Streams based service orchestration, deployed self‑hosted ML models, built agent‑driven workflows, launched an Offline Data Platform, and maintained a client surface spanning iOS, Android, Web, SDKs, and a Chrome extension — with on‑device ML capabilities across all of them. The Architect is the person who holds institutional memory and architectural coherence across this surface area — so that decisions made in isolation don’t quietly contradict each other, patterns are reused rather than reinvented, and deviations from established patterns are documented, not silently absorbed. The work ahead includes enhanced agentic capabilities, continued multi‑region expansion, investments on stream‑based/offline data processing, and a growing ML inference footprint.

On a day to day basis, you will:

• Maintain architectural coherence across a complex and wide surface area.
• Own the load‑bearing substrate through future growth and failure scenarios. The system must survive several multiples of current enterprise scale and every class of infrastructure event we can name.
• Drive the structural decomposition of platform and domain boundaries, service boundaries across the microservice portfolio, agentic framework direction, auth and access‑control architecture, and cross‑cutting concerns like observability and rate limiting.
• Bridge AI research and production infrastructure. Translate LLM and model requirements into efficient, production‑grade services. Lead the agentic framework direction — memory architectures, tool orchestration, A2A patterns, semantic caching. Operate a GPU fleet at high duty cycle and understand dynamic batching, cross‑session batching tradeoffs, and HPA calibration for GPU workloads.
• Document architectural patterns and deviations. Write Architectural Design Records, RFCs, and breaking‑points documents that stand alone for readers unfamiliar with the context. Document deviations from established patterns with their reasons — not as failures, but as data points.
• Remain hands‑on — stay connected to the craft, read and write code. Prototype new architectures. Review pull requests for patterns that matter. Implement the hard parts of a new pattern yourself when it matters. Lead resolution of the most critical incidents.
• Mentor and elevate the engineering organization. Act as a technical multiplier for senior engineers across backend, data, and ML disciplines. Hold a room, defend a position under pushback without collapsing into agreement, and adjust register for engineering vs. product vs. leadership audiences. Foster a culture of deep technical understanding, not just pattern‑matching.
• Represent Suki’s architecture and engineering both in internal and external forums through technical blogs, conferences and meetups.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent production experience
• 10+ years of professional software engineering experience, with a proven track record operating at an Architect, Staff, or Principal level
• Expert‑level proficiency in Go or Python, with the ability to lead architectural decisions and remain hands‑on in code
• Production ownership of a real‑time streaming system (Redis Streams, Kafka, Pulsar, or equivalent) at scale — including personal pager experience and a specific debugging story for a duplicate‑processing or lost‑message bug
• Experience operating multi‑TB storage systems with active OLTP traffic
• Hands‑on experience with offline/batch architectures: Airflow or equivalent orchestration, columnar formats (Iceberg, Delta, or Hudi), and warehouse‑scale query engines (BigQuery, Snowflake, or Redshift)
• Experience designing and operating GPU inference infrastructure at scale, including dynamic batching, Triton/TensorRT, and HPA calibration for GPU workloads — or equivalent ML inference platform depth
• Experience integrating and scaling systems using LLM APIs or foundation models, with opinions about agent framework design, memory architectures, and tool orchestration
• Demonstrated experience navigating product‑vs‑platform decomposition in a real organization — including having been wrong, and articulating what the reversing signal was
• Proven ability to reason about client‑side implications of backend decisions across native mobile, web, SDK, and browser extension surfaces
• Familiarity with healthcare‑adjacent regulation (HIPAA, PIPEDA, PHIPA, SOC2, or HITRUST) as a design constraint, not just a compliance requirement, will be a strong plus
• Strong experience with GCP, Kubernetes, Docker, gRPC, and Protocol Buffers; multi‑region architecture and data residency design will be a strong plus

What We’re Looking For

• Distinguished Technical Expertise: You are a recognized expert with a proven history of architecting, building, and operating complex systems with a strong software engineering talent.
• Strategic, Systems‑Level Thinker: You look beyond immediate requirements to anticipate future challenges. You can navigate deep ambiguity, identify long‑term risks, and make high‑judgment decisions that balance technical purity with business velocity.
• Pragmatic and Action‑Oriented: You have a bias for action and a data‑driven approach to problem‑solving. You understand the entire lifecycle of an ML‑powered feature, from data to deployment, and know how to ship robust solutions quickly.
• Leadership Through Influence: You have a demonstrated ability to lead complex, cross‑functional technical initiatives without direct authority. You build

Suki is an Equal Opportunity Employer. We are dedicated to building a company that fosters inclusion and belonging and reflects the diverse communities we serve across the country. We know we are stronger this way, and we look forward to growing our team with these shared values.