Senior Software Engineer II - AI Platforms

MX; Chennai District; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

MX is seeking an experienced software engineer to architect and build AI developer platforms, including an LLM gateway and SDLC integrations. You will design scalable backend services, SDKs, APIs, and observability to accelerate engineering velocity across MX.

You will enable agent-based workflows, optimize latency and cost, implement governance and safety controls, and collaborate with SRE, security, and product teams to deliver reliable, secure AI capabilities across the organization.

Qualifications

• 8+ years of experience in software engineering, backend development, or platform engineering.
• Experience with LLMs and Agentic AI systems, including context engineering and model integration.
• Strong programming experience in Golang, Java, or Python.
• Experience designing and operating distributed, scalable backend services.
• Experience designing and consuming APIs, microservices, and event-driven architectures.
• Familiarity with CI/CD pipelines, testing frameworks, and developer tooling.
• Strong debugging and problem-solving skills in production environments.

Responsibilities

• Build AI developer platforms and LLM gateway across the SDLC.
• Enable agent-based workflows and harnesses.
• Developer experience: SDKs and APIs to reduce friction for AI capabilities.
• Design scalable backend systems for high-throughput AI workloads.
• Observability, governance, and safety controls for AI systems.
• Collaborate with platform, SRE, security, and product teams to ensure reliability and security.

Skills

LLMs

Agentic AI

Golang

Java

Python

Distributed systems

APIs

CI/CD

Kubernetes

Cloud platforms

Tools

AWS

Docker

Kubernetes

Job description

We are fueled by a moral imperative to advance mankind, and it all begins with our people, our product, and our purpose. Passion isn’t something we turn on and off; it’s woven into everything we do. If you thrive in high-challenge environments, are inspired by exceptional teammates, and are driven to grow beyond what you thought possible, MX is where you belong.

Come build the future with us. Join an award-winning company that isn’t just shaping the financial industry, but transforming it in ways that create meaningful, lasting impact for millions of people.

Job Responsibilities

• Build AI Developer Platforms and integration across SDLC: Design and build core AI developer platforms, like an LLM Gateway for standardized LLM access (routing, caching, observability, cost control), and integrate AI features (code generation, reviews, testing, debugging, documentation) across the SDLC.
• Enable Agentic Systems: Build frameworks and orchestration layers to enable developers to create, deploy, and operate agent-based workflows (multi-step reasoning systems, Harnesses, tool-using agents, etc.).
• Developer Experience & Productivity: Create intuitive abstractions, SDKs, and APIs that reduce friction and enable self-service adoption of AI capabilities across teams.
• Scalable Platform Architecture: Architect and operate highly scalable, low-latency backend systems for high-throughput AI workloads, establishing best practices and "golden paths" for AI application development.
• Observability & Governance: Implement monitoring, tracing, evaluation pipelines, and guardrails for AI systems, including prompt/version management, response quality tracking, and safety controls.
• Cost & Performance Optimization: Design systems to optimize latency, throughput, and cost of LLM usage through techniques like caching, batching, and model routing strategies.
• Collaboration: Work closely with platform, SRE, security, and product engineering teams to ensure AI capabilities are reliable, secure, and aligned with business needs.

Basic Qualifications

• 8+ years of experience in software engineering, backend development, or platform engineering.
• Experience working with LLMs and Agentic AI systems, including Context engineering, Harness engineering, evaluation, or model integration.
• Strong programming experience in languages such as Golang, Java, or Python.
• Experience building and operating distributed systems and scalable backend services.
• Experience designing and consuming APIs, microservices, and event-driven architectures.
• Familiarity with CI/CD pipelines, testing frameworks, and developer tooling.
• Strong debugging and problem-solving skills in production environments.

Preferred Qualifications

• Experience building or integrating LLM Gateways, AI SDKs, or internal AI platforms.
• Familiarity with agent frameworks (e.g., ADK, LangGraph, LangChain, or similar orchestration systems).
• Experience designing multi-step workflows or automation systems using AI.
• Knowledge of vector databases, embeddings, and retrieval-augmented generation (RAG) systems.
• Experience with observability for AI systems, including prompt/version tracking and evaluation pipelines.
• Understanding of cost optimization strategies for large-scale AI workloads.
• Experience building developer platforms or internal tools that improve engineering productivity.
• Exposure to SRE practices, including reliability, SLIs/SLOs, and incident response.
• Hands‑on experience with cloud platforms (AWS preferred) and containerized environments (Kubernetes).

Impact

• Accelerate engineering velocity across MX by embedding AI into everyday engineering workflows.
• Enable safe, scalable adoption of AI across the organization.
• Reduce cognitive load on developers through intelligent automation and tooling.
• Lay the foundation for autonomous and semi-autonomous engineering systems.

Compensation

The expected earnings for this role could be comprised of a base salary and other forms of cash compensation, such as bonus or commissions as applicable.

This pay range is just one component of MX’s total rewards package. MX takes a number of factors into account when determining individual starting pay, including job and level they are hired into, location, skillset, peer compensation.

• Please note applicants applying for this position must have the legal right to work in India without the need for sponsorship. We are unable to provide work sponsorship for this role, and candidates should be able to verify their eligibility to work in the country independently. Proof of eligibility to work in India will be required as part of the hiring process.

Work Environment

In this role, a significant aspect of the job involves working in the office for a standard 40-hour workweek. We believe that the collaborative nature of our work and the face‑to‑face interactions among team members are essential for fostering a dynamic and productive work environment. Being present in the office enables seamless communication, facilitates quick decision‑making, and encourages spontaneous collaboration that contributes to the overall success of our projects. We value the synergy that comes from having our team members physically together, allowing for immediate problem‑solving, idea exchange, and team building.