Lead Engineer (AI/ML and Backend Systems)

IndiaMART; Dadri; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

IndiaMART in Noida is seeking a hands‑on Lead Engineer AI/ML & Backend Systems to build and scale AI‑powered products and the backend platforms behind them. You will own production systems end‑to‑end, mentor engineers, and drive architectural decisions for scalable, observable services.

The role combines strong AI/ML expertise with solid backend engineering, distributed systems, event‑driven architecture, and production ownership in a fast‑growing environment.

Qualifications

• 4–7 years of hands‑on backend engineering experience.
• Strong proficiency in Python and production‑grade services.
• Hands‑on experience building AI/ML and LLM‑based apps.
• Understanding of RAG, embeddings, prompt engineering and AI evaluation.
• Go knowledge to support Go services.
• Backend architecture, APIs, microservices, concurrency, caching, DB design.
• Distributed systems and event‑driven patterns.
• Experience with Kafka, RabbitMQ, Pub/Sub or similar.
• SQL and relational databases expertise.
• Observability and monitoring with metrics/logs/tracing.
• Tooling like Prometheus, Grafana, OpenTelemetry, ELK/Dog, etc.
• Design for scalability, reliability, cost efficiency.
• Mentor engineers and drive technical design.

Responsibilities

• Lead design, development, and production deployment of AI/ML and Generative AI solutions.
• Build LLM‑powered apps using prompts, embeddings, and tool calling.
• Design scalable backend services, APIs, microservices, and async processing.
• Develop production‑grade Python services and contribute to Go services.
• Operate event‑driven systems using Kafka, RabbitMQ, or Pub/Sub.
• Apply distributed‑system patterns: idempotency, retries, timeouts, backpressure.
• Build data pipelines and work with relational DBs, caches, search, vector stores.
• Define systematic evaluation of AI outputs for quality.
• Own production systems end‑to‑end: deployment, monitoring, optimization, incidents.
• Build observability with metrics, logs, traces, dashboards, alerts.
• Lead architecture/code reviews and engineering standards.
• Mentor engineers and collaborate with Product/Data/DevOps teams.

Skills

Python

Go

AI/ML

Distributed systems

Backend architectures

SQL

DevOps/SRE

Observability

Kafka/RabbitMQ

Prometheus/Grafana

Education

B.E./B.Tech in CS/IT or related

Tools

Kafka

RabbitMQ

Kubernetes

Docker

OpenTelemetry

ELK/Opensearch

Datadog/New Relic

Job description

About the Role

We are looking for a hands‑on Lead Engineer AI/ML & Backend Systems to build and scale AI‑powered products and the backend platforms behind them.

This is not a research‑only role. The ideal candidate should combine strong AI/ML and Generative AI expertise with solid backend engineering, distributed systems, event‑driven architecture, observability, and production ownership.

You will work across AI systems, APIs, data pipelines, Go/Python services, messaging platforms, and production monitoring while providing technical direction and mentoring engineers.

Key Responsibilities

• Lead the design, development, and production deployment of AI/ML and Generative AI solutions.
• Build LLM‑powered applications using prompt engineering, RAG, embeddings, structured outputs, tool/function calling, and agentic workflows where appropriate.
• Design and build scalable backend services, APIs, microservices, and asynchronous processing systems.
• Develop production‑grade services using Python and contribute to or work with existing Go‑based services.
• Design and operate event‑driven systems using Kafka, RabbitMQ, Pub/Sub, or equivalent platforms.
• Apply distributed‑system patterns such as idempotency, retries, timeouts, ordering, backpressure, failure recovery, and eventual consistency.
• Build and manage data pipelines and work with relational databases, caches, search systems, and vector stores as required.
• Define systematic evaluation of AI outputs for accuracy, relevance, groundedness, consistency, and regression.
• Own production systems end to end: design, development, deployment, monitoring, optimization, and incident resolution.
• Build strong observability using metrics, logs, distributed tracing, dashboards, and alerts.
• Track and improve system availability, latency, throughput, error rates, AI quality, queue health, and infrastructure efficiency.
• Lead architecture reviews, code reviews, technical decisions, and engineering standards.
• Mentor engineers and collaborate with Product, Data, DevOps/SRE, and other engineering teams.

Must Have

• 4-7 years of relevant engineering experience with strong hands‑on software/backend development experience.
• Strong proficiency in Python and experience building production‑grade services.
• Hands‑on experience developing and deploying AI/ML and LLM‑based applications.
• Strong understanding of RAG, embeddings, prompt/context engineering, AI evaluation, and modern LLM application patterns.
• Working knowledge of Go (Golang) with the ability to understand, debug, and contribute to Go services.
• Strong understanding of backend architecture, APIs, microservices, concurrency, caching, and database design.
• Strong understanding of distributed systems and event‑driven architecture.
• Hands‑on experience with Kafka, RabbitMQ, Pub/Sub, or similar messaging/streaming platforms.
• Strong proficiency in SQL and relational databases.
• Strong production‑debugging and root‑cause‑analysis skills.
• Strong hands‑on experience with observability and monitoring, including metrics, logs, tracing, dashboards, and alerting.
• Experience with tools such as Prometheus, Grafana, OpenTelemetry, ELK/Kibana, Datadog, New Relic, or equivalent.
• Ability to design systems for scalability, reliability, performance, maintainability, and cost efficiency.
• Experience mentoring engineers and driving technical design and code quality.

Good to Have

• Strong hands‑on development experience with Go.
• Experience with LangGraph, LangChain, LlamaIndex, or equivalent AI orchestration frameworks.
• Experience with vector databases/search such as pgvector, FAISS, Qdrant, Pinecone, or equivalent.
• Exposure to MLOps/LLMOps, model/prompt versioning, AI regression testing, and guardrails.
• Experience with Redis, Elasticsearch/OpenSearch, Docker, Kubernetes, and cloud platforms.
• Experience building high‑scale, high‑throughput distributed systems.

Experience & Education

• 57 years of relevant experience across backend engineering, AI/ML, or applied AI.
• B.E./B.Tech/M.E./M.Tech in Computer Science, IT, AI/ML, Data Science, or a related discipline, or equivalent practical experience.

What Success Looks Like

You should be equally comfortable discussing model quality and AI evaluation as you are discussing API latency, Kafka consumers, retries, idempotency, distributed tracing, database performance, and production incidents.

Location: Noida Sector 135 (WFO)