Senior AI Backend Engineer - Immediate joiners only

Epitria Consulting; Bengaluru; On-site; INR 3,200,000 - 5,000,000; Full time

Job summary

Epitria Consulting in Bengaluru offers a hybrid role for a Senior AI Backend Engineer to design, build, and scale backend systems powering AI-driven products.

You will work with ML engineers and DevOps to deploy models in production, develop data pipelines, and ensure low-latency performance, security, and observability.

Proficiency in Python, TensorFlow and Keras, plus API development (REST/GraphQL), Docker, Kubernetes, and cloud platforms is required.

Qualifications

• 7-8 years of backend development experience.
• Strong proficiency in Python (preferred).
• Must have hands-on experience with TensorFlow and Keras.
• Experience developing RESTful APIs and/or GraphQL services.
• Experience with ML frameworks such as TensorFlow or PyTorch.
• Proven experience deploying ML models into production.
• Hands-on experience with RAG, LLMs, and Agentic AI systems.
• Experience with AWS, GCP, or Azure.
• Strong understanding of SQL and NoSQL databases.
• Experience with Docker and containerization.
• Knowledge of distributed systems and microservices architecture.

Responsibilities

• Design and develop scalable backend services powering AI-powered applications.
• Build and maintain APIs for model inference (LLMs, NLP, CV, recommendations).
• Deploy, manage, and optimize ML models in production.
• Develop data pipelines for model training, evaluation, and real-time inference.
• Optimize system performance for low-latency, high-throughput workloads.
• Implement monitoring, logging, and observability for AI services.
• Ensure security, reliability, scalability, and operational excellence.
• Collaborate with ML engineers to productionize AI/ML models.
• Work with DevOps to manage cloud infrastructure and CI/CD pipelines.

Skills

Backend development

Python

TensorFlow

Keras

RESTful APIs

GraphQL

Distributed systems

Microservices

SQL

NoSQL

LLMs

RAG

Tools

Docker

Kubernetes

CI/CD

FastAPI

Triton Inference Server

TorchServe

Job description

We are seeking a highly skilled Senior AI Backend Engineer to design, develop, and scale backend systems that power AI-driven products. This role sits at the intersection of backend engineering, machine learning systems, and production infrastructure, ensuring AI solutions are scalable, secure, reliable, and production-ready.

The ideal candidate must have strong experience in Python, TensorFlow, and Keras, along with expertise in deploying and managing AI/ML solutions in production environments.

Location: Bengaluru, Hyderabad (Hybrid)

Shift Timings: 2:00 PM - 11:00 PM IST

Work Schedule: Monday to Friday

Notice Period: Immediate Joiners only

Key Responsibilities

• Design and develop scalable backend services supporting AI-powered applications.
• Build and maintain APIs for model inference, including LLMs, NLP, computer vision, and recommendation systems.
• Deploy, manage, and optimize machine learning models in production environments.
• Develop data pipelines for model training, evaluation, and real-time inference.
• Optimize system performance to support low-latency, high-throughput AI workloads.
• Implement monitoring, logging, and observability solutions for AI services.
• Ensure system security, reliability, scalability, and operational excellence.
• Collaborate with Machine Learning Engineers to productionize AI and ML models.
• Work closely with DevOps teams to manage cloud infrastructure and CI/CD pipelines.

Required Qualifications

• 7-8 years of backend development experience.
• Strong proficiency in Python (preferred).
• Must have hands-on experience with TensorFlow and Keras.
• Experience developing RESTful APIs and/or GraphQL services.
• Experience working with machine learning frameworks such as TensorFlow or PyTorch.
• Proven experience deploying machine learning models into production environments.
• Hands-on experience with Retrieval-Augmented Generation (RAG), Large Language Models (LLMs), and Agentic AI systems.
• Experience with cloud platforms such as AWS, GCP, or Azure.
• Strong understanding of SQL and NoSQL databases.
• Experience with Docker and containerization technologies.
• Good understanding of distributed systems and microservices architecture.

Preferred Qualifications

• Experience with model serving frameworks such as FastAPI, Triton Inference Server, or TorchServe.
• Knowledge of vector databases such as Pinecone, Weaviate, or FAISS.
• Experience with event streaming platforms such as Kafka or Google Pub/Sub.
• Familiarity with Kubernetes and container orchestration.
• Understanding of MLOps practices, frameworks, and tooling.
• Experience working in high-growth or startup environments.

Technical Skills

• Backend: Python, FastAPI, REST APIs, GraphQL, Microservices
• AI/ML: TensorFlow, Keras, PyTorch, LLMs, RAG, Agentic AI
• Cloud: AWS, Azure, GCP
• Databases: SQL, NoSQL, Vector Databases
• DevOps & Infrastructure: Docker, Kubernetes, CI/CD
• Messaging & Streaming: Kafka, Pub/Sub

Ideal Candidate

The ideal candidate combines strong backend engineering fundamentals with hands‑on experience building and deploying AI-powered applications. They should be comfortable working across backend services, cloud infrastructure, machine learning systems, and production AI environments.