Manager - Senior AI/ML Engineer

Riveron; India; On-site; INR 4,000,000 - 9,000,000; Full time

Job summary

Riveron is seeking a Senior AI/ML Engineer with 5–9 years of hands-on experience designing and deploying production AI and GenAI solutions in enterprise environments. You will lead solution architecture, data pipelines, and observability, while shaping secure, scalable architectures across cloud platforms.

You will design and operate end-to-end AI/ML systems, collaborate with product and security teams, mentor engineers, and drive CI/CD and cloud deployments on AWS or Azure using Docker and

Qualifications

• Bachelor's or Master's in CS, data science, AI/ML, engineering, or equivalent.
• 5–9 years building production software, data, ML, or AI solutions including GenAI/LLM apps.
• Advanced Python and libraries (pandas, NumPy, scikit-learn, PyTorch, TensorFlow).
• Strong grasp of LLM and agentic architecture: prompting, embeddings, RAG, tool calls, orchestration.
• Experience designing APIs and distributed services with secure tool execution for AI agents.
• Hands-on Git/GitHub and CI/CD with automated build, test, security scan, and deploy.
• AWS or Azure expertise and container deployment with Docker; Kubernetes and IaC.
• AWS/Azure AI certification(s) mandatory.
• Hands-on production experience with MCP (Model Context Protocol).
• MLOps/LLMOps practices: tracking experiments, versioning, tracing, evaluation, monitoring, cost.

Responsibilities

• Own AI/ML and GenAI solutions end to end — data pipelines, model workflows, APIs, evaluation, deployment, observability.
• Design enterprise RAG platforms: secure ingestion, chunking, embeddings, hybrid/vector search, citations, and access-aware retrieval.
• Build production agentic systems using tool calling, structured outputs, planning and memory, multi-agent orchestration, human-in-the-loop approvals, failure recovery, and auditable traces.
• Architect MCP clients and servers exposing enterprise tools, with secure transports, authentication, least-privilege, tenant isolation, and prompt injection protection.
• Integrate agents with repositories, source control, ticketing, databases, ERP/CRM, cloud services via connectors and governance patterns.
• Define evaluation strategies and end-to-end observability for agent and MCP activity.
• Build production services in Python with CI/CD and cloud deployment on AWS or Azure using Docker, Kubernetes, and IaC.
• Partner with product, architecture, data science, security, and business stakeholders; lead design and architecture reviews and mentor engineers.

Skills

Python

ML libraries

LLM/agent architecture

APIs/distributed services

Git/GitHub CI/CD

AWS/Azure

Docker/Kubernetes

IaC

MCP

MLOps/LLMOps

Education

Bachelor's or Master's in CS/Data Science/AI/Engineering

Tools

Docker

Kubernetes

AWS

Azure

GitHub

CI/CD tooling

Job description

Role Overview

We are seeking a Senior AI/ML Engineer with 5–9 years of experience designing, building, and operating production-grade AI and Generative AI solutions. You will provide hands‑on technical leadership across solution architecture, data and model pipelines, agentic systems, evaluation, cloud deployment, and observability. The ideal candidate pairs deep AI/ML expertise with strong software‑engineering discipline and sound architectural judgment, and can lead delivery for complex enterprise use cases.

What You Will Do

• Own AI/ML and GenAI solutions end to end — data pipelines, model and prompt workflows, APIs, evaluation, deployment, observability, and continuous optimization.

• Design enterprise RAG platforms: secure ingestion, chunking, embeddings, hybrid/vector search, reranking, citations, and access‑aware retrieval.

• Build production agentic systems using tool/function calling, structured outputs, planning and memory, multi‑agent orchestration, human‑in‑the‑loop approvals, failure recovery, and auditable traces.

• Architect and operate MCP clients and servers that expose enterprise tools, resources, and prompts — with secure transports (stdio, Streamable HTTP), authentication, least‑privilege access, tenant isolation, and protection against prompt injection and unsafe tool execution.

• Integrate agents with enterprise systems (document repositories, source control, ticketing, databases, ERP/CRM, cloud services) through reusable connectors and governance patterns.

• Define evaluation strategies and quality gates for accuracy, groundedness, safety, latency, and cost, and establish end‑to‑end observability for agent and MCP activity.

• Build production services in Python with strong engineering practices, GitHub‑based CI/CD, and cloud‑native deployment on AWS or Azure using Docker, Kubernetes, and infrastructure as code.

• Partner with product, architecture, data science, security, and business stakeholders; lead design and architecture reviews and mentor engineers.

Required Qualifications

• Bachelor's or Master's in Computer Science, Data Science, AI/ML, Engineering, or a related field — or equivalent practical experience.

• 5–9 years developing production software, data, ML, or AI solutions, including hands‑on delivery of GenAI/LLM applications.

• Advanced Python and practical experience with data/ML libraries (pandas, NumPy, scikit‑learn, PyTorch, TensorFlow, or equivalent).

• Strong grasp of LLM and agentic architecture: prompting, context engineering, embeddings, RAG, tool/function calling, structured outputs, orchestration, evaluation, and human‑in‑the‑loop controls.

• Proven experience designing APIs, distributed services, and event‑driven or asynchronous workflows with secure tool execution for AI agents.

• Hands‑on experience with Git/GitHub and CI/CD, including automated build, test, security‑scan, and deployment workflows.

• Strong experience with AWS or Azure and containerized deployment using Docker; Kubernetes and infrastructure‑as‑code experience expected.

• A current, role‑relevant AWS AI/ML certification or Microsoft Azure AI certification is mandatory.

• Hands‑on production experience with Model Context Protocol (MCP) is mandatory — consuming and developing MCP servers, integrating clients with agent frameworks, defining tools/resources/prompts, managing stdio or Streamable HTTP transports, and implementing security, approvals, testing, and tracing.

• MLOps/LLMOps practices: experiment tracking, model and prompt versioning, tracing, evaluation, monitoring, and cost optimization.

Preferred Experience

• GenAI or agent frameworks such as OpenAI Agents SDK, LangGraph/LangChain, Semantic Kernel, AutoGen, LlamaIndex, Amazon Bedrock Agents, or Azure AI Foundry Agent Service.

• Enterprise search and vector technologies (pgvector, Pinecone, Weaviate, Milvus, Elasticsearch/OpenSearch, Azure AI Search, Amazon OpenSearch, or equivalent).

• LLMOps/observability platforms (MLflow or comparable) for tracing, evaluation, prompt management, and governance.

• Strong SQL and data modeling; experience with streaming, workflow orchestration, data lakes, or lakehouse platforms.

• Leading AI solutions in enterprise domains such as finance, accounting, operations, document intelligence, analytics, or compliance.

• Responsible AI, model risk management, data governance, privacy, and regulatory/client‑compliance familiarity.

• Mentoring engineers, defining technical standards, and contributing to reusable platforms or open‑source work.

About Riveron

At Riveron, we partner with clients—from global multinationals to high‑growth private entities—to solve complex finance challenges, guided by our DELTA values: Drive, Excellence, Leadership, Teamwork, and Accountability. Our entrepreneurial culture thrives on collaboration, diverse perspectives, and delivering exceptional outcomes. We are committed to fostering growth, both for our clients and our people, through mentorship, integrity, and a client‑centric approach. This inclusive environment offers flexibility, progressive benefits, and meaningful opportunities for impactful work that supports well‑being in and out of the office.

Riveron Consulting is an Equal Opportunity Employer and believes that we are stronger together through our diversity. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, disability status, protected veteran status, sexual orientation, gender identity or any other characteristic protected by law.

Full time roles are eligible for a full range of benefits including medical, dental, and vision insurance, 401(k) with company match, and PTO. A complete description of all available benefits can be found at Riveron's Benefits page at https://riveron.com/riveron-life/. Contract roles are not eligible for benefits.