AI Agent Observability Engineer

Jobgether; India; Hybrid; INR 223,000 - 446,000; Full time

Benefits offered by this job

Internship program

Work-from-home

Global exposure

Competitive compensation

Job summary

Jobgether, listed on behalf of a partner company in India, seeks an AI Agent Observability Engineer intern. You will contribute to backend and full-stack development while gaining hands-on exposure to AI and LLM capabilities.

You will work with senior engineers on designing, testing, deploying and monitoring production-ready systems, with a focus on observability, RAG pipelines and tooling.

Qualifications

• Pursuing a Bachelor’s or Master’s degree in CS, Software Engineering, AI or related field.
• Strong software engineering fundamentals and coding best practices.
• Proficiency in Python; experience in at least one other programming language (Java/Go/TypeScript) is a plus.

Responsibilities

• Contribute to backend and full-stack feature development and releases for core products.
• Collaborate with senior engineers on module design, API interfaces, system integration and deployment.
• Support logging, monitoring, troubleshooting and performance optimization across services.
• Write and maintain automated tests and CI/CD configurations to improve efficiency and quality.
• Support AI/LLM integration and RAG capabilities based on business needs.
• Integrate LLM APIs, develop basic RAG pipelines and embed tools into existing systems.
• Help build and maintain datasets and benchmarks for AI evaluation and regression testing.
• Document technical work and communicate effectively with engineering and cross-functional teams.

Skills

Python proficiency

Strong CS fundamentals

Git and Linux basics

REST APIs & testing

Observability tooling

Education

Bachelor’s or Master’s degree in CS/SE/AI

Related field coursework

Tools

Docker

Kubernetes

Cloud platforms (AWS/GCP/Azure)

Prometheus/Grafana/ELK

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Agent Observability Engineer based in India.

This opportunity is designed for an early-career engineer interested in building software and applying artificial intelligence to real-world products and platforms. You will contribute to backend and full-stack development while gaining hands‑on exposure to AI and Large Language Model (LLM) capabilities. Working alongside experienced engineers, you will help design, test, deploy and monitor production-ready systems. The role combines software engineering fundamentals with practical work across LLM integrations, Retrieval‑Augmented Generation (RAG), evaluation and agent capabilities. You will also contribute to automated testing, datasets, benchmarks and observability to improve system quality and reliability. This is a fast‑paced environment where you can develop technical skills, collaborate with global teams and build practical experience in emerging technologies.

Accountabilities

• Contribute to backend and full-stack feature development, testing and releases for core products and platforms, delivering production-ready code.
• Collaborate with senior engineers on module design, API and interface definition, system integration and deployment.
• Support logging, monitoring, troubleshooting and performance optimisation across deployed services.
• Write and maintain automated tests and Continuous Integration and Continuous Delivery (CI/CD) configurations to improve development efficiency and code quality.
• Support the integration and deployment of Artificial Intelligence (AI) and Large Language Model (LLM) capabilities based on business requirements.
• Integrate LLM application programming interfaces (APIs), develop basic Retrieval‑Augmented Generation (RAG) pipelines and embed tools or agent capabilities into existing systems.
• Help build and maintain datasets and benchmarks for AI evaluation and regression testing.
• Track online system and model performance, assist with debugging and contribute to resolving technical issues.
• Produce clear technical documentation and communicate effectively with engineering and cross-functional teams.

Requirements

• Currently pursuing a Bachelor’s or Master’s degree in Computer Science, Software Engineering, Artificial Intelligence or a related field.
• Strong software engineering fundamentals, including data structures and algorithms, object-oriented design, common design patterns and coding best practices.
• Proficiency in Python is required, along with experience using at least one primary programming language for engineering work.
• Experience with Java, Go, TypeScript or JavaScript is a plus.
• Familiarity with Git, basic Linux environments and software debugging practices.
• Understanding of unit and integration testing, Representational State Transfer (RESTful) APIs and relational or non‑relational databases.
• Some project or internship experience with AI or LLM technologies is sufficient; deep research experience is not required.
• Familiarity with prompt engineering, function calling, RAG, vector databases or frameworks such as LangChain or LangGraph is a plus.
• Strong ownership and accountability, with the ability to take initiative and deliver assigned work.
• Good communication and collaboration skills, with the ability to work effectively with senior engineers and cross‑functional teams.
• Ability to learn quickly and adapt to new technologies, tools and engineering practices.
• Experience shipping web or backend services is a plus.
• Knowledge of caching, message queues, concurrency and performance tuning is a plus.
• Familiarity with Docker, Kubernetes, cloud platforms such as AWS, Google Cloud Platform (GCP) or Microsoft Azure, or observability tools such as Prometheus, Grafana or ELK is a plus.
• Exposure to LLM evaluation, prompt iteration, data feedback loops or basic fine‑tuning workflows is a plus.
• Able to commit to at least 6 months, 5 days per week.

Benefits

• 3-6 month early‑career internship opportunity with potential for continued engagement based on business needs and applicable local laws.
• Work‑from‑home arrangement, subject to the nature of the business team.
• Opportunity to gain hands‑on experience in blockchain, digital assets, AI and LLM technologies.
• Exposure to backend and full‑stack software development and production engineering.
• Collaboration with experienced engineers and global teams.
• Opportunities for networking and professional development.
• Experience working on fast‑paced, innovative projects with autonomy and meaningful technical challenges.
• Continuous learning and opportunities for career development.
• Competitive salary and company benefits.
• Opportunity to develop transferable technical and professional skills in a global technology environment.

We appreciate your interest and wish you the best!