Senior Software Engineer - AI/ML ( Platform )

Cognite; Bengaluru; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Cognite in Bengaluru seeks a Senior Software Engineer to lead production systems for our Context Services team, bridging Applied Scientists/AI Engineers and the Platform Engineering group to turn analytic solutions into reliable services.

You will design scalable architectures, build low-latency APIs, collaborate across product, architecture and AI teams, and advance AI/LLM orchestration with model serving and vector databases. Strong Python, Docker, and Kubernetes skills are preferred.

Qualifications

• 6–10 years of industry experience in software or systems engineering.
• Strong Python programming and API design skills.
• Experience with AI/ML production systems is a plus.

Responsibilities

• Design robust architectures and low-latency APIs/services for thousands of concurrent users.
• Collaborate with product, architecture and AI teams to translate complex data problems into scalable solutions.
• Architect frameworks for model serving, vector databases, and LLM agent workflows with reliable state management.
• Serve as liaison with Platform Engineering to build reliable AI pipelines and workflows.
• Drive innovation through R&D, prototyping, and potential open-source contributions.

Skills

Python

High-concurrency programming

REST/gRPC APIs

AI/ML production systems

6-10 years experience

Tools

Docker

Kubernetes

Job description

We are looking for a Senior Software Engineer to lead the production systems for our Context Services team. You will serve as the bridge between our Applied Scientists/AI Engineers and the central Platform Engineering team. In this role, you will focus on turning complex analytical solutions—ranging from traditional ML/DL models to modern LLM agents—into highly reliable, production-grade software services.

The Impact you bring to Cognite

Key Responsibilities:

• Architecture & Scale: Design robust system architectures and develop low-latency APIs/services capable of supporting thousands of concurrent users with sub-second response times.
• Cross-Functional Problem Solving: Collaborate closely with product, architecture, and AI teams to translate complex industrial data problems into scalable solutions.
• AI & LLM Orchestration: Architect frameworks for model serving, vector databases, and agentic workflows (LLM agents), ensuring reliable state management and prompt tracking.
• Platform Integration: Act as the technical liaison with the central Platform team, leveraging core infrastructure to build reliable AI pipelines and workflows.
• Innovation: Drive technical innovation through research, prototyping, and potential contributions to open-source initiatives.

Qualifications & Skills:

• Experience: 6–10 years of industry experience in Software Engineering, Backend Engineering, or Systems Engineering, with exposure to AI, ML, or LLM-based production systems.
• Programming: Strong proficiency in Python and experience building high-concurrency applications, asynchronous programming, or REST/gRPC APIs.
• Systems: Solid understanding of containerization (Docker) and modern deployment environments (such as Kubernetes or cloud platforms).
• AI Knowledge: Familiarity with the broader AI lifecycle—including traditional model registries, vector databases, or LLM evaluation frameworks is a major plus, but a strong ability to learn new paradigms is essential.