Principal Software Engineer – (AI & Data Management)

NorthStar HR Consultants; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

NorthStar HR Consultants in Pune, Maharashtra, seeks a Principal Software Engineer to lead AI and data-management initiatives. You will architect and drive high-performance, multi-cloud storage and hybrid-cloud data systems with a focus on scalability, security, and enterprise-grade reliability.

The role demands deep expertise in Go and Java, experience with vector databases (Milvus, Qdrant), RAG pipelines, and AI orchestration tools like LangChain, plus hands-on leadership to mentor a

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• 10+ years of proven experience as a Back End Developer or in a similar role with a focus on server-side components.
• Expertise in Golang, Java.
• Inter-Process Communication, threading models, synchronization concepts, and complex multithreaded software design.
• Strong problem-solving skills and the ability to analyze and optimize file system performance.
• Experience in AI, RAG, and Agentic Chat Bot implementations to scale with enterprise ACLs and data governance.
• Proven experience building complex workflows with AI orchestration layers like LangChain, LangGraph, Semantic Kernel, or Pinecone.

Responsibilities

• Design and development of agentic AI, Vector Database, across platforms to scale using standard orchestration layers.
• Demonstrate production-grade expertise in Go and Java to develop high-performance file system components.
• Design and implement effective inter-process communication mechanisms.
• Utilize threading models and synchronization concepts for optimal performance.
• Collaborate with cross-functional teams to integrate file system components into multi-cloud data management solutions.
• Investigate and troubleshoot complex issues related to file system architecture.
• Design systems that scale horizontally under heavy load.
• Architect production-grade RAG pipelines and scalable chatbot frameworks; integrate with Copilot/Azure AI and Foundry.

Skills

Golang

Docker

Rag pipelines

Agentic

LangChain

Hyperscale deployment

SaaS

Architect (2+ yrs)

Education

Bachelor's or Master's degree in Computer Science / Software Engineering

Tools

Milvus

Qdrant

Zilla

LangChain

Pinecone

Semantic Kernel

Job description

Job Title - Principal Software Engineer – (AI & Data Management)

Job Location - Pune, Maharashtra

MUST Have Skills - Golang, Docker implementation, SaaS or Hyperscale's deployment, Rag pipelines, agentic, Lang chain, Min 2 yrs as an Architect.

Our client is seeking a visionary and highly technical Principal Software Engineer to join their elite engineering team. In this pivotal role, you will be the primary architect and driver in evolving the cutting-edge, AI-integrated global distributed file system and hybrid-cloud data management solutions. They are looking for a technical navigator to lead the evolution of their high-performance storage solutions, acting as the architectural force that ensures systems scale effortlessly in a hybrid-cloud world.

If you are a visionary leader with deep expertise in building advanced AI Systems (RAG, Agentic Chatbots, Vector Databases) to scale and a drive to build world-class solutions, join this team and lead the next generation of multi-cloud filesystem innovation.

Job requirements

Required Qualifications

• Education:

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.

• Experience:

10+ years of proven experience as a Back End Developer or in a similar role with a focus on server-side components.

Technical Expertise

• Languages:

Expertise in Golang, Java.

• Core Systems:

Proficiency in inter-process communication, threading models, synchronization concepts, and complex multithreaded software design.

• Optimization:

Strong problem-solving skills and the ability to analyze and optimize file system performance.

• Performance:

Expertise in performance profiling and modeling for concurrent, large-scale systems.

AI & Cloud Specializations

• AI Solutions:

Experience in AI, RAG, and Agentic Chat Bot implementations to scale that strictly adhere to enterprise ACLs and data governance.

Hands-on experience working with Vector Databases such as Milvus, Qdrant, Zilla, or related embedding stores.

• AI Frameworks:

Proven experience building complex workflows with AI orchestration layers like LangChain, LangGraph, Semantic Kernel, or Pinecone.

Experience in the multi-cloud data management domain is a plus.

Leadership & Soft Skills

Excellent communication and collaboration skills.

• Leadership: Excellent mentorship skills for setting up a high-performing technical team.

Job responsibilities

• Design, Develop, and Maintain:

Design and development of agentic AI, Vector Database, across platforms to scale using industry standard orchestration layers.

Demonstrate production-grade expertise in GoLang and java programming languages to develop high-performance file system components.

• Inter-Process Communication:

Design and implement eDective inter-process communication mechanisms to facilitate seamless interaction between various system components.

• Threading Models and Synchronization:

Utilize proficiency in threading models, synchronization concepts, and complex multithreaded software design to ensure optimal system performance and resource utilization.

Work collaboratively with cross-functional teams, including software engineers, architects, and quality assurance, to integrate file system components into our multi-cloud data management solutions.

• Problem Solving:

Investigate and troubleshoot complex issues related to file system architecture, providing innovative and eDective solutions.

• Performance and Scale:

Designing systems that scale horizontally and remain performant under extreme load.

• AI/ML & RAG:

Architecting production-grade Retrieval-Augmented Generation (RAG) pipelines and scalable chatbot frameworks.

Expert integration within Microsoft (Copilot, Azure AI) and Foundry platforms to bridge global data with generative AI.

• Stay Current:

Stay abreast of industry trends, emerging technologies, and advancements in AI/ML to drive continuous improvement and innovation.