Principal Engineer- Local AI/Hardware AI

Insight Public Sector; Gurugram District; Remote; INR 2,500,000 - 6,000,000; Full time

Benefits offered by this job

Medical Insurance

Health Benefits

Professional Development: Learning平台/证

Shift Allowance

Job summary

Insight is looking for a Principal Engineer/Architect to help enterprise clients adopt local AI deployment and agentic workflows across edge and desktop AI hardware. You will unpack complex business challenges, define practical AI use cases, build proofs of concept, and enable client stakeholders to scale internal AI solutions.

You will collaborate with enterprise stakeholders to map requirements, implement local AI environments on NVIDIA GB10 and Apple Silicon, and build prototypes to

Qualifications

• Experience running local models on NVIDIA GB10 (Grace Blackwell/CUDA) and Apple Silicon.
• Strong understanding of LLM mechanics, prompts, and tool integration.
• Ability to script in Bash/Python and manage Linux environments.

Responsibilities

• Partner with enterprise stakeholders to identify bottlenecks and define AI use cases.
• Implement and optimize local AI environments on NVidia GB10 and Apple Silicon systems.
• Build functional AI prototypes to demonstrate value and gain executive buy-in.
• Configure Linux environments, webhooks, REST APIs, and client integrations; coach teams.

Skills

AI deployment

Edge/desktop AI

Linux

Bash/Python automation

REST APIs & webhooks

Self-directed learning

Tools

Ollama

vLLM

LM Studio

CUDA

Job description

Insight at a Glance

• 14,000+ engaged teammates globally
• $8.2 billion in revenue in 2025
• Certified as a Great Place to work in 9 Countries in 2025
• Fortune 500 Company (No. 447) in 2025
• Received 25+ industry and partner awards in the past year

About the role

As a Principal Engineer/ Architect, you will help enterprise clients adopt local AI deployment and agentic workflows across edge and desktop AI hardware environments. We will count on you to unpack complex business challenges, define practical AI use cases, build proofs of concept, and enable client stakeholders to scale internal AI solutions. Along the way, you will get to:

• Partner with enterprise stakeholders to identify business bottlenecks, map technical requirements, define high-impact AI use cases, and develop clear business and technical narratives.
• Implement and optimize local AI environments on NVIDIA GB10 and Apple Silicon systems, addressing privacy, latency, cost, system dependencies, and secure data-handling needs.
• Build functional AI prototypes, including command-line tools, function-calling solutions, and foundational agentic workflows, to demonstrate value and support executive buy-in.
• Configure and troubleshoot Linux environments, local models, webhooks, REST APIs, networking components, and client integrations while coaching internal champions through AI adoption.

What we’re looking for

• Working familiarity with running local models on NVIDIA GB10 (Grace Blackwell / CUDA) and Apple Silicon (unified memory / MLX) hardware, alongside developer tools (e.g., Ollama, vLLM, LM Studio).
• Understanding of core LLM mechanics, prompt design, API/Console usage, tool integration, and foundational agent patterns.
• Comfortable navigating Linux terminal environments, writing Bash/Python automation scripts, and managing system dependencies/environments.
• Solid understanding of TCP/IP, DNS, RESTful APIs, webhooks, local port forwarding, and secure network traffic basics.
• Exceptional capacity for rapid self-directed learning and a curiosity to explore expanding AI frameworks.

What you can expect

• Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
• Medical Insurance
• Health Benefits
• Professional Development: Learning Platform and Certificate Reimbursement
• Shift Allowance

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.

At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you!

Today's talent leads tomorrow's success. Learn more about Insight: https://www.linkedin.com/company/insight/

Insight does not accept unsolicited resumes from recruiters or employment agencies. Unsolicited resumes will be treated as direct applications from the candidate, and recruiters or agencies who submit candidates for this position without a prior, written vendor agreement will not be eligible for any form of compensation, even if the candidate is hired.

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

Insight India Location:Level 16, Tower B, Building No 14, Dlf Cyber City In It/Ites Sez, Sector 24 &25 A Gurugram Gurgaon Hr 122002 India