Principal Engineer- Local AI/Hardware AI

Insight; Gurugram District; Hybrid; INR 4,000,000 - 6,500,000; Full time

Benefits offered by this job

Freedom to work from another location

Medical Insurance

Professional Development: Learning平台 &

Job summary

Insight is seeking a Principal Engineer/Architect to help enterprise clients adopt local AI deployment and agentic workflows across edge and desktop AI hardware.

You will unpack business challenges, define practical AI use cases, build proofs of concept, and enable client stakeholders to scale internal AI solutions, collaborating with cross-functional teams.

Qualifications

• Experience running local models on NVIDIA GB10 and Apple Silicon hardware.
• Knowledge of core LLM mechanics, prompts, API/Console usage, tool integration, and agent patterns.
• Proficient in Linux, Bash/Python automation, and managing system dependencies/environments.
• Strong self-directed learning mindset with curiosity for expanding AI frameworks.

Responsibilities

• Identify business bottlenecks, map technical requirements, define high‑impact AI use cases, and develop clear business and technical narratives.
• Implement and optimize local AI environments on NVIDIA GB10 and Apple Silicon hardware, addressing privacy, latency, cost, and data handling needs.
• Build functional AI prototypes, including command‑line tools, function‑calling solutions, and foundational agentic workflows.
• Configure and troubleshoot Linux environments, local models, webhooks, REST APIs, networking components, and client integrations.

Skills

NVIDIA GB10

Apple Silicon

Ollama

vLLM

LM Studio

CUDA

Tools

Ollama

vLLM

LM Studio

Job description

Select how often (in days) to receive an alert:

Principal Engineer- Local AI/Hardware AI

Gurugram Gurgaon HR, IN

Requisition Number: 106401

Principal Engineer/Arch II - Local AI/AI Implementation

Location: This is a hybrid opportunity in Delhi NCR, Hyderabad, Bangalore, Pune
Shift: US Aligned - night shift as per IST

Insight at a Glance

• 14,000+ engaged teammates globally
• $8.2 billion in revenue in 2025
• Certified as a Great Place to work in 9 Countries in 2025
• Fortune 500 Company (No. 447) in 2025
• Received 25+ industry and partner awards in the past year

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people‑first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organisations through complex digital decisions.

About the role

As a Principal Engineer/ Architect, you will help enterprise clients adopt local AI deployment and agentic workflows across edge and desktop AI hardware environments. We will count on you to unpack complex business challenges, define practical AI use cases, build proofs of concept, and enable client stakeholders to scale internal AI solutions. Along the way, you will get to:

• Partner with enterprise stakeholders to identify business bottlenecks, map technical requirements, define high‑impact AI use cases, and develop clear business and technical narratives.
• Implement and optimize local AI environments on NVIDIA GB10 and Apple Silicon systems, addressing privacy, latency, cost, system dependencies, and secure data‑handling needs.
• Build functional AI prototypes, including command‑line tools, function‑calling solutions, and foundational agentic workflows, to demonstrate value and support executive buy‑in.
• Configure and troubleshoot Linux environments, local models, webhooks, REST APIs, networking components, and client integrations while coaching internal champions through AI adoption.

What we’re looking for

• Working familiarity with running local models on NVIDIA GB10 (Grace Blackwell / CUDA) and Apple Silicon (unified memory / MLX) hardware, alongside developer tools (e.g., Ollama, vLLM, LM Studio).
• Understanding of core LLM mechanics, prompt design, API/Console usage, tool integration, and foundational agent patterns.
• Comfortable navigating Linux terminal environments, writing Bash/Python automation scripts, and managing system dependencies/environments.
• Solid understanding of TCP/IP, DNS, RESTful APIs, webhooks, local port forwarding, and secure network traffic basics.
• Exceptional capacity for rapid self‑directed learning and a curiosity to explore expanding AI frameworks.

What you can expect

We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include:

• Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
• Medical Insurance
• Professional Development: Learning Platform and Certificate Reimbursement

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.

When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process.

At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you!

Today's talent leadstomorrow's success. Learn more about Insight:

https://www.linkedin.com/company/insight/

Insight does not accept unsolicited resumes from recruiters or employment agencies. Unsolicited resumes will be treated as direct applications from the candidate, and recruiters or agencies who submit candidates for this position without a prior, written vendor agreement will not be eligible for any form of compensation, even if the candidate is hired.

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

Insight India Location:Level 16, Tower B, Building No 14, Dlf Cyber City In It/Ites Sez, Sector 24 &25 A Gurugram Gurgaon Hr 122002 India

Job Segment: Hardware Engineer, Linux, Social Media, Night, Cyber Security, Engineering, Marketing, Technology, Operations, Security