Director of Engineering (AI Inference Platform)

Arm; Bengaluru; On-site; INR 6,000,000 - 9,000,000; Full time

Job summary

Arm is seeking a Director of Engineering to establish a new India team for its AI inference platform in Bengaluru. You will set the engineering strategy, recruit senior leaders, and build an initial organization of about 20 people responsible for delivering and operating the platform capabilities.

The role requires leading across teams in the US, UK, and India, shaping the platform direction, and ensuring performance, reliability, and scalability.

Qualifications

• Experience building engineering organizations, including recruiting senior talent and developing managers.
• Record of setting technical strategy, choosing priorities, and delivering production software as requirements and technology change.
• Technical depth in distributed systems, AI infrastructure, performance engineering, or related platform software.
• Understanding of AI inference and the relationship between workload, hardware, and system performance.
• Experience leading across organizational and geographic boundaries, with clear ownership and productive technical partnerships.
• Nice-to-have: inference engines, accelerator-based systems, or profiling/tuning tools.

Responsibilities

• Set the engineering strategy for the India organization, identify capabilities to lead and translate priorities into a roadmap.
• Recruit and develop the technical leadership and engineering expertise to deliver that strategy.
• Establish an engineering approach suited to an evolving platform using AI throughout development.
• Lead architecture decisions with depth to challenge assumptions and guide difficult decisions.
• Provide leaders with responsibility for platform capabilities and production operation.
• Partner with Arm teams in the US and UK to shape direction and resolve dependencies.

Skills

Engineering leadership

Technical strategy

Distributed systems

AI infrastructure

Cross-border collaboration

Tools

Kubernetes

Cloud platforms

Profiling tools

Job description

Job Overview

We are hiring a Director of Engineering to establish a new team in India for Arm's AI inference platform. You will set its engineering strategy and build an initial organization of approximately 20 people, with responsibility for the capabilities it delivers and operates.

Changes in AI models and hardware create open engineering questions about how inference services should be built and run. Long-context and agentic workloads bring different demands on memory, compute, and response time. This role offers the chance to shape the software that makes these systems practical to operate at scale.

You will help determine where the India organization should lead. Early opportunities include the systems that bring new inference capabilities into production and improve their performance, efficiency, and reliability. The remit will develop through your assessment of platform needs and the expertise you build within the team.

Responsibilities

• Set the engineering strategy for the India organization. Identify the capabilities it should lead, make investment choices, and translate platform priorities into a roadmap that can adapt as the technology develops.
• Recruit and develop the technical leadership and engineering expertise needed to deliver that strategy. Shape the organization as its responsibilities grow, and build a record of developing talent alongside hiring it.
• Establish an engineering approach suited to a team tackling an evolving platform, using AI throughout development and keeping the path from an idea to a reliable release short.
• Lead architecture decisions with enough technical depth to challenge assumptions and evaluate new approaches. Help teams make progress on unfamiliar systems problems through experimentation and sound engineering judgment.
• Give engineering leaders clear responsibility for complete platform capabilities, including their operation in production. Coach them to make decisions and build teams that can deliver independently.
• Partner with Arm teams in the US and UK to shape platform direction, agree ownership, and resolve dependencies. Represent the India organization's priorities in broader engineering and planning decisions.

Required Skills and Experience

• Experience building engineering organizations, including recruiting senior talent and developing managers and technical leaders.
• A record of setting technical strategy, choosing priorities, and delivering production software as requirements and technology change.
• Technical depth in distributed systems, AI infrastructure, performance engineering, or related platform software, with the ability to assess architecture and guide difficult decisions.
• Understanding of AI inference and the relationship between workload, hardware, and system performance.
• Practical experience improving software development with AI, supported by judgment about quality and reliability.
• Experience leading across organizational and geographic boundaries, with clear ownership and productive technical partnerships.

Nice-to-Have Skills and Experience

• Inference engines, accelerator-based systems, or tools for profiling and tuning model performance.
• Kubernetes, cloud platforms, or software deployed across different compute environments.
• Distributed tracing, large-scale data processing, or usage accounting systems.
• Establishing an engineering team in India and recruiting senior technical talent locally.

In Return

You’ll have opportunities to shape Arm’s AI inference platform, build a new engineering team in India, and collaborate with teams across the US and UK. The role also offers scope to influence technical direction and grow your leadership impact while tackling evolving challenges in AI infrastructure, performance and reliability.

Our 10x Mindset

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset

Use of AI in Your Application

At Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact [e-mail] so we can support you.

Recruitment Adjustments and Accommodations

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [e-mail]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.