Software Development Manager , Alexa Sensitive Content Intelligence (ASCI)

Amazon; Gurugram District; On-site; INR 4,000,000 - 9,000,000; Full time

Job summary

Amazon seeks a Software Development Manager for Alexa Sensitive Content Intelligence (ASCI) to lead an ML inference infrastructure team responsible for real-time and on-device content moderation across Alexa+. You will drive end-to-end model lifecycle, deployment pipelines, and cross-functional partnerships with ML science and product teams.

You will influence architecture, optimize latency and memory, and ensure availability across regions while growing engineers and implementing best practices

Qualifications

• 10+ years building large-scale distributed software systems.
• 3+ years engineering team management experience.
• Experience with full software life cycle and livesite operations.
• Experience partnering with product or program management teams.
• Experience communicating with users, tech teams and leadership.
• Experience recruiting and mentoring software engineers.

Responsibilities

• Lead and grow a high-performing engineering team delivering ML inference and content safety services for Alexa+ Responsible AI — cloud and on-device moderation.
• Own inference optimization — GPU/CPU serving strategies for cloud and model compression/distillation for on-device deployment on resource-constrained endpoints.
• Lead building and operating 1-click continuous model deployment infrastructure with zero-downtime rollouts across cloud and edge targets.
• Drive scalable real-time and batch serving systems handling multi-modal content for worldwide Alexa+ moderation.
• Drive on-device moderation capabilities — optimize models for latency, memory, and power constraints while maintaining accuracy.
• Drive operational excellence — availability 99.95%+, latency, cost metrics, and multi-region reliability.
• Partner with applied scientists and platform teams on model architecture trade-offs, traffic migrations, and device integration.
• Grow SDEs/MLEs with a thirst for learning emerging tech in ML hosting and infra optimisation space.

Skills

Distributed systems

Engineering leadership

ML inference infrastructure

Cloud and on-device moderation

Model deployment pipelines

Cross-functional collaboration

Job description

Software Development Manager , Alexa Sensitive Content Intelligence (ASCI)

Alexa Sensitive Content Intelligence team owns the Responsible AI platform for Alexa+ worldwide — building ML-powered infrastructure that keeps content safe across cloud and on-device experiences. We leverage traditional encoder models, RAG based retrieval and large language models to identify and moderate sensitive content in real-time across text, images, video, and LLM-generated responses.

As a Software Development Manager, you will lead an engineering team building production-grade ML inference infrastructure and content safety services spanning cloud-based real-time moderation and on-device moderation for Alexa+ enabled endpoints. You will own the end-to-end model lifecycle from onboarding to production serving, driving 1-click continuous deployment pipelines for encoder (BERT-class), decoder (Qwen 600M-class), and encoder-decoder models powering text classification, multimedia analysis, and LLM-based moderation workloads.

You will influence our overall strategy, drive system architecture decisions, grow engineers, establish best practices, and build relationships with partner ML science and product teams. You will regularly communicate with senior management on status, risks, and technical strategy.

Key job responsibilities

• Lead and grow a high-performing engineering team delivering ML inference and content safety services for Alexa+ Responsible AI — covering both cloud and on-device moderation.
• Own inference optimization — GPU/CPU serving strategies for cloud, and model compression/distillation strategies for on-device deployment on resource-constrained endpoints.
• Lead building and operating 1-click continuous model deployment infrastructure supporting multiple model architectures (encoder, decoder, encoder-decoder) with zero-downtime rollouts, automated validation, and rollback — across cloud and edge targets.
• Drive architecting scalable real-time and batch serving systems handling multi-modal content (text, image, video, LLM invocations) for worldwide Alexa+ moderation.
• Drive on-device moderation capabilities — optimize models for latency, memory, and power constraints on Alexa+ devices while maintaining moderation accuracy.
• Drive operational excellence — availability (99.95%+), latency, cost metrics, and multi-region reliability.
• Partner with applied scientists on model architecture trade-offs and with platform teams on traffic migrations, capacity planning, and device integration.
• Grow highly talented SDEs/MLEs with a thirst for learning emerging and future tech in the ML hosting and Infa optimisation space.

About the team

ASCI owns two charters - Alexa + RAI enablement and compliance and Alexa+ Customer feedback. The org has 60+ engineers, 30+ applied scientists, around 7 product managers and 50+ ops team. We work on exciting opportunities using LLMs/ encoder Models/ RAG based systems to enable Alexa + to be policy compliant world wide, across all regions and Locales. Our customer feedback org owns the Report A Bug (RAB) feature which serves as the voice of the customer. This particular team is the back bone of the entire org enabling efficient ML infrastructure for hosting 20+ ML models and interfacing with multiple LLMs in Bedrock.

Basic Qualifications

• 10+ years of developing large-scale, multi-tiered distributed software systems using distributed programming experience
• 3+ years of engineering team management experience
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience partnering with product or program management teams

Preferred Qualifications

• Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
• Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.