Senior Software Dev Engineer II - ECS Scheduler at Scale

Amazon; Jersey City (NJ); On-site; USD 158,000 - 214,000; Full time

Job summary

Amazon Elastic Container Service (ECS) is seeking a Software Development Engineer II to own and build the distributed systems behind the ECS Scheduler at scale. You will design scheduling algorithms, drive operational excellence, and ship features used by millions of customers daily.

You will design, implement, and optimize highly available, low-latency services in Java and other languages, mentor peers, and collaborate across teams to ensure reliable container orchestration across AWS regions.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• 1+ years of software development engineer or related occupational experience.
• 1+ years of designing and developing large-scale distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience.
• 1+ years of Object Oriented Design experience.
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
• Experience programming with at least one software programming language.

Responsibilities

• Design, develop, and operate highly available, scalable distributed systems for container scheduling and task placement at massive scale (115M+ daily launches).
• Own the end-to-end design and delivery of features in the ECS Scheduler service, from design doc through production deployment.
• Build high-throughput, low-latency scheduling algorithms in Java that make real-time placement decisions across large compute fleets.
• Design and implement resource management systems that optimize utilization, handle capacity constraints, and support diverse workload types (services, tasks, daemon sets).
• Lead operational excellence for services you own, including on-call rotations, COE investigations, deployment safety, and production health.
• Drive technical design documents and lead design reviews for new scheduler capabilities.
• Mentor L4 engineers through code reviews, design guidance, and technical leadership.
• Identify and resolve performance bottlenecks and scalability challenges in a system that operates at AWS-wide scale.
• Collaborate across ECS teams (Control Plane, Data Plane, Agent, Capacity) on cross-cutting projects.
• Build operational tooling and automation that improve diagnostics, accelerate root-cause analysis, and enhance system observability.

Skills

Software development

Distributed systems

Java

C++

C#

Object Oriented Design

Design patterns

Education

Bachelor's degree in CS/Engineering

Tools

Java

C++

C#

Perl

Job description

Amazon Elastic Container Service (ECS) is seeking a Software Development Engineer II to own and build the distributed systems behind the ECS Scheduler at scale. You will design scheduling algorithms, drive operational excellence, and ship features used by millions of customers daily.

You will design, implement, and optimize highly available, low-latency services in Java and other languages, mentor peers, and collaborate across teams to ensure reliable container orchestration across AWS regions.