Software Development Manager, Managed Streaming for Apache Kafka, Amazon MSK

Amazon Web Services (AWS); Seattle (WA); On-site; USD 185,000 - 250,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon.com Services LLC is seeking a seasoned Software Manager to lead a high-performing AWS MSK team. You will recruit and grow technical staff, own the SDLC and operational metrics, define your product roadmap with PMs, and contribute to open source, while presenting at community events.

You will work with a team designing large-scale systems that support millions of transactions per second, with strong emphasis on streaming technologies and open-source frameworks.

Qualifications

• 3+ years of engineering team management experience.
• 7+ years of working directly within engineering teams.
• 3+ years of designing or architecting large-scale systems (design patterns, reliability, scaling).
• 8+ years of leading the definition and development of multi-tier web services.
• Knowledge of full software/hardware/networks development life cycle (coding standards, reviews, CI/CD, testing, live-site ops).
• Experience partnering with product or program management teams.

Responsibilities

• You recruit and grow technical staff.
• You own the software development lifecycle and operational metrics for the service.
• You partner with the product managers to define and execute the product roadmap.
• You contribute to open source and present at community events.

Skills

Engineering team management

Large-scale systems

Open source collaboration

Kafka/Streaming

Open source contributions

Tools

Apache Kafka

Apache Spark

Apache Flink

Apache Storm

Job description

Description

Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team!

Description

Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team!
We are seeking builders for our Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for managers and engineers who are enthusiastic about data streaming, and are as passionate about contributing to open source as they are about solving real customers' business needs, at AWS scale.
As a member of the Amazon MSK team, you will be making contributions to the entire stack - the APIs and the workflows that make up the MSK service, the core Kafka platform, and stand-alone tools that make it easier for Kafka community to operate Kafka better. Upstream compatibility is a core tenet of MSK. Your code changes to the Kafka platform will be released back to open source. As a member of a new AWS service that builds on top of a popular open source technology, this is a unique opportunity to work on a team that straddles both worlds – open source and Amazon-internal software. You will design and build new features, make performance improvements, identify and investigate new technologies, prototype solutions, build scalable services, and test and review changes, to deliver an exceptional customer experience.
Beyond operating the core service, you will identify and lead net-new capabilities that only AWS can build — native platform integrations, smarter managed-service economics, and differentiated features that go beyond what open source delivers. This includes driving greenfield programs that rethink how managed streaming infrastructure is designed and delivered at cloud scale: richer self-service, fundamentally better operational economics, and engine-level capabilities the open-source community was not built to provide. The streaming platform at AWS spans more than Kafka: Amazon Managed Service for Apache Flink (MSF) sits alongside MSK, and the most impactful customer scenarios increasingly combine both services. You will shape how MSK and MSF compose into a complete end-to-end streaming stack — identifying cross-service integration points and building capabilities that span ingestion and stateful stream processing.

Key job responsibilities

The AWS MSK Team Is Looking For a Seasoned Software Manager To Lead An Exceptional High-performing Team. As The Software Development Manager For The AWS MSK Team

• You recruit and grow technical staff.
• You own the software development lifecycle and operational metrics for the service.
• You partner with the product managers to define and execute the product roadmap.
• You contribute to open source and present at community events.

The ideal candidate has experience driving and designing large-scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses analytical, design and problem-solving skills. Ideally you have an in-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other SDMs and engineers to build a large scale AWS service, and work with senior leaders to define your team's roadmap, including identifying design and code changes needed in the underlying open source platforms.

Basic Qualifications

• 3+ years of engineering team management experience
• 7+ years of working directly within engineering teams experience
• 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• 8+ years of leading the definition and development of multi tier web services experience
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience partnering with product or program management teams

Preferred Qualifications

• Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
• Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including

• health insurance (medical, dental, vision, prescription, Basic Life &D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave

Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 184,900.00 - 250,200.00 USD annually

Company

Amazon.com Services LLC

Job ID: A10488657