SDM, ML Data Infra: Feature Store & Real-Time Pipelines

Amazon; Vancouver; On-site; CAD 171,000 - 286,000; Full time

Job summary

Amazon is seeking an experienced Software Development Manager to lead a team of SDEs and Data Engineers building Core Data Infrastructure for Bot Management. You will own the end-to-end data platform, from ingestion to serving, enabling ML and Science initiatives with reliable, scalable data access.

You will partner with Science leadership to translate model requirements into data investments and work with ML Platform to integrate data seamlessly with training and inference systems.

Qualifications

• 3+ years of engineering team management experience.
• 7+ years of working directly within engineering teams experience.
• 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience.
• 8+ years of leading the definition and development of multi tier web services experience.
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations.
• Experience partnering with product or program management teams.

Responsibilities

• Data Infrastructure & Feature Engineering — Own the Feature Store, feature pipelines, and data serving layer.
• Streaming & Real-Time Systems — Design and operate Apache Flink applications and live stream data processing.
• Data Pipelines & Ingestion — Own batch and near real-time pipelines spanning Trails and Non-Trails sources.
• Science & ML Platform Partnership — Serve as the primary data infrastructure partner to Applied Scientists and ML Platform.
• People Leadership — Recruit, develop, and retain a high-performing team of SDEs and DEs.

Skills

Engineering management

Team leadership

System design

Web services

Tools

Kinesis

Kafka

Apache Flink

S3

OpenSearch

AWS Glue

Job description

Amazon is seeking an experienced Software Development Manager to lead a team of SDEs and Data Engineers building Core Data Infrastructure for Bot Management. You will own the end-to-end data platform, from ingestion to serving, enabling ML and Science initiatives with reliable, scalable data access.

You will partner with Science leadership to translate model requirements into data investments and work with ML Platform to integrate data seamlessly with training and inference systems.