This Senior Machine Learning Engineering position focuses on designing and evolving a large-scale offline data platform and the infrastructure used to generate training datasets and run data workflows. The role emphasizes batch and stream processing, reproducibility and observability, and scalable, cost-efficient pipeline architecture.
Responsibilities
- Build infrastructure that supports both batch and streaming big data processing using technologies such as Flink, Spark, and Ray.
- Design and operate large-scale data pipelines that generate training datasets for machine learning training and experimentation.
- Connect data pipelines with workflow orchestration systems such as Flyte, Airflow, or similar tools to enable reliable multi-stage training workflows.
- Enhance reproducibility and observability of data pipelines through dataset validation, monitoring, and automated testing.
- Optimize performance and resource utilization across distributed compute systems used for data processing.
- Collaborate with ML engineers to support large-scale experimentation and iterative model development.
- Drive architectural improvements to keep offline data pipelines scalable, reliable, and cost-efficient.
Requirements
- Experience working with distributed computing frameworks including Flink, Spark, and Ray for distributed data processing.
- Experience creating infrastructure for training data generation, dataset preparation, or ML feature pipelines.
- Experience optimizing big data pipelines and infrastructure with a focus on cost efficiency.
- Strong programming skills in Python and experience working with large-scale distributed workloads.
- Experience with modern data infrastructure such as data lakes, warehouses, orchestration systems, and streaming platforms.
- Strong systems thinking, including the ability to evaluate performance, scalability, reliability, and cost tradeoffs in distributed systems.
- Proven ability to lead technical direction and influence architectural decisions across teams without formal authority.
Technology Stack
- Flink
- Spark
- Ray
- Flyte
- Airflow
- Python
Location
Bellevue, WA (onsite)
Compensation
USD 165,600 - 273,400 per year.
- Zone A: $210,300 - $273,400
- Zone B: $187,200 - $243,300
- Zone C: $165,600 - $215,200
In addition to base salary, the role may be eligible for equity awards and participation in company incentive plans such as annual discretionary bonuses or sales commissions. Final offer amounts depend on geographic location and the candidate’s relevant experience, professional background, and skill set.
Benefits
- Comprehensive health, life, and disability insurance
- Commute subsidy
- Employee stock ownership
- Competitive retirement/pension plans
- Generous vacation and personal days
- Support for new parents through leave and family-care programs
- Office food snacks
- Mental Health and Wellbeing programs and support
- Employee Resource Groups
- Global Employee Assistance Program
- Training and development programs
- Volunteering and donation matching program