Staff ML Platform Engineer: Scale GPU Pipelines

SimplyHired; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

Arriver System Software S.R.L. is seeking a Staff Software Engineer to join the ML Platform team.

You will design, build, and optimize large-scale ML infrastructure across on-prem NVIDIA DGX clusters and AWS Cloud, enabling training pipelines and production-grade ML solutions. You will write high-quality, maintainable code in multiple languages, lead complex projects, and collaborate with data science and engineering teams to deliver scalable data workflows and reliable platform services across

Qualifications

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.
• Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Engineering or related work experience.
• PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
• 2+ years of work experience with programming languages such as C, C++, Java, Python, etc.

Responsibilities

• Architect and develop core components of the ML platform and data infrastructure for training, inference, and large-scale data processing.
• Design and implement scalable solutions for GPU clusters and distributed data pipelines on-prem and in AWS.
• Lead project workstreams, ensuring timely delivery and alignment with platform roadmap; operate independently and drive outcomes end-to-end.
• Build and optimize data pipelines for ingestion, transformation, storage, and retrieval supporting ML workflows.
• Write clean, efficient, and maintainable code (services, operators, automation, tooling) in multiple programming languages.
• Collaborate with data science and engineering teams to integrate ML and data workflows seamlessly.
• Implement CI/CD for ML and data workflows using Argo Workflows, ArgoCD, GitHub Actions; champion testability and reproducibility.
• Maintain observability (Prometheus, Grafana) and logging (AWS CloudWatch, ELK/Opensearch); drive SLOs, tracing, and cost-awareness.
• Operate AWS services (EKS, EC2, VPC, IAM, S3, EFS, Batch) across hybrid environments; contribute to security and compliance controls.
• Continuously improve platform reliability, performance (GPU utilization, throughput), and developer experience; stay current on modern MLOps/Data engineering practices.

Skills

C

C++

Java

Python

Education

Bachelor's degree

Master's degree

PhD

Job description

Arriver System Software S.R.L. is seeking a Staff Software Engineer to join the ML Platform team.

You will design, build, and optimize large-scale ML infrastructure across on-prem NVIDIA DGX clusters and AWS Cloud, enabling training pipelines and production-grade ML solutions. You will write high-quality, maintainable code in multiple languages, lead complex projects, and collaborate with data science and engineering teams to deliver scalable data workflows and reliable platform services across