Remote Staff AI Platform Engineer – ML Ops & LLM Hosting

jobgether; New York (NY); Remote; USD 200,000 - 235,000; Full time

Benefits offered by this job

401(k) match

Health coverage

Remote-friendly

Professional development

Job summary

jobgether is seeking a Staff Software Engineer, IDSM, based in the United States to advance an enterprise AI platform. You will design scalable backend systems, build capabilities for the ML lifecycle, and deliver reliable integrations with cloud ML platforms.

You will partner with customers and cross-functional teams to create secure, scalable APIs, support model deployment, monitoring, and LLM hosting, and drive architectural decisions in a collaborative, innovation-driven environment.

Qualifications

• 8+ years of software engineering experience in an IC role.
• Strong AI/ML systems knowledge across development, training, deployment, and lifecycle management.
• Experience designing scalable backend systems in distributed environments.
• Proficiency with RESTful APIs and/or gRPC.
• Experience with cloud platforms (AWS, Azure, GCP).
• Knowledge of containerization and orchestration (Docker, Kubernetes).
• Experience implementing automated testing and maintaining CI/CD pipelines.
• Ability to collaborate across engineering teams and with customers.

Responsibilities

• Design, develop, and maintain high-performance backend services for data science and ML workflows.
• Collaborate with customers and internal teams to deploy model solutions integrating with AWS SageMaker and Azure ML.
• Enhance model development, training, registration, deployment, and ongoing management to improve reliability.
• Launch centralized data science catalog for resource discovery and summarization.
• Integrate monitoring to provide a view of model health, performance, and operations.

Skills

Backend engineering

Distributed systems

Cloud platforms

REST/gRPC APIs

MLOps/ML platforms

SageMaker/Azure ML

CI/CD

Collaboration

Communication

Problem-solving

Job description

jobgether is seeking a Staff Software Engineer, IDSM, based in the United States to advance an enterprise AI platform. You will design scalable backend systems, build capabilities for the ML lifecycle, and deliver reliable integrations with cloud ML platforms.

You will partner with customers and cross-functional teams to create secure, scalable APIs, support model deployment, monitoring, and LLM hosting, and drive architectural decisions in a collaborative, innovation-driven environment.