Staff Software Engineer, IDSM

jobgether; New York (NY); Remote; USD 200,000 - 235,000; Full time

Benefits offered by this job

401(k) match

Health coverage

Remote-friendly

Professional development

Job summary

jobgether is seeking a Staff Software Engineer, IDSM, based in the United States to advance an enterprise AI platform. You will design scalable backend systems, build capabilities for the ML lifecycle, and deliver reliable integrations with cloud ML platforms.

You will partner with customers and cross-functional teams to create secure, scalable APIs, support model deployment, monitoring, and LLM hosting, and drive architectural decisions in a collaborative, innovation-driven environment.

Qualifications

• 8+ years of software engineering experience in an IC role.
• Strong AI/ML systems knowledge across development, training, deployment, and lifecycle management.
• Experience designing scalable backend systems in distributed environments.
• Proficiency with RESTful APIs and/or gRPC.
• Experience with cloud platforms (AWS, Azure, GCP).
• Knowledge of containerization and orchestration (Docker, Kubernetes).
• Experience implementing automated testing and maintaining CI/CD pipelines.
• Ability to collaborate across engineering teams and with customers.

Responsibilities

• Design, develop, and maintain high-performance backend services for data science and ML workflows.
• Collaborate with customers and internal teams to deploy model solutions integrating with AWS SageMaker and Azure ML.
• Enhance model development, training, registration, deployment, and ongoing management to improve reliability.
• Launch centralized data science catalog for resource discovery and summarization.
• Integrate monitoring to provide a view of model health, performance, and operations.

Skills

Backend engineering

Distributed systems

Cloud platforms

REST/gRPC APIs

MLOps/ML platforms

SageMaker/Azure ML

CI/CD

Collaboration

Communication

Problem-solving

Job description

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Staff Software Engineer, IDSM based in United States .We are looking for an experienced Staff Software Engineer to help advance an enterprise platform for developing, deploying, and managing machine learning and AI solutions at scale. In this senior individual contributor role, you will design scalable backend systems and build capabilities that simplify the machine learning lifecycle, from model development and registration to deployment and monitoring. You will work closely with customers and cross-functional engineering teams to deliver reliable integrations with cloud-based machine learning platforms. Your work will also support improved resource discovery, model observability, and large language model (LLM) hosting. This opportunity is ideal for a technically strong engineer who enjoys solving complex distributed systems challenges and shaping architecture in a collaborative, innovation-driven environment. You will have meaningful ownership over platform capabilities that help organizations operationalize AI securely, efficiently, and reliably.

Accountabilities

• Design, develop, and maintain high-performance backend services that support enterprise-scale data science and machine learning workflows.
• Collaborate with customers and internal teams to design and implement model deployment solutions integrating with platforms such as AWS SageMaker and Azure Machine Learning.
• Enhance capabilities across model development, training, registration, deployment, and ongoing management to improve reliability and efficiency.
• Help design and launch a centralized data science catalog that enables users to discover, explore, and summarize resources across the platform.
• Integrate monitoring capabilities that provide a comprehensive view of deployed model health, performance, and operational status.
• Expand tagging and metadata functionality across platform entities to improve organization, tracking, reuse, and resource discovery.
• Extend large language model hosting capabilities to meet customer requirements for scalability, performance, and operational logging.
• Build secure, reliable, and scalable APIs, including RESTful APIs and gRPC services, and integrate backend systems with frontend interfaces and third-party services.
• Profile, troubleshoot, and optimize backend applications and distributed workloads across cloud environments and containerized infrastructure.
• Implement comprehensive unit, integration, and end-to-end testing practices, and contribute to robust continuous integration and continuous delivery (CI/CD) pipelines.
• Partner with engineering, product, and customer-facing teams to translate technical and business requirements into practical, maintainable solutions.
• Contribute to architectural decisions, share engineering best practices, support team learning, and continuously improve platform quality and performance.

Requirements:

• At least 8 years of experience in software engineering, primarily in an individual contributor capacity.
• Strong knowledge of artificial intelligence and machine learning systems, including model development, training, optimization, deployment, and lifecycle management.
• Demonstrated experience designing, building, and maintaining scalable backend systems in distributed computing environments.
• Proficiency in designing and implementing secure, high-performance APIs, including RESTful APIs and/or gRPC.
• Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Strong understanding of backend performance profiling, troubleshooting, and optimization in cloud-based or distributed environments.
• Familiarity with containerization and orchestration technologies such as Docker and Kubernetes.
• Experience implementing automated testing strategies, including unit, integration, and end-to-end tests, as well as maintaining CI/CD pipelines.
• Ability to collaborate effectively across engineering teams and integrate backend services with frontend applications and external systems.
• Strong analytical and problem-solving skills, with the ability to address complex technical challenges and deliver maintainable, reliable solutions.
• Excellent communication skills and the ability to work collaboratively with technical stakeholders and customers.
• A growth mindset, curiosity, and a willingness to learn, share knowledge, and continuously improve engineering practices.
• Experience with distributed computing frameworks such as Apache Spark, or machine learning platforms such as AWS SageMaker and Azure Machine Learning, is an advantage.
• Familiarity with model registries, model monitoring, enterprise MLOps, and LLM hosting infrastructure is beneficial.
• Ability to work remotely from Canada.

Benefits:

• Competitive compensation:
• Annual US base salary range of USD $200,000–$235,000. The final range may vary based on experience, qualifications, and location.
• Equity opportunities:
• Potential eligibility for equity compensation.
• Performance incentives:
• Additional company bonus opportunities may be available.
• Retirement benefits:
• Access to a 401(k) plan, subject to applicable eligibility and location requirements.
• Health coverage:
• Medical, dental, and vision benefits, subject to the applicable benefits package.
• Wellness support:
• Potential wellness stipends to support employee well-being.
• Remote work flexibility:
• Opportunity to work remotely from Canada.
• Technical ownership:
• Meaningful responsibility for designing and improving enterprise AI and machine learning platform capabilities.
• Complex engineering challenges:
• Work on distributed systems, cloud infrastructure, model monitoring, and LLM hosting at enterprise scale.
• Collaborative culture:
• Join a team that values continuous learning, open communication, diverse perspectives, and ongoing improvement.
• Professional development:
• Opportunities to deepen expertise in AI/ML infrastructure, cloud engineering, and modern software architecture.