Remote Senior ML Engineer: Production-Ready AI Systems

Legionintel; United States; Hybrid; USD 170,000 - 200,000; Full time

Job summary

Legion is seeking a Senior Software Engineer, Machine Learning to design, build, and evolve core AI capabilities that power intelligent experiences across our enterprise AI platform. You will integrate modern foundation models into production systems, develop reusable AI capabilities, and continuously improve their quality, reliability, and performance.

You will collaborate with cross-functional teams to deploy scalable AI services and rapidly prototype emerging techniques, ensuring

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience.
• 5+ years of experience building production software systems.
• Strong software engineering skills with Rust or Python.
• Proven ability to build scalable backend services, distributed systems, APIs, or data-intensive applications.
• Hands-on experience integrating large language models or other foundation models into production applications.

Responsibilities

• Design, build, and maintain the core AI capabilities that power intelligent experiences across the platform.
• Develop reusable capabilities for model integration, reasoning, multimodal understanding, structured generation, evaluation, and other foundational AI functionality.
• Optimize the AI systems that power these capabilities through experimentation, quantitative evaluation, context engineering, and iterative refinement.
• Apply your production software engineering experience to build backend services, APIs, and distributed AI systems.
• Partner closely with cross-functional partners to deploy scalable AI services that enable product teams to rapidly build AI-powered experiences.
• Rapidly prototype emerging AI techniques and translate successful experiments into production-ready platform capabilities.
• Support production systems by debugging failures and continuously improving latency, reliability, observability, and operational performance.
• Stay current with advances in AI engineering, foundation models, and applied machine learning, applying them where they create meaningful customer value.
• Optimize AI systems for performance, latency, reliability, scalability, and cost.
• Contribute to a collaborative engineering culture focused on ownership and continuous learning.

Skills

Rust

Python

Distributed systems

APIs

LLMs integration

Testing & observability

Ownership

Education

Bachelor’s or Master’s in CS/ML or related field

Tools

Kubernetes

Job description

Senior Software Engineer - Machine Learning (Remote US)

USA

About Legion

Let’s be real, AI isn’t magic; Legion was built to move beyond AI hype—delivering secure, reliable systems that work alongside the people tackling the world’s most critical challenges.

Born from a Department of Defense partnership and trusted by leaders across government and enterprise, Legion embeds intelligence inside complex systems, unlocking data, accelerating human workflows, and strengthening mission-critical systems. We don’t replace workflows—we optimize them, ensuring quality, efficiency, and reliability inside the platforms our partners already use.

With world-class collaborators like Palantir, Nvidia, HPE, and Oracle, we’re building intelligent infrastructure that enhances human capability and drives impact at the edge and across a range of enterprises.

We’re looking for bold thinkers and doers to join us in shaping the future of AI that’s secure, grounded, and built to work.

***This role requires expert level in development and deployment of machine learning models***

***US Citizenship or Greencard (Permanent US Residency) is required due to US Government contract requirements***

***You must be domiciled in the U.S. (must live permanently and maintain home address in the US)***

***As a step in the application process you will be required to provide legally authorized Identification to show verification of eligibility through third party provider CLEAR ID***

Senior Software Engineer, Machine Learning

As a Senior Software Engineer, Machine Learning, you will design, build, and evolve the core AI capabilities that power intelligent experiences across our enterprise AI platform. You will integrate modern foundation models into production systems, develop reusable AI capabilities, and continuously improve their quality, reliability, and performance. Working closely with cross-functional teams, you will transform advances in AI into secure, scalable, and production-ready capabilities that accelerate innovation across the platform.

Responsibilities

• Design, build, and maintain the core AI capabilities that power intelligent experiences across the platform.
• Develop reusable capabilities for model integration, reasoning, multimodal understanding, structured generation, evaluation, and other foundational AI functionality.
• Optimize the AI systems that power these capabilities through experimentation, quantitative evaluation, context engineering, and iterative refinement.
• Apply your production software engineering experience to build backend services, APIs, and distributed AI systems.
• Partner closely with cross-functional partners to deploy scalable AI services that enable product teams to rapidly build AI-powered experiences.
• Rapidly prototype emerging AI techniques and translate successful experiments into production-ready platform capabilities.
• Support production systems by debugging failures and continuously improving latency, reliability, observability, and operational performance.
• Stay current with advances in AI engineering, foundation models, and applied machine learning, applying them where they create meaningful customer value.
• Optimize AI systems for performance, latency, reliability, scalability, and cost.
• Contribute to a collaborative engineering culture focused on ownership and continuous learning.

Required Skills and Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience.
• 5+ years of experience building production software systems.
• Strong software engineering skills with experience in Rust, Python, or similar programming languages.
• Proven ability to build scalable backend services, distributed systems, APIs, or data-intensive applications.
• Hands-on experience integrating large language models or other foundation models into production applications.
• Ability to design, evaluate, and improve AI systems through experimentation, quantitative evaluation, and continuous iteration.
• Familiarity with modern AI engineering patterns such as structured outputs, tool calling, context engineering, multimodal systems, or AI workflows.
• Strong understanding of software engineering best practices, including testing, observability, reliability, and maintainability.
• Demonstrated ability to take ownership of technically ambiguous projects from design through production.
• Excellent communication and collaboration skills with the ability to work effectively across cross-functional teams.
• Growth mindset and low ego, with a willingness to learn, adapt, and collaborate.

Preferred Skills and Qualifications

• Experience building reusable AI capabilities or shared AI services.
• Familiarity with deploying, optimizing, or serving open-source foundation models.
• Knowledge of evaluation frameworks, benchmarks, or datasets for AI applications.
• Experience with Kubernetes, cloud-native infrastructure, or distributed systems.
• Experience developing production software in Rust.
• Familiarity with retrieval-augmented generation (RAG), multimodal AI, AI agents, or model orchestration.
• Domain expertise building complex AI systems such as multimodal reasoning, long-running inference workflows, AI agents, or model orchestration.

Compensation Information

$170,000 - $200,000 USD

Equal Opportunity Statement

Legion provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Create a Job Alert

Interested in building your career at Legion Intelligence? Get future opportunities sent straight to your email.

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Education

School Select...

Degree Select...

Select...

Due to Government contract requirements, we are only able to hire people that are US citizens or GreenCard holders.Are you a US Citizen or do you hold a GreenCard? * Select...

Due to the nature of our federal contracts this roles required that you must be domiciled in the U.S. (must live permanently and maintain home address in the US). In subsequent steps of the process will you be able to provide verification of eligibility through third party provider CLEAR (ID Verification)? * Select...

LinkedIn Profile *

By selecting YES, I consent to receive recruiting SMS text messages from Legion Intelligence at the phone number provided above. * Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Legion Intelligence’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.