AI Software Engineer

Gallatin AI, Inc.; Palo Alto (CA); On-site; USD 80,000 - 210,000; Full time

Benefits offered by this job

Equity grant

Healthcare coverage

401k

Unlimited PTO

Job summary

Gallatin AI, Inc. seeks an AI/ML Software Engineer to build and deploy AI-powered solutions across the full lifecycle—from model definition to real-time inference. You will collaborate with cross-functional teams to deliver impactful AI applications for defense and humanitarian missions.

You will shape scalable AI/ML pipelines, monitor model performance, and stay at the forefront of AI innovations while mentoring junior engineers in a mission-driven environment.

Qualifications

• Strong programming skills across modern ML stacks.
• Experience with ML frameworks and model development.
• Knowledge of MLOps, data engineering, and AI security.

Responsibilities

• Build and deploy AI/ML models for core product.
• Own and develop AI model aligned with product needs within 3 months.
• Validate AI-driven features through real-world testing with users.
• Establish scalable MLOps pipelines and real-time inference services.
• Ensure model reliability and uptime through monitoring.
• Identify and ingest data sources from logs, APIs, and datasets.
• Stay ahead of AI trends and document best practices.
• Contribute to hiring and mentoring of AI/ML talent.

Skills

Strong Programming Skills

ML Framework Proficiency

MLOps & Data Engineering

AI Fundamentals & Security Awareness

Growth Mindset

Python / C / C++

Tools

PyTorch

TensorFlow

CUDA

Jupyter Notebooks

LLMs & Open-Source Models

LangChain

RAG

Hugging Face

Apache Kafka

Apache Airflow

AWS Kinesis

Job description

About Gallatin

At Gallatin, we are rebuilding logistics infrastructure for the national security missions of the United States and allied partners. We build AI systems that determine how logistics decisions are made — not just how they're executed. From factory to foxhole, we operate at the layer where data becomes decisions, and decisions make the advantage.

About the Role

We’re looking for an AI/ML Software Engineer to play a foundational role in building and deploying AI-powered solutions for our core product. You’ll work across the full AI/ML lifecycle, from defining and building models to evaluating and deploying large-scale ML pipelines and real-time inference systems, while partnering with cross-functional teams to deliver impactful, real-world AI applications.

What You'll Do

• Build and Deploy AI/ML Models
• Own and develop an AI model aligned with our core product needs within your first three months.
• Validate AI-driven product features through real-world testing and feedback from warfighters.
• Establish scalable MLOps pipelines and real-time inference services to streamline model training, deployment, runtime, and monitoring.
• Own high model reliability and uptime by implementing monitoring across your work.

Data Collection & Processing

• Identify and integrate structured, unstructured, batch, and real-time data sources.
• Work with internal logs, APIs, user interactions, and third-party datasets to improve training data quality.

Continuous Improvement & Best Practices

• Stay ahead of emerging AI trends and technologies to improve model performance.
• Document and share AI/ML development best practices.
• Contribute to the hiring and mentoring of AI/ML talent as we grow our team.
• Help the wider team understand the latest trends and the significance of novel approaches in AI.

What We’re Looking For

• Strong Programming Skills
• ML Framework Proficiency
• MLOps & Data Engineering Knowledge
• AI Fundamentals & Security Awareness
• Growth Mindset

Expertise in at least one: Python, C++, or C.

Hands-on experience with AI/ML training and fine-tuning frameworks, including:

• PyTorch, TensorFlow, CUDA, Jupyter Notebooks
• Large Language Models (LLMs) and Open-Source Models (Llama, Anthropic, Mistral)
• LangChain, Retrieval-Augmented Generation (RAG), Hugging Face, Exo Labs

Experience with data processing and pipeline frameworks such as Apache Kafka, Apache Airflow, AWS Kinesis, pandas, and dbt.

• Understanding of AI model performance monitoring, data drift detection, and observability tools like Grafana or Kibana.

Deep understanding of deep neural networks (DNNs), LLMs, over/underfitting, prompt engineering, and LLM security (jailbreaking risks and protections).

A passion for continuous learning, staying current with the latest advancements in AI/ML, and teaching others

Bonus Points

• Experience mentoring and upskilling junior engineers.
• Familiarity with legacy systems and working with public sector customers.
• Contributions to open-source (AI/ML) projects.

Mission and Identity

We are building the system that enables faster, smarter logistics decisions in contested environments, and we're doing it with a team of seasoned entrepreneurs, operators, and technologists who have built and scaled solutions in this space before. We hold ourselves to an extremely high standard. We value clear thinking, direct communication, and the kind of ownership that doesn't stop until something actually works.

Our mission is to create decision advantage when the stakes are the highest. If we succeed, the system doesn't just run; it gets smarter. We're not building AI for its own sake. We're building it because faster, smarter decisions in the most demanding environments on earth can't wait. If you want to work somewhere the stakes are real and the mission is urgent — you'll fit in here.

Why Gallatin?

The logistics infrastructure that supports America's warfighters and humanitarian disaster responders is overdue for transformation, and we are building it. From defense operations to disaster response, we're solving the hardest problems that keep missions moving when it matters most. Join a team where the mission is the point.

Compensation: Gallatin offers competitive compensation commensurate with experience. Actual compensation may vary based on experience, skills, and location. In addition to base salary, we offer a generous equity grant, full healthcare coverage, 401k, unlimited PTO, and the perks of working in a high-caliber, mission-driven environment.

Gallatin is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other characteristic protected by applicable federal, state, or local law.

This position may require the ability to obtain and maintain a U.S. government security clearance. The successful candidate must be able to work in a classified environment when necessary.

We comply with the United States Department of Labor's Pay Transparency provision.

Note: Due to the nature of certain government contracts held by this organization, U.S. citizenship is a requirement for all positions at Gallatin. Proof of citizenship will be required prior to employment if selected.

Compensation

SWE I: $80K – $120K Offers Equity

SWE II: $84K – $175K Offers Equity

Senior Software Engineer: $134K – $210K Offers Equity