Senior AI Engineer: Productionizing LLM Workflows

Axiomatic-AI Inc.

Boston (MA)

Hybrid

USD 180,000 - 230,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Stock Options Plan
Cutting-Edge Tools
Work-Life Balance
Professional Growth
Impact-Driven Culture

Job summary

Axiomatic_AI is seeking a Senior Applied AI Engineer to bridge AI research and production software, delivering end-to-end LLM-powered features for our hardware-focused product.

You will collaborate with backend engineers, mentor junior developers, and establish workflows from discovery to rollout, emphasizing guardrails, testing, and observability to ensure reliable, scalable AI capabilities.

This hybrid role is based in Boston with flexible options and stock options to share in our growth.

Qualifications

  • 7+ years of software engineering experience (Python preferred).
  • Experience with LLMs and AI/ML in production: OpenAI API, HuggingFace, LangChain, or similar (beyond prototypes).
  • Strong software engineering fundamentals: design patterns, code structure, testing practices, and code review habits.
  • Cloud infrastructure experience: GCP (Vertex AI preferred) or AWS (SageMaker).
  • API/service development experience (e.g., FastAPI/REST/async programming). CI/CD and DevOps: Docker, Terraform, GitHub Actions.
  • Monitoring and observability.
  • Problem-solving mindset.
  • Operating experience with AI deployment in enterprise environment.
  • Proactiveness and versatility: defining and scoping tasks independently and improving processes.

Responsibilities

  • Own applied AI features end-to-end: discovery → design → implementation → rollout → iteration.
  • Translate user feedback and behaviour into clear technical requirements and pragmatic delivery plans.
  • Build LLM workflows such as tool-calling agents, structured output pipelines, retrieval/tool integrations, and safe prompting strategies.
  • Iterate quickly while keeping production quality (readability, maintainability, debuggability).
  • Select and evaluate LLMs (OpenAI/Anthropic/others) based on real constraints: quality, cost, latency, context limits, and reliability.
  • Develop prompt patterns and guardrails (structured prompts, schemas, constraints, fallbacks).
  • Design and run lightweight evaluations to prevent regressions (golden datasets, acceptance criteria, failure-mode testing).
  • Document model decisions and trade-offs in a way that enables other engineers to execute confidently.
  • Write production-grade code: clear abstractions, solid API boundaries, strong typing where appropriate, and consistent error handling.
  • Define and enforce testing practices for applied AI (unit tests, integration tests, golden/regression tests).
  • Implement instrumentation appropriate for debugging and iteration (basic logging/tracing/metrics for AI features).
  • Ensure reliability and security basics: rate limiting where needed, safe input handling, prompt-injection awareness, and sensible defaults.
  • Experience in shipping data projects to real users.

Skills

Python
LLMs in prod
OpenAI API
HuggingFace
LangChain
GCP Vertex AI
AWS SageMaker
API development
CI/CD
Docker
Terraform
GitHub Actions
Monitoring
Observability
Problem-solving
Enterprise AI deployment
Proactivity

Tools

FastAPI
Pydantic AI
LangChain
Docker
GitHub Actions
Terraform
Vertex AI
SageMaker
OpenAI API

Job description

Axiomatic_AI is seeking a Senior Applied AI Engineer to bridge AI research and production software, delivering end-to-end LLM-powered features for our hardware-focused product.

You will collaborate with backend engineers, mentor junior developers, and establish workflows from discovery to rollout, emphasizing guardrails, testing, and observability to ensure reliable, scalable AI capabilities.

This hybrid role is based in Boston with flexible options and stock options to share in our growth.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Applied AI Engineer - Hybrid & Production ML
Senior Applied AI Engineer - Hybrid & Production ML

Axiomatic-AI Inc. • Cambridge (MA)

Hybrid
USD 150,000 - 230,000
Stock Options Plan
Cutting-Edge Tools
Work-Life Balance (flexible remote)
Senior AI Software Engineer — Production LLM Features
Senior AI Software Engineer — Production LLM Features

Zof AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior AI Systems Engineer — LLMs & Production Deployments
Senior AI Systems Engineer — LLMs & Production Deployments

Interview Kickstart • United States

Remote
USD 150,000 - 230,000
Senior AI Production Engineer: LLMs & Agent Workflows
Senior AI Production Engineer: LLMs & Agent Workflows

Acceler • United States

Remote
USD 140,000 - 190,000
Senior AI Engineer: Build Production-Grade LLM Systems
Senior AI Engineer: Build Production-Grade LLM Systems

Innovaccer Analytics • San Francisco (CA)

On-site
USD 230,000 - 340,000
PTO benefits
Parental leave
Rewards & recognition
+1
Principal AI Engineer: Production LLM Systems
Principal AI Engineer: Production LLM Systems

Appian • McLean (VA)

On-site
USD 200,000 - 350,000
Senior AI Software Engineer — Production AI & LLM Deployment
Senior AI Software Engineer — Production AI & LLM Deployment

Associate Staffing • Richmond (VA)

On-site
USD 138,000 - 248,000
Senior AI Engineer — Production LLM & RAG Pipelines
Senior AI Engineer — Production LLM & RAG Pipelines

Brown Brothers Harriman & Co. • Town of Boston (NY)

On-site
USD 175,000 - 215,000
Senior AI Engineer: Production LLM Workflows
Senior AI Engineer: Production LLM Workflows

QAD • United States

Remote
USD 150,000 - 210,000
Senior AI Engineer — Production-Grade LLM Applications
Senior AI Engineer — Production-Grade LLM Applications

Diverse Lynx, LLC • Long Beach (CA)

On-site
USD 96,000 - 165,000