Senior ML Engineer: Production LLM Systems & Client-Facing

Arionkoder; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

Monthly USD Service Fee

Paid Agreed Time Off

Caregiver Time Off

Dynamic remote work culture

Entrepreneurial environment

Job summary

Arionkoder, an AI consulting firm, seeks a Senior Machine Learning Engineer to own LLM-powered systems end-to-end—from rapid PoCs to production-grade solutions trusted by clients. You will operate in AI Labs, bridging engineering and data science, with a focus on eval-driven development, cost-aware design, and scalable architectures.

You will demo capabilities to clients, size pre-sales efforts, and convert learnings into reusable assets for the company.

Qualifications

• 5+ years of professional software engineering with production ownership.
• 2+ years building LLM-powered systems in production.
• Experience designing and running evals with baselines and regression thresholds.
• Advanced Python: clean, tested, typing, packaging, async.
• Hands-on MCP experience and judgment on exposing capability as a tool/server.
• Hands-on RAG experience: embeddings, vector stores, reranking.
• Experience with at least one LLM orchestration framework.
• Cloud deployment of AI/ML workloads, preferably AWS.
• CI/CD, automated tests, reproducible builds, containerization.
• Practical understanding of cost and latency engineering for LLM systems.
• Awareness of LLM security and privacy risks.
• AI-first working style with daily AI coding-tool use.
• Senior judgment: autonomous, problem framing, risk focus.
• Excellent written and spoken English; remote client-facing.

Responsibilities

• Own LLM-powered systems end-to-end from PoC to production.
• Demo live to clients; explain trade-offs to non-technical stakeholders.
• Size effort honestly in pre-sales and turn learnings into reusable assets.
• Challenge problem framing when data does not support the ask.
• Build and maintain evals, baselines, and CI-driven quality gates.
• Collaborate in a fully remote, distributed client-facing team.

Skills

Senior software engineering

LLM systems

Python

CI/CD

Cost latency engineering

Security awareness

AI tooling

Autonomous judgment

English proficiency

Tools

LangChain/LangGraph

LlamaIndex

Pydantic AI

AWS Bedrock

SageMaker

Lambda

ECS

S3

MLflow

Weights & Biases

DVC

Job description

Arionkoder, an AI consulting firm, seeks a Senior Machine Learning Engineer to own LLM-powered systems end-to-end—from rapid PoCs to production-grade solutions trusted by clients. You will operate in AI Labs, bridging engineering and data science, with a focus on eval-driven development, cost-aware design, and scalable architectures.

You will demo capabilities to clients, size pre-sales efforts, and convert learnings into reusable assets for the company.