Senior AI Engineer: Production-Ready LLM & Automation

Koda North; United States; Remote; USD 140,000 - 230,000; Full time

Job summary

Koda North is seeking a Senior AI Engineer to design, build, and scale AI-powered software systems for production use. You will translate business problems into reliable AI applications, working on LLM-powered products, AI automation, retrieval workflows, and data pipelines.

You will address evaluation, latency, cost, security, and production risk while collaborating with product, engineering, design, QA, and operations to deliver robust, scalable AI solutions.

Qualifications

• 8+ years of professional software engineering experience.
• Experience building production systems, not only prototypes.
• Hands-on AI application development with LLMs and modern AI APIs.
• Strong Python backend and server-side development skills.
• Ability to design scalable data pipelines, retrieval workflows, and AI guardrails.

Responsibilities

• Design and build production-ready AI applications and automation workflows.
• Develop LLM-powered features using modern AI APIs and backend systems.
• Build retrieval, search, RAG, document processing, and knowledge workflows.
• Design prompts, tools, evaluation flows, and guardrails for reliable AI behavior.
• Integrate AI systems with APIs, databases, and internal tools.
• Create data pipelines for ingestion, cleaning, embedding, and retrieval.
• Evaluate model outputs, debug AI behavior, and improve system quality.
• Ensure secure handling of sensitive data and access controls.

Skills

Backend engineering (Python)

AI/ML application development

LLMs & AI APIs

Data pipelines

Security & privacy

Software architecture

Documentation and code reviews

Cross-functional collaboration

Product stakeholder communication

Production-ready systems

Tools

OpenAI API

LangChain

Pinecone

Weaviate

Chroma

pgvector

AWS Bedrock

Azure AI

Docker

CI/CD

Job description

Koda North is seeking a Senior AI Engineer to design, build, and scale AI-powered software systems for production use. You will translate business problems into reliable AI applications, working on LLM-powered products, AI automation, retrieval workflows, and data pipelines.

You will address evaluation, latency, cost, security, and production risk while collaborating with product, engineering, design, QA, and operations to deliver robust, scalable AI solutions.