Senior Applied AI Engineer: Real-Time Coaching & LLM

Orum ?; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Orum seeks an experienced AI/ML engineer to lead the design and delivery of AI-powered product features from concept to production. You will build LLM-based coaching insights and real-time recommendations, architect low-latency systems, and set best practices across the engineering org, partnering with product teams to identify high-impact AI opportunities.

You will construct scalable data pipelines, enable real-time intelligence during calls, and mentor engineers to raise the bar on applied AI

Qualifications

• 7+ years of software engineering experience with strong hands-on AI and ML experience.
• Proven track record of shipping AI/ML systems into production.
• Experience building and deploying ML pipelines for training, inference, monitoring, and continuous improvement.
• Deep experience with LLMs and modern AI tooling, including prompting, RAG, embeddings, and agents.
• Experience training and fine-tuning models for domain-specific use cases.
• Strong system design skills and ability to build scalable, reliable AI systems.

Responsibilities

• Lead the design and delivery of AI-powered product features from idea to production.
• Build LLM-based systems for coaching insights and real-time recommendations during calls.
• Architect systems that support low latency and large-scale AI use cases.
• Define and implement AI and ML best practices across the engineering org.
• Partner with Product and Engineering to identify high-impact AI opportunities.
• Build scalable data and feature pipelines to support AI use cases.
• Establish evaluation, monitoring, and feedback loops to improve model performance.
• Mentor engineers and raise the bar on applied AI engineering practices.

Skills

AI/ML engineering

LLMs

System design

Production ML

Data pipelines

Python

Mentorship

Tools

BigQuery

ClickHouse

TensorFlow

PyTorch

Job description

Orum seeks an experienced AI/ML engineer to lead the design and delivery of AI-powered product features from concept to production. You will build LLM-based coaching insights and real-time recommendations, architect low-latency systems, and set best practices across the engineering org, partnering with product teams to identify high-impact AI opportunities.

You will construct scalable data pipelines, enable real-time intelligence during calls, and mentor engineers to raise the bar on applied AI