Senior Applied AI Engineer, Real-Time Coaching & Insights

Orum; Austin (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

Orum is seeking an experienced AI/ML engineer to lead the design and delivery of AI-powered product features from idea to production. You will build LLM-based systems for coaching insights and real-time recommendations during calls, and architect low-latency AI solutions at scale.

You will define and implement AI/ML best practices across the engineering org, partnering with Product and Engineering to identify high-impact AI opportunities, and build scalable data pipelines to support AI use

Qualifications

• 7+ years of software engineering experience with strong hands-on AI and ML experience.
• Proven track record of shipping AI and ML systems into production.
• Experience building and deploying ML pipelines for training, inference, monitoring, and continuous improvement.
• Deep experience with LLMs and modern AI tooling, including prompting, RAG, embeddings, and agents
• Experience training and fine-tuning models for domain-specific use cases
• Strong system design skills and ability to build scalable, reliable AI systems
• Experience working with large-scale data systems such as pipelines, warehouses, or streaming
• Ability to operate in ambiguity and drive technical direction independently
• Strong product mindset focused on customer impact

Responsibilities

• Lead the design and delivery of AI-powered product features from idea to production
• Build LLM-based systems for coaching insights and real-time recommendations during calls
• Architect systems that support low latency and large-scale AI use cases
• Define and implement AI and ML best practices across the engineering org
• Partner with Product and Engineering to identify high-impact AI opportunities
• Build scalable data and feature pipelines to support AI use cases
• Establish evaluation, monitoring, and feedback loops to improve model performance
• Mentor engineers and raise the bar on applied AI engineering practices
• AI-driven coaching and insights from call transcripts
• Real-time intelligence during calls, such as next best action and signals
• Prospect enrichment and intelligent data augmentation
• Internal AI tools to improve engineering and product velocity
• You will play a key role in defining our AI strategy and execution
• Your work will unlock value from our data and enable AI-driven product innovation
• You will have a broad impact across multiple teams and domains
• High-impact AI features shipped and adopted by customers
• Real-time AI capabilities integrated into core product workflows
• Clear technical direction for applied AI across teams
• Measurable improvements in product outcomes such as conversion, call quality, and coaching effectiveness

Skills

AI/ML experience

System design

Data pipelines

LLMs & tooling

Ambiguity tolerance

Tools

BigQuery

ClickHouse

Airflow

Job description

Orum is seeking an experienced AI/ML engineer to lead the design and delivery of AI-powered product features from idea to production. You will build LLM-based systems for coaching insights and real-time recommendations during calls, and architect low-latency AI solutions at scale.

You will define and implement AI/ML best practices across the engineering org, partnering with Product and Engineering to identify high-impact AI opportunities, and build scalable data pipelines to support AI use