Senior ML Engineer - Legal AI & RAG Systems

Compunnel, Inc.; Raleigh, Northern (NC, KY); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Compunnel, Inc. in Raleigh, NC seeks a Senior Machine Learning Engineer to lead design and validation of AI-driven capabilities in the legal domain, using Python and LLMs to solve complex workflows.

You will drive experimentation, modeling, and evaluation in partnership with data scientists to translate approaches into scalable, customer-facing solutions. This role emphasizes production-grade NLP, RAG, and MLOps practices, mentoring engineers, and collaborating with product managers and legal

Qualifications

• 7–10+ years in AI/ML engineering with production deployment experience.
• Experience designing agentic workflows and applying generative AI techniques.
• Strong background in Python software engineering for ML.
• Experience with unstructured data, including NLP and embeddings.
• Proven ability to build scalable ML systems at production scale.
• Hands-on experience with LLMs, Generative AI, and RAG deployment.

Responsibilities

• Design, build, and deploy scalable ML and generative AI solutions for legal technology products.
• Develop NLP, LLM, and RAG applications for production.
• Engineer agentic AI workflows and multi-step reasoning systems.
• Implement and improve retrieval systems, including vector and semantic search.
• Build and maintain ML pipelines, APIs, and model serving infrastructure.
• Establish MLOps practices for deployment, monitoring, and lifecycle management.
• Evaluate model performance, latency, and cost across AI apps.
• Collaborate with product managers, data scientists, and engineers to deliver AI solutions.
• Troubleshoot production ML systems and optimize performance.
• Provide technical leadership on ML engineering and AI platform best practices.

Skills

Python

LLMs

Generative AI

RAG deployment

NLP

Production ML systems

Team leadership

Tools

Vector databases

Model serving

Job description

Compunnel, Inc. in Raleigh, NC seeks a Senior Machine Learning Engineer to lead design and validation of AI-driven capabilities in the legal domain, using Python and LLMs to solve complex workflows.

You will drive experimentation, modeling, and evaluation in partnership with data scientists to translate approaches into scalable, customer-facing solutions. This role emphasizes production-grade NLP, RAG, and MLOps practices, mentoring engineers, and collaborating with product managers and legal