Senior AI Architect: LLMs, RAG & Enterprise AI

Compunnel, Inc.; Columbus (OH); On-site; USD 130,000 - 180,000; Full time

Job summary

Compunnel, Inc. seeks a Senior AI Solutions Engineer in a short-term project-based role. The candidate will design, build, and deploy AI-powered solutions that solve complex business challenges, combining software engineering, ML/LLM, and cloud platforms.

The ideal candidate collaborates with data scientists, product managers, and engineering teams to translate business requirements into production-ready AI systems, with emphasis on scalable, secure enterprise applications and governance.

Qualifications

• 10+ years of Software Engineering or ML/LLM Engineering experience with at least 3+ years focused on AI/GenAI.
• Strong hands-on development experience with Python and building production-grade backend services.
• Designing and implementing LLM applications with platforms like OpenAI, Anthropic Claude, Gemini or Llama.
• Proven experience building RAG architectures and integrating vector databases.
• Deep understanding of LangChain, AI orchestration frameworks, and agent-based architectures.
• Experience building and consuming REST APIs, microservices, and event-driven integrations.
• Strong knowledge of AI solution architecture, prompt engineering, model evaluation, and governance.
• Experience integrating AI into enterprise applications and workflows.
• Experience designing scalable, secure, maintainable enterprise applications.
• Ability to communicate architecture decisions and AI strategies to technical and business stakeholders.

Responsibilities

• Design, build, and deploy AI-powered solutions to solve complex business challenges.
• Collaborate with data scientists, product managers, and engineers to translate requirements into production systems.
• Develop scalable and secure backend services and AI pipelines.
• Evaluate and govern AI model performance and alignment with governance best practices.
• Interface with enterprise stakeholders to communicate architecture decisions and roadmaps.

Skills

Python backend

LLM platforms

RAG architecture

Vector databases

LangChain

AI governance

REST APIs

Microservices

Event-driven

Enterprise AI

Stakeholder communication

Tools

OpenAI API

Anthropic Claude

Gemini

Llama

Job description

10+ years of Software Engineering or ML/LLM Engineering experience with at least 3+ years focused on Artificial Intelligence and Generative AI solutions (Open AI)

Strong hands-on development experience with Python and building production-grade backend services.

Experience designing and implementing Large Language Model (LLM) applications utilizing platforms such as OpenAI, Anthropic Claude, Gemini, or Llama.

Proven experience building RAG (Retrieval Augmented Generation) architectures and integrating vector databases.

Deep understanding of LangChain, AI orchestration frameworks, and agent-based architectures.

Experience building and consuming REST APIs, microservices, and event-driven integrations.

Strong knowledge of AI solution architecture, prompt engineering, model evaluation, and AI governance best practices.

Experience integrating AI capabilities into enterprise applications and workflows.

Experience designing scalable, secure, and maintainable enterprise applications.

Ability to communicate architecture decisions and AI strategies to both technical and business stakeholders.

Job Summary

A large Life Sciences company based in San Diego, CA is seeking a Sr. AI Solutions Engineer to join their team for a short-term project based need.

The Sr. AI Solutions Engineer designs, builds, and deploys AI-powered solutions that solve complex business challenges.

This role combines expertise in software engineering, machine learning, large language models (LLMs), cloud platforms, and solution architecture to deliver scalable AI applications.

The ideal candidate works closely with business stakeholders, data scientists, product managers, and engineering teams to translate business requirements into production-ready AI systems.