Senior AI Systems Architect — LLM & RAG Leader

Compunnel Inc.; Dallas (TX); On-site; USD 130,000 - 180,000; Full time

Job summary

Compunnel, Inc. is looking for an experienced Principal Software Engineer to head the design and development of cutting-edge AI and machine learning solutions focusing on Large Language Models (LLMs). This role demands expertise in software engineering, especially with Python, and hands-on experience in machine learning engineering.

The ideal candidate will work collaboratively across teams to ensure the delivery of scalable and reliable AI systems, providing architectural leadership and guidance in advanced AI projects.

Qualifications

• 10+ years of experience in software engineering with recent experience at Principal or Architect level.
• Strong hands-on experience in Machine Learning Engineering and AI system development.
• Extensive experience with Large Language Models (LLMs) and AI workflows.

Responsibilities

• Design, develop, and implement scalable AI and machine learning systems in production environments.
• Lead architecture and engineering efforts for LLM, RAG, and agentic AI solutions.
• Provide technical leadership and architectural guidance across AI and software engineering teams.

Skills

Software engineering expertise

Machine Learning Engineering

Large Language Models (LLMs)

Retrieval-Augmented Generation (RAG)

Architectural leadership

Python programming

Scalable system architecture

Collaboration and communication skills

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Cloud platforms

CI/CD pipelines

Containerization technologies

Job description

We are seeking an experienced Principal Software Engineer to lead the design and development of advanced AI and machine learning solutions with a strong focus on Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic workflows. The ideal candidate will combine deep software engineering expertise with hands-on machine learning engineering experience to build scalable, production-ready AI systems. This role requires strong Python engineering skills, architectural leadership, and the ability to guide technical strategy across AI initiatives.

Key Responsibilities:

• Design, develop, and implement scalable AI and machine learning systems in production environments
• Lead architecture and engineering efforts for LLM, RAG, and agentic AI solutions
• Develop and maintain high-quality Python applications and frameworks
• Build and optimize AI pipelines, APIs, and distributed systems
• Provide technical leadership and architectural guidance across AI and software engineering teams
• Collaborate with cross-functional teams to deliver scalable and reliable AI solutions
• Review code, mentor engineers, and establish engineering best practices
• Troubleshoot and resolve complex engineering and system performance issues
• Drive innovation and continuous improvement in AI engineering processes and system design
• Ensure system reliability, scalability, security, and maintainability

Required Skills:

• 10+ years of experience in software engineering with recent experience at Principal or Architect level
• Strong hands-on experience in Machine Learning Engineering and AI system development
• Extensive experience with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI workflows
• Advanced Python programming and software engineering expertise
• Strong understanding of scalable system architecture and distributed systems
• Experience designing and deploying production-grade AI applications
• Strong problem-solving, debugging, and analytical skills
• Excellent collaboration, communication, and leadership abilities

Preferred Skills:

• Experience with cloud platforms and AI infrastructure
• Familiarity with MLOps, CI/CD pipelines, and containerization technologies
• Experience with vector databases, orchestration frameworks, and AI workflow automation
• Knowledge of API development and microservices architecture

Education:

Bachelor’s or Master’s degree in Computer Science, Engineering, Artificial Intelligence, or related field