LLM Application Engineer

Software Guidance & Assistance, Inc. (SGA, Inc.); San Francisco (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Software Guidance & Assistance, Inc. (SGA) is seeking an LLM Application Engineer for a Remote Full Time assignment with a premier Technology client. You will design, develop, and deploy applications powered by large language models and intelligent workflow automation in a production environment.

The role requires hands-on experience with LLM platforms, Python development, and building agent-based systems. You will collaborate with product and engineering stakeholders to optimize performance and

Qualifications

• Strong software engineering background with production-grade AI apps.
• Hands-on with large language models or autonomous agents.

Responsibilities

• Design, develop, and deploy AI-powered applications.
• Build agent-based systems for reasoning, planning, memory, tool integration, and multi-step tasks.
• Integrate AI with APIs, databases, search platforms, and services.
• Implement prompt engineering, context management, and tool-calling techniques.
• Develop evaluation benchmarks and datasets to monitor quality and regression risks.
• Troubleshoot AI stack issues across models, orchestration layers, backends, and UI.

Skills

Software engineering

Python

LLM technologies

Prompt engineering

Agent architectures

API design

Tools

OpenAI-compatible APIs

PyTorch

JAX

Vector databases

Job description

Software Guidance & Assistance, Inc., (SGA), is searching for an LLM Application Engineer for a Remote Full Time assignment with one of our premier Technology clients.

Responsibilities

• Design, develop, and deploy applications powered by large language models and intelligent workflow automation.
• Create agent-based systems that support reasoning, planning, memory management, tool integration, and multi-step task execution.
• Build orchestration frameworks that transform AI-generated outputs into dependable, observable, and secure business processes.
• Integrate AI solutions with APIs, databases, search platforms, internal services, and third-party systems.
• Implement prompt engineering, context management, structured responses, and tool-calling techniques to improve model performance.
• Develop evaluation methodologies, benchmarks, and datasets to monitor quality, accuracy, and regression risks.
• Troubleshoot issues across the AI stack, including model behavior, orchestration layers, backend systems, and user experience components.
• Optimize solutions for performance, scalability, response times, and operational cost.
• Partner with product and engineering stakeholders to convert business requirements into practical AI-driven solutions.
• Establish best practices for monitoring, experimentation, traceability, and continuous improvement of production AI systems.

Required Skills

• Strong software engineering background with experience building production-grade AI applications.
• Hands-on experience with large language models, generative AI technologies, or autonomous agent architectures.
• Proficiency in Python development.
• Experience designing prompts, workflows, evaluation frameworks, and AI behavior optimization strategies.
• Knowledge of LLM platforms, model APIs, and open-source model ecosystems.
• Ability to develop clean, maintainable, and scalable production code.
• Experience working across multiple layers of AI solutions, including models, systems, and end-user applications.
• Strong analytical and problem-solving capabilities in fast-paced and evolving environments.

Preferred Skills

• Experience with AI orchestration frameworks and agent development platforms.
• Knowledge of vector databases, retrieval systems, and semantic search technologies.
• Experience building backend services, APIs, and distributed systems.
• Familiarity with machine learning frameworks such as PyTorch or JAX.
• Demonstrated success in iterative product development and continuous improvement initiatives.

Tech Stack

• Python
• LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models
• Agent frameworks and orchestration systems
• Vector databases and retrieval systems
• Backend services, APIs, and distributed systems
• PyTorch / JAX

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/.

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.