AI Engineer

Insight Global; San Mateo (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Insight Global is seeking an AI Software Engineer in the San Mateo, CA area to design and build production-ready AI solutions across digital commerce. This role emphasizes applied AI, not training or research, and focuses on scalable, reliable AI-powered products.

You will partner with engineering, product, operations, data, and risk teams to develop AI-driven workflows using LLMs, RAG, and agentic systems.

Qualifications

• 5+ years of software engineering experience (backend/platform).
• Strong coding skills in Python or Java.
• Hands-on experience building applied AI/GenAI solutions integrated into real workflows.
• Experience with LLM APIs like OpenAI, Anthropic, or similar.

Responsibilities

• Build and deploy AI-powered services and workflows (LLMs, RAG, agentic systems, automation).
• Translate business use cases into scalable, production AI solutions.
• Develop retrieval systems using embeddings, vector search, and hybrid search.
• Implement tool/function calling, structured outputs, and workflow orchestration.
• Improve AI quality and safety through evaluation, monitoring, and guardrails.
• Build APIs, microservices, and event-driven systems in Python or Java.
• Deploy solutions in AWS with CI/CD, containers, and infrastructure as code.
• Collaborate cross-functionally on design, delivery, and continuous improvement.

Skills

5+ years software engineering

Python

Java

Production AI

LLMs

RAG

Agentic systems

Embeddings

Distributed systems

CI/CD

Tools

LangChain

LlamaIndex

Semantic Kernel

OpenAI APIs

Kafka

Airflow

Job description

Job Description

We are seeking an AI Software Engineer to design and build production-ready AI solutions that solve high-value business problems across digital commerce. This is an applied AI role focused on delivering scalable, reliable AI-powered products-not model training or research.

You’ll partner with engineering, product, operations, data, and risk teams to develop AI-driven workflows that improve efficiency, decision-making, and automation, leveraging LLMs, RAG, and agentic systems.

Key Responsibilities

• Build and deploy AI-powered services and workflows (LLMs, RAG, agentic systems, automation)
• Translate business use cases into scalable, production AI solutions
• Develop retrieval systems using embeddings, vector search, and hybrid search
• Implement tool/function calling, structured outputs, and workflow orchestration
• Improve AI quality and safety through evaluation frameworks, monitoring, and guardrails
• Build APIs, microservices, and event-driven systems in Python or Java
• Deploy solutions in AWS using CI/CD, containers, and infrastructure as code
• Collaborate cross-functionally on design, delivery, and continuous improvement

What We’re Looking For

Strong engineering mindset with a focus on building reliable, production-grade systems

Proven ability to move beyond prototypes into scalable AI workflows

Someone with deep applied AI experience, especially with agentic system

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 5+ years of software engineering experience (backend/platform)
• Strong coding skills in Python or Java
• Hands-on experience building applied AI/GenAI solutions integrated into real workflows
• Experience with LLM APIs (OpenAI, Anthropic, Bedrock, Vertex, etc.)
• Familiarity with RAG, embeddings, and vector/hybrid search
• Experience building production workflows (beyond simple chatbots)
• Exposure to agentic workflows / orchestration frameworks Experience with AI orchestration tools (LangChain, LlamaIndex, Semantic Kernel, etc.)
• Knowledge of AI observability, evaluation, and guardrails
• Experience building reusable AI platform components
• Familiarity with data/event platforms (Kafka, Airflow, Spark, etc.)
• Experience applying AI in commerce, risk, fraud, or customer operations