Senior AI Software Engineer – Agentic AI / Python

CEI; Orlando (FL); Hybrid; USD 103,000 - 110,000; Full time

Job summary

CEI is seeking a Senior AI Software Engineer to productionize an agentic AI platform and evolve a prototype into scalable, observable production services. You will work in a fast-moving Agile environment and design robust Python backends for agentic AI applications.

You will develop multi-agent LLM workflows, implement tool use, guardrails, and structured outputs using Pydantic, while emphasizing observability, logging, and CI/CD within a GCP/Vertex AI stack.

Qualifications

• Experience building production-grade Python services.
• Proven multi-agent LLM applications experience.
• Strong knowledge of async Python and FastAPI.
• Experience with GCP and Vertex AI.

Responsibilities

• Design production-grade Python services for agentic AI.
• Develop multi-agent LLM workflows.
• Implement tool use, guardrails, and workflows.
• Ensure production services are scalable and observable.
• Collaborate in Agile environment to iterate on architecture.

Skills

Python development

Async programming

FastAPI

Agentic AI / multi-agent

GCP / Vertex AI

Observability / logging

CI/CD

Prompt engineering

Pydantic schemas

Containerization

Education

Bachelor’s degree in Computer Science

Tools

Google ADK

LangGraph

A2A

OpenTelemetry

Vertex AI

Job description

Senior AI Software Engineer – Agentic AI / Python

Job at a Glance

Title:Senior AI Software Engineer – Agentic AI / Python
Location:Orlando, FL (onsite 4 days per week)
Contract:W2 only, 12 month contract with potential for extension or conversion to full time with either the client or CEI
Pay:$75-$80/hour + optional medical, dental, vision, 401(k) match

Overview

We are seeking a Senior AI Software Engineer to help advance and productionize a sophisticated agentic AI platform. This role will focus on taking an existing, highly functional AI agent prototype and evolving it into a scalable, observable, and production-ready solution. You will work in a highly iterative environment where experimentation, rapid feedback, and continuous improvement are expected.

Key Responsibilities

• Design, build, and enhance production-grade Python services supporting agentic AI applications.
• Develop and refine multi-agent LLM workflows using frameworks such as Google ADK, LangGraph, A2A, or comparable technologies.
• Implement agent orchestration, tool use, guardrails, structured outputs, and workflow logic.
• Help transition advanced AI prototypes into scalable, reliable production services.
• Establish and improve logging, monitoring, tracing, observability, and operational visibility for AI agents.
• Develop evaluation strategies for LLM and agent performance, including quality, safety, accuracy, and behavioral metrics.
• Support A/B testing and experimentation to continuously improve agent performance.
• Build and maintain integrations with services and APIs consumed by AI agents.
• Work extensively with GCP and Vertex AI for AI services, model serving, retrieval, search, and related platform capabilities.
• Apply prompt engineering techniques to improve agent behavior and response quality.
• Design reliable structured outputs and schemas using tools such as Pydantic.
• Containerize services and support automated build, test, deployment, and CI/CD processes.
• Collaborate with product and engineering teams in a fast-moving Agile environment.
• Troubleshoot production issues across AI agents, backend services, integrations, and supporting infrastructure.
• Continuously iterate on architectures, prompts, tools, and workflows as the platform evolves.

Required Skills

• Strong professional experience developing production-grade Python applications and backend services.
• Advanced knowledge of asynchronous Python, including async/await, concurrency, and asynchronous service architectures.
• Hands-on experience with FastAPI, ASGI, or comparable Python API frameworks.
• Proven experience developing agentic or multi-agent LLM applications.
• Experience with Google ADK, LangGraph, A2A, or similar agent orchestration frameworks.
• Strong understanding of agent tool use, orchestration, workflows, guardrails, and state management.
• Hands-on experience with LLMOps, AI evaluation, or agent evaluation.
• Experience with tools or platforms such as Phoenix/Arize, Vertex AI Evaluation, OpenTelemetry, or comparable observability and evaluation technologies.
• Strong experience with Google Cloud Platform and Vertex AI.
• Experience building production services with containers and modern CI/CD practices.
• Experience with observability, logging, monitoring, and tracing within distributed production systems.
• Strong prompt engineering skills and experience refining LLM behavior through experimentation and evaluation.
• Experience designing structured LLM outputs and schemas using Pydantic or similar technologies.
• Strong software engineering fundamentals and the ability to work effectively in a rapidly evolving, highly iterative environment.

Required Education

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related technical field required.

Preferred Skills

• Experience with Retrieval-Augmented Generation (RAG), embeddings, and vector search.
• Experience supporting large-scale MySQL or other relational database environments.
• Knowledge of enterprise authentication and authorization, including OAuth2 and scopes.
• Experience with MLOps platforms, experimentation, and model or prompt tracking.
• Experience mentoring engineers or contributing to architecture and technical direction.
• Java development experience, particularly Java Reactor / reactive programming.
• Experience integrating AI applications with Java-based or reactive backend services.
• Experience taking Generative AI or agentic AI solutions from prototype through production.

Why Should I Apply?

This role offers the opportunity to productionize an advanced agentic AI prototype into a scalable, observable platform while working in a highly iterative engineering environment.

About CEI:

As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.