Senior AI Developer

Jobgether; United States; A distancia; USD 140.000 - 230.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health insurance

Dental insurance

Meal and food allowances

Childcare assistance

Extended parental leave

Wellness benefits

Profit-sharing program (PLR)

Life insurance

Continuous learning

Online learning opportunities

Language learning

Discount club

Physical and mental well-being

Parental support

Inclusive workplace

Remote work

Descripción de la vacante

Jobgether is seeking an experienced Python-based AI orchestration engineer to design, develop, and maintain AI agent orchestration services for voice and chat channels. You will build low-latency conversational workflows, integrate LangChain/LlamaIndex, and collaborate with SREs on OCI and Kubernetes deployments.

You will apply prompt engineering, secure REST APIs with mTLS, monitor latency and costs with Langfuse, and work with data scientists to improve model quality and safety.

Formación

• Advanced Python development skills with reliable backend services.
• Experience orchestrating LLM-powered apps using LangChain or LlamaIndex.
• Knowledge of observability, tracing, and cost monitoring using Langfuse.
• Experience with secure REST APIs and mutual TLS (mTLS).

Responsabilidades

• Design, develop, and maintain Python-based AI orchestration services.
• Build conversational workflows with low latency and high accuracy.
• Integrate AI workflows with enterprise systems via APIs.
• Implement and manage LLM orchestration with LangChain/LlamaIndex.
• Apply prompt engineering to improve responses and relevance.
• Collaborate with SREs to deploy on OCI/OKE.

Conocimientos

Python development

LLM orchestration

LangChain/LlamaIndex

Prompt engineering

API security (mTLS)

Observability (Langfuse)

SRE collaboration

Production troubleshooting

Herramientas

LangChain

LlamaIndex

Langfuse

MCP servers

OCI Generative AI SDK

Docker

Kubernetes

OKE

Redis

Descripción del empleo

Accountabilities:

• Design, develop, and maintain Python-based orchestration services for generative AI agents supporting voice and chat channels.
• Build and optimize conversational workflows that deliver low-latency responses, high accuracy, and consistent user experiences.
• Implement and manage large language model orchestration using frameworks such as LangChain and/or LlamaIndex.
• Configure and maintain AI security and safety layers, including guardrails designed to improve response reliability and reduce inappropriate or unsafe outputs.
• Integrate enterprise tools and legacy systems, including CRM and billing platforms, through APIs and Model Context Protocol (MCP) servers.
• Implement comprehensive observability for AI agents using Langfuse, including trace instrumentation and monitoring of latency, performance, costs, and response quality.
• Collaborate with Site Reliability Engineering (SRE) teams to deploy, operate, and maintain AI applications on Oracle Cloud Infrastructure, including Oracle Kubernetes Engine (OKE).
• Work closely with data scientists to evaluate and refine LLM responses, improve conversational quality, and support continuous model and workflow optimization.
• Apply prompt engineering techniques to improve instruction following, contextual relevance, and the accuracy of AI-generated responses.
• Integrate enterprise services securely through REST APIs and mutual TLS (mTLS), following established security and communication standards.
• Troubleshoot production issues, identify performance bottlenecks, and implement improvements to the reliability, scalability, and efficiency of AI applications.
• Contribute to engineering best practices for deploying, monitoring, and maintaining production-grade generative AI solutions.

Requirements:

• Advanced Python development skills, with experience building reliable, maintainable applications and backend services.
• Professional experience developing and orchestrating LLM-powered applications using LangChain, LlamaIndex, or comparable frameworks.
• Practical knowledge of Langfuse or similar observability platforms for monitoring AI agents, tracing execution flows, and analyzing performance and costs.
• Strong prompt engineering skills, including the ability to design, test, and refine prompts for complex conversational use cases.
• Experience integrating enterprise applications and services through REST APIs, with knowledge of secure communication mechanisms such as mutual TLS (mTLS).
• Understanding of generative AI architectures, conversational workflows, and the challenges involved in deploying LLM-powered applications in production.
• Ability to diagnose technical issues, optimize application performance, and improve the reliability and accuracy of AI-driven solutions.
• Strong collaboration and communication skills, with the ability to work effectively alongside SREs, data scientists, and multidisciplinary engineering teams.
• A proactive, analytical mindset and commitment to continuous improvement, technical quality, and secure software development practices.

Nice to have:

• Familiarity with NVIDIA NeMo Guardrails or similar frameworks for implementing safety and security controls in generative AI applications.
• Knowledge of the Model Context Protocol (MCP) and experience building or integrating MCP servers.
• Experience with the Oracle Cloud Infrastructure (OCI) Generative AI SDK.
• Familiarity with Docker, Kubernetes, and Oracle Kubernetes Engine (OKE) for containerized application deployment and orchestration.
• Experience using Redis for conversational context management, session state, or related caching requirements.
• Exposure to GPU-based infrastructure and cloud environments for deploying and operating generative AI workloads.

Benefits:

• Health insurance: Medical coverage to support your health and well-being.
• Dental insurance: Access to dental care and related services.
• Meal and food allowances: Benefits to help cover daily meals and grocery expenses.
• Childcare assistance: Financial support for eligible childcare expenses.
• Extended parental leave: Additional time and support for employees welcoming a child.
• Wellness benefits: Access to fitness facilities and health and wellness professionals through partner platforms, including Wellhub and TotalPass.
• Profit-sharing program (PLR): Participation in a profit-sharing and results program, subject to applicable terms.
• Life insurance: Additional financial protection for employees and their beneficiaries.
• Continuous learning: Access to professional development resources and an internal learning platform.
• Online learning opportunities: Partnerships with online course providers to support ongoing technical development.
• Language learning: Access to language-learning platforms to help strengthen communication skills.
• Discount club: Access to discounts and special offers through partner programs.
• Physical and mental well-being: Access to an online platform focused on physical health, mental health, and overall wellness.
• Parental support: Educational resources covering pregnancy and responsible parenting.
• Inclusive workplace: Dedicated support for professionals with disabilities, including assistance with accommodations throughout the recruitment process.
• Remote work: A remote working arrangement, with office attendance required for professionals residing in the Campinas metropolitan area in accordance with the applicable attendance policy.