AI Backend Engineer - LLM Integrations & Pipelines

Univio; Town of Poland (NY); On-site; USD 82,656 - 192,864; Full time

Job summary

Univio is seeking an experienced backend engineer to develop AI-driven tools and APIs, focusing on AI agents, workflows, and LLM integrations. You will build AI-powered backend systems, connect Jira/SharePoint/Power BI, and manage Docker-based development environments.

You will collaborate on deployments, CI/CD, and Kubernetes, while monitoring model usage, costs, and performance. Strong emphasis on security and cost optimization applies across projects.

Qualifications

• Experience developing backend solutions and API integrations.
• Practical experience with AI / LLM tools, including prompts, tokens, and cost considerations.
• Experience integrating with AI models (OpenAI, Azure OpenAI, Gemini, Claude/Anthropic, or open-source).
• Ability to design AI agent-based solutions, workflows, or pipelines.
• Knowledge of Docker / Docker Compose and creating isolated dev environments.
• Experience with Git, reviews, refactoring, and code quality.
• Understanding CI/CD, containers, and testing in dev/prod contexts.
• Strong collaboration with developers, DevOps, analysts, and stakeholders.
• Focus on security, access control, and license compliance for AI tools.

Responsibilities

• Develop and maintain tools based on AI agents, workspaces, prompts, and pipelines.
• Integrate applications with LLM models and build an AI gateway / proxy / broker.
• Develop backend AI apps handling import, indexing, and processing of documents (PDF, DOCX, XLSX, CSV, Markdown).
• Build integrations with Jira, SharePoint, Power BI, Grafana, n8n, and databases.
• Prepare and maintain Docker-based dev environments and isolated workspaces.
• Collaborate on deployments, config, CI/CD, and Kubernetes environments.
• Monitor AI model usage: tokens, costs, requests, metrics; expand Grafana dashboards.
• Test new AI models (open-source included) for quality, costs, and deployment potential.
• Optimize AI costs via caching, proxies, prompt compression, and token best practices.
• Refactor code, perform code reviews, fix bugs, and organize repositories.
• Co-create and document AI usage standards and best practices for the team.

Skills

Backend development

APIs and integrations

AI / LLM tools

AI agents / workflows

Docker / Docker Compose

Git & code reviews

CI/CD

Kubernetes

Security & compliance

Tools

Docker / Docker Compose

Git

Kubernetes

n8n

Grafana

Power BI

Jira

SharePoint

AWS

Azure

Job description

Univio is seeking an experienced backend engineer to develop AI-driven tools and APIs, focusing on AI agents, workflows, and LLM integrations. You will build AI-powered backend systems, connect Jira/SharePoint/Power BI, and manage Docker-based development environments.

You will collaborate on deployments, CI/CD, and Kubernetes, while monitoring model usage, costs, and performance. Strong emphasis on security and cost optimization applies across projects.