Public Sector AI & Automation Engineer — LLM/RAG

INVOKE; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Invoke is a consulting and Innovation firm focused on intelligent automation. We seek a software engineer to build LLM-powered automations, chat/voice assistants, and agents that integrate with client systems across public sector and industry verticals.

You will design retrieval-augmented generation pipelines, implement tool calling and multi-step workflows with human-in-the-loop where needed, and package solutions with FastAPI/Node.js, tests, observability, and CI/CD, deployed in

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 2–3 years of software engineering experience in Python/Java/Node.js/C# or similar.
• 1–2 years building with LLMs—prompt engineering, RAG, agents, and structured outputs.
• Experience with LLM SDKs, vector databases, and ingestion/embedding pipelines.
• Familiarity with evaluation, observability tools, and automated tests for LLM workflows.
• Basic DevOps/MLOps skills: Docker, Kubernetes or serverless, CI/CD, secrets/IAM.
• Exposure to cloud platforms (AWS/Azure/GCP) and related services.

Responsibilities

• Build LLM-powered automations, chat/voice assistants, and intelligent agents that integrate with client systems.
• Design and deploy retrieval-augmented generation pipelines with document ingestion and grounding.
• Implement tool/function calling and multi-step agent workflows with human-in-the-loop.
• Package solutions as reliable services with tests, observability, and CI/CD; deploy to cloud/serverless or containerized architectures.
• Instrument, evaluate, and tune LLM solutions including tracing, latency, cost budgets, and A/B tests.
• Implement guardrails, safety mechanisms, and model routing across providers.
• Collaborate with product, delivery, and client stakeholders to scope use cases and scale prototypes to production.
• Participate in code reviews and contribute to templates, tooling, and documentation.

Skills

Python

Java

Node.js

C#

LLMs

Prompt engineering

Structured outputs

Streaming

Problem solving

Communication

Education

Bachelor’s or Master’s degree in CS/Engineering

Tools

OpenAI SDKs

LangChain

LlamaIndex

Pinecone

Weaviate

pgvector/Postgres

FAISS

Docker

Kubernetes

Serverless

CI/CD

Cloud platforms (AWS/Azure/GCP)

Job description

Invoke is a consulting and Innovation firm focused on intelligent automation. We seek a software engineer to build LLM-powered automations, chat/voice assistants, and agents that integrate with client systems across public sector and industry verticals.

You will design retrieval-augmented generation pipelines, implement tool calling and multi-step workflows with human-in-the-loop where needed, and package solutions with FastAPI/Node.js, tests, observability, and CI/CD, deployed in