Senior AI Engineer

OpportuLand

Colorado

On-site

USD 120,000 - 180,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Blackthorn Vision is seeking a Senior AI Engineer to advance AI-powered features and agentic workflows in a Colorado-based, US-centric product environment. You will design and implement AI capabilities, including orchestration microservices, LLM integrations, and guardrails, while driving evaluation and cost controls.

You will lead production-ready AI solutions, collaborating with architects and engineers to scale across US and EU Azure regions, and contribute to a high-quality, data-driven

Qualifications

  • 5+ years of professional software engineering or ML engineering experience.
  • 2+ years building and shipping LLM-powered features to production; prompt design, structured outputs, offline evaluation, A/B testing, latency and cost optimization.
  • Experience building a tool-calling agent or conversational assistant over real data using a framework such as Microsoft Agent Framework, Semantic Kernel, LangGraph, or OpenAI Agents SDK.
  • Strong Python skills for experimentation, evaluation, and data analysis.
  • Practical C# / .NET experience in an ASP.NET Core codebase.

Responsibilities

  • Build AI Insights and agentic product experiences.
  • Develop our AI orchestration microservice using C# / .NET and data stores.
  • Integrate LLMs using Microsoft Agent Framework and Azure OpenAI.
  • Design prompt templates and structured outputs with model selection and cost controls.
  • Evolve the platform toward chat and agentic workflows with tool calling and guardrails.
  • Manage AI model deployments and capacity across environments in US and EU regions.

Skills

Software engineering
LLM features development
Experimentation
Python
C# / .NET
GitHub Copilot usage
Communication to non-AI

Tools

MongoDB
Redis
RabbitMQ
Kubernetes
Azure OpenAI
Azure AI Foundry
Semantic Kernel
LangGraph
OpenAI Agents SDK
Microsoft Agent Framework
Azure DevOps YAML

Job description

## Senior AI EngineerBlackthorn Vision is looking for a Senior AI Engineer. Our client, established in 2011 and based in Colorado, is a leading player in the U.S. application management market. We’ve had a successful partnership with this client and are seeking someone who is passionate about exploring the potential of AI, solving real customer problems, and bringing impactful AI capabilities to a product trusted by over 6,000 enterprises.What you’ll work onBuild AI Insights and agentic product experiencesDevelop our AI orchestration microservice using C# / .NET 10, MongoDB, Redis, RabbitMQ, and Kubernetes, working closely with architects and technical leads.Integrate LLMs using Microsoft Agent Framework and Microsoft.Extensions.AI with Azure AI Foundry / Azure OpenAI, including the Responses API.Design prompt templates and structured JSON-schema outputs, select the right model for each task, and implement token metering, cost estimation, and budget controls.Decide what customer data an LLM should see for each task, including devices, vulnerabilities, installed applications, and patch deployments, and design efficient retrieval strategies that balance context quality with token cost.Evolve the platform from batch-generated insights toward chat and agentic workflows, including tool calling over customer data, multi-step agents, and appropriate guardrails.Make AI quality measurable through evaluation datasets, prompt A/B experiments on real tenant data, LLM-as-judge evaluation, duplicate detection, source attribution, and latency benchmarking.Manage AI model deployments and capacity across development, staging, and production environments in US and EU Azure regions.Improve AI-assisted software developmentWe also use AI inside the engineering process itself.You’ll help maintain a shared GitHub Copilot instruction and tooling catalog used across 40+ engineering repositories, covering:coding, security, and testing conventions;reusable prompts;agents and skills;Copilot plugins.You’ll evolve the delivery pipeline that distributes updates to consumer repositories through automated PRs, while supporting repository-specific overrides and opt-outs using Azure DevOps YAML, PowerShell, and CI guards.Discover and ship new AI opportunitiesIdentify product problems where AI can provide capabilities that conventional software cannot.Research ideas and test their feasibility against real product data.Build prototypes and compare them against meaningful baselines.Take successful experiments through production rather than stopping at the demo stage.Help other engineering teams design and integrate AI capabilities.Write technical proposals for product and engineering leadership.Turn ambiguous ideas into scoped, deliverable engineering work.What we’re looking for5+ years of professional software engineering or ML engineering experience.2+ years building and shipping LLM-powered features to production, with hands-on experience in areas such as:prompt design;structured outputs;offline evaluation datasets;A/B experimentation;LLM-as-judge evaluation;latency and cost optimization.Experience building at least one tool-calling agent or conversational assistant over real data, using a framework such as Microsoft Agent Framework, Semantic Kernel, LangGraph, OpenAI Agents SDK, or equivalent.Strong experimental discipline: you can define a baseline, choose meaningful metrics, run experiments on real data, and interpret disappointing results as honestly as successful ones.Strong Python skills for experimentation, evaluation, and data analysis.Practical C# / .NET experience. You should be comfortable implementing production features in an existing ASP.NET Core codebase with support from technical leads.Hands-on experience using GitHub Copilot or another AI coding assistant as part of your daily engineering workflow, ideally including custom instructions, prompts, agents, or similar extensions.Ability to explain LLM behavior, limitations, costs, and engineering trade-offs to non-AI specialists and product leadership.Strong ownership. Given an open-ended product problem, you can turn it into a testable question, evaluate it on real data, and independently drive a useful result to completion.Nice to haveMicrosoft Agent FrameworkMicrosoft.Extensions.AIAzure OpenAI / Azure AI FoundryOpenTelemetryMicroservices architectureRabbitMQDocker and KubernetesAzure DevOps YAML or GitHub ActionsPowerShellTerraformRolling out AI coding assistants across multiple engineering teamsEndpoint management, patching, or vulnerability managementMicrosoft Intune or Configuration ManagerCVE, EPSS, or CISA KEV data
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior .NET Software Engineer with strong AI Engineering experience
Senior .NET Software Engineer with strong AI Engineering experience

EPAM Systems • United States

Remote
USD 140,000 - 180,000
Senior Software Engineer, .NET & AI
Senior Software Engineer, .NET & AI

CDS Home Services • United States

Remote
USD 125,000 - 136,000
Lead AI Engineer with .NET
Lead AI Engineer with .NET

EPAM Systems • United States

Remote
USD 140,000 - 210,000
Senior Software Engineer — AI Engineering
Senior Software Engineer — AI Engineering

Growthspace • United States

Remote
USD 170,000 - 210,000
Senior AI Engineer
Senior AI Engineer

Evren AI • United States

Remote
USD 190,000 - 260,000
Sr. AI Enablement Engineer
Sr. AI Enablement Engineer

Elevate • Addison (TX)

On-site
USD 140,000 - 190,000
Senior AI/.NET Engineer
Senior AI/.NET Engineer

Milbank LLP • New York (NY)

On-site
USD 140,000 - 175,000
Senior/Lead AI Solution Engineer
Senior/Lead AI Solution Engineer

EPAM Systems • United States

Remote
USD 150,000 - 210,000
AI Engineer
AI Engineer

Oakwood Systems Group Inc. • Kansas City (MO)

On-site
USD 120,000 - 160,000
Sr AI Solutions Engineer
Sr AI Solutions Engineer

Connection • New Hampshire

On-site
USD 130,000 - 190,000
Free therapy visits
Mental health resources
Wellness days
+1