AI Infrastructure Engineer: Agents & ML Systems

HavocAI; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

Health, Dental and Vision Insurance (6

Life Insurance

401k (Matching)

Unlimited PTO

Equity Package

Work / Home Office Stipend

Global Entry

Parental Leave

Wellness Stipend

Job summary

HavocAI is seeking an AI Infrastructure Engineer – Agents & ML Systems to build internal AI infrastructure that safely connects LLMs, agents, tools, and data sources. You will develop pipelines, connectors, and services enabling HavocAI teams to reason over data and automate engineering workflows.

You will work on production systems for data prep, simulator support, model evaluation, and deployment, collaborating with Autonomy, Software, Data, Simulation, and Product teams to deliver reliable

Qualifications

• Bachelor’s degree in Computer Science, Engineering, ML, Data Science or related field.
• 3+ years in software/infra/ML infrastructure or related roles.
• Strong Python/TypeScript/Go/C++ programming experience.
• Experience building production software, APIs, data pipelines, or internal platforms.
• Interest in LLM apps, AI agents, tool-use, RAG or AI developer tools.
• Knowledge of embeddings, vector search, prompt management, evaluation, MLOps.
• Ability to integrate systems across APIs, DBs, data lakes, and logs.
• Strong reliability, observability, testing, and maintainability.

Responsibilities

• Build internal AI infrastructure connecting LLMs, agents, tools, and data sources.
• Develop agentic AI systems for automation, data analysis, and simulation workflows.
• Create tool integration infrastructure for AI agents and connectors.
• Build pipelines for retrieval, RAG, context management, and knowledge search.
• Support ML workflows: data prep, curation, experiment tracking, evaluation, deployment.
• Develop observability, logging, tracing, and audit tooling for AI pipelines.
• Collaborate with Autonomy, Software, Data, Simulation, Product, and Operations teams.
• Ensure security with least-privilege access, prompts safety, and data handling.
• Document templates, examples, and best practices for internal teams.

Skills

Python

TypeScript

Go

C++

LLM apps

AI infrastructure

Security

Debugging distributed systems

Education

Bachelor's degree in Computer Science/Engineering/ML

Tools

Kubernetes

Docker

Ray

Airflow

Dagster

MLflow

Weights & Biases

Kafka

Postgres

S3-compatible storage

Job description

HavocAI is seeking an AI Infrastructure Engineer – Agents & ML Systems to build internal AI infrastructure that safely connects LLMs, agents, tools, and data sources. You will develop pipelines, connectors, and services enabling HavocAI teams to reason over data and automate engineering workflows.

You will work on production systems for data prep, simulator support, model evaluation, and deployment, collaborating with Autonomy, Software, Data, Simulation, and Product teams to deliver reliable