AI Engineer

Latitude

Livingston (NJ)

On-site

USD 143,000 - 210,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with match

Paid parental leave

Tuition Reimbursement

Flexible PTO

Job summary

CoreWeave, The Essential Cloud for AI, is seeking an AI Engineer to design, build, and operate systems used during real customer incidents. You will own agent logic, retrieval, safeguards, and measurement, shipping your own services in production and collaborating with engineers who rely on them.

You will balance deterministic and AI components, implement controls like approvals and idempotency, and drive observability, cost, and latency improvements across Kubernetes-based deployments.

Qualifications

3+ years of professional software engineering experience with Go or Python.
Experience taking an AI application from prototype to production use and supporting it afterward.
Hands-on experience with agent patterns: tool and function calling, multi-step orchestration, and handling incorrect model output.
Experience building and evaluating retrieval systems with held-out data.
Experience designing controls for automation that acts on production systems (approval steps, idempotency, audit trails).
Experience diagnosing failures in LLM applications and fixing underlying causes, not symptoms.
Experience with observability for LLM applications (tracing, cost, latency).
Working knowledge of Kubernetes and CI/CD for deploying services.
Experience integrating with third-party APIs, including authentication and secrets handling.

Responsibilities

Design and build AI agents that investigate and act on real customer issues.
Build safeguards grounding model output in authoritative data and require human approval before actions.
Develop retrieval over large historical support data and compare with experienced engineers’ handling.
Balance AI and deterministic logic for production use.
Instrument systems for quality, cost, and adoption to guide future builds.
Deploy and operate services on Kubernetes and support them when issues arise.
Collaborate with support engineers and domain experts during live investigations.

Skills

Python

AI systems

Agent patterns

Retrieval systems

Automation controls

LLM observability

Kubernetes

CI/CD

APIs & secrets

Tools

Kubernetes

CI/CD

Job description

CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com.

What You’ll Do

The Field Engineering organization at CoreWeave supports the clients running some of the largest AI workloads in the world. This team builds the tooling that engineers rely on to identify and diagnose customer issues faster. We work where AI and deterministic based systems meet live production infrastructure, so what we build has to be accurate, has to show its reasoning, and has to earn the trust of engineers who are the real experts solving issues.

About The Role

As an AI Engineer, you’ll design, build, and operate systems that engineers use during real customer incidents. You will define the right balance between deterministic and AI systems, and work with both. For AI systems, you’ll own the agent logic, the retrieval behind it, the safeguards that stop it from acting on bad information, and the measurement that tells us whether it’s actually helping. This is a full-ownership role: you ship your own services and stay responsible for how they behave in production. You’ll work closely with the engineers who use what you build.

In This Role, You Will

Design and build AI agents that investigate and act on real customer issues.
Build the safeguards that make that safe: grounding model output in authoritative data, requiring human approval before consequential actions, and defining the conditions under which the system should stop.
Build and evaluate retrieval over a large body of historical support data, measured against how experienced engineers handled the same problems.
Determine the optimal balance between AI and deterministic logic.
Instrument these systems for quality, cost, and adoption, then use what you learn to decide what to build next.
Deploy and operate your own services on Kubernetes, including supporting them when something breaks.
Partner with support engineers and domain experts, including sitting in on live investigations to see where automation helps and where it gets in the way.

Who You Are

3+ years of professional software engineering experience, with strong proficiency in Go or Python.
Experience taking an AI application from prototype to production use and supporting it afterward.
Hands-on experience with agent patterns: tool and function calling, multi-step orchestration, and handling incorrect model output.
Experience building and evaluating retrieval systems, including measuring quality against a baseline using held‑out data.
Experience designing controls for automation that acts on production systems, such as approval steps, idempotency, and audit trails.
Experience diagnosing failures in LLM applications and fixing the underlying cause rather than the symptom.
Experience with observability for LLM applications, including tracing, cost, and latency.
Working knowledge of Kubernetes and experience deploying services through CI/CD.
Experience integrating with third party APIs, including authentication and secrets handling.

Preferred

Experience building conversational or chat-based interfaces for internal users.
A background in infrastructure, SRE, or technical support, and comfort reading logs and metrics from a live system.
Experience testing both deterministic and non-deterministic systems.
Experience with fine-tuning or building training datasets from production data.
Open source contributions to AI tooling or agent frameworks.

Wondering if you're a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are a few qualities we've found compatible with our team. If some of this describes you, we'd love to talk.

You can tell the difference between the thing that's interesting and the thing that's urgent, and you'll say so out loud when they aren't the same.
You've worked with a team that already had tooling they liked, and found the integration instead of arguing for a rewrite.
You'd rather sit in on a real incident than infer how the work goes from a ticket.
Blunt feedback from the engineers using your software is the most useful thing you'll hear all week, and you don't get defensive about it.

The base salary range for this role is $143,00 to $210,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

What We Offer

The range we’ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings for full-time employees; for roles in other locations, benefits vary and are shared during the hiring process. These include: