Senior LLM Orchestration Engineer

Dow Jones

New York (NY)

Hybrid

USD 125,000 - 155,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Healthcare plans
Paid time off
Retirement plans
Education benefits
Wellness resources
Commuter transit program
Subscription discounts
Employee referral program
Financial health programs
Cybersecurity protection

Job summary

Dow Jones invites a Senior Machine Learning Engineer to design and build the core systems behind our production LLM applications, including orchestration, tooling, and evaluation harnesses for trustworthy AI.

You will work with Python, LangChain/LangGraph, and cloud platforms (AWS, Snowflake, Vertex) to create scalable multi-step workflows and agent harnesses while driving observability, latency and cost metrics.

Qualifications

  • At least 2+ years’ experience in software/ML engineering with production LLMs.
  • Expert Python, hands-on with LLM APIs and cloud platforms (AWS, Snowflake, Vertex).
  • Deep experience orchestrating multi-step LLM workflows as execution graphs.

Responsibilities

  • Design and build the orchestration, prompting, and workflow layers behind production AI features
  • Create composable tools and integrations, including retrieval and MCP servers and clients
  • Build evaluators, dashboards, and alerts that track accuracy, latency, cost, and hallucination
  • Harden the platform for production scale: caching, reliability, incidents, and model rollbacks
  • Set the technical bar through architecture decisions, design reviews, and mentoring

Skills

Python
LLM systems
Prompt engineering
Observability
Mentoring
Explain AI concepts

Tools

LangChain/LangGraph
AWS
Snowflake
Vertex
Claude Code

Job description

Dow Jones invites a Senior Machine Learning Engineer to design and build the core systems behind our production LLM applications, including orchestration, tooling, and evaluation harnesses for trustworthy AI.

You will work with Python, LangChain/LangGraph, and cloud platforms (AWS, Snowflake, Vertex) to create scalable multi-step workflows and agent harnesses while driving observability, latency and cost metrics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer, Production LLM Orchestration
Senior ML Engineer, Production LLM Orchestration

Dow Jones & Company • New York (NY)

Hybrid
USD 125,000 - 155,000
Healthcare Plans
Paid Time Off
Retirement Plans
+10
Senior AI Engineer - LLM Orchestration & Cloud Infra
Senior AI Engineer - LLM Orchestration & Cloud Infra

Ethereum Technologies • Chicago (IL)

On-site
USD 165,000 - 210,000
Senior AI Engineer — Production-Grade LLM Applications
Senior AI Engineer — Production-Grade LLM Applications

Diverse Lynx, LLC • Long Beach (CA)

On-site
USD 96,000 - 165,000
Senior AI/ML Engineer: Production LLMs & Orchestration
Senior AI/ML Engineer: Production LLMs & Orchestration

CyberCoders, Inc. • United States

Remote
USD 180,000 - 240,000
Remote work
Unlimited vacation
Comprehensive benefits
+2
Senior AI Agent Engineer: LLM Orchestration & Retrieval
Senior AI Agent Engineer: LLM Orchestration & Retrieval

Tata Consultancy Services Limited • Houston (TX)

On-site
USD 120,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
401K Plan
Remote Senior Staff ML Engineer — LLM Systems Lead
Remote Senior Staff ML Engineer — LLM Systems Lead

Undisclosed • United States

Remote
USD 180,000 - 260,000
Remote-friendly culture
Flexible time off
Comprehensive benefits
+1
AI Platform Engineer: LLM Orchestration & Cloud-Native
AI Platform Engineer: LLM Orchestration & Cloud-Native

Valiant Technologies LLC • Chicago (IL)

On-site
USD 130,000 - 190,000
Senior ML Engineer: Production LLM Orchestrator
Senior ML Engineer: Production LLM Orchestrator

News Corp • New York (NY)

Hybrid
USD 125,000 - 155,000
Healthcare Plans
Paid Time Off
Retirement Plans
+9
Senior AI/ML Engineer: LLM Agents & Orchestration
Senior AI/ML Engineer: LLM Agents & Orchestration

Veriipro • Maryland Heights (MO)

On-site
USD 150,000 - 210,000
Senior ML Engineer: Production LLM Systems & Client-Facing
Senior ML Engineer: Production LLM Systems & Client-Facing

Arionkoder • United States

Remote
USD 150,000 - 230,000
Monthly USD Service Fee
Paid Agreed Time Off
Caregiver Time Off
+2