Senior ML Engineer: Production LLM Orchestrator

News Corporation; Northern, New York (KY, NY); Hybrid; USD 125,000 - 155,000; Full time

Benefits offered by this job

Healthcare Plans

Paid Time Off

Retirement Plans

Insurance Plans

Wellness Resources

Education Benefits

Family Care Benefits

Commuter Transit Program

Subscription Discounts

Employee Referral Program

Financial Health Programs

Cybersecurity Protection

Job summary

Dow Jones is seeking a Senior Machine Learning Engineer to design and build core systems powering our LLM applications in production. You will focus on orchestration, tooling, and evaluation harnesses under the guidance of the Director, Data Science & Insights.

You will build scalable, reliable AI features, craft memory-oriented agent harnesses, and collaborate with stakeholders to ensure robust performance, security, and governance in a hybrid work setup.

Qualifications

• At least 2+ years of software/ML engineering experience, including 1+ year building LLM systems in production.
• Proficiency in Python and extensive experience with LLM APIs and cloud platforms (AWS, Snowflake, Vertex).
• Strong ability to design orchestration and workflow layers for production AI features.

Responsibilities

• Design and build orchestration, prompting, and workflow layers behind production AI features.
• Create composable tools and integrations, including retrieval and MCP servers and clients.
• Build evaluators, dashboards, and alerts that track accuracy, latency, cost, and hallucination.
• Harden the platform for production scale: caching, reliability, incidents, and model rollbacks.
• Set the technical bar through architecture decisions, design reviews, and mentoring.

Skills

Python programming

LLM APIs

Cloud platforms

Orchestrating LLM workflows

Agent harnesses

Prompt engineering

AI evaluation

Explain AI concepts

Tools

AWS

Snowflake

Vertex AI

LangChain/LangGraph

MCP servers/clients

Job description

Dow Jones is seeking a Senior Machine Learning Engineer to design and build core systems powering our LLM applications in production. You will focus on orchestration, tooling, and evaluation harnesses under the guidance of the Director, Data Science & Insights.

You will build scalable, reliable AI features, craft memory-oriented agent harnesses, and collaborate with stakeholders to ensure robust performance, security, and governance in a hybrid work setup.