Agentic Systems Architect (DEAI DS) Cloud & Data Engineering United States of America

Hitachi Digital Services, LLC

Dallas (TX)

On-site

USD 180,000 - 240,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Hitachi Digital Services, LLC is seeking an experienced systems architect to design and deploy end-to-end agentic systems that integrate data, analytics, and operations. You will bridge agent infrastructure with data architecture to enable governed, cost-controlled reasoning over complex data.

The role demands 10+ years in software engineering, hands-on with multi-agent frameworks, and production experience with MCP servers and lakehouse governance. Strong AWS/Databricks expertise is preferred.

Qualifications

  • 10+ years in software engineering, platform engineering or systems architecture.
  • 2+ years shipping production LLM or agent applications (not prototypes).
  • Hands-on with multi-agent frameworks; understand loops, tool calls, memory, constraints.
  • Shipped MCP servers; understand transport, auth, statefulness.
  • Lakehouse experience (AWS, Databricks or similar); governance and semantic layers.

Responsibilities

  • Design multi-agent orchestration and justify architecture for business use cases.
  • Build constraint-driven agents with guardrails, gates, and approval workflows.

Skills

Software engineering
Platform engineering
Systems architecture
LLM/agent apps
Python/REST APIs

Education

Bachelor's degree in CS or related field

Tools

AWS
Terraform
Databricks
OpenSearch
Neo4j

Job description

We're Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world's potential. We're people-centric and here to power good.Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save lives. This is a world where innovation, technology, and deep expertise come together to take our companyand customers from what's now to what's next.We make it happen through the power of acceleration.

Imagine the sheer breadth of talent it takes to bring a better tomorrow closer to today. We don't expect you to 'fit' every requirement – your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us.

Job Description
Summary

Design and deploy end-to-end agentic systems that integrate data, analytics, and operations. Bridge agent infrastructure (LLMs, tools, memory, MCP) with data architecture (lakehouses, semantic layers, knowledge graphs) to enable safe, governed, cost-controlled reasoning over complex data.

Key Responsibilities
  • Design multi-agent orchestration (orchestrator-worker, hierarchical) and justify architecture for business use cases.
  • Build constraint-driven agents with explicit guardrails, scoring gates, and approval workflows for high-impact actions.
  • Architect MCP servers for enterprise integration; define auth, role-based access, stateful vs stateless patterns.
  • Design semantic layers over Databricks (metrics, dimensions, business logic); implement text-to-SQL with cost estimation and query safeguards.
  • Design knowledge graphs or ontologies for supplier/parts relationships; plan entity resolution and multi-hop queries.
  • Select vector database (OpenSearch, Pinecone, native Databricks); design chunking, hybrid retrieval, metadata filtering.
  • Establish tracing for agents: inputs, reasoning, tool calls, latency, tokens, cost, model versions.
  • Design evaluation frameworks as release gates (golden sets, LLM-as-judge, regression tests).
  • Implement per-decision cost tracking, alerts for runaway loops, per-tenant budgets.
  • Design secure deployment (identity, secrets, compute), versioning, canary rollouts, on-call runbooks.
Required Experience
  • 10+ years in software engineering, platform engineering, or systems architecture.
  • 2+ years shipping production LLM or agent applications (not prototypes).
  • Hands-on with multi-agent frameworks; understand loops, tool calling, memory, constraints.
  • Built and deployed MCP servers; understand transport, auth, statefulness.
  • Shipped evaluation frameworks (golden sets, LLM-as-judge) as release gates; measured agent quality in production.
  • Designed or worked with lakehouse (AWS, Databricks or similar); understand semantic layers, text-to-SQL, governance.
  • Production experience with vector databases; know ANN, HNSW, chunking trade-offs or Built or maintained knowledge graphs (RDF/OWL, Neo4j, property graphs); understand entity resolution and relationship inference.
  • Built observability systems for multi-step workflows: traced tokens, latency, cost, model versions (OpenTelemetry, Dynatrace, etc.).
  • FinOps or cost optimization in cloud systems; demonstrated ability to control runaway compute or API costs.
  • Python, REST API design, infrastructure-as-code (Terraform), CI/CD, cloud infrastructure (AWS).
Nice to Have
  • Databricks experience (Genie, Mosaic AI Agent Framework, Unity Catalog).
  • GraphRAG or multi-hop reasoning patterns.
  • Model routing and cost optimization (Haiku vs Opus).
  • Prompt versioning and systematic evaluation.

#LI-MS2

About Us

We're a global, team of innovators. Together, we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. We turn organizations into data-driven leaders that can make a positive impact on their industries and society. If you believe that innovation can bring a better tomorrow closer to today, this is the place for you.

Fostering innovation through diverse perspectives

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.

How we look after you

We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We're also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We're always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you'll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.

We're proud to say we're an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic.Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engagement Lead Architect
Engagement Lead Architect

Hitachi Digital Services, LLC • Dallas (TX)

On-site
USD 180,000 - 240,000
Engagement Lead Architect- Data & Agentic AI
Engagement Lead Architect- Data & Agentic AI

Hitachi Digital Services, LLC • Dallas (TX)

On-site
USD 180,000 - 230,000
Senior Enterprise AI & Agent Architect (DEAI DS) Cloud & Data Engineering United States of America
Senior Enterprise AI & Agent Architect (DEAI DS) Cloud & Data Engineering United States of America

Hitachi Digital Services, LLC • Reading

On-site
USD 180,000 - 260,000
Engagement Lead Architect- Data & Agentic AI
Engagement Lead Architect- Data & Agentic AI

HITACHI ENERGY CZECH REPUBLIC S.R.O. • Dallas (TX)

On-site
USD 180,000 - 240,000
Agent Platform Engineer
Agent Platform Engineer

hitachi • Dallas (TX)

On-site
USD 140,000 - 190,000
Senior Enterprise AI & Agent Architect
Senior Enterprise AI & Agent Architect

Hitachi Digital Services, LLC • Reading

Hybrid
USD 180,000 - 240,000
Engagement Lead Architect
Engagement Lead Architect

Hitachi • Dallas (TX)

On-site
USD 150,000 - 210,000
AI Data Architect
AI Data Architect

H-E Parts • Dallas (TX)

On-site
USD 180,000 - 280,000
AI Architect
AI Architect

Hitachi Digital Services, LLC • Dallas (TX)

On-site
USD 180,000 - 280,000
Data & Context Architect
Data & Context Architect

Hitachi Digital Services, LLC • Dallas (TX)

On-site
USD 150,000 - 210,000