AI Software Architect

Siemens; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Siemens in Bangalore is seeking a Software Architect (AI) to design and own the runtime that wraps LLMs, enabling orchestrations, tool integration, memory, and security.

You will work across on-prem, hybrid, and cloud deployments with strict trust guarantees, focusing on deterministic vs probabilistic components, knowledge graphs, and governance.

Qualifications

• Education bachelors or masters equivalent.
• 7+ years software architecture, 3+ years involving AI/ML systems in production
• Experience separating deterministic and probabilistic concerns in a single system
• Multi-environment deployment with data sovereignty or offline operation constraints
• Work in a regulated or safety-adjacent domain (energy, medical, automotive, aerospace, industrial)
• Generative AI Agentic orchestration frameworks, RAG, designing LLMs as orchestrators
• Safety-critical design trust boundaries between probabilistic and deterministic components
• Knowledge engineering: domain knowledge and knowledge graphs

Responsibilities

• Agent harness architecture - design and own the runtime that wraps LLMs: orchestration, tool integration, memory, security
• Determinism boundary - enforce separation between AI-assisted interpretation and deterministic computation
• Multi-posture deployment - ensure the system runs on-premises, hybrid, and cloud with identical trust guarantees
• Knowledge engineering - design how domain knowledge is captured, versioned, and consumed by both AI and deterministic components
• Traceability and governance - audit trails, human-in-the-loop approval gates, structured error handling
• Portfolio scaling - generalize patterns across agent use cases; maintain architecture documentation.

Skills

Software architecture

AI/ML systems

Deterministic separation

Multi-environment deployment

Knowledge engineering

Governance & traceability

Security & identity

Observability

API integration

Knowledge graphs

Azure cloud

Local LLM inference

OAuth2/OIDC

IEC 61850

COMTRADE

Education

Bachelor's or Master's degree

Tools

LLM orchestration frameworks

Azure cloud

Knowledge graphs

Job description

Dear Aspirant!We empower our people to stay resilient and relevant in a constantly changing world. We’re looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like you’d make a great addition to our vibrant international team.

Dear Aspirant!We empower our people to stay resilient and relevant in a constantly changing world. We’re looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like you’d make a great addition to our vibrant international team.

We are looking for: Software Architect (AI)

You’ll make an impact by:

• Agent harness architecture - design and own the runtime that wraps LLMs: orchestration, tool integration, memory, security
• Determinism boundary - enforce separation between AI-assisted interpretation and deterministic computation
• Multi-posture deployment - ensure the system runs on-premises, hybrid, and cloud with identical trust guarantees
• Knowledge engineering - design how domain knowledge is captured, versioned, and consumed by both AI and deterministic components
• Traceability and governance - audit trails, human-in-the-loop approval gates, structured error handling
• Portfolio scaling - generalize patterns across agent use cases; maintain architecture documentation.

Use your skills to move the world forward!

• Education bachelors or masters equivalent.
• 7+ years software architecture, 3+ years involving AI/ML systems in production
• Experience separating deterministic and probabilistic concerns in a single system
• Multi-environment deployment where data sovereignty or offline operation were real constraints
• Work in a regulated or safety-adjacent domain (energy, medical, automotive, aerospace, industrial)
• Generative AI Agentic orchestration frameworks, RAG, designing LLMs as orchestrators rather than decisionmakers
• Safety-critical design Trust boundaries between probabilistic and deterministic components, audit and provenance architecture
• Knowledge engineering Structured and versioned domain knowledge, knowledge graphs or semantic technologies
• Deployment multi-posture delivery (on-prem + cloud), local and cloud-hosted LLM inference, CI/CD
• Security & identity Auth2/OIDC, zero-trust principles, least-privilege access for AI tool integration
• AI evaluation prompt/model versioning, regression testing, evaluation pipelines, model promotion governance
• Integration design API design across heterogeneous systems, complex domain data format parsing and transformation
• Observability Monitoring, tracing, and logging for production AI systems
• Architecture practice structured documentation, decision records, hypothesis-driven design
• Desired Domain Exposure:
• Electrical power systems or protection engineering
• Industrial automation, OT/IT convergence
• Energy sector product development
• Technology Landscape
• Python
• TypeScript
• LLM orchestration frameworks
• Knowledge graphs
• Azure cloud
• Local LLM inference
• OAuth2/OIDC
• IEC 61850
• COMTRADE.

Create a better #TomorrowWithUs!

This role is based in Bangalore, where you’ll get the chance to work with teams impacting entire cities, countries - and the shape of things to come.

We value your unique identity and perspective and are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society.

We’re dedicated to equality, and we encourage applications that reflect the diversity of the communities we work in.

All employment decisions at Siemens are based on qualifications, merit and business need.

Find out more about Siemens careers at: www.siemens.com/careers

Find out more about the Digital world of Siemens here:

www.siemens.com/careers/digitalminds