AI Software Architect

Siemens; Bengaluru Urban; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Siemens Bangalore is seeking a Software Architect (AI) to design and own the runtime that wraps LLMs, orchestrates tools, and ensures secure, deterministic computing across on‑premises, hybrid, and cloud environments.

You will work on knowledge engineering, governance, and scalable architecture patterns for energy, industrial automation, and OT/IT convergence, with a focus on safety-critical design and provenance.

Qualifications

• Bachelor's or Master's degree in a relevant field.
• Experience designing AI/ML systems in production.
• Ability to separate deterministic and probabilistic concerns.

Responsibilities

• Design and own the runtime that wraps LLMs: orchestration, tool integration, memory, security.
• Enforce separation between AI-assisted interpretation and deterministic computation.
• Ensure multi-environment deployment: on‑prem, hybrid, cloud with identical trust.
• Design knowledge capture and versioning for domain knowledge.
• Establish audit trails, human-in-the-loop gates, and error handling.

Skills

Python

TypeScript

LLM orchestration

Knowledge graphs

Azure cloud

Local LLM inference

OAuth2/OIDC

IEC 61850

COMTRADE

Security & identity

Education

Bachelor's or master's degree

Job description

Dear Aspirant!
We empower our people to stay resilient and relevant in a constantly changing world. We’re looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like you’d make a great addition to our vibrant international team.

Dear Aspirant!
We empower our people to stay resilient and relevant in a constantly changing world. We’re looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like you’d make a great addition to our vibrant international team.

We are looking for: Software Architect (AI)

You’ll Make An Impact By

• Agent harness architecture - design and own the runtime that wraps LLMs: orchestration, tool integration, memory, security
• Determinism boundary - enforce separation between AI-assisted interpretation and deterministic computation
• Multi-posture deployment - ensure the system runs on-premises, hybrid, and cloud with identical trust guarantees
• Knowledge engineering - design how domain knowledge is captured, versioned, and consumed by both AI and deterministic components
• Traceability and governance - audit trails, human-in-the-loop approval gates, structured error handling
• Portfolio scaling - generalize patterns across agent use cases; maintain architecture documentation.

Use your skills to move the world forward!

• Education bachelors or masters equivalent.
• 7+ years software architecture, 3+ years involving AI/ML systems in production
• Experience separating deterministic and probabilistic concerns in a single system
• Multi-environment deployment where data sovereignty or offline operation were real constraints
• Work in a regulated or safety-adjacent domain (energy, medical, automotive, aerospace, industrial)
• Generative AI Agentic orchestration frameworks, RAG, designing LLMs as orchestrators rather than decisionmakers
• Safety-critical design Trust boundaries between probabilistic and deterministic components, audit and provenance architecture
• Knowledge engineering Structured and versioned domain knowledge, knowledge graphs or semantic technologies
• Deployment multi-posture delivery (on-prem + cloud), local and cloud-hosted LLM inference, CI/CD
• Security & identity Auth2/OIDC, zero-trust principles, least-privilege access for AI tool integration
• AI evaluation prompt/model versioning, regression testing, evaluation pipelines, model promotion governance
• Integration design API design across heterogeneous systems, complex domain data format parsing and transformation
• Observability Monitoring, tracing, and logging for production AI systems
• Architecture practice structured documentation, decision records, hypothesis-driven design
• Desired Domain Exposure:
• Electrical power systems or protection engineering
• Industrial automation, OT/IT convergence
• Energy sector product development
• Technology Landscape
• Python
• TypeScript
• LLM orchestration frameworks
• Knowledge graphs
• Azure cloud
• Local LLM inference
• OAuth2/OIDC
• IEC 61850
• COMTRADE.

Create a better #TomorrowWithUs!

This role is based in Bangalore, where you’ll get the chance to work with teams impacting entire cities, countries - and the shape of things to come.

We value your unique identity and perspective and are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society. Come bring your authentic self and create a better tomorrow with us.

We’re Siemens. A collection of over 312,000 minds building the future, one day at a time in over 200 countries. We're dedicated to equality, and we encourage applications that reflect the diversity of the communities we work in. All employment decisions at Siemens are based on qualifications, merit and business need. Bring your curiosity and imagination and help us shape tomorrow.

Find out more about the Digital world of Siemens here:

www.siemens.com/careers/digitalminds #STS

Find out more about Siemens careers at: www.siemens.com/careers