SW Architect - AI Engineering

Siemens; Maharashtra; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Hybrid work opportunities

Job summary

Siemens seeks an experienced Software Architect - AI Engineering to design and deliver enterprise-grade Generative AI solutions. You will lead LLM-powered apps, RAG pipelines, and AI agent frameworks, while ensuring governance and security.

The role emphasizes cloud-native development, MLOps, and collaboration with global teams to drive innovation in AI across platforms and products.

Qualifications

• 6–10 years in Software Engineering, ML Engineering, or AI solution development.
• Hands-on delivery of Generative AI in enterprise environments.
• Strong Python/Java/Go programming and design skills.
• Cloud-native development on AWS/Azure/GCP knowledge and MLOps/LMMOps exposure.

Responsibilities

• Design, develop, and deploy LLM-powered applications and AI copilots.
• Architect RAG pipelines for enterprise knowledge discovery.
• Build AI agent frameworks and autonomous workflows.
• Lead prompt engineering, evaluation, and optimization efforts.
• Integrate AI models with enterprise apps, APIs, and data sources.
• Fine-tune and evaluate foundation models and ensure governance.

Skills

Python

Java

Go

Software Architecture

LLM/MLOps

Cloud-native development

Distributed systems

Prompt engineering

Communication

Team collaboration

Education

Bachelor's or Master's in CS/AI/Data Science or related

Tools

OpenAI

Hugging Face

LangChain

LlamaIndex

ADK

LangGraph

CrewAI

AutoGen

Azure OpenAI

Job description

Hello Visionary!

We know that the only way a business thrives is if our people are growing. That's why we always put our people first. Our global, diverse team would be happy to support you and challenge you to grow in new ways. Who knows where our shared journey will take you?

We are seeking an experienced Software Architect - AI Engineering to lead the design and development of next-generation AI-powered solutions. You will architect, build, and scale enterprise-grade Generative AI applications leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and modern cloud technologies. This role requires a strong balance of technical leadership, software architecture expertise, and hands-on experience delivering production-ready AI solutions.

You’ll Make a Difference By

• Designing, developing, and deploying LLM-powered applications such as AI assistants, copilots, chatbots, document intelligence platforms, and intelligent automation solutions.
• Architecting and optimizing Retrieval-Augmented Generation (RAG) pipelines to enable enterprise knowledge discovery and contextual AI experiences.
• Building AI agent frameworks and autonomous workflows using modern agentic AI technologies and orchestration platforms.
• Driving prompt engineering, experimentation, evaluation, and optimization strategies to improve model performance and business outcomes.
• Integrating Generative AI models with enterprise applications, APIs, databases, and external data sources.
• Fine-tuning, adapting, and evaluating foundation models including GPT, LLaMA, multimodal models, and Small Language Models (SLMs).
• Designing scalable AI architectures covering data ingestion, vectorization, embeddings, retrieval, orchestration, and content generation.
• Implementing LLMOps practices including monitoring, model evaluation, governance, versioning, observability, and cost optimization.
• Ensuring security, compliance, responsible AI, and governance practices are embedded throughout the AI solution lifecycle.
• Collaborating closely with product owners, architects, platform teams, data engineers, and business stakeholders to deliver high-value AI solutions.
• Providing technical leadership and architectural guidance to development teams while driving engineering excellence and innovation.
• Evaluating emerging AI technologies, frameworks, and best practices to continuously enhance solution capabilities and performance.

You’ll Win Us Over By

• 6 to 10 years of overall experience in Software Engineering, Machine Learning Engineering, or AI Solution Development.
• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, or related disciplines.
• 1 to 2+ years of hands‑on experience delivering Generative AI and Large Language Model (LLM)-based solutions in enterprise environments.
• Strong programming expertise in Python, Java, or Go, with solid software design and architecture skills.
• Hands‑on experience with leading GenAI ecosystems including OpenAI, Hugging Face, Anthropic, Google AI, Azure OpenAI, or similar platforms.
• Proven experience in prompt engineering, prompt optimization, and model evaluation techniques.
• Strong understanding and implementation experience of RAG architectures and vector database technologies.
• Experience working with frameworks such as LangChain, LlamaIndex, ADK, or equivalent AI orchestration platforms.
• Knowledge of deep learning frameworks including PyTorch and TensorFlow.
• Experience developing APIs, microservices, and distributed applications.
• Familiarity with cloud‑native development on AWS, Azure, or Google Cloud Platform.
• Strong understanding of MLOps and LLMOps practices for deploying and managing production AI systems.
• Excellent communication, collaboration, and stakeholder management skills.
• Ability to work effectively with globally distributed teams and cross‑functional organizations.

Nice To Have

• Experience with agentic AI frameworks such as LangGraph, CrewAI, AutoGen, ADK, or similar technologies.
• Exposure to multimodal AI solutions involving text, image, audio, or video processing.
• Experience fine‑tuning, customizing, or adapting foundation models for domain-specific use cases.
• Familiarity with knowledge graphs, semantic search technologies, and graph-based retrieval mechanisms.
• Experience building enterprise AI copilots, intelligent assistants, or automation platforms.
• Knowledge of AI governance, responsible AI practices, model risk management, and regulatory compliance.
• Experience with CI/CD pipelines, DevOps practices, and scalable cloud‑native architectures.
• Relevant certifications in AI, Machine Learning, Cloud Technologies, or Solution Architecture.

What You’ll Gain

• Collaborate with global product development, AI research, data engineering, and platform teams with deep technical and domain expertise.
• Work on cutting‑edge Generative AI and intelligent automation solutions that shape the future of digital transformation.
• Be part of an innovative and empowering culture where your architectural decisions directly influence product strategy and business outcomes.
• Benefit from hybrid work opportunities and a diverse, inclusive working environment.
• Access to continuous learning opportunities, training programs, and emerging AI technologies.
• Contribute to building responsible, secure, and scalable AI solutions that create meaningful impact for customers worldwide.

Create a better #TomorrowWithUs!

This role is an individual contributor position based out in Pune. You may be required to collaborate with teams across locations within India and globally. In return, you'll have the opportunity to work with talented professionals shaping the future of AI and digital innovation.

At Siemens, we are a collection of over 312,000 minds building the future, one day at a time, worldwide. We are dedicated to equality and welcome applications that reflect the diversity of the communities we serve. All employment decisions at Siemens are based on qualifications, merit, and business need.

Bring your curiosity and imagination, and help us shape tomorrow.

Find out more about Siemens careers at: www.siemens.com/careers #STS