AI Application & Prompt Specialist

Moonfire; Chennai District; On-site; INR 1,800,000 - 2,800,000; Full time

Benefits offered by this job

Staff insurance coverage (APAC)

Job summary

Harting is seeking an AI Application & Prompt Specialist to join our engineering teams in India. You will design, build and productionize internal AI solutions using Python, LLMs and RAG pipelines, with hands-on development and production-grade practices.

You will collaborate across product, security and IT to deploy cloud-native services on AWS, implement modular code, tests and monitoring, and ensure safe enterprise integrations with services like ServiceNow and SAP.

Qualifications

• 3+ years building software systems with hands-on Python development (production code, packaging, testing).
• Practical experience integrating LLMs and building RAG pipelines; LangChain/LangGraph or equivalent frameworks.

Responsibilities

• Design, build and productionize internal AI solutions with production-grade Python engineering, agent orchestration and secure enterprise integrations.
• Develop reusable SDKs, libraries and microservices for LLM integrations (prompt templates, prompt chaining, tool calling, caching).
• Architect multi-agent orchestration using LangGraph/LangChain to support supervisor/worker and tool-calling designs.
• Implement secure RAG pipelines with document ingestion, embedding and vector DBs.
• Write production Python code (APIs, async messaging, WebSockets, background workers) to integrate LLMs and vector stores.
• Deploy and operate LLM components on AWS Bedrock or equivalent; manage secrets/OAuth2 and RBAC.

Skills

Python

LangChain

LangGraph

RAG

AWS

Docker

CI/CD

REST APIs

WebSockets

PostgreSQL

Prompt engineering

Testing

Tools

LangSmith

Job description

HARTING stands for strong connections – across the globe. As one of the leading international suppliers of industrial connectivity, we are connecting customers to their digital future. And as an employer? We connect around 6,000 people at our headquarter in Espelkamp and at locations worldwide. Here you’ll find great colleagues, as well as ever new opportunities and innovations revolving around IoT and artificial intelligence. In everything we do, we remain true to our roots: as a regionally connected family business that always stays firmly grounded in spite of our stellar high-tech. Here’s to your unique future with us: Yours!

Job Title: AI Application & Prompt Specialist

Required Experience (3–7 Years)

• 3+ years building software systems with hands‑on Python development (production code, packaging, testing)
• Practical experience integrating LLMs and building RAG pipelines; experience with LangChain and/or LangGraph or equivalent agent frameworks
• Experience with vector databases and embeddings workflows (Qdrant, OpenSearch, FAISS, Milvus or similar)
• Cloud deployment experience (AWS required or strongly preferred; experience with Bedrock or other cloud model‑hosting services advantageous)
• Containerization (Docker), CI/CD pipelines, and basic infra‑as‑code or orchestration knowledge
• Familiarity with REST/async APIs, WebSockets, and relational DBs (PostgreSQL or equivalent)
• Demonstrable prompt engineering skills and experience measuring prompt performance and reducing hallucinations
• Strong engineering practices: modular code, unit tests, code reviews, documentation, and reproducible deployments
• Clear communication and cross‑functional collaboration skills

Roles And Responsibilities

Design, build and productionize internal AI solutions that combine strong prompting/LLM experience with production-grade Python engineering, agent orchestration, and secure enterprise integrations. Deliver reusable frameworks, observability, and guardrails so business teams can adopt LLM-enabled features safely and reliably.Build reusable SDKs, libraries and microservices for LLM integrations (prompt templates, prompt chaining, tool calling, caching, retry & backoff logic)

Architect and implement multi-agent orchestration and workflow systems using LangGraph and/or LangChain patterns to support supervisor/worker and tool‑calling agent designs

Implement secure RAG pipelines: document ingestion, chunking strategies, embeddings, vector DB integration (Qdrant, OpenSearch, FAISS-style stores) and retrieval tuning

Write production Python code (APIs, async messaging, WebSockets, background workers) to integrate LLMs (cloud-hosted or private) and vector stores; package services with containers and CI/CD

Deploy and operate LLM components on cloud platforms (AWS + Bedrock or equivalent; familiarity with Azure OpenAI is a plus) and manage secrets/OAuth2 and RBAC integrations

Define and run systematic prompt evaluation and monitoring (accuracy, hallucination, cost-per-response); implement guardrails and automated tests for prompt suites (unit tests, A/B experiments)

Integrate AI features with enterprise systems (ServiceNow, SAP SuccessFactors, internal HR/ERP systems) to enable end‑to‑end workflows (ticket creation, approvals, data updates)

Implement observability/alerting (latency, throughput, cost, drift, hallucination rates) and incident handling; produce runbooks and monitoring dashboards

Collaborate with product, legal, security and domain experts to ensure privacy, compliance and acceptable use; implement technical controls (input redaction, auditing, access controls)

Document patterns, run enablement sessions and deliver onboarding materials for internal developers and business users

Primary Skills

• Python (production‑grade code, packaging, typing)
• LangChain and LangGraph (agent orchestration, prompt chaining, tool calling)
• RAG: ingestion, chunking strategies, embeddings, vector search and retrieval tuning
• Cloud: AWS (S3, Lambda, ECS/EKS, Bedrock or model‑hosting services); familiarity with Azure OpenAI helpful
• Databases: PostgreSQL, session state and audit logging best practices
• DevOps: Docker, CI/CD, monitoring/observability tools, basic Kubernetes concepts
• Security: OAuth2, role‑based access control, input filtering/redaction, audit trails

Prompting & Evaluation Capabilities

• Craft and iterate high-quality prompts and templates for retrieval, summarization, instruction following and tool use
• Build reusable prompt libraries and parameterized templates for scale
• Implement automated prompt testing and evaluation pipelines (unit tests, A/B experiments, quantitative metrics)
• Define and monitor metrics: accuracy, usefulness, hallucination rate, latency, and cost per useful response
• Design mitigation patterns for failure modes (refusal strategies, retrieval confidence thresholds, fallback flows)
• Governance, compliance & security
• Apply enterprise AI usage rules: use approved/private model instances, avoid uploading personal or strictly confidential data into external models, and enforce output review processes where required
• Implement technical enforcement: input filtering/redaction, access controls, logging/auditing and support approval workflows for publishing outputs
• Collaborate with information owners, legal and security teams to ensure policies are enforced and audits supported

Secondary Skills

• Hands‑on experience with LangSmith or similar evaluation/orchestration tooling
• Experience with LLM fine‑tuning or instruction‑tuning workflows
• Experience building internal SDKs, admin panels or developer platforms for AI adoption
• Domain knowledge in industrial automation, manufacturing, connectivity or related fields

Interview & Assessment Suggestions

Take-home task: build a small Python microservice that performs RAG using a vector DB, exposes a prompt template interface, includes unit tests and basic monitoring metrics

Live exercise: iterate prompts for a defined internal workflow, demonstrate evaluation choices and explain failure modes and mitigations

System design: outline architecture for safe LLM integration at enterprise scale (ingestion, retrieval, orchestration, monitoring, access control)

Request GitHub or code samples, architecture diagrams, and runbook/monitoring artifacts where available

Professional Competencies

• Technical Expertise
• Analytical Skills
• Demonstrate Ownership
• Communication
• Leadership
• Execution
• Technological Insight
• Process Optimization Knowledge
• Business & Financial Acumen
• Trust and Collaborate

Culture Competencies

• Become better everyday
• Break new ground
• Champion customers satisfaction
• Demonstrate ownership
• Trust and collaborate

Benefits: Staff insurance coverage (APAC)