Artificial Intelligence Engineer

Hexaware Technologies Limited

Pune District, Chennai, Bengaluru

Presencial

INR 1 800 000 - 3 000 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Hexaware Technologies Limited is seeking a senior AI QA specialist to lead the evaluation of AI systems, focusing on safety, reliability and responsible AI behavior. You will define evaluation strategies for LLMs, RAG, and agent-based systems across functional and non-functional dimensions, and work on Golden and synthetic data curation.

You will implement AI observation through CI/CD pipelines, instrumentation with OTEL, and align with regulatory considerations, ensuring rigorous validation and

Qualificações

  • Proven experience with RAG and agentic system architecture.
  • Ability to develop AI assurance test strategies for quality, safety and reliability.
  • Design AI evaluation strategies for LLMs, RAG, and agents across dimensions.
  • Experience curating Golden datasets and generating synthetic data.
  • Implement AI evaluation frameworks (e.g., Ragas, DeepEval).
  • Use AI evaluation tools like LangSmith, Arize, Langfuse, Galileo, Evidently.
  • Instrumentation for AI Observability using OTEL libraries.
  • Integrate AI evaluation into CI/CD pipelines.
  • Knowledge of regulatory considerations for AI systems.

Conhecimentos

RAG architecture
Agentic systems
AI assurance tests
Evaluation strategy design
Golden/synthetic data
AI evaluation frameworks
Integrate CI/CD
Responsible AI validation
Regulatory awareness

Ferramentas

LangSmith
Arize
Langfuse
Galileo
Evidently
OTEL

Descrição da oferta de emprego

  • Strong understanding of RAG & agentic system architecture
  • Ability to develop AI Assurance test strategy to assess AI systems for quality, safety, reliability and responsible AI behavior
  • Design AI evaluation strategy for LLMs, RAG and agent evaluation across functional and non-functional dimensions
  • Experience in Golden dataset curation & Synthetic dataset generation
  • Experience in implementing AI evaluation frameworks like Ragas, DeepEval, etc.
  • Experience in using AI Evaluation tools like LangSmith, Arize, Langfuse, Galileo, Evidently, etc.
  • Experience in instrumentation to establish AI Observability / tracing using OTEL libraries
  • Experience in Integrating AI evaluation into CI/CD pipeline
  • Experience in Responsible AI validation
  • Knowledge of regulatory considerations for AI systems
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Artificial Intelligence Engineer
Artificial Intelligence Engineer

Hexaware Technologies Limited • Pune District, Chennai District

Presencial
INR 1 200 000 - 1 800 000
AI Testing
AI Testing

Momento Cybertech Solutions • Hyderabad, Pune, Chennai

Híbrido
INR 1 200 000 - 2 000 000
Test Analyst - AI Assurance
Test Analyst - AI Assurance

Hexaware Technologies Limited • Índia

Presencial
INR 4 500 000 - 7 500 000
Test Analyst - AI Assurance
Test Analyst - AI Assurance

Hexaware Technologies Limited • Chennai District

Presencial
INR 800 000 - 1 100 000
AI Automation Testing
AI Automation Testing

Hexaware Technologies Limited • Chennai District

Presencial
INR 1 800 000 - 2 200 000
AI Trust and Governance Architect
AI Trust and Governance Architect

Infosys • Bengaluru

Presencial
INR 1 600 000 - 2 400 000
Artificial Intelligence Engineer
Artificial Intelligence Engineer

Simform • Ahmedabad District

Presencial
INR 2 800 000 - 4 500 000
AI Architect - Generative AI
AI Architect - Generative AI

Jero Technologies • Ahmedabad District

Presencial
INR 1 500 000 - 3 000 000
Artificial Intelligence Engineer
Artificial Intelligence Engineer

Orange Datatech • Indore District

Presencial
INR 1 200 000 - 1 800 000
AI Architect | Generative AI
AI Architect | Generative AI

Jero Technologies • Indore District

Presencial
INR 800 000 - 1 200 000