Package com.alibaba.cloud.ai.evaluation

Class LaajEvaluator

java.lang.Object

com.alibaba.cloud.ai.evaluation.LaajEvaluator

All Implemented Interfaces:

org.springframework.ai.evaluation.Evaluator

Direct Known Subclasses:

AnswerCorrectnessEvaluator, AnswerFaithfulnessEvaluator, AnswerRelevancyEvaluator

public abstract class LaajEvaluator
extends Object
implements org.springframework.ai.evaluation.Evaluator

Title LLM as a judge evaluator.
Description LLM as a judge evaluator.

Since:

1.0.0-M2

Author:

yuanci.ytb

Constructor Summary

Constructors

Constructor	Description
LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder)
LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder, com.fasterxml.jackson.databind.ObjectMapper objectMapper)
LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder, String evaluationPromptText)
LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder, String evaluationPromptText, com.fasterxml.jackson.databind.ObjectMapper objectMapper)

Method Summary

Modifier and Type	Method	Description
protected String	doGetResponse(org.springframework.ai.evaluation.EvaluationRequest evaluationRequest)
String	doGetSupportingData(org.springframework.ai.evaluation.EvaluationRequest evaluationRequest)
org.springframework.ai.chat.client.ChatClient.Builder	getChatClientBuilder()
protected abstract String	getDefaultEvaluationPrompt()
String	getEvaluationPromptText()
abstract String	getName()
com.fasterxml.jackson.databind.ObjectMapper	getObjectMapper()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.springframework.ai.evaluation.Evaluator

evaluate

Constructor Details

LaajEvaluator

public LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder)

LaajEvaluator

public LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder,
 String evaluationPromptText)

LaajEvaluator

public LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder,
 com.fasterxml.jackson.databind.ObjectMapper objectMapper)

LaajEvaluator

public LaajEvaluator(org.springframework.ai.chat.client.ChatClient.Builder chatClientBuilder,
 String evaluationPromptText,
 com.fasterxml.jackson.databind.ObjectMapper objectMapper)

Method Details

doGetResponse

protected String doGetResponse(org.springframework.ai.evaluation.EvaluationRequest evaluationRequest)

doGetSupportingData

public String doGetSupportingData(org.springframework.ai.evaluation.EvaluationRequest evaluationRequest)

Specified by:

doGetSupportingData in interface org.springframework.ai.evaluation.Evaluator

getDefaultEvaluationPrompt

protected abstract String getDefaultEvaluationPrompt()

getName

public abstract String getName()

getChatClientBuilder

public org.springframework.ai.chat.client.ChatClient.Builder getChatClientBuilder()

getEvaluationPromptText

public String getEvaluationPromptText()

getObjectMapper

public com.fasterxml.jackson.databind.ObjectMapper getObjectMapper()