Package com.alibaba.cloud.ai.graph.agent.hook

Interface TokenCounter

Functional Interface:
This is a functional interface and can therefore be used as the assignment target for a lambda expression or method reference.
@FunctionalInterface public interface TokenCounter
Functional interface for counting tokens in messages.

Implementations of this interface provide different strategies for estimating token counts in conversation messages.

Example: TokenCounter counter = messages -> { int total = 0; for (Message msg : messages) { total += msg.getText().length() / 4; } return total; };

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final int
    DEFAULT_CHARS_PER_TOKEN
     

  • Method Summary

    Modifier and Type
    Method
    Description
    static TokenCounter
    approximateMsgCounter()
     
    static TokenCounter
    approximateMsgCounter(int charsPerToken)
    Creates a token counter with a custom character-to-token ratio.
    int
    countTokens(List<org.springframework.ai.chat.messages.Message> messages)
    Count the approximate number of tokens in the given messages.

  • Field Details

  • Method Details

    • approximateMsgCounter

      static TokenCounter approximateMsgCounter()

    • approximateMsgCounter

      static TokenCounter approximateMsgCounter(int charsPerToken)
      Creates a token counter with a custom character-to-token ratio. Handles ToolResponseMessage (processing ToolResponse) and AssistantMessage (processing ToolCall).
      Parameters:
      charsPerToken - The average number of characters per token
      Returns:
      A token counter using the specified ratio

    • countTokens

      int countTokens(List<org.springframework.ai.chat.messages.Message> messages)
      Count the approximate number of tokens in the given messages.
      Parameters:
      messages - The list of messages to count tokens for
      Returns:
      The estimated token count