agentscope.utils.token_utils module

Token utils.

agentscope.utils.token_utils.get_openai_max_length(model_name: str) → int

Get the max length of the OpenAi models.

agentscope.utils.token_utils.count_openai_token(content: str | list, model: str) → int

Count token in format of OpenAI API

agentscope.utils.token_utils.num_tokens_from_content(content: list, model: str) → int

Count token in format of OpenAI Chat API