Skip to content

vllm.utils.mistral

Provides lazy import of the vllm.tokenizers.mistral module.

is_mistral_tokenizer 

is_mistral_tokenizer(
    obj: TokenizerLike | None,
) -> TypeGuard[MistralTokenizer]

Return true if the tokenizer is a MistralTokenizer instance.

Source code in vllm/utils/mistral.py 
19
20
21
22
23
24
25
26
27
28
def is_mistral_tokenizer(obj: TokenizerLike | None) -> TypeGuard[mt.MistralTokenizer]:
    """Return true if the tokenizer is a MistralTokenizer instance."""
    cls = type(obj)
    # Check for special class attribute, this avoids importing the class to
    # do an isinstance() check.  If the attribute is True, do an isinstance
    # check to be sure we have the correct type.
    return bool(
        getattr(cls, "IS_MISTRAL_TOKENIZER", False)
        and isinstance(obj, mt.MistralTokenizer)
    )