encoding¶ Wrapper of tiktoken.get_encoding to retrieve tokenizer files from disk. Usefull for machines which are behind a proxy. mfai.encoding.get_tiktoken_encoding(tokenizer_name)[source]¶ Wrapper of tiktoken.get_encoding to retrieve tokenizer files from disk. Return type: Encoding Parameters: tokenizer_name (str)