Home Reference Source Test 
import SentencePieceTokenizer from 'causal-net/packages/causality-preprocessing/src/Tokenizer/sentencePiece.js'
public class | source

SentencePieceTokenizer

Constructor Summary

Public Constructor
public

Member Summary

Public Members
public

trie: *

public

Method Summary

Public Methods
public

encode(input: *): *

Public Constructors

public constructor() source

Public Members

public trie: * source

public vocabulary: * source

Public Methods

public encode(input: *): * source

Params:

NameTypeAttributeDescription
input *

Return:

*