HFST - Helsinki Finite-State Transducer Technology API  version 3.7.1
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Pages
HfstTokenizer Member List

This is the complete list of members for HfstTokenizer, including all inherited members.

add_multichar_symbol(const std::string &symbol)HfstTokenizer
add_skip_symbol(const std::string &symbol)HfstTokenizer
check_utf8_correctness(const std::string &input_string)HfstTokenizerstatic
HfstTokenizer()HfstTokenizer
tokenize(const std::string &input_string) const HfstTokenizer
tokenize(const std::string &input_string, const std::string &output_string) const HfstTokenizer
tokenize_one_level(const std::string &input_string) const HfstTokenizer
Generated on Thu Jun 12 2014 13:39:58 for HFST - Helsinki Finite-State Transducer Technology API by   doxygen 1.8.6