gotokenizer v1.0.0 Release Notes

Release Date: 2018-10-15 // about 3 years ago
    • ๐Ÿ‘Œ Support Maximum Matching Method
    • ๐Ÿ‘Œ Support Minimum Matching Method
    • ๐Ÿ‘Œ Support Reverse Maximum Matching
    • ๐Ÿ‘Œ Support Reverse Minimum Matching
    • ๐Ÿ‘Œ Support Bidirectional Maximum Matching
    • ๐Ÿ‘Œ Support Bidirectional Minimum Matching
    • ๐Ÿ‘Œ Support using Stop Tokens