Tagify v0.59.0 Release Notes
-
- ๐ use different segmentation logic based on the
github.com/go-ego/gse
segmenter for Chinese & Japanese languages; - ๐ improved HTML parser logic: optimised the way it collects contents of a document and improved logic for splitting into sentences;
- fallback to the English language for the stop words in cases when language detection is not reliable;
- โ added
lang
option to the CLI to be able to provide the language of the document; - โฌ๏ธ bumped
github.com/zoomio/stopwords
to0.11.0
.
- ๐ use different segmentation logic based on the