nori analyzer
The nori
analyzer consists of the following tokenizer and token filters:
nori_tokenizer
nori_part_of_speech
token filternori_readingform
token filterlowercase
token filter
It supports the decompound_mode
and user_dictionary
settings from nori_tokenizer
and the stoptags
setting from nori_part_of_speech
.