Smart Chinese analysis plugin

edit

The Smart Chinese Analysis plugin integrates Lucene’s Smart Chinese analysis module into elasticsearch.

It provides an analyzer for Chinese or mixed Chinese-English text. This analyzer uses probabilistic knowledge to find the optimal word segmentation for Simplified Chinese text. The text is first broken into sentences, then each sentence is segmented into words.

Installation

edit

This plugin can be installed using the plugin manager:

sudo bin/elasticsearch-plugin install analysis-smartcn

The plugin must be installed on every node in the cluster, and each node must be restarted after installation.

You can download this plugin for offline install from https://artifacts.elastic.co/downloads/elasticsearch-plugins/analysis-smartcn/analysis-smartcn-8.16.1.zip. To verify the .zip file, use the SHA hash or ASC key.

Removal

edit

The plugin can be removed with the following command:

sudo bin/elasticsearch-plugin remove analysis-smartcn

The node must be stopped before removing the plugin.

smartcn tokenizer and token filter

edit

The plugin provides the smartcn analyzer, smartcn_tokenizer tokenizer, and smartcn_stop token filter which are not configurable.

The smartcn_word token filter and smartcn_sentence have been deprecated.