New

The executive guide to generative AI

Read more
About usPartnersSupport|Login
IMPORTANT: No additional bug fixes or documentation updates will be released for this version. For the latest information, see the current release documentation.
« Normalization Token Filter CJK Bigram Token Filter »
Elastic Docs ›Elasticsearch Guide [7.2] ›Analysis ›Token Filters

CJK Width Token Filter

edit
IMPORTANT: This documentation is no longer updated. Refer to Elastic's version policy and the latest documentation.

CJK Width Token Filter

edit

The cjk_width token filter normalizes CJK width differences:

  • Folds fullwidth ASCII variants into the equivalent basic Latin
  • Folds halfwidth Katakana variants into the equivalent Kana

This token filter can be viewed as a subset of NFKC/NFKD Unicode normalization. See the analysis-icu plugin for full normalization support.

« Normalization Token Filter CJK Bigram Token Filter »
Was this helpful?
Feedback