-
feat: enhance FlexSearch encoding for CJK support (#553)
released this
2025-01-19 02:54:54 +08:00 | 7 commits to main since this release- Added support for CJK (Chinese, Japanese, Korean) languages in FlexSearch encoding.
- Introduced
isCJK
function to detect language and select appropriate encoding method. - Implemented
encodeCJK
andencodeDefault
functions for different tokenization strategies.
Downloads