Supported languages
The following table lists all languages and scripts with dedicated tokenization support in Charabia:
Languages not listed above still work with Meilisearch. Any language that uses whitespace to separate words benefits from the default Latin pipeline. Results may be less relevant for unlisted languages that do not use spaces between words.
We aim to provide global language support, and your feedback helps us move closer to that goal. If you notice inconsistencies in your search results or the way your documents are processed, please open an issue in the Meilisearch repository.
Read more about our tokenizer
Multilingual hybrid search
Meilisearch’s keyword-based search relies on Charabia for tokenization, but hybrid search and semantic search use embedding models that can handle languages independently of the tokenizer. Many embedding providers offer multilingual models that work across 100+ languages out of the box:
Using a multilingual embedding model allows you to:
- Search across languages: a query in English can match documents written in French, German, or Japanese.
- Simplify multilingual indexing: instead of creating one index per language, a single index with a multilingual embedder can serve multiple languages.
- Complement keyword search: combine Charabia’s keyword tokenization with semantic embeddings in hybrid search for the best of both approaches.
For guidance on structuring multilingual datasets, see Handling multilingual datasets.