- Encoding. Fusion and App Studio support the language encodings of the selected languages both for search and display.
- Language detection. The superset of languages supported was determined based on our use of the Language Detection Library for Java that recognizes 71 languages and the supported languages in Solr.
- Thesaurus. Solr can support a supplied thesaurus for the selected language.
- Did you mean (spell check). Fusion can return spelling suggestions for the selected language.
- Stemming. Supported with an externally-supplied dictionary or out of the box with
HunspellStemFilter. - Summary. The ability to display matching text from a search request which may also include highlighting.
- App Studio. Text in the selected language can be displayed and Right-to-Left languages are also supported.
- Administration tools. The language is supported in the Fusion UI.
- Backtranslation task. Part of the Data Augmentation Job. Translates the input data into one or more intermediate languages before translating it back to the source language.
- Synonym Substitution task. Part of the Data Augmentation Job. Takes in the input text and substitutes some words with synonyms derived from the included wordner/ppdb dictionaries or user-supplied dictionaries.
- Keystroke Misspelling task. Part of the Data Augmentation Job. Simulates typos one might make based on the layout of the keyboard.
- Split Word task. Part of the Data Augmentation Job. Randomly splits words by introducing a space “ “ at some random point in the word.
Language Support in Fusion
The table below shows how various language are supported in the Fusion product suite. The meanings of the columns are as follows:
import from ‘/snippets/LwTemplate.jsx’;