Natural language detection library for Rust. Try demo online: https://whatlang.org/
nlp
language
rust
classifier
algorithm
ai
text-classification
text-analysis
rustlang
detect-language
language-recognition
text-classifier
whatlang
-
Updated
Aug 18, 2021 - Rust
Need to implement a smarter method of tokenization which takes into account languages that traditionally does not use spaces between words (currently resulting in full-sentence tokens not suitable for the current method of cosine similarity comparisons).
Some of these languages include: