pemistahl / lingua-rs Star 1k Code Issues Pull requests Discussions The most accurate natural language detection library for Rust, suitable for short text and mixed-language text nlp rust natural-language-processing language-detection rust-library nlp-machine-learning language-recognition language-processing rust-crate language-identification language-classification Updated Nov 14, 2025 Rust
oscar-project / ungoliant Star 173 Code Issues Pull requests Discussions 🕷️ The pipeline for the OSCAR corpus nlp crawler corpus-linguistics fasttext oscar commoncrawl common-crawl language-classification Updated Nov 9, 2025 Rust
omarmhaimdat / whatlang-pyo3 Star 14 Code Issues Pull requests Discussions Python Binding for Rust WhatLang, a language detection library python nlp language language-detection language-classification whatlang detection-algorithm language-detection-library pyo3-rust-bindings Updated Jan 5, 2024 Rust
eliangonde / langid Star 0 Code Issues Pull requests Rust implementation of the langid library for language identification. Easily classify text with a simple API. 🌍🔍 python nlp language pytorch multlingual language-detector language-recognition lid language-identification language-classification language-identification-toolkit language-detection-library language-identifier langid low-resource-nlp langid-csharp langid-dotnet glotcc Updated Nov 15, 2025 Rust