Detoxify vs Huawei Cloud Content Moderation

Detoxify is a free, self-hosted library that provides trained models and code to classify toxic comments. Its original, unbiased, and multilingual models are based on BERT, RoBERTa, and XLM-RoBERTa, respectively. Depending on the model, outputs include categories such as threats, obscenity, insults, identity attacks, and explicit sexual content. The multilingual model is intended for English, French, Spanish, Italian, Portuguese, Turkish, and Russian. The project describes research, fine-tuning on carefully constructed representative datasets, and helping moderators flag harmful content faster as intended uses. It can be installed with pip and called from Python to predict labels for one string or a list. Inference uses CPU by default and accepts a PyTorch device such as CUDA. The project warns that profanity-associated words may be labeled toxic regardless of tone or intent, potentially biasing results against vulnerable minority groups. Inference uses Transformers and PyTorch Lightning; training also requires the Kaggle API to download data. API access can be requested by email. The library is distributed under Apache-2.0.

Huawei Cloud Content Moderation has no write-up on Specifiction yet; its figures are above.