spaCy vs Spark NLP

spaCy is a free, open-source Python library for building natural language processing applications, with a focus on production use and large volumes of text. Its components handle named entity recognition, part-of-speech tagging, dependency parsing, sentence segmentation, text classification, lemmatization, morphology, and entity linking. The project lists support for 75+ languages and 84 trained pipelines for 25 languages, though trained pipelines are not available for every language. Developers can configure and train custom pipelines, describe training runs with configuration files, and package pipelines for installation as Python packages. spaCy can use pretrained transformers through spacy-transformers, and supports custom models in PyTorch, TensorFlow, and other frameworks. spaCy Projects supports workflows for downloads, commands, checksum verification, and caching, along with integrations for tracking, demos, model serving, distributed training, and Hugging Face Hub. Installation is available through pip, conda, or source on Linux, macOS, and Windows. The library can run on a user's servers without data leaving them. It is not a hosted software-as-a-service product or web application. The library is free under AGPL or a commercial license; transformer models require a GPU to run effectively.

Spark NLP has no write-up on Specifiction yet; its figures are above.