Robust Video Matting vs unscreen.io

Robust Video Matting is a free project for separating people from video backgrounds. It processes frames with a recurrent neural network that carries temporal memory, and the project says it can perform matting in real time without additional inputs. A browser webcam demo runs the model live and can visualize its recurrent states. The conversion API accepts a video or image sequence and can produce a composited video or PNG sequence, optionally including alpha and foreground outputs.

Models are available for PyTorch, TorchHub, TorchScript, ONNX, TensorFlow, TensorFlow.js, and CoreML. MobileNetv3 is recommended for most uses; ResNet50 is larger and described as offering small performance improvements. The README reports GPU throughput figures, including 4K at 76 FPS and HD at 104 FPS on a GTX 1080 Ti, and 4K at 154 FPS and HD at 172 FPS on an RTX 3090 with FP16 under specified settings. The project cautions that file conversion runs much slower because its script does not use hardware video encoding or decoding or parallel tensor transfers. CoreML models require iOS 13 or later and do not support dynamic resolution. The code is GPL-3.0 licensed.

unscreen.io removes video backgrounds with AI, without requiring a green screen. Its web uploader accepts MP4, MOV, WebM, AVI, MKV, and GIF files. The free browser plan offers processing up to 1080p without time limits or an account, but supports WebM only, has no sound or storage, and uses limited bitrate. Premium plans support exports up to 4K with audio, no watermark, API access, and a commercial license; prices start at $2.97 per month. Premium processing offers Portrait Mode at 1 credit per second and Studio Quality at 4 credits per second. Unscreen Studio adds real-time background removal, virtual camera output, live face swap, video file processing, custom backgrounds, and a media downloader. The virtual camera can supply Zoom, OBS, Teams, or any camera-compatible application. Studio processes frames on the user's machine and says footage is not uploaded, streamed, or stored in the cloud. For cloud processing, videos remain available for download for 30 days before automatic deletion. The product also provides a REST API with a Node.js SDK.