SourcererCC
github.com
Spec sheet
- Purpose
- SourcererCC is a token-based code clone detector for very large code bases and Internet-scale project repositories.Read 9 Oct 2026 · github.com
- Support
- The tutorial invites users to contact the team for technical help, including hardware performance tuning.Read 9 Oct 2026 · github.com
- License
- The GitHub repository identifies its license as GPL-3.0.Read 9 Oct 2026 · github.com
- DéjàVu
- The project says SourcererCC supports DéjàVu, a large-scale study of code cloning on GitHub, and describes DéjàVu as a web tool for clone analysis.Read 9 Oct 2026 · github.com
- Detection scope
- It can detect clones between files, methods, statements, or blocks, in any language.Read 9 Oct 2026 · github.com
- File size bounds
- The documented file-level clone detection configuration ignores files below 65 tokens or above 500000 tokens by default.Read 4 Oct 2026 · github.com
- Getting started
- The project provides a virtual machine with instructions and programs for processing source code into a database with clone mappings.Read 9 Oct 2026 · github.com
- Granularity
- It can detect clones between files, methods, statements, or blocks.Read 4 Oct 2026 · github.com
- Input preparation
- Source code must first be tokenized, and the documented tokenizer accepts configured file extensions and project paths.Read 4 Oct 2026 · github.com
- Input size limits
- The documented configuration ignores files below 65 tokens or above 500,000 tokens.Read 9 Oct 2026 · github.com
- Language support
- The README says it can detect clones in any language, with tokenizer language settings and file extensions configured by the user.Read 4 Oct 2026 · github.com
- Languages
- The tokenizer can be configured with language comment syntax and a list of file extensions to analyze.Read 9 Oct 2026 · github.com
- Notable platform limit
- The README says the tokenizer's multiprocessing features do not work on Macs with Python versions later than 3.6 and recommends avoiding Mac for this workflow.Read 4 Oct 2026 · github.com
- Parallel processing
- The tool splits clone detection across multiple nodes, whose output must be aggregated.Read 9 Oct 2026 · github.com
- Platform limitation
- The tutorial says the tokenizer requires Python 3.6 on Mac because later versions have multiprocessing incompatibilities.Read 9 Oct 2026 · github.com
- Processing
- Source code must be tokenized before SourcererCC runs, and the repository provides a tokenizer for that step.Read 9 Oct 2026 · github.com
- Similarity threshold
- The documented default flags clones at 80% similarity, and the threshold can be changed.Read 9 Oct 2026 · github.com
- VM artifact
- The project describes a virtual machine artifact with pre-programmed steps from raw source code to a database with clone mappings and says it is an easy way to get started.Read 4 Oct 2026 · github.com
- Web tool
- The README describes DéjàVu as a supporting web tool for quick and simple clone analysis.Read 4 Oct 2026 · github.com
Where Specifiction places it
- Code Duplication Detection Tools#12 of 186.6
- Code Clone Detection Tools#22 of 236.6