DQE One Unify vs OpenRefine

DQE One Unify identifies, merges, and helps prevent duplicate contacts and accounts across customer databases. Duplicate handles existing records in bulk, while Look-Up checks for an existing contact before a new record is created. Processing can be batch or real time, and the engine can run on company platforms or AWS, Azure, GCP, and Heroku. A SaaS option hosts curative processing in DQE’s cloud. For deployments in a customer’s environment, DQE says information is processed there and does not leave the customer’s IT system. The Data Stewardship interface is available in Salesforce through AppExchange, and API access is supported. A free 30-day trial is available, with limits of 200,000 database records, the first 20 duplicate groups in visualization, and the first 20 records for standardization. DQE describes the product for technical, sales, and marketing departments, including projects involving tens of millions of records. Pricing is on request.

OpenRefine is a free, open-source tool for cleaning, transforming, and extending messy data. It works on the user's machine rather than sending data to a cloud service, and basic functions can run offline through a small web server on that computer. Facets help explore large datasets and apply changes to filtered views. Clustering uses heuristics to find similar values and address inconsistencies; reconciliation matches values to external databases through reconciliation services. Users can undo and redo operations without a stated history limit. OpenRefine imports formats including CSV, TSV, fixed-width text, JSON, XML, spreadsheets, PC-Axis, MARC, RDF formats, and Wikitext. It can also upload data to Google Sheets and create or update Wikidata statements. Releases are available for Windows, Mac, and Linux. Java must be installed and configured, although the Mac version and some Windows packages include it. Data is not encrypted by default; operating-system full-disk encryption can protect it. The project offers support through its forum, GitHub, community calls, and Gitter chat.