data.table vs Pentaho Data Integration

data.table is a free R package providing a high-performance version of base R’s data.frame. Its code interface supports filtering, grouping, aggregation, ordered and rolling joins, overlapping and non-equi joins, reshaping with dcast and melt, and adding, updating, or deleting columns. fread() reads delimited text, including CSV, TSV, compressed .gz and .bz2 files, and can source web URLs or shell commands. fwrite() writes delimited files with an emphasis on speed for large files. Many operations use multiple CPU threads internally. Columns can be changed by reference without copies, and the project reports no external Imports, LinkingTo, or Depends dependencies. Queries can call R functions from other packages. data.table runs on Linux, macOS, and Windows and requires base R. It is self-hosted and licensed under MPL-2.0. The project’s stated scope excludes binary formats such as Parquet and data stored on disk or in remote SQL databases.

Pentaho Data Integration has no write-up on Specifiction yet; its figures are above.