FitBenchmarking

Spec sheet

Purpose

FitBenchmarking is an open source tool for comparing minimizers and fitting frameworks.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Audience

The project identifies scientists, scientific software developers, and mathematicians or numerical software developers as communities interested in fitting software.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Deployment

desktopRead 23 Sep 2026 · fitbenchmarking.readthedocs.io

Free plan

YesRead 23 Sep 2026 · fitbenchmarking.readthedocs.io

Integrations

The documented benchmark data includes problems from NIST, CUTEst, Mantid, and SASView examples and tests.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Security

The project advises users to install the latest version to stay up to date with security fixes.Read 11 Oct 2026 · github.com

Support

For questions, feature requests, or other inquiries, the project asks users to open a GitHub issue.Read 11 Oct 2026 · github.com

Benchmark data

Shipped problem data includes NIST nonlinear regression, CUTEst, Mantid, and SASView examples.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Comparison caveat

The documentation cautions that comparing minimizers across different software packages and problem formats may not be on truly equal terms.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Comparisons

It compares fitting methods by runtime and accuracy on benchmark problems.Read 11 Oct 2026 · github.com

Custom datasets

Users can add custom datasets in supported file formats and run them with available fitting methods.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Custom problems

Users can analyze problems in supported file formats by passing their paths, and can add custom datasets to the benchmark.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Data import formats

CUTEst, Native, Mantid, NIST, Horace, HOGBEN, BALRead 23 Sep 2026 · fitbenchmarking.readthedocs.io

Dependency limit

The Gradient-Free-Optimizers integration requires finite bounds on all parameters.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

External dependencies

Some benchmark datasets require external packages such as Mantid, CUTEst, pycutest, or sasmodels.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Fitting integrations

Supported fitting software includes SciPy, Bumps, DFO-LS, GALAHAD, GOFit, Mantid, MATLAB, Minuit, and NLopt.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Installation

The package can be installed with pip, and the documentation also describes installing from source.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Interactive results

By default, running FitBenchmarking starts a Dash app to provide interactive plots.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Large problems

Bundle Adjustment in the Large problems can currently only be run with scipy_ls, which supports sparse Jacobians.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Maker collaboration

The package is described as a collaboration between STFC’s Scientific Computing Department, ISIS Neutron and Muon Facility, and Diamond Light Source.Read 11 Oct 2026 · github.com

Optional dependencies

Some fitting packages are optional dependencies, and external software that cannot be installed using pip must be installed separately.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Problem inputs

Each test problem includes data points, a fitting function definition, and at least one set of initial parameter values.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Regression models

NoRead 23 Sep 2026 · fitbenchmarking.readthedocs.io

Scripting support

YesRead 23 Sep 2026 · fitbenchmarking.readthedocs.io

Statistical tests

NoRead 23 Sep 2026 · fitbenchmarking.readthedocs.io

Supported fitting software

Optional fitting packages listed in the installation documentation include Bumps, DFO-LS, GALAHAD, GOFit, Gradient-Free-Optimizers, Minuit, Sasmodels, and NLopt.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Supported operating systems

The documentation says FitBenchmarking supports Windows, Linux, and Mac OS.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Testing

The project says its automated tests run via GitHub Actions.Read 11 Oct 2026 · fitbenchmarking.readthedocs.io

Plans and prices

Every FitBenchmarking plan and price →

Where Specifiction places it

• Statistical Analysis Software#36 of 1068.1