JAX vs tinygrad

JAX has no write-up on Specifiction yet; its figures are above.

tinygrad is a deep learning framework for neural network training, bringing together a tensor library, compiler, JIT, and training tools. It supports forward and backward automatic differentiation, and tensor operations run lazily when a tensor is realized. Neural network classes, optimizers, and state loading and saving are included. TinyJit captures and replays kernels in a decorated function, and tensors can be distributed across multiple GPUs. Listed accelerators include OpenCL, CPU, Metal, CUDA, AMD, NV, Qualcomm, and WebGPU. The project describes use in openpilot to run a driving model on a Snapdragon 845 GPU. It supports Python and local training, with multiple deployment targets and safetensors or PyTorch weights through model-specific loaders. Installation instructions cover pip, though the project recommends installing from source. tinygrad is free under the MIT license. Its API is described as stable for a while, though the project is not yet version 1.0.