PasLLM

LLM inference engine written in pure Object Pascal: run transformer models locally without external dependencies, with support for quantised weights. Note the licence: AGPL-3.0 (strong copyleft) — derived works, and network services built on it, must be released under the same licence.

Source: github.com/BeRo1985/pasllm · License: see source