antimatter15/alpaca.cpp
alpaca.cpp, antimatter15/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM (github.com),
antimatter15/alpaca.cpp: Locally run an Instruction-Tuned ...
GitHub
https://github.com › antimatter15 › alpaca, на сайте с 04 мая 2023, 21:21
Run a fast ChatGPT-like model locally on your device. The screencast below is not sped up and running on an M2 Macbook Air with 4GB of weights.
asciicast
This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat interface.