antimatter15/alpaca.cpp

alpaca.cpp, antimatter15/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM (github.com), antimatter15/alpaca.cpp: Locally run an Instruction-Tuned ... GitHub https://github.com › antimatter15 › alpaca, на сайте с May 04, 2023 21:21

Run a fast ChatGPT-like model locally on your device. The screencast below is not sped up and running on an M2 Macbook Air with 4GB of weights. asciicast This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat interface.