Latest Vicuna (free and local chatGPT) versions - FiveTech Support Forums

Board index Utilities / Utilidades Latest Vicuna (free and local chatGPT) versions

Antonio Linares

Posts: 44158

Joined: Thu Oct 06, 2005 05:47 PM

Latest Vicuna (free and local chatGPT) versions
Posted: Wed Apr 12, 2023 06:21 AM

* Binaries:
https://github.com/ggerganov/llama.cpp/releases/tag/master-8b67998

* Uncensored data:
https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g/blob/main/gpt4-x-alpaca-13b-ggml-q4_1-from-gptq-4bit-128g/ggml-model-q4_1.bin

go.bat

Code (fw): Select all Collapse

main -i --interactive-first -t 8 --temp 0.3 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m ggml-model-q4_1.bin

regards, saludos

Antonio Linares
www.fivetechsoft.com

Continue the discussion