FiveTech Support Forums

FiveWin / Harbour / xBase community
Board indexAll discussionsLogin (GitHub)
Board index FiveWin for Harbour/xHarbour Using free AI power from our Harbour apps !!!
Antonio Linares
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
Re: Using free AI power from our Harbour apps !!!
Posted: Wed Apr 05, 2023 03:46 PM
A faster version named "vicuna" is already available:

Download the EXE from here, select the one that matches your CPU AVX, AVX2 or AVX512:
https://github.com/ggerganov/llama.cpp/releases

Download the data from here:
https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/resolve/main/ggml-vicuna-13b-4bit.bin

Create this run.bat to execute it:
Code (fw): Select all Collapse
title llama.cpp
:start
main -i --interactive-first -r "### Human:" -t 8 --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m models/llama-7B/ggml-vicuna-13b-4bit.bin
pause
goto start
regards, saludos

Antonio Linares
www.fivetechsoft.com
Ari
Posts: 253
Joined: Fri Feb 03, 2006 04:21 PM
Re: Using free AI power from our Harbour apps !!!
Posted: Sat Apr 08, 2023 10:07 AM
Hello Antonio

Congratulations ! :D


Does it run on mod_harbour :?:
Thanks,
Ari

FWH 2501 - Harbour 3.2.0 - Embarcadero 7.43 - MySQL
São Paulo - SP - Brasil
www.sisrev.com.br
Otto
Posts: 6983
Joined: Fri Oct 07, 2005 07:07 PM
Re: Using free AI power from our Harbour apps !!!
Posted: Sat Apr 08, 2023 01:39 PM

Hello Antonio,

I use ChatGPT a lot as a kind of lexicon.

But I can't imagine what exactly AI could do starting inside my programme.

Does you have practical examples of use?

Best regards,

Otto

Antonio Linares
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
Re: Using free AI power from our Harbour apps !!!
Posted: Sat Apr 08, 2023 09:00 PM
Dear Otto,

There is a new revolution named AutoGPT: (automatic prompting)
https://github.com/Torantulino/Auto-GPT

It is __literally__ mind blowing :-)

look for autoGPT in youtube... get prepared for the BIG revolution!

This is evolving every day! :-)
regards, saludos

Antonio Linares
www.fivetechsoft.com
Antonio Linares
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
Re: Using free AI power from our Harbour apps !!!
Posted: Sun Apr 09, 2023 06:43 AM
A powershell script to install and run vicuna:

https://github.com/mps256/vicuna.ps1
regards, saludos

Antonio Linares
www.fivetechsoft.com
Antonio Linares
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
Re: Using free AI power from our Harbour apps !!!
Posted: Sun Apr 09, 2023 06:44 AM
Ari wrote:Hello Antonio

Congratulations ! :-)


Does it run on mod_harbour :-)


Dear Ari,

This is changing everyday, so fast. Yes, it should work with mod_harbour fine too. We have not tested it yet
regards, saludos

Antonio Linares
www.fivetechsoft.com

Continue the discussion

Static archive · New replies & topics via GitHub Discussions