CetaceanNeeded@lemmy.worldtoAsklemmy@lemmy.ml•I'm increasingly unhappy with the limits on AI text generation and I have heard that it's not that hard to do it on a laptop oneself. What is the best path forward?
4·
6 months agoI’ve been using GPT4All on my laptop and using mostly 7B models due to my RAM limitations and I am amazed how good some of them are.
It’s been really easy to use. There are models you can download from within the UI or you can get adventurous and download them from elsewhere, they just need to be in the .gguf format. I get most from TheBloke on hugging face.
So far my favourite has been solar-10.7B-instruct-v1.0-uncensored, it has been astonishingly good.
Cat bus is a cat but he’s got bus-ness on his brain