Vicuna AI WOW! It is possible to run an open-source AI like ChatGPT for free on your local PC without even accessing the internet!

Michael McAnally
2 min readJul 15, 2023

--

It would seem impossible, and unbelievable that I could run a powerful AI LLM on my local PC without internet access (unless I want it), with no connection to ChatGPT, Bard, Bing, or even using an API.

All human knowledge compressed into an open-source 13 billion-parameter program running on my personal home PC. And on top of that, it’s free and open source. Just add powerful hardware… that’s not free, of course!

Here is an ad-hoc video poorly filmed with my phone demonstrating Vicuna on my standalone PC. No video card is used, and although I have internet access enabled it is not being used to run the AI.

Here is a podcast that is very interesting about someone already building a home base AI box (what I would coin a “home brain” for a true smart house):

Here are some thoughts from Dr. Ben Goertzel, Cognitive Scientist on architecture for an AGI (Artificial General Intelligence), one that would be much more capable than an LLM AI on one of my blogs.

Update = Other Models Recently Available:

https://www.makeuseof.com/the-best-local-offline-llms-you-can-try-right-now/

--

--

Michael McAnally

Temporary gathering of sentient stardust. Free thinker. Evolving human. Writer, coder, and artist.