Absolutely stunning.
Llama-3 8B was the most powerful small AI model a few hours ago.
Microsoft has just released Phi-3 Mini which is better in almost every benchmark.
You can use it locally for free as it's open-source (details below):
Llama-3 8B was the most powerful small AI model a few hours ago.
Microsoft has just released Phi-3 Mini which is better in almost every benchmark.
You can use it locally for free as it's open-source (details below):
1. Download LM Studio - it's free, open-source software that lets you run any open-source AI model.
Go to lmstudio.ai, then download and install the one for your OS.
Go to lmstudio.ai, then download and install the one for your OS.
2. Get Phi-3
Search for "Phi-3" on the home page.
Select "microsoft/Phi-3-mini-4k-instruct-gguf" and, in the list on the right, download the Q4 version.
The Q4 version is lighter and faster, but has a little more loss than the "fp16".
Search for "Phi-3" on the home page.
Select "microsoft/Phi-3-mini-4k-instruct-gguf" and, in the list on the right, download the Q4 version.
The Q4 version is lighter and faster, but has a little more loss than the "fp16".
3. Start using Phi-3
Click on the chat tab in the left-hand menu and on "New Chat".
Select the Phi-3 model is selected in the top bar.
Then write and send your prompt!
Click on the chat tab in the left-hand menu and on "New Chat".
Select the Phi-3 model is selected in the top bar.
Then write and send your prompt!
It works 100% offline and on your computer.
So it's the best way to use a pretty powerful LLM privately... and for free!
So it's the best way to use a pretty powerful LLM privately... and for free!
جاري تحميل الاقتراحات...