ai/ai
ai/ai
1
0
This commit is contained in:
syui 2025-03-23 04:34:18 +09:00
parent d5603926aa
commit ee09a383be
Signed by: syui
GPG Key ID: 5417CFEBAD92DF56

View File

@ -2,7 +2,50 @@
AI model `ai`
`ollama`, `LoRA`, `unsloth`, `open-webui`
```json
{
"model": [ "gemma3", "deepseek-r1" ],
"tag": [ "ollama", "LoRA", "unsloth", "open-webui", "n8n" ]
}
```
## model
1. gemma3:b14
2. deepseek-r1:b14
```sh
$ brew install ollama
$ brew service restart ollama
$ ollama pull gemma3:14b
$ ollama run gemma3:14b "hello"
```
## n8n
```sh
# https://github.com/n8n-io/n8n/
$ docker volume create n8n_data
$ docker run -it --rm --name n8n -p 5678:5678 -v n8n_data:/home/node/.n8n docker.n8n.io/n8nio/n8n
```
## webui
```sh
$ winget install ollama.ollama
$ ollama server
$ ollama run llama3.2
$ winget install --id Python.Python.3.11 -e
$ python --version
$ python -m venv webui
$ cd webui
$ .\Scripts\activate
$ pip install open-webui
$ open-webui serve
http://localhost:8080
```
## LoRA
@ -41,20 +84,3 @@ model, tokenizer = FastLanguageModel.from_pretrained(
)
```
## webui
```sh
$ winget install ollama.ollama
$ ollama server
$ ollama run llama3.2
$ winget install --id Python.Python.3.11 -e
$ python --version
$ python -m venv webui
$ cd webui
$ .\Scripts\activate
$ pip install open-webui
$ open-webui serve
http://localhost:8080
```