This commit is contained in:
syui 2025-03-24 07:10:00 +09:00
parent 7f3ba0d82e
commit 4f3555e477
Signed by: syui
GPG Key ID: 5417CFEBAD92DF56
2 changed files with 1 additions and 54 deletions

View File

@ -11,57 +11,4 @@
|os|ai/os|
|ai|ai/ai|
ゲームはatprotoのアカウントを使用するので、testでは[ai.syu.is](https://web.syu.is/profile/ai.syu.is)などを使います。
```sh
$ winget install ollama.ollama
$ ollama server
$ ollama run llama3.2
$ winget install --id Python.Python.3.11 -e
$ python --version
$ python -m venv webui
$ cd webui
$ .\Scripts\activate
$ pip install open-webui
$ open-webui serve
http://localhost:8080
```
## LoRA
finetuning
```sh
$ conda create -n finetuning python=3.11
$ conda activate finetuning
$ pip install mlx-lm #apple silicon
$ ollama run llama3.2
$ echo "{ \"model\": \"https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct\", \"data\": \"https://github.com/ml-explore/mlx-examples/tree/main/lora/data\" }"|jq .
$ model=meta-llama/Llama-3.2-3B-Instruct
$ data=ml-explore/mlx-examples/lora/data
$ mlx_lm.lora --train --model $model --data $data --batch-size 3
$ ls adapters
$ vim Modelfile
FROM llama3.2:3b
ADAPTER ./adapters
$ ollama create ai -f ./Modelfile
```
## unsloth
```sh
$ pip install unsloth
```
```py
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name="Qwen2.5-1.5B",
grpo=True
)
```

View File

@ -29,7 +29,7 @@ $ winget install git.git
|lazygit|https://github.com/jesseduffield/lazygit|jesseduffield.lazygit|
|node|https://github.com/nodejs/node|openjs.nodejs|
|nvm|https://github.com/nvm-sh/nvm|coreybutler.nvmforwindows|
|python|https://github.com/python|python.python.3.11|
|python|https://github.com/python|python.python.3.12|
|conda|https://github.com/anaconda|anaconda.miniconda3|
## その他