We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 6fc29cb commit bed604dCopy full SHA for bed604d
docs/QAnything_Startup_Usage_README.md
@@ -77,7 +77,7 @@ bash ./run.sh -c local -i 0 -b hf -m Qwen-7B-QAnything -t qwen-7b-qanything
77
```bash
78
## Step 1. Download the public LLM model (e.g., MiniChat-2-3B) and save to "/path/to/QAnything/assets/custom_models"
79
cd /path/to/QAnything/assets/custom_models
80
-git clone https://huggingface.co/GeneZC/MiniChat-2-3B
+git lfs clone https://huggingface.co/GeneZC/MiniChat-2-3B
81
82
## Step 2. Execute the service startup command. Here we use "-b hf" to specify the Huggingface transformers backend.
83
## Here we use "-b hf" to specify the transformers backend that will load model in 8 bits but do bf16 inference as default for saving VRAM.
0 commit comments