Skip to content

Commit 8f20fe0

Browse files
committed
Update installation instructions
1 parent 7cd13e2 commit 8f20fe0

File tree

2 files changed

+12
-20
lines changed

2 files changed

+12
-20
lines changed

README.md

Lines changed: 7 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -112,6 +112,7 @@ MOSS是一个支持中英双语和多种插件的开源对话语言模型,`mos
112112

113113

114114
## :robot: 本地部署
115+
115116
### 硬件要求
116117

117118
下表提供了一个batch size=1时本地部署MOSS进行推理所需的显存大小。**量化模型暂时不支持模型并行。**
@@ -123,35 +124,30 @@ MOSS是一个支持中英双语和多种插件的开源对话语言模型,`mos
123124
| Int4 | 7.8GB | 12GB | 26GB |
124125

125126
### 下载安装
127+
126128
1. 下载本仓库内容至本地/远程服务器
127129

128130
```bash
129131
git clone https://github.com/OpenLMLab/MOSS.git
130132
cd MOSS
131133
```
132134

133-
2. 创建conda环境
135+
2. 创建 conda 环境
134136

135137
```bash
136-
conda create --name moss python=3.8
138+
conda env create --file conda-recipe.yaml # or `mamba env create --file conda-recipe.yaml`
137139
conda activate moss
138140
```
139141

140-
3. 安装依赖
141-
142-
```bash
143-
pip install -r requirements.txt
144-
```
145-
146-
4. (可选) 4/8-bit 量化环境
142+
3. (可选) 4/8-bit 量化环境
147143

148144
```bash
149145
pip install triton
150146
```
151147

152-
其中`torch``transformers`版本不建议低于推荐版本。
148+
其中 `torch``transformers` 版本不建议低于推荐版本。
153149

154-
目前triton仅支持Linux及WSL,暂不支持Windows及Mac OS,请等待后续更新。
150+
目前 triton 仅支持 Linux 及 WSL,暂不支持 Windows 及 macOS,请等待后续更新。
155151

156152
### 使用示例
157153

README_en.md

Lines changed: 5 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -108,6 +108,7 @@ MOSS is an open-sourced plugin-augmented conversational language model. `moss-mo
108108

109109

110110
## :robot: Chat with MOSS
111+
111112
### GPU Requirements
112113

113114
The table below shows the minimal GPU memory required by performing MOSS inference when batch size is 1. Please note that **currently the quantized models do not support model parallism**.
@@ -119,6 +120,7 @@ The table below shows the minimal GPU memory required by performing MOSS inferen
119120
| Int4 | 7.8GB | 12GB | 26GB |
120121

121122
### Installation
123+
122124
1. Clone this repo to your local/remote machine.
123125

124126
```bash
@@ -129,25 +131,19 @@ cd MOSS
129131
2. Create a new conda environment
130132

131133
```bash
132-
conda create --name moss python=3.8
134+
conda env create --file conda-recipe.yaml # or `mamba env create --file conda-recipe.yaml`
133135
conda activate moss
134136
```
135137

136-
3. Install requirements
137-
138-
```bash
139-
pip install -r requirements.txt
140-
```
141-
142-
4. (Optional) 4/8-bit quantization requirement
138+
3. (Optional) 4/8-bit quantization requirement
143139

144140
```bash
145141
pip install triton
146142
```
147143

148144
Note that the version of `torch` and `transformers` should be equal or higher than recommended.
149145

150-
Currently triton only supports Linux and WSL. Please wait for later updates if you are using Windows/MacOS.
146+
Currently triton only supports Linux and WSL. Please wait for later updates if you are using Windows/macOS.
151147

152148
### Try MOSS
153149

0 commit comments

Comments
 (0)