Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,9 @@ Please follow the license of the original model. This model could **NOT** run on
|
|
| 16 |
|
| 17 |
## How To Use
|
| 18 |
|
| 19 |
-
|
|
|
|
|
|
|
| 20 |
|
| 21 |
**To prevent potential overflow, we recommend using the CPU version.**
|
| 22 |
|
|
@@ -238,7 +240,7 @@ But wait, maybe the question is more literal. If the hunter successfully shoots
|
|
| 238 |
|
| 239 |
~~~
|
| 240 |
|
| 241 |
-
###
|
| 242 |
|
| 243 |
Requirements
|
| 244 |
|
|
|
|
| 16 |
|
| 17 |
## How To Use
|
| 18 |
|
| 19 |
+
### INT2 Inference on CUDA(4X80G)
|
| 20 |
+
|
| 21 |
+
please note int2 **may be slower** than int4 on CUDA due to kernel issue.
|
| 22 |
|
| 23 |
**To prevent potential overflow, we recommend using the CPU version.**
|
| 24 |
|
|
|
|
| 240 |
|
| 241 |
~~~
|
| 242 |
|
| 243 |
+
### INT2 Inference on CPU
|
| 244 |
|
| 245 |
Requirements
|
| 246 |
|