cicdatopea commited on
Commit
3834679
·
verified ·
1 Parent(s): d85ee50

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -16,7 +16,9 @@ Please follow the license of the original model. This model could **NOT** run on
16
 
17
  ## How To Use
18
 
19
- INT4 Inference on CUDA(4X80G), please note int2 **may be slower** than to int4 on CUDA due to kernel issue.
 
 
20
 
21
  **To prevent potential overflow, we recommend using the CPU version.**
22
 
@@ -238,7 +240,7 @@ But wait, maybe the question is more literal. If the hunter successfully shoots
238
 
239
  ~~~
240
 
241
- ### INT4 Inference on CPU
242
 
243
  Requirements
244
 
 
16
 
17
  ## How To Use
18
 
19
+ ### INT2 Inference on CUDA(4X80G)
20
+
21
+ please note int2 **may be slower** than int4 on CUDA due to kernel issue.
22
 
23
  **To prevent potential overflow, we recommend using the CPU version.**
24
 
 
240
 
241
  ~~~
242
 
243
+ ### INT2 Inference on CPU
244
 
245
  Requirements
246