KamilaMila commited on
Commit
e60f7f2
·
verified ·
1 Parent(s): 6608501

Upload FastVlmForConditionalGeneration

Browse files
README.md ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags: []
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+ This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
config.json ADDED
@@ -0,0 +1,888 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "FastVlmForConditionalGeneration"
4
+ ],
5
+ "dtype": "bfloat16",
6
+ "image_seq_length": 256,
7
+ "image_token_index": 151646,
8
+ "model_type": "fast_vlm",
9
+ "multimodal_projector_bias": true,
10
+ "projector_hidden_act": "gelu",
11
+ "text_config": {
12
+ "_name_or_path": "Qwen/Qwen2-7B",
13
+ "architectures": [
14
+ "Qwen2ForCausalLM"
15
+ ],
16
+ "attention_dropout": 0.0,
17
+ "bos_token_id": 151643,
18
+ "dtype": "bfloat16",
19
+ "eos_token_id": 151643,
20
+ "hidden_act": "silu",
21
+ "hidden_size": 3584,
22
+ "initializer_range": 0.02,
23
+ "intermediate_size": 18944,
24
+ "layer_types": [
25
+ "full_attention",
26
+ "full_attention",
27
+ "full_attention",
28
+ "full_attention",
29
+ "full_attention",
30
+ "full_attention",
31
+ "full_attention",
32
+ "full_attention",
33
+ "full_attention",
34
+ "full_attention",
35
+ "full_attention",
36
+ "full_attention",
37
+ "full_attention",
38
+ "full_attention",
39
+ "full_attention",
40
+ "full_attention",
41
+ "full_attention",
42
+ "full_attention",
43
+ "full_attention",
44
+ "full_attention",
45
+ "full_attention",
46
+ "full_attention",
47
+ "full_attention",
48
+ "full_attention",
49
+ "full_attention",
50
+ "full_attention",
51
+ "full_attention",
52
+ "full_attention"
53
+ ],
54
+ "max_position_embeddings": 131072,
55
+ "max_window_layers": 28,
56
+ "model_type": "qwen2",
57
+ "num_attention_heads": 28,
58
+ "num_hidden_layers": 28,
59
+ "num_key_value_heads": 4,
60
+ "rms_norm_eps": 1e-06,
61
+ "rope_scaling": null,
62
+ "rope_theta": 1000000.0,
63
+ "sliding_window": null,
64
+ "use_cache": true,
65
+ "use_sliding_window": false,
66
+ "vocab_size": 152128
67
+ },
68
+ "transformers_version": "4.56.0.dev0",
69
+ "vision_config": {
70
+ "_name_or_path": "timm/fastvit_mci3.apple_mclip2_dfndr2b",
71
+ "architecture": "fastvit_mci3",
72
+ "do_pooling": true,
73
+ "global_pool": "avg",
74
+ "hidden_size": 3072,
75
+ "initializer_range": 0.02,
76
+ "label_names": [
77
+ "LABEL_0",
78
+ "LABEL_1",
79
+ "LABEL_2",
80
+ "LABEL_3",
81
+ "LABEL_4",
82
+ "LABEL_5",
83
+ "LABEL_6",
84
+ "LABEL_7",
85
+ "LABEL_8",
86
+ "LABEL_9",
87
+ "LABEL_10",
88
+ "LABEL_11",
89
+ "LABEL_12",
90
+ "LABEL_13",
91
+ "LABEL_14",
92
+ "LABEL_15",
93
+ "LABEL_16",
94
+ "LABEL_17",
95
+ "LABEL_18",
96
+ "LABEL_19",
97
+ "LABEL_20",
98
+ "LABEL_21",
99
+ "LABEL_22",
100
+ "LABEL_23",
101
+ "LABEL_24",
102
+ "LABEL_25",
103
+ "LABEL_26",
104
+ "LABEL_27",
105
+ "LABEL_28",
106
+ "LABEL_29",
107
+ "LABEL_30",
108
+ "LABEL_31",
109
+ "LABEL_32",
110
+ "LABEL_33",
111
+ "LABEL_34",
112
+ "LABEL_35",
113
+ "LABEL_36",
114
+ "LABEL_37",
115
+ "LABEL_38",
116
+ "LABEL_39",
117
+ "LABEL_40",
118
+ "LABEL_41",
119
+ "LABEL_42",
120
+ "LABEL_43",
121
+ "LABEL_44",
122
+ "LABEL_45",
123
+ "LABEL_46",
124
+ "LABEL_47",
125
+ "LABEL_48",
126
+ "LABEL_49",
127
+ "LABEL_50",
128
+ "LABEL_51",
129
+ "LABEL_52",
130
+ "LABEL_53",
131
+ "LABEL_54",
132
+ "LABEL_55",
133
+ "LABEL_56",
134
+ "LABEL_57",
135
+ "LABEL_58",
136
+ "LABEL_59",
137
+ "LABEL_60",
138
+ "LABEL_61",
139
+ "LABEL_62",
140
+ "LABEL_63",
141
+ "LABEL_64",
142
+ "LABEL_65",
143
+ "LABEL_66",
144
+ "LABEL_67",
145
+ "LABEL_68",
146
+ "LABEL_69",
147
+ "LABEL_70",
148
+ "LABEL_71",
149
+ "LABEL_72",
150
+ "LABEL_73",
151
+ "LABEL_74",
152
+ "LABEL_75",
153
+ "LABEL_76",
154
+ "LABEL_77",
155
+ "LABEL_78",
156
+ "LABEL_79",
157
+ "LABEL_80",
158
+ "LABEL_81",
159
+ "LABEL_82",
160
+ "LABEL_83",
161
+ "LABEL_84",
162
+ "LABEL_85",
163
+ "LABEL_86",
164
+ "LABEL_87",
165
+ "LABEL_88",
166
+ "LABEL_89",
167
+ "LABEL_90",
168
+ "LABEL_91",
169
+ "LABEL_92",
170
+ "LABEL_93",
171
+ "LABEL_94",
172
+ "LABEL_95",
173
+ "LABEL_96",
174
+ "LABEL_97",
175
+ "LABEL_98",
176
+ "LABEL_99",
177
+ "LABEL_100",
178
+ "LABEL_101",
179
+ "LABEL_102",
180
+ "LABEL_103",
181
+ "LABEL_104",
182
+ "LABEL_105",
183
+ "LABEL_106",
184
+ "LABEL_107",
185
+ "LABEL_108",
186
+ "LABEL_109",
187
+ "LABEL_110",
188
+ "LABEL_111",
189
+ "LABEL_112",
190
+ "LABEL_113",
191
+ "LABEL_114",
192
+ "LABEL_115",
193
+ "LABEL_116",
194
+ "LABEL_117",
195
+ "LABEL_118",
196
+ "LABEL_119",
197
+ "LABEL_120",
198
+ "LABEL_121",
199
+ "LABEL_122",
200
+ "LABEL_123",
201
+ "LABEL_124",
202
+ "LABEL_125",
203
+ "LABEL_126",
204
+ "LABEL_127",
205
+ "LABEL_128",
206
+ "LABEL_129",
207
+ "LABEL_130",
208
+ "LABEL_131",
209
+ "LABEL_132",
210
+ "LABEL_133",
211
+ "LABEL_134",
212
+ "LABEL_135",
213
+ "LABEL_136",
214
+ "LABEL_137",
215
+ "LABEL_138",
216
+ "LABEL_139",
217
+ "LABEL_140",
218
+ "LABEL_141",
219
+ "LABEL_142",
220
+ "LABEL_143",
221
+ "LABEL_144",
222
+ "LABEL_145",
223
+ "LABEL_146",
224
+ "LABEL_147",
225
+ "LABEL_148",
226
+ "LABEL_149",
227
+ "LABEL_150",
228
+ "LABEL_151",
229
+ "LABEL_152",
230
+ "LABEL_153",
231
+ "LABEL_154",
232
+ "LABEL_155",
233
+ "LABEL_156",
234
+ "LABEL_157",
235
+ "LABEL_158",
236
+ "LABEL_159",
237
+ "LABEL_160",
238
+ "LABEL_161",
239
+ "LABEL_162",
240
+ "LABEL_163",
241
+ "LABEL_164",
242
+ "LABEL_165",
243
+ "LABEL_166",
244
+ "LABEL_167",
245
+ "LABEL_168",
246
+ "LABEL_169",
247
+ "LABEL_170",
248
+ "LABEL_171",
249
+ "LABEL_172",
250
+ "LABEL_173",
251
+ "LABEL_174",
252
+ "LABEL_175",
253
+ "LABEL_176",
254
+ "LABEL_177",
255
+ "LABEL_178",
256
+ "LABEL_179",
257
+ "LABEL_180",
258
+ "LABEL_181",
259
+ "LABEL_182",
260
+ "LABEL_183",
261
+ "LABEL_184",
262
+ "LABEL_185",
263
+ "LABEL_186",
264
+ "LABEL_187",
265
+ "LABEL_188",
266
+ "LABEL_189",
267
+ "LABEL_190",
268
+ "LABEL_191",
269
+ "LABEL_192",
270
+ "LABEL_193",
271
+ "LABEL_194",
272
+ "LABEL_195",
273
+ "LABEL_196",
274
+ "LABEL_197",
275
+ "LABEL_198",
276
+ "LABEL_199",
277
+ "LABEL_200",
278
+ "LABEL_201",
279
+ "LABEL_202",
280
+ "LABEL_203",
281
+ "LABEL_204",
282
+ "LABEL_205",
283
+ "LABEL_206",
284
+ "LABEL_207",
285
+ "LABEL_208",
286
+ "LABEL_209",
287
+ "LABEL_210",
288
+ "LABEL_211",
289
+ "LABEL_212",
290
+ "LABEL_213",
291
+ "LABEL_214",
292
+ "LABEL_215",
293
+ "LABEL_216",
294
+ "LABEL_217",
295
+ "LABEL_218",
296
+ "LABEL_219",
297
+ "LABEL_220",
298
+ "LABEL_221",
299
+ "LABEL_222",
300
+ "LABEL_223",
301
+ "LABEL_224",
302
+ "LABEL_225",
303
+ "LABEL_226",
304
+ "LABEL_227",
305
+ "LABEL_228",
306
+ "LABEL_229",
307
+ "LABEL_230",
308
+ "LABEL_231",
309
+ "LABEL_232",
310
+ "LABEL_233",
311
+ "LABEL_234",
312
+ "LABEL_235",
313
+ "LABEL_236",
314
+ "LABEL_237",
315
+ "LABEL_238",
316
+ "LABEL_239",
317
+ "LABEL_240",
318
+ "LABEL_241",
319
+ "LABEL_242",
320
+ "LABEL_243",
321
+ "LABEL_244",
322
+ "LABEL_245",
323
+ "LABEL_246",
324
+ "LABEL_247",
325
+ "LABEL_248",
326
+ "LABEL_249",
327
+ "LABEL_250",
328
+ "LABEL_251",
329
+ "LABEL_252",
330
+ "LABEL_253",
331
+ "LABEL_254",
332
+ "LABEL_255",
333
+ "LABEL_256",
334
+ "LABEL_257",
335
+ "LABEL_258",
336
+ "LABEL_259",
337
+ "LABEL_260",
338
+ "LABEL_261",
339
+ "LABEL_262",
340
+ "LABEL_263",
341
+ "LABEL_264",
342
+ "LABEL_265",
343
+ "LABEL_266",
344
+ "LABEL_267",
345
+ "LABEL_268",
346
+ "LABEL_269",
347
+ "LABEL_270",
348
+ "LABEL_271",
349
+ "LABEL_272",
350
+ "LABEL_273",
351
+ "LABEL_274",
352
+ "LABEL_275",
353
+ "LABEL_276",
354
+ "LABEL_277",
355
+ "LABEL_278",
356
+ "LABEL_279",
357
+ "LABEL_280",
358
+ "LABEL_281",
359
+ "LABEL_282",
360
+ "LABEL_283",
361
+ "LABEL_284",
362
+ "LABEL_285",
363
+ "LABEL_286",
364
+ "LABEL_287",
365
+ "LABEL_288",
366
+ "LABEL_289",
367
+ "LABEL_290",
368
+ "LABEL_291",
369
+ "LABEL_292",
370
+ "LABEL_293",
371
+ "LABEL_294",
372
+ "LABEL_295",
373
+ "LABEL_296",
374
+ "LABEL_297",
375
+ "LABEL_298",
376
+ "LABEL_299",
377
+ "LABEL_300",
378
+ "LABEL_301",
379
+ "LABEL_302",
380
+ "LABEL_303",
381
+ "LABEL_304",
382
+ "LABEL_305",
383
+ "LABEL_306",
384
+ "LABEL_307",
385
+ "LABEL_308",
386
+ "LABEL_309",
387
+ "LABEL_310",
388
+ "LABEL_311",
389
+ "LABEL_312",
390
+ "LABEL_313",
391
+ "LABEL_314",
392
+ "LABEL_315",
393
+ "LABEL_316",
394
+ "LABEL_317",
395
+ "LABEL_318",
396
+ "LABEL_319",
397
+ "LABEL_320",
398
+ "LABEL_321",
399
+ "LABEL_322",
400
+ "LABEL_323",
401
+ "LABEL_324",
402
+ "LABEL_325",
403
+ "LABEL_326",
404
+ "LABEL_327",
405
+ "LABEL_328",
406
+ "LABEL_329",
407
+ "LABEL_330",
408
+ "LABEL_331",
409
+ "LABEL_332",
410
+ "LABEL_333",
411
+ "LABEL_334",
412
+ "LABEL_335",
413
+ "LABEL_336",
414
+ "LABEL_337",
415
+ "LABEL_338",
416
+ "LABEL_339",
417
+ "LABEL_340",
418
+ "LABEL_341",
419
+ "LABEL_342",
420
+ "LABEL_343",
421
+ "LABEL_344",
422
+ "LABEL_345",
423
+ "LABEL_346",
424
+ "LABEL_347",
425
+ "LABEL_348",
426
+ "LABEL_349",
427
+ "LABEL_350",
428
+ "LABEL_351",
429
+ "LABEL_352",
430
+ "LABEL_353",
431
+ "LABEL_354",
432
+ "LABEL_355",
433
+ "LABEL_356",
434
+ "LABEL_357",
435
+ "LABEL_358",
436
+ "LABEL_359",
437
+ "LABEL_360",
438
+ "LABEL_361",
439
+ "LABEL_362",
440
+ "LABEL_363",
441
+ "LABEL_364",
442
+ "LABEL_365",
443
+ "LABEL_366",
444
+ "LABEL_367",
445
+ "LABEL_368",
446
+ "LABEL_369",
447
+ "LABEL_370",
448
+ "LABEL_371",
449
+ "LABEL_372",
450
+ "LABEL_373",
451
+ "LABEL_374",
452
+ "LABEL_375",
453
+ "LABEL_376",
454
+ "LABEL_377",
455
+ "LABEL_378",
456
+ "LABEL_379",
457
+ "LABEL_380",
458
+ "LABEL_381",
459
+ "LABEL_382",
460
+ "LABEL_383",
461
+ "LABEL_384",
462
+ "LABEL_385",
463
+ "LABEL_386",
464
+ "LABEL_387",
465
+ "LABEL_388",
466
+ "LABEL_389",
467
+ "LABEL_390",
468
+ "LABEL_391",
469
+ "LABEL_392",
470
+ "LABEL_393",
471
+ "LABEL_394",
472
+ "LABEL_395",
473
+ "LABEL_396",
474
+ "LABEL_397",
475
+ "LABEL_398",
476
+ "LABEL_399",
477
+ "LABEL_400",
478
+ "LABEL_401",
479
+ "LABEL_402",
480
+ "LABEL_403",
481
+ "LABEL_404",
482
+ "LABEL_405",
483
+ "LABEL_406",
484
+ "LABEL_407",
485
+ "LABEL_408",
486
+ "LABEL_409",
487
+ "LABEL_410",
488
+ "LABEL_411",
489
+ "LABEL_412",
490
+ "LABEL_413",
491
+ "LABEL_414",
492
+ "LABEL_415",
493
+ "LABEL_416",
494
+ "LABEL_417",
495
+ "LABEL_418",
496
+ "LABEL_419",
497
+ "LABEL_420",
498
+ "LABEL_421",
499
+ "LABEL_422",
500
+ "LABEL_423",
501
+ "LABEL_424",
502
+ "LABEL_425",
503
+ "LABEL_426",
504
+ "LABEL_427",
505
+ "LABEL_428",
506
+ "LABEL_429",
507
+ "LABEL_430",
508
+ "LABEL_431",
509
+ "LABEL_432",
510
+ "LABEL_433",
511
+ "LABEL_434",
512
+ "LABEL_435",
513
+ "LABEL_436",
514
+ "LABEL_437",
515
+ "LABEL_438",
516
+ "LABEL_439",
517
+ "LABEL_440",
518
+ "LABEL_441",
519
+ "LABEL_442",
520
+ "LABEL_443",
521
+ "LABEL_444",
522
+ "LABEL_445",
523
+ "LABEL_446",
524
+ "LABEL_447",
525
+ "LABEL_448",
526
+ "LABEL_449",
527
+ "LABEL_450",
528
+ "LABEL_451",
529
+ "LABEL_452",
530
+ "LABEL_453",
531
+ "LABEL_454",
532
+ "LABEL_455",
533
+ "LABEL_456",
534
+ "LABEL_457",
535
+ "LABEL_458",
536
+ "LABEL_459",
537
+ "LABEL_460",
538
+ "LABEL_461",
539
+ "LABEL_462",
540
+ "LABEL_463",
541
+ "LABEL_464",
542
+ "LABEL_465",
543
+ "LABEL_466",
544
+ "LABEL_467",
545
+ "LABEL_468",
546
+ "LABEL_469",
547
+ "LABEL_470",
548
+ "LABEL_471",
549
+ "LABEL_472",
550
+ "LABEL_473",
551
+ "LABEL_474",
552
+ "LABEL_475",
553
+ "LABEL_476",
554
+ "LABEL_477",
555
+ "LABEL_478",
556
+ "LABEL_479",
557
+ "LABEL_480",
558
+ "LABEL_481",
559
+ "LABEL_482",
560
+ "LABEL_483",
561
+ "LABEL_484",
562
+ "LABEL_485",
563
+ "LABEL_486",
564
+ "LABEL_487",
565
+ "LABEL_488",
566
+ "LABEL_489",
567
+ "LABEL_490",
568
+ "LABEL_491",
569
+ "LABEL_492",
570
+ "LABEL_493",
571
+ "LABEL_494",
572
+ "LABEL_495",
573
+ "LABEL_496",
574
+ "LABEL_497",
575
+ "LABEL_498",
576
+ "LABEL_499",
577
+ "LABEL_500",
578
+ "LABEL_501",
579
+ "LABEL_502",
580
+ "LABEL_503",
581
+ "LABEL_504",
582
+ "LABEL_505",
583
+ "LABEL_506",
584
+ "LABEL_507",
585
+ "LABEL_508",
586
+ "LABEL_509",
587
+ "LABEL_510",
588
+ "LABEL_511",
589
+ "LABEL_512",
590
+ "LABEL_513",
591
+ "LABEL_514",
592
+ "LABEL_515",
593
+ "LABEL_516",
594
+ "LABEL_517",
595
+ "LABEL_518",
596
+ "LABEL_519",
597
+ "LABEL_520",
598
+ "LABEL_521",
599
+ "LABEL_522",
600
+ "LABEL_523",
601
+ "LABEL_524",
602
+ "LABEL_525",
603
+ "LABEL_526",
604
+ "LABEL_527",
605
+ "LABEL_528",
606
+ "LABEL_529",
607
+ "LABEL_530",
608
+ "LABEL_531",
609
+ "LABEL_532",
610
+ "LABEL_533",
611
+ "LABEL_534",
612
+ "LABEL_535",
613
+ "LABEL_536",
614
+ "LABEL_537",
615
+ "LABEL_538",
616
+ "LABEL_539",
617
+ "LABEL_540",
618
+ "LABEL_541",
619
+ "LABEL_542",
620
+ "LABEL_543",
621
+ "LABEL_544",
622
+ "LABEL_545",
623
+ "LABEL_546",
624
+ "LABEL_547",
625
+ "LABEL_548",
626
+ "LABEL_549",
627
+ "LABEL_550",
628
+ "LABEL_551",
629
+ "LABEL_552",
630
+ "LABEL_553",
631
+ "LABEL_554",
632
+ "LABEL_555",
633
+ "LABEL_556",
634
+ "LABEL_557",
635
+ "LABEL_558",
636
+ "LABEL_559",
637
+ "LABEL_560",
638
+ "LABEL_561",
639
+ "LABEL_562",
640
+ "LABEL_563",
641
+ "LABEL_564",
642
+ "LABEL_565",
643
+ "LABEL_566",
644
+ "LABEL_567",
645
+ "LABEL_568",
646
+ "LABEL_569",
647
+ "LABEL_570",
648
+ "LABEL_571",
649
+ "LABEL_572",
650
+ "LABEL_573",
651
+ "LABEL_574",
652
+ "LABEL_575",
653
+ "LABEL_576",
654
+ "LABEL_577",
655
+ "LABEL_578",
656
+ "LABEL_579",
657
+ "LABEL_580",
658
+ "LABEL_581",
659
+ "LABEL_582",
660
+ "LABEL_583",
661
+ "LABEL_584",
662
+ "LABEL_585",
663
+ "LABEL_586",
664
+ "LABEL_587",
665
+ "LABEL_588",
666
+ "LABEL_589",
667
+ "LABEL_590",
668
+ "LABEL_591",
669
+ "LABEL_592",
670
+ "LABEL_593",
671
+ "LABEL_594",
672
+ "LABEL_595",
673
+ "LABEL_596",
674
+ "LABEL_597",
675
+ "LABEL_598",
676
+ "LABEL_599",
677
+ "LABEL_600",
678
+ "LABEL_601",
679
+ "LABEL_602",
680
+ "LABEL_603",
681
+ "LABEL_604",
682
+ "LABEL_605",
683
+ "LABEL_606",
684
+ "LABEL_607",
685
+ "LABEL_608",
686
+ "LABEL_609",
687
+ "LABEL_610",
688
+ "LABEL_611",
689
+ "LABEL_612",
690
+ "LABEL_613",
691
+ "LABEL_614",
692
+ "LABEL_615",
693
+ "LABEL_616",
694
+ "LABEL_617",
695
+ "LABEL_618",
696
+ "LABEL_619",
697
+ "LABEL_620",
698
+ "LABEL_621",
699
+ "LABEL_622",
700
+ "LABEL_623",
701
+ "LABEL_624",
702
+ "LABEL_625",
703
+ "LABEL_626",
704
+ "LABEL_627",
705
+ "LABEL_628",
706
+ "LABEL_629",
707
+ "LABEL_630",
708
+ "LABEL_631",
709
+ "LABEL_632",
710
+ "LABEL_633",
711
+ "LABEL_634",
712
+ "LABEL_635",
713
+ "LABEL_636",
714
+ "LABEL_637",
715
+ "LABEL_638",
716
+ "LABEL_639",
717
+ "LABEL_640",
718
+ "LABEL_641",
719
+ "LABEL_642",
720
+ "LABEL_643",
721
+ "LABEL_644",
722
+ "LABEL_645",
723
+ "LABEL_646",
724
+ "LABEL_647",
725
+ "LABEL_648",
726
+ "LABEL_649",
727
+ "LABEL_650",
728
+ "LABEL_651",
729
+ "LABEL_652",
730
+ "LABEL_653",
731
+ "LABEL_654",
732
+ "LABEL_655",
733
+ "LABEL_656",
734
+ "LABEL_657",
735
+ "LABEL_658",
736
+ "LABEL_659",
737
+ "LABEL_660",
738
+ "LABEL_661",
739
+ "LABEL_662",
740
+ "LABEL_663",
741
+ "LABEL_664",
742
+ "LABEL_665",
743
+ "LABEL_666",
744
+ "LABEL_667",
745
+ "LABEL_668",
746
+ "LABEL_669",
747
+ "LABEL_670",
748
+ "LABEL_671",
749
+ "LABEL_672",
750
+ "LABEL_673",
751
+ "LABEL_674",
752
+ "LABEL_675",
753
+ "LABEL_676",
754
+ "LABEL_677",
755
+ "LABEL_678",
756
+ "LABEL_679",
757
+ "LABEL_680",
758
+ "LABEL_681",
759
+ "LABEL_682",
760
+ "LABEL_683",
761
+ "LABEL_684",
762
+ "LABEL_685",
763
+ "LABEL_686",
764
+ "LABEL_687",
765
+ "LABEL_688",
766
+ "LABEL_689",
767
+ "LABEL_690",
768
+ "LABEL_691",
769
+ "LABEL_692",
770
+ "LABEL_693",
771
+ "LABEL_694",
772
+ "LABEL_695",
773
+ "LABEL_696",
774
+ "LABEL_697",
775
+ "LABEL_698",
776
+ "LABEL_699",
777
+ "LABEL_700",
778
+ "LABEL_701",
779
+ "LABEL_702",
780
+ "LABEL_703",
781
+ "LABEL_704",
782
+ "LABEL_705",
783
+ "LABEL_706",
784
+ "LABEL_707",
785
+ "LABEL_708",
786
+ "LABEL_709",
787
+ "LABEL_710",
788
+ "LABEL_711",
789
+ "LABEL_712",
790
+ "LABEL_713",
791
+ "LABEL_714",
792
+ "LABEL_715",
793
+ "LABEL_716",
794
+ "LABEL_717",
795
+ "LABEL_718",
796
+ "LABEL_719",
797
+ "LABEL_720",
798
+ "LABEL_721",
799
+ "LABEL_722",
800
+ "LABEL_723",
801
+ "LABEL_724",
802
+ "LABEL_725",
803
+ "LABEL_726",
804
+ "LABEL_727",
805
+ "LABEL_728",
806
+ "LABEL_729",
807
+ "LABEL_730",
808
+ "LABEL_731",
809
+ "LABEL_732",
810
+ "LABEL_733",
811
+ "LABEL_734",
812
+ "LABEL_735",
813
+ "LABEL_736",
814
+ "LABEL_737",
815
+ "LABEL_738",
816
+ "LABEL_739",
817
+ "LABEL_740",
818
+ "LABEL_741",
819
+ "LABEL_742",
820
+ "LABEL_743",
821
+ "LABEL_744",
822
+ "LABEL_745",
823
+ "LABEL_746",
824
+ "LABEL_747",
825
+ "LABEL_748",
826
+ "LABEL_749",
827
+ "LABEL_750",
828
+ "LABEL_751",
829
+ "LABEL_752",
830
+ "LABEL_753",
831
+ "LABEL_754",
832
+ "LABEL_755",
833
+ "LABEL_756",
834
+ "LABEL_757",
835
+ "LABEL_758",
836
+ "LABEL_759",
837
+ "LABEL_760",
838
+ "LABEL_761",
839
+ "LABEL_762",
840
+ "LABEL_763",
841
+ "LABEL_764",
842
+ "LABEL_765",
843
+ "LABEL_766",
844
+ "LABEL_767"
845
+ ],
846
+ "model_args": {
847
+ "inference_mode": true
848
+ },
849
+ "model_type": "timm_wrapper",
850
+ "num_classes": 768,
851
+ "num_features": 3072,
852
+ "pretrained_cfg": {
853
+ "classifier": "head.fc",
854
+ "crop_mode": "center",
855
+ "crop_pct": 0.95,
856
+ "custom_load": false,
857
+ "first_conv": [
858
+ "stem.0.conv_kxk.0.conv",
859
+ "stem.0.conv_scale.conv"
860
+ ],
861
+ "fixed_input_size": false,
862
+ "input_size": [
863
+ 3,
864
+ 256,
865
+ 256
866
+ ],
867
+ "interpolation": "bicubic",
868
+ "license": "apple-amlr",
869
+ "mean": [
870
+ 0.48145466,
871
+ 0.4578275,
872
+ 0.40821073
873
+ ],
874
+ "pool_size": [
875
+ 8,
876
+ 8
877
+ ],
878
+ "std": [
879
+ 0.26862954,
880
+ 0.26130258,
881
+ 0.27577711
882
+ ],
883
+ "tag": "apple_mclip2_dfndr2b"
884
+ }
885
+ },
886
+ "vision_feature_layer": -1,
887
+ "vision_feature_select_strategy": "full"
888
+ }
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 151643,
4
+ "eos_token_id": 151643,
5
+ "transformers_version": "4.56.0.dev0"
6
+ }
model-00001-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ffbb9c121a695f1d986f939f1f803292c559518c9ab5cad61d7be61499254fd
3
+ size 4976900000
model-00002-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffdaae0d80da9ad0ba385f41b9f87ee0eaf314103720d2f475a75c75cf731d07
3
+ size 4991497808
model-00003-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4fa6ac6dabef94e392379bfdecb64c43bd36395f6e0b9d4f8e692c9bb04f9f7
3
+ size 4466657600
model-00004-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9602c6f9f353a3f58897ff9e4a236c9900ce1abf171bd3ea5e1bb9ff2b75a90e
3
+ size 1090453632
model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff