amang1802
/

Llama3.2-1B-summary-length-exp3

Text Generation

text-generation-inference

Model card Files Files and versions

Model Card for Model ID

Summary Length PPO experiment #2
No KL divergence in loss

Model Details

Dataset size: 1024
Epochs: 2
Batch Size: 4

Optimizer args: Torch AdamW default, except

LR = 0.0001

Downloads last month: 12

Safetensors

Model size

1B params

Tensor type

BF16

·

Collection including amang1802/Llama3.2-1B-summary-length-exp3

PPO experiments

Using PPO with simpler reward functions • 8 items • Updated Jan 23, 2025