# Progress bars shown despite disable\_tqdm=True in Trainer

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogress-bars-shown-despite-disable-tqdm-true-in-trainer%2F22003%3E%5C
**Category:** Beginners\
**Created:** [August 23, 2022, 9:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogress-bars-shown-despite-disable-tqdm-true-in-trainer%2F22003 "2022-08-23T21:10:47Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Eichhof](https://avatars.discourse-cdn.com/v4/letter/e/f4b2a3/32.png) [@Eichhof](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FEichhof)%5C
**Post date:** [August 23, 2022, 9:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogress-bars-shown-despite-disable-tqdm-true-in-trainer%2F22003%2F1 "2022-08-23T21:10:47Z")

</div>

I’m running HuggingFace Trainer with TrainingArguments(disable\_tqdm=True, …) for fine-tuning the EleutherAI/gpt-j-6B model but there are still progress bars displayed (please see picture below). Does somebody know how to remove these progress bars?

```auto
training_args = TrainingArguments(
    disable_tqdm=True,
    output_dir='./checkpoints',
    save_total_limit=10,
    logging_dir='/content/logs',
    num_train_epochs=config["N_EPOCHS"],
    evaluation_strategy='epoch'
    save_strategy='steps',
    save_steps=30,
    logging_steps=10,
    overwrite_output_dir=True,
    per_device_train_batch_size=4,
    per_device_eval_batch_size=4,
    gradient_accumulation_steps=4,
    eval_accumulation_steps=4,
    gradient_checkpointing=True,
    max_grad_norm=0.5,
    lr_scheduler_type="cosine",
    learning_rate=1e-4,
    warmup_ratio=0.05,
    weight_decay=0.1,
    fp16_full_eval=True
    fp16=True,
    fp16_opt_level='O1',
    report_to=['tensorboard']
)

```

 ![186213857-528e089b-1114-4490-a799-e2598604e1c3](https://us1.discourse-cdn.com/hellohellohello/original/2X/a/afcbedccc18d5fb02abc6ad498e103a17ac69cba.png)

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/64813_2.png) [@lhoestq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flhoestq)%5C
**Post date:** [August 23, 2022, 11:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogress-bars-shown-despite-disable-tqdm-true-in-trainer%2F22003%2F2 "2022-08-23T23:10:54Z")

</div>

Hi ! I believe these are progress bars of the dataset processing step before training, in particular the calls to `map` using the Hugging Face datasets library

You can disable them with

```python
import datasets 
datasets.disable_progress_bar()

```

---

<div class="post-metadata">

**Author:** ![ndvb](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/ndvb/32/17239_2.png) [@ndvb](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fndvb)%5C
**Post date:** [May 4, 2023, 7:32pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogress-bars-shown-despite-disable-tqdm-true-in-trainer%2F22003%2F3 "2023-05-04T19:32:34Z")

</div>

How do I pass disable\_tqdm=True to Trainer’s TrainingArguments, without giving output\_dir?  
I am only instantiating Trainer so I can run trainer.predict() right after, I don’t want Trainer to save anything in anywhere.
