# Loading dataset with streaming model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826%3E%5C
**Category:** Beginners\
**Created:** [July 1, 2021, 11:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826 "2021-07-01T11:23:41Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![sbmaruf](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sbmaruf/32/1528_2.png) [@sbmaruf](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsbmaruf)%5C
**Post date:** [July 1, 2021, 11:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826%2F1 "2021-07-01T11:23:41Z")

</div>

I am trying to load dataset in streaming model.  
The current datasets version I am using is 1.8.  
But it is producing the following error.

```auto

---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
<ipython-input-3-518060a18801> in <module>()
----> 1 dataset = load_dataset('oscar', "unshuffled_deduplicated_en", split='train', streaming=True)

3 frames
/usr/local/lib/python3.7/dist-packages/datasets/builder.py in _create_builder_config(self, name, custom_features, **config_kwargs)
    339 if value is not None:
    340 if not hasattr(builder_config, key):
--> 341 raise ValueError(f"BuilderConfig {builder_config} doesn't have a '{key}' key.")
    342 setattr(builder_config, key, value)
    343 

ValueError: BuilderConfig OscarConfig(name='unshuffled_deduplicated_en', version=1.0.0, data_dir=None, data_files=None, description='Unshuffled and deduplicated, English OSCAR dataset') doesn't have a 'streaming' key.

```

Quick notebook [link](https://colab.research.google.com/drive/1gmUpNFeI5kMYHw1GI_8it3ko0Gshird4?usp=sharing).

---

<div class="post-metadata">

**Author:** ![sbmaruf](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sbmaruf/32/1528_2.png) [@sbmaruf](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsbmaruf)%5C
**Post date:** [July 1, 2021, 11:55pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826%2F2 "2021-07-01T23:55:29Z")

</div>

@valhalla Can you take a look?

---

<div class="post-metadata">

**Author:** ![w11wo](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/w11wo/32/23477_2.png) [@w11wo](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fw11wo)%5C
**Post date:** [July 5, 2021, 6:41am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826%2F3 "2021-07-05T06:41:20Z")

</div>

Hi, I ran into the same issue using Colab. So I ended up cloning the `datasets` Github repo entirely and installing it from there. Here’s what I ran:

```python
!git clone https://github.com/huggingface/datasets.git && cd datasets && pip install -q -e ".[streaming]"

```

Afterwards, I had to restart the runtime to make things work. Note that it installs the `1.8.1.dev0` version of `datasets`. Notebook link [here](https://colab.research.google.com/drive/1Sze2MKK2JUiRF-u8OZP-tDPPmVfWKIal?usp=sharing).

Cheers!

---

<div class="post-metadata">

**Author:** ![sbmaruf](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sbmaruf/32/1528_2.png) [@sbmaruf](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsbmaruf)%5C
**Post date:** [July 5, 2021, 9:19pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826%2F4 "2021-07-05T21:19:48Z")

</div>

Ahh!!! Got it. It was not ported earlier.  
We just need to compile from the source.  
@w11wo

---

<div class="post-metadata">

**Author:** ![YueChangjie](https://avatars.discourse-cdn.com/v4/letter/y/f14d63/32.png) [@YueChangjie](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FYueChangjie)%5C
**Post date:** [March 11, 2024, 2:26am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Floading-dataset-with-streaming-model%2F7826%2F5 "2024-03-11T02:26:11Z")

</div>

Thank you for your reply，I met an error, like this

```auto
ValueError: BuilderConfig ReazonSpeechConfig(name='all', version=0.0.0, data_dir=None, data_files=None, description=None) doesn't have a 'trust_remote_code' key.

```

I solved by

```auto
git clone https://github.com/huggingface/datasets.git && cd datasets && pip install -q -e ".[trust_remote_code]

```