# Dataset shows 0 rows when loaded but full when pushed

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdataset-shows-0-rows-when-loaded-but-full-when-pushed%2F48174%3E%5C
**Category:** 🤗Datasets\
**Created:** [July 26, 2023, 3:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdataset-shows-0-rows-when-loaded-but-full-when-pushed%2F48174 "2023-07-26T03:17:09Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![GeneralCognition-Has](https://avatars.discourse-cdn.com/v4/letter/g/839c29/32.png) [@GeneralCognition-Has](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FGeneralCognition-Has)%5C
**Post date:** [July 26, 2023, 3:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdataset-shows-0-rows-when-loaded-but-full-when-pushed%2F48174%2F1 "2023-07-26T03:17:09Z")

</div>

Hi,

I have a dataset dict with 2 splits and 4 features

```py
DatasetDict({
    train: Dataset({
        features: ['screenshot', 'raw_html', 'clean_html', 'metadata'],
        num_rows: 3996
    })
    test: Dataset({
        features: ['screenshot', 'raw_html', 'clean_html', 'metadata'],
        num_rows: 444
    })
})

```

The screenshot feature is a PIL image, the html features are strings, the metadata feature is a dict with strings and numbers in the values.

I am trying to push it to the hub with

```py
dataset_dict.push_to_hub(
    'GeneralCognition/SEC_Tables_Lite', 
     token='<MY_WRITE_TOKEN>', 
     private=True
)

```

And then I see the parquet files in the UI

 ![Screenshot 2023-07-25 at 10.11.07 PM](https://us1.discourse-cdn.com/hellohellohello/original/3X/5/a/5afddbbe8b979fc126316f108b9239f861ca0771.png)

But then if I go to colab and try to load the dataset

```py
!pip install datasets --quiet
from datasets import load_dataset

ds = load_dataset(
    'GeneralCognition/SEC_Tables_Lite', 
    token='<MY_READ_TOKEN>', 
    # verification_mode='no_checks', 
    download_mode='force_redownload'
)

print(ds)

```

I get the following error (I formatted it for clarity)

```auto
NonMatchingSplitsSizesError: [
    {
        "expected": SplitInfo(
            name="train",
            num_bytes=157882062.6,
            num_examples=3996,
            shard_lengths=None,
            dataset_name=None,
        ),
        "recorded": SplitInfo(
            name="train",
            num_bytes=0,
            num_examples=0,
            shard_lengths=None,
            dataset_name="sec_tables_lite",
        ),
    },
    {
        "expected": SplitInfo(
            name="test",
            num_bytes=17542451.4,
            num_examples=444,
            shard_lengths=None,
            dataset_name=None,
        ),
        "recorded": SplitInfo(
            name="test",
            num_bytes=0,
            num_examples=0,
            shard_lengths=None,
            dataset_name="sec_tables_lite",
        ),
    },
]

```

Now if instead I load it with `verification_mode='no_checks'` I get an empty dataset.

```auto
DatasetDict({
    test: Dataset({
        features: ['screenshot', 'raw_html', 'clean_html', 'metadata'],
        num_rows: 0
    })
    train: Dataset({
        features: ['screenshot', 'raw_html', 'clean_html', 'metadata'],
        num_rows: 0
    })
})

```

This is my first time uploading a dataset to the hub, why is this not working, what am I doing wrong? Thanks for the help.

_Note: I did try using the same token for reading and writing, I tried just uploading from a dataset instead of a dataset\_dict. I tried messing with max\_shard\_size. To no avail._