# How to load two pandas dataframe into dataset object?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-load-two-pandas-dataframe-into-dataset-object%2F18713%3E%5C
**Category:** 🤗Datasets\
**Created:** [June 4, 2022, 11:43am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-load-two-pandas-dataframe-into-dataset-object%2F18713 "2022-06-04T11:43:36Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![aaditya](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/aaditya/32/20855_2.png) [@aaditya](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Faaditya)%5C
**Post date:** [June 4, 2022, 11:43am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-load-two-pandas-dataframe-into-dataset-object%2F18713%2F1 "2022-06-04T11:43:36Z")

</div>

Hello, I am trying to load the train and test data frame into the dataset object. The usual way to load a pandas dataframe into dataset object is:

```auto
from datasets import Dataset
import pandas as pd
df = pd.DataFrame({"a": [1, 2, 3]})
dataset = Dataset.from_pandas(df)

```

My question is how to load train and test both pandas dataframe into the dataset?

for example if I have two dataframes:

```auto
from datasets import Dataset
import pandas as pd
df_train = pd.DataFrame({"a": [1, 2, 3]})
df_test = pd.DataFrame({"ab": [1, 2, 3]})

```

How to load these two frames?

---

<div class="post-metadata">

**Author:** ![mariosasko](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mariosasko/32/31548_2.png) [@mariosasko](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmariosasko)%5C
**Post date:** [June 5, 2022, 11:47am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-load-two-pandas-dataframe-into-dataset-object%2F18713%2F2 "2022-06-05T11:47:05Z")

</div>

Hi! You can concatenate them with:

```python
from datasets import Dataset, concatenate_datasets
import pandas as pd
df_train = pd.DataFrame({"a": [1, 2, 3]})
df_test = pd.DataFrame({"ab": [1, 2, 3]}) 
ds_train = Dataset.from_pandas(df_train)
ds_test = Dataset.from_pandas(df_test)
ds = concatenate_datasets([ds_train, ds_test])

```

---

<div class="post-metadata">

**Author:** ![aaditya](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/aaditya/32/20855_2.png) [@aaditya](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Faaditya)%5C
**Post date:** [June 5, 2022, 11:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-load-two-pandas-dataframe-into-dataset-object%2F18713%2F3 "2022-06-05T23:44:59Z")

</div>

Hi I am looking for something like this:

```auto
DatasetDict({
    train: Dataset({
        features: ['a'],
        num_rows: 3
    })
    test: Dataset({
        features: ['ab'],
        num_rows: 3
    })
})

```

---

<div class="post-metadata">

**Author:** ![limsc](https://avatars.discourse-cdn.com/v4/letter/l/a87d85/32.png) [@limsc](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flimsc)%5C
**Post date:** [June 6, 2022, 3:08am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-load-two-pandas-dataframe-into-dataset-object%2F18713%2F4 "2022-06-06T03:08:17Z")

</div>

This should work.

```auto
from datasets import Dataset, DatasetDict
import pandas as pd

df_train = pd.DataFrame({'a' : [1, 2, 3]})
df_test = pd.DataFrame({'ab' : [1, 2, 3]})

ds_dict = {'train' : Dataset.from_pandas(df_train),
           'test' : Dataset.from_pandas(df_test)}

ds = DatasetDict(ds_dict)

```
