# Host and share datasets: S3

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhost-and-share-datasets-s3%2F20367%3E%5C
**Category:** 🤗Datasets\
**Created:** [July 14, 2022, 7:05am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhost-and-share-datasets-s3%2F20367 "2022-07-14T07:05:31Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Pannis](https://avatars.discourse-cdn.com/v4/letter/p/ac8455/32.png) [@Pannis](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FPannis)%5C
**Post date:** [July 14, 2022, 7:05am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhost-and-share-datasets-s3%2F20367%2F1 "2022-07-14T07:05:31Z")

</div>

Basically I have a text file, and I want to save it on S3 and use python “datasets” library to load and share for collaboration. I followed the instructions mentioned here. [Cloud storage](https://huggingface.co/docs/datasets/filesystems)

I have uploaded the text on S3.  
I am trying use datasets to list the data from S3 and getting access issues.  
I want to use load\_from\_disk() function later to load data from S3.

```
import datasets
s3 = datasets.filesystems.S3FileSystem(anon=True)
s3.ls('text-data/processed/')

```

I did check `aws s3 ls s3://text-data/processed/` and I am able to list the objects and hence doesn’t seems like access issue.

A good example would be easier for a beginner to start.

Please let me know if I am missing something. Thanks.

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/64813_2.png) [@lhoestq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flhoestq)%5C
**Post date:** [July 22, 2022, 11:55am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhost-and-share-datasets-s3%2F20367%2F2 "2022-07-22T11:55:40Z")

</div>

Hi ! `load_from_disk` can be used to load an Arrow dataset exported with `save_to_disk`.

To load a text file from your S3, you can use `load_dataset` and pass the URLs of your text files as `data_files`, for example:

```python
from datasets import load_dataset

url = "https://s3.amazonaws.com/conceptnet/downloads/2018/omcs-sentences-free.txt"
ds = load_dataset("text", data_files={"train": [url]})

```