FileNotFoundError: Couldn't find a dataset script at /home/BrushNet/webdataset/webdataset.py or any data file in the same directory. Couldn't find 'webdataset' on the Hugging Face Hub either: FileNotFoundError: Dataset 'webdataset' doesn't exist on the Hub

[Tramac]

import os
from datasets import load_dataset

train_data_dir = "./data/BrushData"

train_dataset = load_dataset(
    "webdataset",
    data_files={"train": os.path.join(train_data_dir,"*.tar")},
    split="train",
    streaming=True
)

The data structure is:

|-- data
    |-- BrushData
        |-- 00200.tar
        |-- 00201.tar
        |-- ...

There will be the following error:

FileNotFoundError: Couldn't find a dataset script at /home/BrushNet/webdataset/webdataset.py or any data file in the same directory. Couldn't find 'webdataset' on the Hugging Face Hub either: FileNotFoundError: Dataset 'webdataset' doesn't exist on the Hub