Why Does ExpectedMoreSplits Error Occur?

[cleverchloe]

Hi, I'm trying to sparsify my model using your code, but I'm encountering the "ExpectedMoreSplits Error" shown below.

The error arises from this line when loading the training data.

Could you help me understand the reason for this error and suggest how I might fix it?

    raise ExpectedMoreSplits(str(set(expected_splits) - set(recorded_splits)))
datasets.utils.info_utils.ExpectedMoreSplits: {'validation'}

[TagoreZhao]

I followed this post to resolve this issue: https://huggingface.co/datasets/allenai/c4/discussions/7

edit the two load_dataset function to look like this:

If this does not work(The error should change), try to install the newest huggingface dataset by running this:
conda install -c huggingface -c conda-forge datasets

[HaroldHuanrongLIU]

I followed this post to resolve this issue: https://huggingface.co/datasets/allenai/c4/discussions/7

edit the two load_dataset function to look like this:

If this does not work(The error should change), try to install the newest huggingface dataset by running this: conda install -c huggingface -c conda-forge datasets

Hi, I try ti use your method, but still encounter this problem