Chore(deps-dev): update datasets requirement from <5,>=4.4.0 to >=4.4.0,<6

[dependabot]

Updates the requirements on datasets to permit the latest version.

Release notes

Sourced from datasets's releases.

5.0.1

Bug fixes

• Fix version string in init.py by @​qgallouedec in huggingface/datasets#8244
• fix conda build by @​lhoestq in huggingface/datasets#8250
• Fix JSON loader schema inference for files starting with a UTF-8 BOM (#8241) by @​archievi in huggingface/datasets#8243
• Support hermes traces by @​lhoestq in huggingface/datasets#8255
• Fix batch(by_column=...) crashing after shard/shuffle/split by @​pkooij in huggingface/datasets#8259
• fix traces streaming by @​lhoestq in huggingface/datasets#8277
• support droid agent traces by @​cfahlgren1 in huggingface/datasets#8263
• Fix CI: commit operation equality (hfh 1.20.0) and pytest parametrize collection error by @​Wauplin in huggingface/datasets#8283
• Fix lance auth by @​lhoestq in huggingface/datasets#8301
• Fix symlink-following arbitrary file write in archive extraction by @​AAtomical in huggingface/datasets#8303
• Bug Fix: Resuming Twice Resets the Dataloader by @​francesco-bertolotti in huggingface/datasets#8295
• Bump fsspec and simpler wds compr by @​lhoestq in huggingface/datasets#8337
• fix: validate Arrow IPC record batches by @​XciD in huggingface/datasets#8350
• Make the dataset fingerprint independent of Arrow chunking by @​SuryanshSS1011 in huggingface/datasets#8339
• Fix casting a nullable LargeList to a different inner type by @​vineethsaivs in huggingface/datasets#8346
• docs: replace AutoFeatureExtractor with AutoImageProcessor in image preprocessing docs by @​gautamkishore in huggingface/datasets#8326
• Fix column drop in Arrow path of axis=1 concatenation by @​ebarkhordar in huggingface/datasets#8342
• Raise on length mismatch in batched IterableDataset.map by @​sohumt123 in huggingface/datasets#8332
• Fix require_storage_embed recursing into require_storage_cast by @​vineethsaivs in huggingface/datasets#8349
• Fix path traversal via metadata file_name in folder-based builders by @​Kaif10 in huggingface/datasets#8325
• Support batched=True in Dataset.to_dict by @​vineethsaivs in huggingface/datasets#8333
• Fix hdf5 external files by @​lhoestq in huggingface/datasets#8355
• remove bad require_storage test by @​lhoestq in huggingface/datasets#8357
• ensure fiels are in repo by @​lhoestq in huggingface/datasets#8356
• Keep flat numeric columns with nulls numeric in numpy format by @​ebarkhordar in huggingface/datasets#8352
• Fix bucket dataset card handling and push metadata accounting by @​pjh4993 in huggingface/datasets#8354
• Fix CSV loader dropping on_bad_lines/encoding_errors on pandas 2.0-2.2 by @​ebarkhordar in huggingface/datasets#8358
• Keep integers on the python read path for fixed-shape ArrayXD columns with nulls by @​ebarkhordar in huggingface/datasets#8363
• Rebatch arrow source before formatting in IterableDataset.filter to fix resume data loss by @​ebarkhordar in huggingface/datasets#8360
• Decode Json() columns in Dataset.to_pandas() by @​ebarkhordar in huggingface/datasets#8344
• fix buckets on windows by @​lhoestq in huggingface/datasets#8369
• Fix DatasetDict.push_to_hub leaving removed splits in the dataset card by @​pjh4993 in huggingface/datasets#8367
• Preserve nullable integer columns in to_json/to_csv/to_sql by @​ebarkhordar in huggingface/datasets#8366

Docs

• docs: fix duplicate "to" in IterableDataset push-to-hub example by @​DaoyuanLi2816 in huggingface/datasets#8252
• Clarify dataset creation vs loading workflows in create_dataset tutorial by @​zanvari in huggingface/datasets#8235

New Contributors

• @​DaoyuanLi2816 made their first contribution in huggingface/datasets#8252
• @​zanvari made their first contribution in huggingface/datasets#8235
• @​archievi made their first contribution in huggingface/datasets#8243
• @​pkooij made their first contribution in huggingface/datasets#8259
• @​AAtomical made their first contribution in huggingface/datasets#8303
• @​francesco-bertolotti made their first contribution in huggingface/datasets#8295
• @​XciD made their first contribution in huggingface/datasets#8350
• @​SuryanshSS1011 made their first contribution in huggingface/datasets#8339
• @​vineethsaivs made their first contribution in huggingface/datasets#8346

... (truncated)

Commits

• 921c2a7 release: 5.0.1 (#8370)
• c6fc5cd Preserve nullable integer columns in to_json/to_csv/to_sql (#8366)
• 6747b87 Fix DatasetDict.push_to_hub leaving removed splits in the dataset card (#8367)
• b305031 fix buckets on windows (#8369)
• 030a3e5 Decode Json() columns in Dataset.to_pandas() (#8344)
• 0f207a0 Rebatch arrow source before formatting in IterableDataset.filter to fix resum...
• adad35d Keep integers on the python read path for fixed-shape ArrayXD columns with nu...
• 8966746 Fix CSV loader dropping on_bad_lines/encoding_errors on pandas 2.0-2.2 (#8358)
• b8e861a Fix bucket dataset card handling and push metadata accounting (#8354)
• 521a590 Keep flat numeric columns with nulls numeric in numpy format (#8352)
• Additional commits viewable in compare view