Recently, the Hugging Face š¤ datasets team met with the Language Technologies team led by Marta Villegas (@mvillegas) at Barcelona Supercomputing Center @BSC-LT. Eager to collaborate to promote AI across Catalan, Spanish, Basque, and Galician languages and share open-source datasets/models. š¤ #AI #LanguageTech #OpenSource
š„ What's New: - Polars integration š»āāļø - fsspec support for conversion to JSON, CSV, and Parquet - Mode parameter for Image feature - CLI function to convert script-datasets to Parquet - Dataset.take and Dataset.skip
Plus, a bunch of general improvements & bug fixes!