datatrove — the data-processing library behind FineWeb, FineWeb2, and FinePDFs — just shipped...
datatrove — the data-processing library behind FineWeb, FineWeb2, and FinePDFs — just shipped 0.10.0! - JobsPipelineExecutor: run pipelines on @huggingface Jobs: fan-out, multi-stage dependencies, retries, resume. No Slurm cluster needed - HF storage buckets a
Many AI tasks can now run fully local or on-device.
Many AI tasks can now run fully local or on-device. - Redact PII in the browser: OpenAI privacy-filter (1.5B) - Streaming speech-to-text: Nemotron-3.5 ASR (0.6B) - Parse documents: OvisOCR2 (0.9B) - Run agent loops: LFM2.5 (2.6B) - Moderate with your own polic
Uploaded a dataset of 1,080,814 public domain images, mostly from 19th-century books, to the ...
Uploaded a dataset of 1,080,814 public domain images, mostly from 19th-century books, to the Hub. https:// huggingface.co/datasets/bigla m/british-library-book-images …