diff --git a/CHANGELOG.md b/CHANGELOG.md index 68558bb..26399d2 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -5,6 +5,42 @@ All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/), and this project follows [Semantic Versioning](https://semver.org/spec/v2.0.0.html). +## [0.2.1] - 2026-06-11 + +### Added + +- **Amazon Reviews 2023 (Subscription Boxes) dataset** + (`amazon-reviews-2023-subscription-boxes`) — the catalog's first + redistribution-restricted entry. The McAuley-Lab Amazon-Reviews-2023 + corpus is an academic HTML crawl of Amazon with no upstream license, + and Amazon's Conditions of Use forbid both the data-mining that + produced it and any redistribution of the derivatives, so it's + recorded as `NoAssertion` / `redistribution_permitted=false` with a + `scrape_advisory` documenting the provenance. Ships the smallest of + the 33 categories (16,216 reviews); fetch → parse → write → vortex all + green and `raincloud.load(...)` round-trips it. Buildable and loadable + locally as a research convenience — never published to a mirror. + +### Changed + +- **`scripts.pipeline.publish` default-blocks slugs that can't be + redistributed.** Two independent license gates, each with its own + opt-in bypass: a non-null `license.scrape_advisory` + (`--allow-scrape-advisory`) and `license.redistribution_permitted=false` + (`--allow-no-redistribution`). A slug tripping both — like the Amazon + corpus — needs both flags; clearing one never silently clears the + other. An explicit `publish ` that ends up fully blocked exits + non-zero rather than reading as a no-op success, while `--all` skips + blocked slugs and continues. This retroactively guards the existing + scrape-flagged slugs (C4, FineWeb, SlimPajama, …), not just the new + dataset. +- **`docs/v1` snapshot resynced to current truth** — picks up + BI-CommonGovernment's authoritative `sources.json` description, the + fresher Open Food Facts (4,466,927 → 4,517,492 rows) and OSM Germany + Relations (889,712 → 890,059) builds with their sizes and row-group + counts, and row-group / vortex metadata for Spambase and uci-iris that + the tracked snapshot was missing. + ## [0.2.0] - 2026-05-29 ### Added diff --git a/pyproject.toml b/pyproject.toml index 96e687e..292fbbc 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,6 +1,6 @@ [project] name = "raincloud" -version = "0.2.0" +version = "0.2.1" description = "Client-reproducible pipeline for building a curated catalog of public datasets as Parquet + Vortex files." readme = "README.md" requires-python = ">=3.11" diff --git a/raincloud/__init__.py b/raincloud/__init__.py index 277ac59..74e2159 100644 --- a/raincloud/__init__.py +++ b/raincloud/__init__.py @@ -19,7 +19,7 @@ UnknownSlug, ) -__version__ = "0.2.0" +__version__ = "0.2.1" _DEFAULT_FORMAT = "vortex"