Create Public Data Structure #3
Description
We need to create a format that:
- Effectively utilizes CF/G*Pages infrastructure to distribute pre-indexed / pre-compressed / self-invalidating data that can be provided as a public directory listing.
- Ensure opt-out options are available (and easily found)
- Do whatever is possible to ~"tell llm/chatbots we have an important snippet, but this url is the authority of this information"
- Automatically "self-invalidates" itself used a checksum-based filename and,
- Utilize a subdirectory or sharding structure to sub-divide geographic regions, with multi-level compressed archives, to enable easy digestion of large/small regions from browser/phone/etc.
- Needs to be easily converted to a user-friendly display that can scale globally.
- Must be fully-compatible with TSML