Currently transitioning from "Type A" to "Type B" archives. They contain the same information, just better compressed due to delta compression.
Per-10-minute archives, tar gzipped. About 20 - 25 GiB per day or 8 - 10 TiB per year.
Per-day git repositories packed as 'git bundles'. 10-minutes per commit. Due to delta differences and compression a factor 30 smaller than Type A archives. About 600 - 700 MiB per day or 220 - 255 GiB per year.
To unpack a Type B git bundle use: git clone -b main rpkiviews-2024-01-03.bundle
.
This results in a useful directory with a .git
directory, use git log
to list all the commits and git checkout
to go to that time stamp of the archive.
One will want to store this in a memory filesystem (tmpfs etc) instead of on a spinning disk, as there are lots of files.