Profile
Back to NewsBack
Hacker News 2 min
Reader Mode
Fog-Bank: Archiving the oldest webcam feed

Fog-Bank: Archiving the oldest webcam feed

15 hours ago

The net: how every FogCam frame gets caught

FogCam publishes one picture at a time and throws it away when the next one lands. Fog-Bank keeps every one of them, and when something goes wrong (on my side or FogCam's), the record shows exactly when, for how long and whose fault it was.

Four catchers on three networks ask FogCam for its picture: a poller on my own server every 7 seconds, fogline on Cloudflare every 15 seconds (it keeps a 30-day buffer), a Cloudflare worker every 20 seconds that writes straight to permanent storage, and a machine at my house every 15 seconds. Each one pushes every frame it gets into the archive, and sweeps every 5 minutes and every night pull back anything a push dropped. Every request asks for the real file (a unique query string plus no-cache headers), because in August I found FogCam's web server cache handing out copies minutes old. Each frame is named by FogCam's own upload time, fingerprinted with sha-256, stamped without re-compressing, stored as lossless JPEG XL and copied to Cloudflare R2 the same minute.

A status board checks every stage from the camera to YouTube every few minutes and pages me on Telegram when one stops. The page lists every outage so far, in order, marked as mine or FogCam's: FogCam's server outage on Aug 13, its 64-hour freeze on Sep 8 to 10, my server's 40-hour outage inside that freeze (a full disk), and the rest.

More: the live archive · how the backup works · the forensic record · the story

Chat with me