Let's archive the web (Interview)

The Changelog: Software Development, Open Source

Nick Sweeting joins Adam and Jerod to talk about the importance of archiving digital content, his work on ArchiveBox to make it easier, the challenges faced by Archive.org and the Wayback Machine, and the need for both centralized and distributed archiving solutions.

Join the discussion

Changelog++ members get a bonus 5 minutes at the end of this episode and zero ads. Join today!

Sponsors:

• Fly.io – The home of Changelog.com — Deploy your apps close to your users — global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes.
• Timescale – Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai.
• Wix Studio – Wix Sudio is for devs who build websites, sell apps, go headless, or manage clients. Integrate, extend and write custom scripts in a VS code-based IDE. Leverage zero set up dev, test and production environments. Ship faster with an AI code assistant. And work with Wix headless API’s on any tech stack.
• WorkOS – AuthKit offers 1,000,000 monthly active users (MAU) free — The world’s best login box, powered by WorkOS + Radix. Learn more and get started at WorkOS.com and AuthKit.com

Featuring:

• Nick Sweeting – Twitter, GitHub, LinkedIn, Website
• Adam Stacoviak – Mastodon, Twitter, GitHub, LinkedIn, Website
• Jerod Santo – Mastodon, Twitter, GitHub, LinkedIn

Show Notes:

• ArchiveBox
• ArchiveBox/abx-dl
• ArchiveBox/abx-pkg
• So you want to build a social network?
• The Internet Archive Loses Its Appeal of a Major Copyright Case
• Hachette v. Internet Archive | Electronic Frontier Foundation
• Fahrenheit 451 - Wikipedia
• Winamp Skin Museum
• Fiscal Sponsorship – Hack Club
• DigestBox

Something missing or broken? PRs welcome!

Chapter

1. Software moves fast. So keep up. (00:00:00)

2. Sponsor: Fly.io (00:01:06)

https://fly.io/

3. Let's talk archiving (00:03:35)

4. Wayback Machine has had challenges (00:05:34)

5. Starting ArchiveBox (00:14:25)

https://archivebox.io/

6. Fahrenheit 451 (00:16:11)

https://en.wikipedia.org/wiki/Fahrenheit_451

7. The internet is young (00:22:47)

8. The time unlock (00:29:45)

9. Sponsor: Timescale (00:33:00)

https://www.timescale.com

10. Sponsor: Wix (00:35:17)

https://www.wix.com/studio

11. Archiving for legacy (00:36:11)

12. 2070 headline (00:38:16)

13. How does it work? (00:41:34)

14. Dealing archive and file size (00:44:28)

15. Nick uses ZFS!! (00:46:41)

16. Going mainstream? (00:48:12)

17. Accessing credentialed stuff (00:49:27)

18. Single or multiplayer game? (00:51:54)

19. Running ArchiveBox (00:54:47)

20. abx-dl is cool (00:56:29)

https://github.com/ArchiveBox/abx-dl

21. Adam's confession (00:59:39)

22. This needs to become a thing (01:01:09)

23. Nick's personal archive (01:02:40)

24. Sponsor: WorkOS (01:03:29)

https://workos.com

25. This video is no longer available (01:06:19)

26. Seriously using ArchiveBox (01:09:12)

27. Mostly cooking videos (01:11:52)

28. An internet on the internet (01:15:27)

29. Session replay for your archive (01:17:00)

30. An index worth sharing (01:18:45)

31. Adam is sold, Jerod is not. (01:21:18)

32. Thanks Hack Club Bank (HBC) (01:22:01)

https://hackclub.com/fiscal-sponsorship/

33. Nick interviews Adam and Jerod (01:23:31)

34. You as a model (01:27:54)

35. Are we done? (01:31:05)

36. Closing thoughts and stuff (01:31:53)

37. ++ Teaser (01:36:01)

https://changelog.com/++