Suck-It: Recursively visit and download a website's content to your disk (multi-threaded). rsync: An open source utility that provides fast incremental file transfer. Rclone: A command line program to sync files and directories to and from various cloud storage providers. Plowshare: Command-line tool to manage file-sharing site. news-crawl: Cralwer for news feeds based on StromCrawler that prouduces WARC files. httpie: a tool similar to curl and wget but designed to be user friendly, useful for web scraping with shell scripts but be aware you're adding a dependency by doing so. Horahora: Video hosting website and video archival manager for Niconico, Bilibili, and Youtube. curl: Tool and library for transferring data with URL syntax, supporting many protocols. CrowLeer: Powerful C++ web crawler based on libcurl. aria2: A lightweight multi-protocol & multi-source command-line download utility. annie: Youtube-DL alternative written in Golang. wikiteam: set of tools for archiving wikis. webrecorder: An integrated platform for creating high-fidelity, ISO-compliant web archives in a user-friendly interface, providing access to archived content, and sharing collections. wail: Web Archiving Integration Layer: One-Click User Instigated Preservation. HTTrack: Download a website from the Internet to a local directory. Heritrix: Extensible, web-scale, archival-quality web crawler. grab-site: The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns. Collect: A server to collect & archive websites that also supports video downloads. Browsertrix Crawler: Browsertrix Crawler is a simplified (Chrome) browser-based high-fidelity crawling system, designed to run a complex, customizable browser-based crawl in a single Docker container. Takes browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more. ArchiveBox: The open source self-hosted web archive. I will try to organize the list with more useful sections in the future You can also view all of these in a playlist on YouTube: The Practical Guide To Mac Security on YouTube.Note: This is only a first draft/brainstorm. By following these common-sense techniques you can keep your Mac secure and prevent problems. 
Watch 20 videos for regular Mac users about how to prevent online account theft, malware and other disasters.
This is a free course offered by MacMost.
0 kommentar(er)
