Fork of Meteor Spiderable with longer timeout, caching, better server handling
-
Updated
Aug 1, 2017 - JavaScript
Fork of Meteor Spiderable with longer timeout, caching, better server handling
Fake server that produces the specified amount of pages in directories to test web crawlers
Single-file PHP library for FTP uploads with crawlable file pages, PDF/image previews, admin metadata, and no database.
To associate your repository with the crawlable topic, visit your repo's landing page and select "manage topics."