The Linux Terminal ZCrawler Project

“Crawler” is a generic term for any program (such as a robot or spider) used to automatically discover and scan websites by following links from one webpage to another. TheLinuxTerminal’s main crawler is called ZCrawler.
You will see this User-agent in your Apache logs:

Mozilla/5.0 (compatible; ZCrawler/1.0; +http://www.thelinuxterminal.com/zcrawler-project/)

Submit website

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a “spider” or a “bot.” Crawlers are typically programmed to visit sites that have been submitted by their owners as new or updated. Entire sites or specific pages can be selectively visited and indexed. Crawlers apparently gained the name because they crawl through a site a page at a time, following the links to other pages on the site until all pages have been read.

Come back in a day or two to see if your website got indexed.

Search for a indexed website

Use: zcrawler domain.tld then hit ENTER

ZCrawler Index Page