Spider
What is a spider and what does a spider do, precisely? The word spider is commonly referred to as a bot. A spider is a computerized program that automatically gathers web pages. Spiders are specifically considered these creatures because they virtually crawl the World Wide Web to discover new links and new websites. Once spiders have completed their algorithm, fetched web pages are fed to search engines.As a webcrawler, a spider is the direct transmission line to the World Wide Web because it explores the vast Net to retrieve information for search engines such as Google, Alta Vista, etc. A spider not only reads a website's meta tags, but also reads the actual information on the website, in addition to following links to all onsite connections - all the while, indexing.
When the spider has completed its mission, it feeds all of its fetched information back to a central database where web pages can be indexed for search engine purposes.
During its algorithm, a spider basically analyzes the way pages are linked to other pages on the Net. In doing so, search engines are better able to rank these pages according to relevancy and pertinence to themed websites. Having the right information, and the right SEO plan can help spiders accurately read your website, and further help increase your website's page rank.
To learn more about spiders and what effect they can have on you website, feel free to contact SEOAdept.com. We can help.
Created: 02/27/2006; Updated: 04/27/2006