Many search engines will look for a robots.txt file before spidering your sites content. The robots.txt file contains specific rules a robot/spider should abide by when capturing data.
- 524 Users Found This Useful
Related Articles
Common Search Engine Optimization Tips
Get other websites to link to you. Have your website linked and posted in socal media...
I can not get the transfer authorization email can it be forwarded to a different email address?
The authorization has to be authorized by the registered contact for the domain. We cannot change...
How do I cancel my account?
We are sorry to hear you would like to cancel your account! If there is anything we can do,...
Domain Slamming - Beware
There are several companies out there using a predatory practice of attempting to have you renew...
Point my domain to my wix account
How can I point my domain name to my wix.com account?To set this up you will want to login to...
