Hi David,
how can I improve the link structure of my website . I especially think at spiders. I have some links on my website and the spiders visit these links. But not all links to products are set on my website. I e.g. have links to 20 products or brands on my website but I have about 20.000 products adn several 100 brands in my database. How could a code be so that spiders visit all possible links when they access my index.php.
Regards
Roland
Hi Roland,
A spider _should_ be able to find all products on your site by using the Merchant index - that is the way I have intended it to happen. The other way of course is your Google sitemap (http://www.yoursite.com/sitemap.php), which I presume you have registered with Google.
You can check to see how many pages Google has indexed using the site: query, for example:
site:www.yoursite.com
Cheers,
David.