This is assuming of course, that the spider finds your website important enough in the first place to have a look - something that can only happen through a persistent link-building campaign.