Please check if you passed the document limit for your account
If you provide us sitemap and the folder/subpath is listed there, we will ignore your robots.txt. To get around without changing your sitemap, you can use our blacklist feature.
You can do that in 2 different ways:
(1) Put it under robots.txt as our crawler will respect it.
(2) Use our crawler blacklist feature.
There are two things you can check:
(1) The sites you want to cross search needs to be indexed and put under the same group.
(2) Make you have turn on “Display results from Linked Site” on Dashboard.