Try our conversational search powered by Generative AI!
AI OnAI Off
How can I make the Find Crawler ignore an HTML section?
Support is still very limited I think. We hid chunks of HTML based on Find crawler's User Agent string but then of course you need backend code access to the target site.
Feb 22, 2017 18:05
Hi,
We are using a Find connector to crawl an old site. This site has a pretty bad HTML structure and a large static section in the top of each page is messing up the excerpt text. We can't make any big changes to the old site, but can add a couple of HTML tags or headers to improve the search results.
Is there a way to add some hints to the Find crawler, like Google's appliance-tag , or some other suggestions?
Regards,
Morten