Remove strings from body_content in Crawler

Elastic Search
1

I have a WordPress page, and crawler always puts Menu, Footer, and all of it in body_content field,e.g.

Company name, Company description Home What We Do Mission Our Process Technology Who We Are About Us Our Team Community Get Involved Students Corner Donations Portal Support the Project News Press News & Events Newsletters Get Social Contact MAIN CONTENT OF ARTICLE/PAGE.. All rights reserved. Site by XXX..REST OF THE FOOTER

Any ideas how to remove this from Crawling, or how to completely ignore these strings in search / mappings? Thanks

2

Hi @ansamHox ,

I think that these instructions for meta tags is what would help you avoid this. However, I'm not familiar with the level of control you have over WordPress's HTML. Right now (v7.16.3) if you don't have control over the source HTML of a website, there's not a lot you can do to control the crawled content. However, this is a feature that is being worked on, so stay tuned in future versions for other content extraction controls.

2 Likes