You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have updated the HTML crawler configuration to include the aside tag in the list of pruned tags. This change aims to improve the relevance of crawled content by excluding sections typically not central to the main content, such as sidebars and supplementary information.
This modification ensures that the HTML crawler will skip content within aside tags during the crawling process, focusing more on the primary content of the pages.
The text was updated successfully, but these errors were encountered:
We have updated the HTML crawler configuration to include the aside tag in the list of pruned tags. This change aims to improve the relevance of crawled content by excluding sections typically not central to the main content, such as sidebars and supplementary information.
This modification ensures that the HTML crawler will skip content within aside tags during the crawling process, focusing more on the primary content of the pages.
The text was updated successfully, but these errors were encountered: