an intermittent failure at my host interrupted the 4seo crawler server connection on multiple occasions. Not sure if the crawler restarted where it left off or started from scratch each time, but it apparently thinks I have 7000+ links on my website. I wonder if it is possible to purge that entire database and restart from scratch, as I am certain there is some level of corruption in the site links database now.
Last post
25 min ago
Posts last week
81
Average response time last week
44 min
All time posts
70349
All time tickets
10858
All time avg. posts per day
20
Helpdesk is open from Monday through Friday CET
Please create an (free) account to post any question in the support area.
Please check the development versions area. Look at the changelog, maybe your specific problem has been resolved already!
All tickets are private and they cannot be viewed by anyone. We have made public only a few tickets that we found helpful, after removing private information from them.
#8812 – Can I purge my Links database and restart the crawler from scratch
Posted in ‘4SEO’
This is a public ticket. Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.
drcobar
wb_weeblr
Hi
Not sure if the crawler restarted where it left off or started from scratch each time,
It never stops actually, and is constantly collecting any new link to crawl them, or re-crawling already crawled pages if there is a suspicion its content has changed.
When you trigger it in the admin, you only make sure it's running as fast as possible, crawling all pages that were identified as needing to be analyzed as fast as possible.
If you let it run by itself, pages from the "To be crawled list" are crawled one by one whenever a user visits one page on the frontend. The front end visit of a page is used as a trigger to analyze a page.
I wonder if it is possible to purge that entire database and restart from scratch, as I am certain there is some level of corruption in the site links database now.
Yes, it's a good idea to reset the analysis if you make some changes in URLs for instance, or move content around from category to category. Adding new stuff is not a problem, because it does not "invalidate" the data already collected but if you change URLs or change content, 4SEO will see that and crawl the new content, but it does not know that the old content is now invalid, and will keep both.
You can use the Reset analysis button on Pages | Settings | Site analysis to clear relevant data.
Best regards
Yannick Gaultier
weeblr.com / @weeblr
drcobar
Thank You, Yannick
wb_weeblr
Hi
You're welcome! Closing this ticket now, feel free to open a new one as needed. If you do so, please mention this ticket number in the new one.
If you created any superadmin account for us, be sure to delete or block it now to avoid unnecessary risk in the future.
Best regards
Yannick Gaultier
weeblr.com / @weeblr
This ticket is closed, therefore read-only. You can no longer reply to it. If you need to provide more information, please open a new ticket and mention this ticket's number.