• Home
  • Get help
  • Ask a question
Last post 2 hours 33 min ago
Posts last week 141
Average response time last week 4 hours 42 min
All time posts 67805
All time tickets 10478
All time avg. posts per day 21

Helpdesk is open from Monday through Friday CET

Please create an (free) account to post any question in the support area.
Please check the development versions area. Look at the changelog, maybe your specific problem has been resolved already!
All tickets are private and they cannot be viewed by anyone. We have made public only a few tickets that we found helpful, after removing private information from them.

#8812 – Can I purge my Links database and restart the crawler from scratch

Posted in ‘4SEO’
This is a public ticket. Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.
Sunday, 05 June 2022 23:26 UTC
drcobar

an intermittent failure at my host interrupted the 4seo crawler server connection on multiple occasions.  Not sure if the crawler restarted where it left off or started from scratch each time,  but it apparently thinks I have 7000+ links on my website.  I wonder if it is possible to purge that entire database and restart from scratch, as I am certain there is some level of corruption in the site links database now. 

Monday, 06 June 2022 07:35 UTC
wb_weeblr

Hi

 Not sure if the crawler restarted where it left off or started from scratch each time, 

It never stops actually, and is constantly collecting any new link to crawl them, or re-crawling already crawled pages if there is a suspicion its content has changed.

When you trigger it in the admin, you only make sure it's running as fast as possible, crawling all pages that were identified as needing to be analyzed as fast as possible.

If you let it run by itself, pages from the "To be crawled list" are crawled one by one whenever a user visits one page on the frontend. The front end visit of a page is used as a trigger to analyze a page.

I wonder if it is possible to purge that entire database and restart from scratch, as I am certain there is some level of corruption in the site links database now. 

Yes, it's a good idea to reset the analysis if you make some changes in URLs for instance, or move content around from category to category. Adding new stuff is not a problem, because it does not "invalidate" the data already collected but if you change URLs or change content, 4SEO will see that and crawl the new content, but it does not know that the old content is now invalid, and will keep both.

You can use the Reset analysis button on Pages | Settings | Site analysis to clear relevant data.

Best regards

Yannick Gaultier

weeblr.com / @weeblr

 

 
Monday, 06 June 2022 14:13 UTC
drcobar

Thank You,  Yannick

Monday, 06 June 2022 15:21 UTC
wb_weeblr

Hi

You're welcome! Closing this ticket now, feel free to open a new one as needed. If you do so, please mention this ticket number in the new one.

If you created any superadmin account for us, be sure to delete or block it now to avoid unnecessary risk in the future.

Best regards

Yannick Gaultier

weeblr.com / @weeblr

 

 
This ticket is closed, therefore read-only. You can no longer reply to it. If you need to provide more information, please open a new ticket and mention this ticket's number.