Last post 14 hours 18 min ago

Posts last week 94

Average response time last week 34 min

All time posts 67837

All time tickets 10483

All time avg. posts per day 20

Helpdesk is open from Monday through Friday CET

Please create an (free) account to post any question in the support area.

Please check the development versions area. Look at the changelog, maybe your specific problem has been resolved already!

All tickets are private and they cannot be viewed by anyone. We have made public only a few tickets that we found helpful, after removing private information from them.

#2558 – 1000s of URLs

Posted in ‘sh404SEF’

This is a public ticket. Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Tuesday, 02 August 2016 05:18 UTC

fcdigital

Hello!

I have 3 very similar stores, all of them:

Joomla 3.6.0
VM 3.0.12
SH404 4.7.3.3292

www.xxxx.mx
About
400 products
50 K2 items
sh404 reports 33.9K URLS31.5K never visited

www.xxxx.mx
About
800 products
50 k2 items
sh404 reports 6K URLS 3K never visited

www.xxxx.mx
About
100 products
50 k2 items
sh404 reports 2100 URLS 1300 never visited

Basically all of them have the same plugins and components installed.

Why there are so many never visited URLS.

And particularly, why xxxx has 33K URLS!!! It has less products than xxxx, but has more than 5 times more URLs.

What is happening? Please check image.

Best regards!

Admin access:

url: http://www.xxxx.mx/administrator/
user: xxxx
password: xxxx

Tuesday, 02 August 2016 09:34 UTC

wb_weeblr

Why there are so many never visited URLS.

Because nobody uses them I believe. On a single page, VM will create many links, and many won't be used (sorting by rating, prices, etc)

That said:

- 30 or 50000 URLs is not a problem, that's a small set of data
- on that site, you have that issue with / at the end, and possibly many more.

To be honest, and considering the other thread, I am starting to think that the best might be to simply purge URLs. This will delete all automatic URLs (not manually customized or meta data). But I think you may have garbage URLs in that database, maybe some still there from development or various phases.
If you were to Purge URLs, your site may face multiple 404s, as the site is well indexed in Google I assume. So you would have the site crawled by, for instance, and online sitemap maker, or an SEO tools such as Screaming Frog. Crawling all pages of the site would cause all URLs to be recreated by sh404SEF.

Rgds

Wednesday, 03 August 2016 00:45 UTC

fcdigital

Thanks for your advice, I just purged xxxx.mx

How can I find if something is crawling my site. I have JSitemap PRO installed and generates a very reasonable 400-500 links site map http://www.xxxx.mx/sitemap?lang=es

I don't have any other site map creator enabled.

Regards!

Wednesday, 03 August 2016 07:48 UTC

wb_weeblr

How can I find if something is crawling my site

I did not suggest that you have something crawling your site.

I said that after purging your URLs, it would be a good idea to use a sitemap generator to crawl your site, so that all pages of the site are created, and all URLs as well. There are multiple sitemap generator online. Some may not handle large site like yours, at least not for free.

Rgds

Thursday, 18 August 2016 05:34 UTC

system

This ticket has been automatically closed. All tickets which have been inactive for a long time are automatically closed. If you believe that this ticket was closed in error, please contact us.

This ticket is closed, therefore read-only. You can no longer reply to it. If you need to provide more information, please open a new ticket and mention this ticket's number.