• Home
  • Get help
  • Ask a question
Last post 4 hours 21 min ago
Posts last week 89
Average response time last week 30 min
All time posts 67739
All time tickets 10468
All time avg. posts per day 21

Helpdesk is open from Monday through Friday CET

Please create an (free) account to post any question in the support area.
Please check the development versions area. Look at the changelog, maybe your specific problem has been resolved already!
All tickets are private and they cannot be viewed by anyone. We have made public only a few tickets that we found helpful, after removing private information from them.

#7453 – Default robots meta tag

Posted in ‘sh404SEF’
This is a public ticket. Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.
Monday, 19 October 2020 10:28 UTC
Lena

Hi I found "Default robots meta tag" in configuration of sh404.

Do I understand this correct: If I enter NO INDEX, NO FOLLOW every url will be set NO INDEX, NO FOLLOW unless I change the urls individually which I want to have different robots tag?

Will this work also on existing URLS if I add this to configuration?

Thx, Lena

PS: Why is "max-snippet:-1, max-image-preview:large, max-video-preview:-1" set in my configuration? I don't know this as default robots meta tag.

Monday, 19 October 2020 11:18 UTC
wb_weeblr

Hi

PS: Why is "max-snippet:-1, max-image-preview:large, max-video-preview:-1" set in my configuration? I don't know this as default robots meta tag

This is the current and valid default meta tags that should be used on all pages. Do not change that. "index,follow" is NOT  the correct default meta tag to use on normal pages.

Do I understand this correct: If I enter NO INDEX, NO FOLLOW every url will be set NO INDEX, NO FOLLOW unless I change the urls individually which I want to have different robots tag?

Yes, this is what will happen. Why would you want to do that? Setting noindex, nofollow as the default is obviously very dangerous.

Will this work also on existing URLS if I add this to configuration?

The default value will be changed for all URLs, including existing. However if you already added a per-url robots tag, this of course will be applied.

Best regards

Yannick Gaultier

weeblr.com / @weeblr

 

 
Monday, 19 October 2020 11:30 UTC
Lena

I want most of my sites not to be listed in search engines. It would take a lot of time to explain. But I try it in short. Users are able to set up a Sedcard and I don't want google or any other engine to index those sedcards. I will have thousands of Sedcards and due to GPDR I would have a lot of work getting the sedcards out of the engines and cache of engines when users delete their profile...so I decided not to let the engines crawl the Sedcards.

Is there a way to change the "Default robots meta tag" directly in the database? I am facing a problem on my website (not only in sh404) everytime I want to make changes to the configuration.

What would I have to add the to have it NO INDEX, NO FOLLOW? Will I have write:

keep max-snippet:-1, max-image-preview:large, max-video-preview:-1, NO INDEX, NO FOLLOW ?

Thx, Lena

Monday, 19 October 2020 12:15 UTC
wb_weeblr

Hi

No, if you really want to keep search engines away, the right thing to do is just use a single line in your robots.txt file. That's all and the most efficient way to do it.

Best regards

Yannick Gaultier

weeblr.com / @weeblr

 

 
Monday, 19 October 2020 12:18 UTC
Lena

This way I already tried it and it’s indexing anyway but without meta data – This is also to be find in hundreds of tutorials on google that google is indexing it anyway.

 

 

 

Von: [email protected] <[email protected]> Im Auftrag von Weeblr
Gesendet: Montag, 19. Oktober 2020 14:16
An: Lena <[email protected]>
Betreff: [weeblr.com] Reply to your private ticket #7453 Default robots meta tag [sh404SEF]
Priorität: Hoch

 

 

 

 

Monday, 19 October 2020 12:31 UTC
wb_weeblr

Hi

This way I already tried it and it’s indexing anyway but without meta data

They will index the URLs, ie not the content, if they find them by some other ways. So indeed if they found the direct links somewhere, they'll still read them and the URL will be indexed (again, not the content). Which means that URL will likely not be displayed in search results because, well, it does not have any content.

That said, meta tag is of course more efficient for that purpose. Note also that for those pages that already exists and are indexed, the removal will require that pages are crawled again before the meta can take effect.

Best regards

Yannick Gaultier

weeblr.com / @weeblr

 

 
Thursday, 19 November 2020 05:34 UTC
system
This ticket has been automatically closed. All tickets which have been inactive for a long time are automatically closed. If you believe that this ticket was closed in error, please contact us.
This ticket is closed, therefore read-only. You can no longer reply to it. If you need to provide more information, please open a new ticket and mention this ticket's number.