• Home
  • Get help
  • Ask a question
Last post 4 hours 8 min ago
Posts last week 141
Average response time last week 4 hours 42 min
All time posts 67794
All time tickets 10475
All time avg. posts per day 21

Helpdesk is open from Monday through Friday CET

Please create an (free) account to post any question in the support area.
Please check the development versions area. Look at the changelog, maybe your specific problem has been resolved already!
All tickets are private and they cannot be viewed by anyone. We have made public only a few tickets that we found helpful, after removing private information from them.

#6991 – Build a bulk import file

Posted in ‘sh404SEF’
This is a public ticket. Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.
Saturday, 07 March 2020 18:13 UTC
Syed
Hello Team,

I am writing to seek your help to build a bulk import file to make SEF URLs. I have tried the following steps:

1. Saved the export
2. Opened it in Excel
3. Added the new entries and saved a file as .csv
4. Tried import but failed

- I tried to save it as CSV UTF-8; however, I had no luck.
- Tried to save in .xls and xlsx and .csv, however, all these formats failed to import
- I tried to follow the guideline mentioned here, however, could not make an import friendly file.
- I tried adding double quotes around each cell and then saved it as .txt, .csv, but still had no luck.

I have several URLs in the planning stage, and bulk import would be a great option to speed up the work. I am requesting your expert help to build an import friendly file where our focus is mainly on four fields, i.e., Non-SEO Link, SEF Link, Page Title, and Description tag.

I am attaching an excel file with some sample data inside. Kindly help us to achieve this.

I am looking forward to hearing from you soon.

Best Regards,
Syed H
Monday, 09 March 2020 11:13 UTC
wb_weeblr
Hi

Unfortuntaly Excel is real bad at building CSV files. Here is what I can comment:

- File should be a .csv
- It should have comma to separate items on the same line
- It should have double-quote to enclose each items on the same line

In the past, I have noticed that LibreOffice was better at producing CSV. For all these reasons, we're hoping to switch to directly using Excel files within a version or 2 as there are now reliable libraries to read and write those files. Unfortunately, this is planned over the few next weeks, not immediately.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Monday, 09 March 2020 13:24 UTC
Syed
Dear Yannick,

Thank you for your humble advice and valuable information. I will certainly try the LibreOffice. I have a few additional questions

1. If I want to update only four fields, say, Non-SEO Link, SEF Link, Page Title, and Description tag.
2. Now if I have imported Non-SEO Link, SEF Link and later I would like to import their respective Page Titles, and Description tags will my import of these two fields will amend or do I have to upload all fields together.
3. If I upload the same set of data again i.e. Non-SEO Link, SEF Link, Page Title, and Description tag with slight changes, will it overwrite the existing sets?

Kindly help.

Best Regards,
Syed H
Monday, 09 March 2020 14:00 UTC
Syed
Dear Yannick,

I was able to prepare the import compatible file, however, I cannot import it successfully. It says,

There was an error inserting a record in the database. This happened with record #2870 of the import file. Please double-check the file content and try again! Many times, the reason for such error is that the record already exists in the database. Either remove it from the database, or from the import file.


I tried to add the next number in the series i.e., I had 2869 URLs, so I added 5 links to test starting the "Nbr" value from 2870, however, I keep getting this error, [attached screenshot for reference].


I am certain that these records do not appear in the set of existing links, however, I still get the above error. Please advice.

Best Regards,
Syed H
Monday, 09 March 2020 14:12 UTC
wb_weeblr
Hi

1. If I want to update only four fields, say, Non-SEO Link, SEF Link, Page Title, and Description tag.

2. Now if I have imported Non-SEO Link, SEF Link and later I would like to import their respective Page Titles, and Description tags will my import of these two fields will amend or do I have to upload all fields together.
All fields have to be uploaded together, in the same file.

3. If I upload the same set of data again i.e. Non-SEO Link, SEF Link, Page Title, and Description tag with slight changes, will it overwrite the existing sets?
Yes.

I am certain that these records do not appear in the set of existing links, however, I still get the above error. Please advice.
Can't say anything without real data, ie the exact and full line in question.

If it says that, then the non-SEF/SEF pair is most likely here though.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Monday, 09 March 2020 14:20 UTC
Syed
Dear Yannick,

I was able to prepare the import compatible file, however, I cannot import it successfully. It says,

There was an error inserting a record in the database. This happened with record #2870 of the import file. Please double-check the file content and try again! Many times, the reason for such error is that the record already exists in the database. Either remove it from the database, or from the import file.


I tried to add the next number in the series i.e., I had 2869 URLs, so I added 5 links to test starting the "Nbr" value from 2870, however, I keep getting this error, [attached screenshot for reference].


I am certain that these records do not appear in the set of existing links, however, I still get the above error. Please advice.

Best Regards,
Syed H
Monday, 09 March 2020 14:22 UTC
wb_weeblr
Hi

Can't say anything without real data, ie the exact and full line in question.



If it says that, then the non-SEF/SEF pair is most likely here though.

 
Wednesday, 11 March 2020 15:19 UTC
Syed
I am one hundred percent certain that the URLs I am trying to update are not in the system already. However, I keep getting the error that does not allow me to upload them successfully. [see attached images]

Please help.

Best Regards,
Syed H
Wednesday, 11 March 2020 16:09 UTC
wb_weeblr
Hi

As long as you won't reply to my question, I don't think we can make any progress.



So what's exactly the content of that line in your file?

I would suggest that you also provide 1 or 2 lines before and after that line, just in case. And please do not provide a screenshot. Just copy/paste the content of those lines here.

Lastly, please provide us with superadmin credentials to your website. You can create a temporary account, and delete it afterward, but it must have superuser level, because when I have the content of the line, the simplest thing is probably that I just look at what you already have in your database.

Thanks and regards

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Sunday, 15 March 2020 06:36 UTC
Syed
Hello Yannick,

Thank you for your quick response. Here is the data that I am trying to import:

"Nbr","Sef url","Non sef url","Hits","Rank","Date added","Page title","Page description","Page keywords","Page language","Robots tag","Canonical","Referrer type","Src id"
1,"jobs-in-SRM-Gateway","index.php?search=&location%5B%5D=0&exf_1=SRM Gateway&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147",,,,"Jobs in SRM Gateway","Jobs in SRM Gateway is a page with vacancies in SRM Gateway. If you are looking for career opportunities in SRM Gateway check this page of Job Walkins now. The SRM Gateway careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in SRM Gateway today.","Jobs in SRM Gateway",,,,0,
2,"jobs-in-Adecco-India-Pvt.-Ltd.","index.php?search=&location%5B%5D=0&exf_1=Adecco India Pvt. Ltd.&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147",,,,"Jobs in Adecco India Pvt. Ltd.","Jobs in Adecco India Pvt. Ltd. is a page with vacancies in Adecco India Pvt. Ltd.. If you are looking for career opportunities in Adecco India Pvt. Ltd. check this page of Job Walkins now. The Adecco India Pvt. Ltd. careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in Adecco India Pvt. Ltd. today.","Jobs in Adecco India Pvt. Ltd.",,,,0,
3,"jobs-in-PI-Industries","index.php?search=&location%5B%5D=0&exf_1=PI Industries&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147",,,,"Jobs in PI Industries","Jobs in PI Industries is a page with vacancies in PI Industries. If you are looking for career opportunities in PI Industries check this page of Job Walkins now. The PI Industries careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in PI Industries today.","Jobs in PI Industries",,,,0,
4,"jobs-in-Ujjivan","index.php?search=&location%5B%5D=0&exf_1=Ujjivan&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147",,,,"Jobs in Ujjivan","Jobs in Ujjivan is a page with vacancies in Ujjivan. If you are looking for career opportunities in Ujjivan check this page of Job Walkins now. The Ujjivan careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in Ujjivan today.","Jobs in Ujjivan",,,,0,


Admin Link: https://xxxx.in/administrator/
User: xxxx
Pass: xxxx

Kindly help.

Best Regards,
Syed H
Monday, 16 March 2020 09:23 UTC
wb_weeblr
Hi

OK but are those the lines that break? is this line 2870 plus one or two lines before and after?

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Saturday, 21 March 2020 10:43 UTC
Syed
Dear Yannick,

I am not sure if I am getting your question right. Irrespective of line numbers, it simply does not take the links import. The above links do not exist in the system so far.

Please help.

Best Regards,
Syed H
Saturday, 21 March 2020 14:56 UTC
wb_weeblr
Hi

Irrespective of line numbers,
The line number is the only thing that matters. The import process says that it finds an error in the import file at line 2870 of the file. So I want to know what is the content of line 2870 of your CSV import file because that's where the system says there is an error.

You provided me with line 1, 2, 3 and 4 of the import file but that's not where the importer says there is an error.

So trying to put it in a clearer manner: I want you to tell me what's the content of line 2868, 2869, 2870, 2871 and 2872 of the CSV file you are trying to import.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Sunday, 22 March 2020 12:07 UTC
Syed
Dear Yannick,

I guess I understood the question this time. here is what I did.

1. Opened the SEF URLs section under the component
2. Went to the last page which is 203 [20 in one-page view]
3. Looked up the last value in the first column which was showing 4051
4. Now prepared the file with just two links to import and got the following error:

There was an error inserting a record in the database. This happened with record #4052 of the import file. Please double-check the file content and try again! Many times, the reason for such error is that the record already exists in the database. Either remove it from the database, or from the import file.


Here is the data that I tried to import (These URLs does not exist in the existing set):
"Nbr","Sef url","Non sef url","Hits","Rank","Date added","Page title","Page description","Page keywords","Page language","Robots tag","Canonical","Referrer type","Src id"
4052,"jobs-in-Sanathnagar","index.php?search=Sanath+Nagar&location%5B%5D=0&exf_1=&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147",0,0,"2020-03-22","Jobs in Sanath Nagar, Hyderabad","Jobs in Sanath+Nagar is a page with vacancies in Sanath+Nagar. If you are looking for career opportunities in Sanath+Nagar check this page of Job Walkins now. The Sanath+Nagar careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in Sanath+Nagar today.","Jobs in Sanath Nagar, Hyderabad",,,,0,
4053,"jobs-in-Gachibowli","index.php?search=Gachibowli&location%5B%5D=0&exf_1=&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147",0,0,"2020-03-22","Jobs in Gachibowli","Jobs in Gachibowli is a page with vacancies in Gachibowli. If you are looking for career opportunities in Gachibowli check this page of Job Walkins now. The Gachibowli careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in Gachibowli today.","Jobs in Gachibowli",,,,0,


Am I doing it right or is there something I am not doing correctly, please help me.

Best Regards,
Syed H
Monday, 23 March 2020 11:08 UTC
wb_weeblr
Hi

1. Opened the SEF URLs section under the component

2. Went to the last page which is 203 [20 in one-page view]

3. Looked up the last value in the first column which was showing 4051

4. Now prepared the file with just two links to import and got the following error:
That's not at all what I asked for :) . I asked that you open the CS file that you are using and then just copy line #2870 of it. Nothing to do inside of sh404SEF or Joomla. Just open the CSV file!

Anyway, if the error happens with these 2 lines, I can test that on my local machine and see what happens. It seems to me at least one column is missing i the data (the last one) but I'll get back to you later today after testing.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Monday, 23 March 2020 11:23 UTC
wb_weeblr
Hi

So the problem is indeed with the file format. Please have a look at the file format used when exporting existing URLs:

1 - All fields must be present
2 - All fields must be quoted.

Here is your sample corrected in that way:

"Nbr","Sef url","Non sef url","Hits","Rank","Date added","Page title","Page description","Page keywords","Page language","Robots tag","Canonical","Referrer type","Src id"
"4052","jobs-in-Sanathnagar","index.php?search=Sanath+Nagar&location%5B%5D=0&exf_1=&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147","0","0","2020-03-22","Jobs in Sanath Nagar, Hyderabad","Jobs in Sanath+Nagar is a page with vacancies in Sanath+Nagar. If you are looking for career opportunities in Sanath+Nagar check this page of Job Walkins now. The Sanath+Nagar careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in Sanath+Nagar today.","Jobs in Sanath Nagar, Hyderabad","","","","0",""
"4053","jobs-in-Gachibowli","index.php?search=Gachibowli&location%5B%5D=0&exf_1=&exf_5=-1&exf_4=-1&option=com_jomclassifieds&view=search&Itemid=147","0","0","2020-03-22","Jobs in Gachibowli","Jobs in Gachibowli is a page with vacancies in Gachibowli. If you are looking for career opportunities in Gachibowli check this page of Job Walkins now. The Gachibowli careers is a great way to explore new ways for your career growth. Access this page to check for suitable Jobs in Gachibowli today.","Jobs in Gachibowli","","","","0",""



This corrected file import correctly.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Monday, 23 March 2020 19:07 UTC
wb_weeblr
Syed,

I have made progress today on using Excel files to import data instead of CSV. So I suggest you wait until tomorrow and I'll be able to send you a dev version that can import directly from an XLSX file.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Tuesday, 24 March 2020 10:51 UTC
wb_weeblr
Hi Syed,

So I have now uploaded the latest sh404SEF version onto this online folder.

Please download it from this address and install over your current version.

There will be no change for exporting: you will still obtain CSV file.

However for importing, you should now upload a xlsx file. You can obtain that file by importing or opening the CSV file from the same or an older version of sh404SEF. The make your changes as needed and then save as an xlsx file.

Be sure to keep the exact same column titles as before.

I have tested creating those .xlsx files with both latest Excel version and latest LibreOffice Calc.

Let me know how it goes!

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
Friday, 27 March 2020 07:38 UTC
Syed
Dear Yannick,

Thank you so much for making it possible. It worked like a charm.
May God Bless you with Grace and Mercy all the time ... Amen

Best Regards,
Syed H
Friday, 27 March 2020 11:26 UTC
wb_weeblr
Hi Syed!

Thanks for your kind words! Happy that this new feature makes it easier for you to work with sh404SEF, it was a much needed improvement anyway and certainly an asset now for the component!

Thanks again for trying it, it will be in next release.

Closing this ticket now, feel free to open a new one as needed. If you do so, please mention this ticket number in the new one.

Best regards

Yannick Gaultier
weeblr.com
@weeblr
 
This ticket is closed, therefore read-only. You can no longer reply to it. If you need to provide more information, please open a new ticket and mention this ticket's number.