ElkArte Community

General => OpenImporter => Topic started by: overscan on December 01, 2014, 02:44:21 am

Title: SMF 2.0 - Elkarte Migration with 19GB of attachments.
Post by: overscan on December 01, 2014, 02:44:21 am
Cloned Prod site to new SMF 2.0.9 instance.

Ran OpenImporter to import to new Elkarte forum.

Updated cloned SMF 2.0.9 Ito  SMF Beta 2.1

Ran attachment maintenance tasks in each forum.

SMF 2.1
Total attachments:104,957
Total size of all attachment directories:19,858,173.58 KB
Total files in current attachment directory:233,433

Elkarte
Total attachments:77,668
Total size of all attachment directories:14,874,542.85 KB
Total files in current attachment directory:153,176

I appear to have lost a bunch of attachments in Elkarte. There are definitely attachments missing when I compare topics,

I will run the openimporter again and see if the missing attachments are present before the maintenance tasks.

On a side note - SMF 2.1 was underwhelming.
Title: Re: SMF 2.0 - Elkarte Migration with 19GB of attachments.
Post by: emanuele on December 01, 2014, 11:31:07 am
Interesting.

Are you using multiple directories for attachments?
If so, what settings?
Title: Re: SMF 2.0 - Elkarte Migration with 19GB of attachments.
Post by: overscan on December 01, 2014, 12:21:19 pm
I wasn't using multiple directories. I have just tested that functionality and it seems to work fine.
Title: Re: SMF 2.0 - Elkarte Migration with 19GB of attachments.
Post by: emanuele on December 01, 2014, 06:27:13 pm
I didn't answer immediately because I'm still trying to figure out good questions to ask.
The theory of the process is:
fetch some attachments from the database
move them
* rinse and repeat until all attachments in the db are processed.
the code doesn't even do any "filtering" on the type of attachments...

Well, let's try with something easy for the moment:
1) could you please go to phpMyAdmin, attachments table and see how many records are there in total and the result of these two queries:
Code: [Select]
SELECT COUNT(*) FROM {db_prefix}_attachments WHERE attachment_type = 0
Code: [Select]
SELECT COUNT(*) FROM {db_prefix}_attachments WHERE attachment_type = 1
of course change {db_prefix} with the one you are using, I guess "smf".
2) could you check how many files are in the attachments directory of your forum?

Quote from: overscan – I wasn't using multiple directories. I have just tested that functionality and it seems to work fine.
Actually I'm quite surprised you managed to reach that amount of attachments with just one directory! :o