CPCWiki forum

General Category => CPCWiki Discussion => Topic started by: Gryzor on 11:53, 08 June 18

Title: Migrating the forum
Post by: Gryzor on 11:53, 08 June 18
Hello guys!


I've had reports over the past couple of days (today I confirmed them) that the forum has, once more, been exceedingly slow at times.


...I'm giving up. There's nothing on the server to suggest something's amiss and I haven't been able to address the issues.


So, I was thinking, maybe it's time to move on to some other platform?


If so, here are the points we should consider:
-it should probably be a paid-for platform
-it should be possible to import the SMF database to it
-we should cover the costs
-we would lose some functionality we've been accustomed to - for instance, even if the new platform supports Likes and/or Karma etc, we will lose current Likes.


Right now I'm looking at Invision/XenForo(?)/vBulletin.


If anyone has any experience or opinion about those (or others), please let's discuss!


Thanks!
Title: Re: Migrating the forum
Post by: roudoudou on 12:03, 08 June 18
Quote from: Gryzor on 11:53, 08 June 18
So, I was thinking, maybe it's time to move on to some other platform?


I cannot disagree  ;D


IMO the worst thing on this forum is the wysiwyg editor that is absolutly not what you get  >:(


I hope you will keep attached files of every topics
Title: Re: Migrating the forum
Post by: Gryzor on 12:05, 08 June 18
Attachments will *probably* be kept with each post, but as for their position within the posts themselves, I have my doubts.


What's not wys in the editor though?
Title: Re: Migrating the forum
Post by: roudoudou on 12:27, 08 June 18
Quote from: Gryzor on 12:05, 08 June 18
Attachments will *probably* be kept with each post, but as for their position within the posts themselves, I have my doubts.


What's not wys in the editor though?


Very often my messages are screwed up with a tiny tiny tiny font size (why? don't know) I had to re-edit, select all the text and font size, and pray  ;D

Title: Re: Migrating the forum
Post by: Gryzor on 12:54, 08 June 18
I think I have described somewhere when this happens. All you have to do though it clear the formating and it'll be fine.


But anyhow, that's only one of the smaller annoyances...
Title: Re: Migrating the forum
Post by: Shaun M. Neary on 12:57, 08 June 18
I've always found vBulletin the most stable, and with the most options for optimising (databases, etc).

Used IPB (invision) briefly, found it the biggest pile of shit ever.  :laugh:
Title: Re: Migrating the forum
Post by: Gryzor on 13:39, 08 June 18
I tried the IPB demo a bit, seemed nice. But, as always with systems of such complexity, it's not unless you have used it for a while before you start appreciating its pros and cons...


vBulletin is, in my mind, a steady sort-of-behemoth, not without its flaws though. At least it's (I think) a once-off payment.


They also offer ncie cloud hosting plans, but I doubt their bandwidth will fit our size (the disk space certainly won't!).
Title: Re: Migrating the forum
Post by: Shaun M. Neary on 14:44, 08 June 18
Quote from: Gryzor on 13:39, 08 June 18
I tried the IPB demo a bit, seemed nice. But, as always with systems of such complexity, it's not unless you have used it for a while before you start appreciating its pros and cons...


vBulletin is, in my mind, a steady sort-of-behemoth, not without its flaws though. At least it's (I think) a once-off payment.


They also offer ncie cloud hosting plans, but I doubt their bandwidth will fit our size (the disk space certainly won't!).
vBul is definitely a once off payment, and then I think the updates are free for life. Or at least they used to be. I haven't been a forum admin since 2013 so my information could be well out of date.
Title: Re: Migrating the forum
Post by: Targhan on 20:36, 08 June 18
I don't personally care much about the sometimes-slowness of this forum. But pleeeeeease make sure the new forum, if there is one, is nice looking and nice to use. Some very known websites changed their design/forum/whatever and they LOST many users because they didn't like the new design, or simply got lost. Habit is a dangerous thing on the web!
Title: Re: Migrating the forum
Post by: Gryzor on 16:07, 09 June 18
Sooo, bad news. I asked vBulletin about migration options and they had this to say:


Quote


Hello,

Unfortunately there is no importer to go direct from SMF to VB5. What you may be able to use is a free open source importer called Impex to import from SMF to vBulletin 4.x and after the import, assuming everything is working, you can then upgrade to VB 5.x. However you would need to purchase the vBulletin license to know if this would work and there would be no refund once you download the software. I understand this is a major issue for someone in your position and we have no great solution.

Other options are 3rd party conversion services listed below- we do not endorse either but we know other customers have used them with success in the past-

http://gconverters.com/ (http://gconverters.com/)
https://cms2cms.com/ (https://cms2cms.com/)

You can learn more about Impex here: https://www.vbulletin.com/forum/forum/vbulletin-4/vbulletin-impex-import-system/4045829-impex-how-and-where-to-download (https://www.vbulletin.com/forum/forum/vbulletin-4/vbulletin-impex-import-system/4045829-impex-how-and-where-to-download)

The online demo is here but you cannot import into it: https://www.vbulletin.com/en/vb5-trial/ (https://www.vbulletin.com/en/vb5-trial/)





Ideas?
Title: Re: Migrating the forum
Post by: ComSoft6128 on 16:23, 09 June 18
What would be the cost for this?
Title: Re: Migrating the forum
Post by: Gryzor on 16:26, 09 June 18
Depends on the target platform. For vBulletin, it's $249 for the base version and $399 for the base+mobile suite.


The conversion service first mentioned in my quote is $100.


Others vary, but in general we're talking a few hundred euros...
Title: Re: Migrating the forum
Post by: pelrun on 17:07, 09 June 18
I'm currently in the middle of the Switch On 2018 demoparty, trying to hack together a prod, and the forum goes down for ages! Aaaaaugh!  :picard2:


Thanks for getting it back up :)
Title: Re: Migrating the forum
Post by: Shaun M. Neary on 18:52, 09 June 18
I do have an idea. You could probably find a cracked version of VB4 and install it in a separate directory and see if those converters work before you shell out hundreds for VB5 only to find it still won't work. Obviously remove the cracked version before installing the proper version if you go that route.

Not ideal, but how else are you going to find out if it works or not?
Title: Re: Migrating the forum
Post by: Gryzor on 19:05, 09 June 18
@pelrun (http://www.cpcwiki.eu/forum/index.php?action=profile;u=1106) : apologies mate :( Had to put it in maintenance mode - seems ok for now, but if it happens again do drop me an email and I can try to set you up with some special access (not sure if possible, but I can try).


@Shaun M. Neary (http://www.cpcwiki.eu/forum/index.php?action=profile;u=728) : yeah, thought about it, too. But I'm weary of installing it on our production server - and this would mean setting up a VM, copying everything over and doing it. Doable, but it'd take quite a bit of time...


Such a pity they don't offer trial versions any more!
Title: Re: Migrating the forum
Post by: reidrac on 20:55, 09 June 18
I don't think this is going to help, but I've used Discourse a bit in some projects and I liked it; but I see that is a quite "modern" experience that some folk here may not like.

It is open source, further info: https://en.wikipedia.org/wiki/Discourse_(software) (https://en.wikipedia.org/wiki/Discourse_(software))

My two cents!
Title: Re: Migrating the forum
Post by: Fessor on 21:04, 09 June 18
what about the memory? maybe the timeouts are caused by the memory sometimes running out and the server starts to swap?

Title: Re: Migrating the forum
Post by: ASiC on 22:20, 09 June 18
What about phpBB on AWS?
You can launch it on a free tier account (even on a t2.micro ec2 instance) and do some testing.
If/once happy, you can take it to production and size it up accordingly.


Where is the current BB hosted on?
Title: Re: Migrating the forum
Post by: Gryzor on 06:25, 10 June 18
@reidrac (http://www.cpcwiki.eu/forum/index.php?action=profile;u=1504) : I like Discourse myself, but as you said its approach is quite 'modern'.  Plus I don't really know much about it, but this could change I suppose :D If people say they like it (you can try it at https://try.discourse.org ) I may consider it since it seems I can migrate the data to it!


@Fessor (http://www.cpcwiki.eu/forum/index.php?action=profile;u=1495) : no, memory is ok. It's always 'something' that causes the CPU to spike. The problem is, I can't nail it down; one time it's this query, the other that one, this subsystem, that module... drives me crazy.


@ASiC (http://www.cpcwiki.eu/forum/index.php?action=profile;u=22) : moving to a cloud hosting would be akward. Indeed, I briefly thought about letting someone else manage our forum serving, but that would leave the wiki itself out... Also, isn't phpBB old news?


We're currently on our own bare metal server, btw.
Title: Re: Migrating the forum
Post by: reidrac on 07:39, 10 June 18
Quote from: Gryzor on 06:25, 10 June 18
@reidrac (http://www.cpcwiki.eu/forum/index.php?action=profile;u=1504) : I like Discourse myself, but as you said its approach is quite 'modern'.  Plus I don't really know much about it, but this could change I suppose :D If people say they like it (you can try it at https://try.discourse.org ) I may consider it since it seems I can migrate the data to it!

Is not only a modern UX, it is also modern regarding operations: it is deployed using docker.

So I guess it may have a learning curve if you're not into the new stuff.
Title: Re: Migrating the forum
Post by: Gryzor on 08:48, 10 June 18
Ah, that does it :( I've dabbled with dockers but I'm nowhere near proficient enough. I wouldn't want to learn with our forum!


Also, from a structure point of view - it seems that the Discourse docker requires its own domain. I could place in on a subdomain, but then I'd have to 301 *every* page from here. It'd be challenging, to say the least, not only doing it (since I doubt SMF<->Discourse URLs are one:one) but also successfully implementing it from an SEO point of view.


Sooo I guess Discourse's out; pity, I'd love to try it.
Title: Re: Migrating the forum
Post by: AMSDOS on 11:44, 10 June 18
@Gryzor (http://www.cpcwiki.eu/forum/index.php?action=profile;u=1) don't want you to take it personally, as a precaution I was able to transfer many of the Bookmarked threads I've built over the years by using the Print Option and Exporting as PDF, just in case.
Title: Re: Migrating the forum
Post by: Docent on 12:04, 10 June 18
Quote from: Gryzor on 06:25, 10 June 18

@Fessor (http://www.cpcwiki.eu/forum/index.php?action=profile;u=1495) : no, memory is ok. It's always 'something' that causes the CPU to spike. The problem is, I can't nail it down; one time it's this query, the other that one, this subsystem, that module... drives me crazy.

What system is on the server? Linux, FreeBSD?
I had similar problem on Linux and it was caused by read/write disk error/disk failure. Is there anything interesting in logs around the time it happens ?

Title: Re: Migrating the forum
Post by: Gryzor on 15:22, 10 June 18
It's an Ubuntu system, but no, I never noticed a hardware issue...
Title: Re: Migrating the forum
Post by: gerald on 16:21, 10 June 18
Could it be a some king of garbage collection happening somewhere ?
database ?
web server ?
syslog/journald ?
Title: Re: Migrating the forum
Post by: Gryzor on 16:49, 10 June 18
As I said above (I think), looks like SQL is having trouble with some queries, no matter how much allowance it is given. Slow queries are different every time and there's no discernable pattern...
Title: Re: Migrating the forum
Post by: Poliander on 17:03, 10 June 18
Quote from: Gryzor on 16:49, 10 June 18
As I said above (I think), looks like SQL is having trouble with some queries, no matter how much allowance it is given. Slow queries are different every time and there's no discernable pattern...
Enable logging dead locks and slow queries
Title: Re: Migrating the forum
Post by: Gryzor on 17:56, 10 June 18
Logging slow queries led to the non-conclusion described above ;)


As for deadlocks, I think I had at some time or another and found nothing of use. But they should be taken care of if and when we move over to innodb - which is a whole different chapter that kinda scares me.
Powered by SMFPacks Menu Editor Mod