CPCWiki forum

Hello guys!


I apologise for the downtime. Getting the system up and running again took longer than expected, so let me give you the story.


The problem
On Saturday our site certificate expired. This should normally not be a problem because Letsencrypt/certbot was set up to auto-renew. Alarm bells went off when this didn't happen and some of you landed on the site to be greeted with stern browser messages about hackers and Elbonians stealing your data.


So, ok, let's renew manually, that's easy, right? Well yes, if you have Letsenrypt installed. In our case, it was gone. Turns out, the OS update we did a while back did not agree with Letsencrypt and it was removed.


So, ok, let's update the server, right? Right. And that's what was done, down to the kernel. Except the new OS version came with PHP7, and our forum version did not support PHP7 (in fact that was one of the reasons we had stayed back a few versions).


So, ok, let's update the forum software! Have done this dozens of times over the years, this should be a breeze (actually started doing it on my mobile during a grocery run). But no! It shouldn't be that easy, fate decided, and a key file was corrupted. Tracking down that issue alone (which was giving an Error 500 when visiting) took me a whole day. Once understood, it was an easy fix, so last night I finished the installation and put the forum in working mode this morning.


The status
We are now on the latest stable forum software version. Because that was a large update, most of the mods have been removed. Only those that rely on hooks survived, those that depended on changing code, or the manual code changes I had done, are gone. That was inevitable because the installation replaced all modified files with the official ones. More on this later in this post.


A major pain point at the moment: if you look at your browser's address bar you'll see a not-so-friendly URL. Pretty URLs was a mod we had running that provides human-readable URLs, and it'll have to be reinstalled. Not a huge issue by itself, but it means that all URLs that are out there (bookmarks, links from other sites, Google results) give a 404. So that'a  priority.


As a bonus, though, we can now update the wiki software, too. That side is also stale because newer mediawiki versions required more up-to-date platforms. It will take some time because I'll have to be very careful and set up basic functionality like email, but we'll get there.


The Future
Since the discussion we had some time ago about changing platforms did not bear any fruits, we're staying with SMF.


To minimize disruption from OS updates in the future we're looking into making a docker container out of the platform. This comes with its own set of problems but has very specific benefits in managing the forum.


Also: the 2.0 branch of SMF is, by all measures, pretty old-fashioned. There's a 2.1 in the horizon which is much more modern (and has a proper mobile version), which is now at RC4 and is nearing release. Now, we could jump onto it because it looks like it's pretty useable, *but* going from a RC to the stable release later on would cause the loss of any mods, again. So I'm trying to decide what to do...


Current issues/mods
As I said, most mods are missing. Because we have amassed quite a few modifications over the years I'm not sure I remember all of them. Please let me know of any functionality you're missing and I'll put it in the list below along with a status.


Thanks for listening,
T


Mods list (done ones with green)

   
• Pretty URLs
• Likes - won't do as it affects performance in a big way. Will wait for the next release of SMF which includes such functionality as core.
• Mobile theme
• Mentions
• Flags
• Media embedding
• Unread posts (https://www.cpcwiki.eu/forum/unread/?all;start=0 (https://www.cpcwiki.eu/forum/unread/?all;start=0))
• Donations
• Inline attachments

*goes to like the post* Oh wait...  :laugh: :picard2:

Quote from: pelrun on 09:03, 28 September 21
*goes to like the post* Oh wait...  :laugh: :picard2:

Oh right.

Don't worry, these things happen. Thank you very much Gryzor.

Welcome to the Upgrade Hell ... thank you Gryzor!

Likes reinstalled. Worth saying that the upcoming smf version has such functionality built into it so I'm not sure what will happen then.

All good Gryzor, great to have you and the wiki back!
I have to admit I did panic a little when I found the website dead.

Where is the donations button?
I feel like throwing you some moneys after what you went through!

Likes removed from now, causing issues with server performance; will revisit.

Donations mod must be reapplied, but no need really :)

What an adventure!

The forum takes a lot to load now, at least for me.

e.g. this post took 8 secs to get the response. Then the modify was ~500ms. Then the "save" operation 39 seconds.

Just FYI.

Well, I think that now the forum is faster than ever. URLs have returned too, so if you have any bookmarks feel free to try them out!

Testing embeds

https://twitter.com/krakout/status/1442731093342539777 (https://twitter.com/krakout/status/1442731093342539777)

Testing mentions. Paging dr @Bryce (https://www.cpcwiki.eu/forum/index.php?action=profile;u=225) ...

Ok, some mods installed. I've had enough for now, if you run into any issues let me know :)

Quote from: Gryzor on 08:41, 28 September 21Mobile theme

Not sure if that is really a good idea to get it back. Imho it made more problems than it helped. Without it, I can at least fully access the forum with my mobile phone. With the mobile theme I could hardly use it at all.

Donations are back! *kaching*  8)

I think mobile Theme would be nice, right now I got massive differences in text size, buttons below are so small I cannot even read whats on there ...

Quote from: SkulleateR on 14:38, 28 September 21
I think mobile Theme would be nice, right now I got massive differences in text size, buttons below are so small I cannot even read whats on there ...

you can zoom in and out. With the mobile theme, depending on your exact resolution it could happen that elements were completely hidden.

It's a bit annoying to zoom in, but at least you get what you want. But if the element is simply not there, you are doomed.

Mobile view IMO, though lacking in features, offered a pretty nice mobile experience. Sure, every now and then I'd want to use a feature that was missing but basic functionality was there... so you were doing maybe 90% of the stuff you usually do at 100% instead of 100% of features at a 50% ease of use.

Yes, donations are back, thanks so much @pelrun (https://www.cpcwiki.eu/forum/index.php?action=profile;u=1106) !! Much, much appreciated :)

Something I forgot to mention:
At no point was the database at risk. All files had been specifically backed up before I started tinkering with the site (note to self: delete the backup, that's several 10s of GB on the disk), and both files and the db are on a daily rsync job and transferred to an external server as redundancy, with a rotation of several days' worth of backups. As a matter of fact when it became clear a file was corrupted I just pulled the latest backup and fixed it in seconds.


This, just in case anyone was worried.

Now let me ask a question.

The reason it wasn't fixed a bit sooner and indeed the reason why nowadays it takes me a bit more time to do stuff on the server (well, apart from the toddler that climbs on me the moment I enter our home), is that the best times to do such stuff is at work: I have lots of hours in front of a PC so taking a little break here and there is the best opportunity to work on the server.

However, at my current job the wise IT stuff have decided to close all "non-standard" ports, which means that SSH at port 22 (or indeed any other random port) is a no-go. Any ideas how I could access the server with such a restriction in place? Cheers!

What the hell do they consider "standard", then? Lemme guess, only 80 and 443, because anything that isn't web browsing must be hacking  :picard2:
Nobody said you had to send only HTTP over port 80 though...  :laugh: https://daniel.haxx.se/docs/sshproxy.html

Yeah that's their logic, naturally.

But if we do it on 80 then what happens with the web server's 80?

Great to see the site back up! And thanks for all the work that you put in Gryzor on keeping this thing afloat, we all appreciate it!  :)

Quote from: Skunkfish on 16:13, 28 September 21Great to see the site back up! And thanks for all the work that you put in Gryzor on keeping this thing afloat, we all appreciate it! 

Agreed :D

Quote from: Gryzor on 13:17, 28 September 21
Well, I think that now the forum is faster than ever. URLs have returned too, so if you have any bookmarks feel free to try them out!

It is, indeed! Whatever was happening, it is gone now!

Called it on TLS cert issue(deal with that crap regularly lol), great to see the site back, great job @Gryzor (https://www.cpcwiki.eu/forum/index.php?action=profile;u=1)

Thanks for the kind words and the encouragement guys, I mean it🙂

Quote from: Gryzor on 15:04, 28 September 21
Mobile view IMO, though lacking in features, offered a pretty nice mobile experience. Sure, every now and then I'd want to use a feature that was missing but basic functionality was there... so you were doing maybe 90% of the stuff you usually do at 100% instead of 100% of features at a 50% ease of use.

I'd like to add my vote to getting the mobile theme reinstalled. It makes the forum so much more accessible on a casual basis when looking at what new posts have been made. And it was always adaptable that if you needed a bit more functionality you could turn the phone to landscape as I am whilst I type this.

Well it just occurred to me, if you're not a fan of the mobile view then why not turn desktop mode on?

Quote from: Gryzor on 19:47, 28 September 21
Well it just occurred to me, if you're not a fan of the mobile view then why not turn desktop mode on?

I did ... it still applied the same CSS so that elements vanished.

Ahh hah! You're back  :D

When I tried to access the wiki and then the forums several times over the weekend with no change, I feared that the site had suffered big problems.

Thanks @Gryzor (https://www.cpcwiki.eu/forum/index.php?action=profile;u=1) for restoring the site  :) 

Mark

Quote from: eto on 19:50, 28 September 21

I did ... it still applied the same CSS so that elements vanished.

Oh wow I wonder how it does that!

Testing inline attachments....

[attach=1]

...looks like it works?

Quote from: Gryzor on 15:36, 28 September 21
Yeah that's their logic, naturally.

But if we do it on 80 then what happens with the web server's 80?

There's a few ways it can go. Many of them you'll have to set up a second external server that you can run sshd on port 80 or 443, rather than trying to do it all on the cpcwiki machine. A simple Pi at home with some port forwarding on the router is enough. Then you could ssh to the Pi and from there bounce through to wherever.

Quote from: Gryzor on 12:48, 29 September 21Testing inline attachments... ...looks like it works?

My RSS feed rendered it as the following...  :laugh:

nbsp [ You are not allowed to view this attachment ]  nbsp

Yeah well I posted the comment about SSH before actually reading the article (sorry) and I thought it was talking about changing the SSH port. Hence my question.

Yes I've considered such a solution, no Pi needed since I have my NAS running 24/7. However my double NAT structure (don't ask) has been causing troubles with port forwarding...

Never mind though, we'll either do it the Copilot way or try and find a web-based terminal that works well :)

As for the RSS, hm, could be a permissions issue so I'll check, but since this is a complex mod if it's not a permission then it'll be very hard to debug. I'm thinking it has to do with Guest access because your reader is reading the feed as a guest user. If so then logging out and checking out the thread in your browser should give the same result.

I'm not concerned at all by the RSS issues (it still does the job I expect of it), it's mostly posted for amusement.  ;D

Eh, since we're at it ...

I confirmed it's a permissions thing with guests accounts, will find which one to touch.

By God the forum is fast now.

Ahhh, the 'unread' function isn't built-in, that's nuts, the the primary feature of the forum!

@Sykobee (Briggsy) (https://www.cpcwiki.eu/forum/index.php?action=profile;u=100) : no, it *is* built-in, just at a different place (top left, next to your avatar). I had just made it easier to access.


@pelrun (https://www.cpcwiki.eu/forum/index.php?action=profile;u=1106) : ah I remembered why it is so - a while back I disabled attachments for guests because sites outside the wiki were linking directly to the files and that pissed me off.

Cheers. Well done on getting it all fixed, a lot of stress I'm sure!

Can we have "Answers" and "Unread" back please?

What's "answers"?

Quote from: Sykobee (Briggsy) on 15:45, 29 September 21
Cheers. Well done on getting it all fixed, a lot of stress I'm sure!

Haven't cursed so much in a long time😂

Stellar job getting it all back up and running again. Huzzah for Gryzor.

Huzzah! Huzzah!

Erm... ok :D

Ha, we were not the only ones!

https://www.zdnet.com/article/fortinet-shopify-others-report-issues-after-root-ca-certificate-from-lets-encrypt-expires/

AAAAND the font size bug is back :-) Is that due to some add-on or is it part of the main forum software?

It's not back, it never left. However, theoretically if you use the quick reply box under the thread to reply it should not appear because I didn't enable the WYSIWYG editor there.

Oh look, we have reactions! I thought it'd be neat until we get to the next major version that has Likes built-in, but this looks too busy and, frankly, like shite. I can add/remove reactions, so let me know which I should keep (if any).

Quote from: Gryzor on 10:09, 08 October 21
Oh look, we have reactions! I thought it'd be neat until we get to the next major version that has Likes built-in, but this looks too busy and, frankly, like shite. I can add/remove reactions, so let me know which I should keep (if any).

I say keep the thumbs up and remove everything else.

mmm, honestly, I do not like that this is seen in every post, I see it confusing.

Yeah, my thought about removing most of them. But what would the alternative be to "appearing in every post"?

Too many.

Maybe, Funny, Informative, and Thumbs up. All these sum up 99% of topics.

It would be nice if the reaction was not where it is with that big blob border. Maybe if it could be on the right of the comment instead.

Definitely not doing such manual hacks while we're on 'maintain' mode :D Though I agree, the one thing I want to avoid is editing the sources until the upgrade comes.

If people don't like it, away it goes :)

Quote from: Gryzor on 10:32, 08 October 21
Yeah, my thought about removing most of them. But what would the alternative be to "appearing in every post"?

I guess it is a bit "in the way" and it looks a bit like is part of the post itself. It is a bit weird TBH :D

If moving it or doing anything fancy means having to do manual hacks, best leave it as it is.

It currently looks a little odd, but most people will get used to it in it's current position.

However, the animation is the most irritating part for me. Is there an option for a static version?

Mark

Yes, I could upload another icon, but current likes will be lost. Oh well.

I consider "Likes" to be the black plague of this century, and now they're back with a vengeance! :). A big animated icon is a bit too invasive, in my opinion :).

As a member I can use the "Show unread posts since last visit" option but before logging in that option isn't displayed on the screen - so are visitors limited to this uniformity?

Might be a permission somewhere, send me an email and I'll check it out at some point🙂

And yes the animated icon is pretty invasive. Not sure I can easily modify size though, will have to look.