News:

Printed Amstrad Addict magazine announced, check it out here!

Main Menu
avatar_Gryzor

PLEASE READ: Regarding forum performance issues

Started by Gryzor, 18:06, 17 June 16

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

arnoldemu

#75
Quote from: Bryce on 13:43, 27 June 16
Hey, I just checked too and had 5 pages of drafts??? Why is the system creating drafts at all?

Bryce.
I have 8 pages of drafts.

@Gryzor: I never knew they were there and there is no easy way to delete them except 1 by 1?

Crazy thing is that my drafts seem to repeat. Lots have identical content. I am sure the forum is automatically saving them as I type, but it doesn't need to keep each character I type!
My games. My Games
My website with coding examples: Unofficial Amstrad WWW Resource

Gryzor

Quote from: Grim on 16:09, 24 June 16

       
  • Is there anything clogging up files-system IO when it happens? (eg. backup script or stats/monitoring script)
  • And nothing in the DB's logs would indicate if it is often (re-)building huge index/temp tables? (you might have to change the log level setting and restart the DB to get these information).
  • Try the EXPLAIN command on a query that sometime takes too long to execute.
  • Maybe check if there's no unusual amount of HTTP requests when it happens? (such as h4x0rz scripts brute-forcing the auth to the admin panel or other well-known vulnerabilities)
  • Also the default MariaDB configuration might not be adequate anymore with the growing size/traffic of the forum and would require some tweaking?


Good points. Lemme answer them....

       
  • No, there was monitoring set up but only after the problems appeared (and it was turned off once we saw all we could). Backing the system up happens during the small hours (Europe time), but even then it's not a big deal - it's an rsync basically so not very many changes. Database is backed up in under 30 seconds for both the forum and the wiki, so it's not that either.
  • Nope.
  • didn't offer any insight. Basically we saw that the system was trying, say, to locate one member in the table and add one like to the relevant value. That was all.
  • This used to happen a long time ago, we did put some systems in place, and indeed Apache was shooting up in resource usage. But the problem is not there, the problem is indeed with the database. It's not like the queue gets so big things get clogged up; it's that random queries take very long to execute... so even if it was a kind of DDoS thing, queries should take a reasonable amount of time to execute given the resources allocated.
  • yes, indeed - it got tweaked already :D But the size of the forum is not big enough to cause problems by itself!


Now, congratulations guys, you found the drafts feature :D
Truth be told, it wasn't working properly when I installed it, so I didn't tell people; then, I forgot about it. Probably something I changed made it work!!!

Audronic

@Gryzor


Today Now I was unable to look at a Pm at Exactly 03:00 this morning your time , I was unable to progress until approx. 8 Minutes later.
Hope that this helps


I opened a new Tab and went to the Wiki which took about 10 seconds to open (normally about 1 second) at about 03:08 .


Good luck      ray

Procrastinators Unite,
If it Ain't Broke PLEASE Don't Fix it.
I keep telling you I am Not Pedantic.
As I Live " Down Under " I Take my Gravity Tablets and Wear my Magnetic Boots to Keep me from Falling off.

Audronic

@Gryzor


Is there any progress on getting alerts for Pms etc via email.


Thanks    Ray
Procrastinators Unite,
If it Ain't Broke PLEASE Don't Fix it.
I keep telling you I am Not Pedantic.
As I Live " Down Under " I Take my Gravity Tablets and Wear my Magnetic Boots to Keep me from Falling off.

AMSDOS

Quote from: Gryzor on 14:11, 28 June 16
Now, congratulations guys, you found the drafts feature :D
Truth be told, it wasn't working properly when I installed it, so I didn't tell people; then, I forgot about it. Probably something I changed made it work!!!


Unfortunately I didn't make a note of when these Drafts started occurring, but noticed I have them dating back in 2014.



* Using the old Amstrad Languages :D   * with the Firmware :P
* I also like to problem solve code in BASIC :)   * And type-in Type-Ins! :D

Home Computing Weekly Programs
Popular Computing Weekly Programs
Your Computer Programs
Updated Other Program Links on Profile Page (Update April 16/15 phew!)
Programs for Turbo Pascal 3

Bryce

Mine went from early 2014 to 2016. Haven't had any new ones since I deleted them all though.

Bryce.

Gryzor

Quote from: Audronic on 01:38, 29 June 16
@Gryzor
Is there any progress on getting alerts for Pms etc via email.


No, not yet; first I'll be reinstalling the forum, then I'll deal with email once I know the forum works perfectly...

AMSDOS

Quote from: Gryzor on 12:02, 01 July 16
 


No, not yet; first I'll be reinstalling the forum, then I'll deal with email once I know the forum works perfectly...


I noticed the ignore feature started functioning, unfortunately I cannot give specific date or month, think it started happening in May.
* Using the old Amstrad Languages :D   * with the Firmware :P
* I also like to problem solve code in BASIC :)   * And type-in Type-Ins! :D

Home Computing Weekly Programs
Popular Computing Weekly Programs
Your Computer Programs
Updated Other Program Links on Profile Page (Update April 16/15 phew!)
Programs for Turbo Pascal 3

Gryzor

Hello guys!


Long time no see. Just got back from my vacation and I'm seriously thinking of going back to the island I missed you all.


One of the things I was going to do upon my return was to prepare for the forum re-installation.


However... is it my idea or has been the forum much stabler over the past few weeks?

EgoTrip

Quote from: Gryzor on 15:43, 01 August 16
Hello guys!


Long time no see. Just got back from my vacation and I'm seriously thinking of going back to the island I missed you all.


One of the things I was going to do upon my return was to prepare for the forum re-installation.


However... is it my idea or has been the forum much stabler over the past few weeks?

Not really, it's still really sluggish/unresponsive at times.

1024MAK

It may be perception, but when there is an interesting thread that I want to see or reply to, the forum sometimes appears to take an age to respond.

But if it is just me checking the main page to see what recent activity there has been, it appears to be okay in terms of response.

Looking forward to summer in Somerset :-)

1024MAK

@Gryzor, Oh, nearly forgot, I hope you had a nice holiday :-)
Looking forward to summer in Somerset :-)

SOS

Maybe helpful:
I try to access the forum+site at 7:56 and 8:10 but get no response :(    (UTC+2)

I tried the links:
http://www.cpcwiki.eu/forum/index.php
AMSDOS Memory Map - CPCWiki

Tapatalk doesn't response too

AMSDOS

Quote from: Gryzor on 15:43, 01 August 16
Hello guys!


Long time no see. Just got back from my vacation and I'm seriously thinking of going back to the island I missed you all.


One of the things I was going to do upon my return was to prepare for the forum re-installation.


However... is it my idea or has been the forum much stabler over the past few weeks?


Here & there.


I wasn't sure if you've seen this bug from the Recent Forum Topics, I don't know what's doing it, and I'm unsure if it's rearing it's ugly head on different pages, this screenshot shots Topics 31-37 for example and if I go to Page 5, it continues 41-50, which is leaving a void of unseen Forum Topics.


[attachimg=1]
* Using the old Amstrad Languages :D   * with the Firmware :P
* I also like to problem solve code in BASIC :)   * And type-in Type-Ins! :D

Home Computing Weekly Programs
Popular Computing Weekly Programs
Your Computer Programs
Updated Other Program Links on Profile Page (Update April 16/15 phew!)
Programs for Turbo Pascal 3

1024MAK

I had problems loading the forum home / index page this morning at 06:55 UK time :-(

Mark
Looking forward to summer in Somerset :-)

seanb

It took 9 minutes one night to load the main page and just now 12:55pm it took 2 minutes to access the raspberry pi thread.
Thou shall not question Captain Wrong!

Gryzor

Thanks guys, so it seems the issue remains; I was asking because my monitors didn't warn me about any downtime while I was away. Of course they're not 100% reliable - there's a threshold and they don't check every second, but I usually do get a notification - it seems it was just pure coincidence. Ok, I will do something about it...


@1024MAK : thanks man, yeah, it was awesome :D


@AMSDOS : that's a separate issue, if you want report it somewhere else, though I don't think it's a problem - if you click on '6' it should show '7' and the rest I guess.

||C|-|E||

In my hands I feel that it has been much more stable during the past days, I did not experiment any performance issue. Too bad that this did not happen to all of us  :'(

Dagger

Down time was about 1pm gmt today. Gave up after 25 mins
Life's a bitch. You marry one or two then you die !

Gryzor

Today was just a random fluke on the part of the host, a problem with the account - they solved it as soon as I found out :)

Powered by SMFPacks Menu Editor Mod