CPCWiki forum

General Category => CPCWiki Discussion => Topic started by: Octoate on 13:29, 06 April 10

Title: CPCWiki forum RSS feed
Post by: Octoate on 13:29, 06 April 10
Hi,
I just noticed that the RSS feed of the CPCWiki forum publishes all the email-addresses of those who submitted a post. You should change that immediatly if you want to prevent spammbots to spam the users of the forum.

Edit: It seems that the email address is only published, if the setting is enabled in the account settings... Maybe this should be disabled by default!?
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 16:50, 06 April 10
Ehm... that's really weird. At this moment, I can't get the RSS feed, I get this error:
Quote
XML Parsing Error: XML or text declaration not at start of entity
Location: http://www.cpcwiki.eu/index.php?title=Special:RecentChanges&feed=atom
Line Number 1, Column 2: <?xml version="1.0"?>
-^

However, I'm looking at the posts that I have already downloaded through RSS and I can't find an email address... how do you see it?
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 22:35, 06 April 10
Well, I see the mail addresses in the feedreader of my webbrowser (Opera 10.51). You can also have a look at the XML code of the RSS feed and you will see, that the mail addresses are within the author-tag.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 07:46, 07 April 10
I don't get it... both at home and here at work, with O10.51 and FF I get the same error I described above...

At the same time, FeedDemon and Google Reader seem able to read the feed just fine, but they don't give me any email addresses... would it be easy for you to take a screenshot to demonstrate exactly what you mean?

Thanks!
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 09:45, 07 April 10
No problem.

I attached two images: The first shows the feedreader in Opera and the second one the sourcecode of the feed. As you can see, you can't see the email address of all users.


Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 09:50, 07 April 10
Ahhh I see.

I can't, for the love of it, understand why I can't parse the RSS xml but I'll look into it.

Btw, which setting did you refer to? Is it the "allow users to email me" option?


AAAARGH! I just noticed you're talking about the forum, not the wiki itself! Grmpf! Still, which option are you referring to?
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 11:41, 07 April 10
Quote from: Gryzor on 09:50, 07 April 10
Btw, which setting did you refer to? Is it the "allow users to email me" option?
Yes, I guess, that this could be the option which could cause this behaviour.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 08:09, 08 April 10
Unfortunately there seems to be no easy or obvious way to set the option off by default... So I guess we must rely on the users not publicizing their email...
Title: Re: CPCWiki forum RSS feed
Post by: nocash on 17:06, 08 April 10
>> Is it the "allow users to email me" option?
> Yes, I guess, that this could be the option

Why do you say "could"? Didn't you try that?

The option is a nice thing, allowing to reach people even they aren't visiting the forum. Would be a pity to have to disable it.
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 18:53, 08 April 10
Quote from: nocash on 17:06, 08 April 10
>> Is it the "allow users to email me" option?
> Yes, I guess, that this could be the option
Why do you say "could"? Didn't you try that?
The option is a nice thing, allowing to reach people even they aren't visiting the forum. Would be a pity to have to disable it.
Well, I don't like to publish my mail address with every posting. I get enough spam every day - if someone would like to contact me, (s)he can register here and send me an PM. It was the first option which I disabled in my profile when I signed up.
Title: Re: CPCWiki forum RSS feed
Post by: nocash on 19:29, 08 April 10
The email option isn't intended to "publish" email addresses. It works like this: People can click on "Octoate" (shown in the upper-left of your posts), bringing them to your Profile Info. If the email option is enabled, then there should be a "send email" button...

The message is entered in a browser template, without showing your email address at all, so in that template it should be 100% proof that nobody could see your address (unless you decide to reply to the message).
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 19:59, 08 April 10
Maybe you should have a look at what I wrote at the beginning of this thread and the screenshots. Even your mailaddress is fully visible in the RSS feed (which will be indexed by webcrawlers for sure). My address is invisible in the RSS feed...
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 07:53, 09 April 10
I don't think RSS feeds are crawled - never heard of it actually. But I'm still trying to figure out how to disable it. It's not only a forum issue, it's got something to do with the RSS XML specs...

As a side-note: with Gmail, if any of you is using it, it used to be so that if you had an address of, say, spamme@gmail.com and you sent an email to spamme+dumdidum@gmail.com it will still end in your email inbox.

The difference is, you can then very easily archive this and any other such pseudo-labels. So, for instance, you could register here with myemail+cpcwiki@gmail.com and then redirect all such incoming email to a specific label. Why this is useful, aside from obvious categorization reasons? Because you can check for spam. If someone sent you spam to your "+cpcwiki" email you'd know it was harvested from here!  In general, you can know where your email address has leaked from...
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 09:33, 09 April 10
Quote from: Gryzor
I don't think RSS feeds are crawled - never heard of it actually. But I'm still trying to figure out how to disable it. It's not only a forum issue, it's got something to do with the RSS XML specs...
In times where spammers break captchas with OCR to register at forums or send mails this seem to be obvious ;).
For the specification: It is suggested, that the author field includes the mail, but it mustn't - otherwise the forum RSS feed is malformed anyway (as it is missing the author field completly in some entries).

Quote from: Gryzor
...
obvious categorization reasons? Because you can check for spam. If someone sent you spam to your "+cpcwiki" email you'd know it was harvested from here!  In general, you can know where your email address has leaked from...
I use Spamgourmet like other users in this forum (I saw that in the RSS feed). It works similar, but stops forwarding mails after a specified amounts of mails.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 09:50, 09 April 10
Never heard of Spamgourmet before, but it looks nice; like every other disposable email address service, but with the username twist. The problem is that it allows up to a maximum number of emails to come in, which is really inconvenient for legitimate sites like ours... so you start missing messages from the system or the admin once the limit has been reached.

Now, on the RSS itself: yes, you're right, I've seen these details, but I've yet to find out where to set things up without breaking the lot of it. I wonder how many people access the forum through RSS anyway? I wouldn't like to disable it altogether...

Btw, while looking around for the RSS thing I found a nice mod that feeds an RSS stream into the forum... so I could, for instance, stream your blog into a subforum if, for some strange reason, you'd like that :)

Quite handy, though!
Title: Re: CPCWiki forum RSS feed
Post by: nocash on 14:03, 09 April 10
> Maybe you should have a look at what I wrote at the beginning of this thread
Yes, yes, I know. You have discovered a nasty bug there.
With "intended" I just meant how it "should" work, if the bug wouldn't be there.
Title: Re: CPCWiki forum RSS feed
Post by: nocash on 20:51, 09 April 10
How does one change the forum skin/style? The "Look and Layout" options don't seem allow to do that. For me, the cpcwiki-forum looks always like cpcwiki-for-unregistered users (small region with text, surrounded by rather useless blue borders). I'd prefer the style used by wikipedia (without borders).

Btw. I've disabled the "Allow users to email me" option 2-3 days ago. If that was causing the problem, then you could see my address until then? And now you can't see it anymore?
Title: Re: CPCWiki forum RSS feed
Post by: Octoate on 21:11, 09 April 10
Quote from: nocash on 20:51, 09 April 10
Btw. I've disabled the "Allow users to email me" option 2-3 days ago. If that was causing the problem, then you could see my address until then? And now you can't see it anymore?
Yep, now it's gone and not longer within the RSS feed.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 11:42, 12 April 10
Quote from: nocash on 20:51, 09 April 10
How does one change the forum skin/style? The "Look and Layout" options don't seem allow to do that. For me, the cpcwiki-forum looks always like cpcwiki-for-unregistered users (small region with text, surrounded by rather useless blue borders). I'd prefer the style used by wikipedia (without borders).


I'm not sure which one you're talking about, since you mention the Forum and wikipedia all at once... so which is it? :)
Title: Re: CPCWiki forum RSS feed
Post by: nocash on 14:26, 12 April 10
Uh, what did I wanted to say? :-)
*  wikipedia has a "mainly text" style by default (with less "blank borders")
*  cpcwiki defaults to "blank borders", but can be reconfigured to "mainly text" style

now the forum:
*  cpcwiki-forum seems to support only "blank border" style (?)

At least, I couldn't find any options to change the forum style or skin. Or is that possible? As far as I understood, Bryce said he has changed the forums skin to "Modern Dark 64" - though maybe he was talking of something different :-)
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 09:21, 13 April 10
Ok, a bit more clear now. But in your previous message the two were mixed :)

I guess the 'blank borders' you mention depend on your resolution, because Wikipedia has some empty borders at my 1650-pixel wide screen... Btw, the Wikipedia skin (and default skin for all mediawiki-based installations) is Monobook. When I installed the new skin there was a discussion as to the optimal width of it, and I think it works pretty ok now...

The forum also scales up nicely to different resolutions as far as I can see, with the default ("Curve") skin. But you can change yours at Profile->Look and Layout. Pretty straightforward :)
Title: Re: CPCWiki forum RSS feed
Post by: genesis8 on 21:05, 17 June 10
Hi,

can I use the RSS feed to show the last x posts of the forum on my web site ?
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 07:55, 18 June 10
Quote from: genesis8 on 21:05, 17 June 10
Hi,

can I use the RSS feed to show the last x posts of the forum on my web site ?

Hello mate!

I'm not sure what you mean - whether you can do it technically (of course you can) or if you're allowed to (of course you are!!!!)?

PS Can I do it too? With your RSS feed, on the wiki's homepage?
PS2 Just read about GBCPC... what's the deal? :( When did the scene become that way?
Title: Re: CPCWiki forum RSS feed
Post by: genesis8 on 10:02, 19 June 10
You can of course use the RSS of the news as you wish.

Hmm, I was able to show the forum rss when tested locally, but when I upload the php code on genesis8.free.fr I just get a :

Warning: MagpieRSS: Failed to fetch http://cpcwiki.eu/forum/index.php?type=rss;action=.xml (HTTP Response: HTTP/1.0 403 Forbidden )

I really dont know why.

Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 10:59, 19 June 10
Hmmm this is interesting. Can you post the code you use? Maybe it's got something to do with the referrer, will look into it!

I'm looking to incorporate rss news into the homepage, so thanks :)
Title: Re: CPCWiki forum RSS feed
Post by: Nich on 15:30, 20 June 10
Quote from: Gryzor on 07:55, 18 June 10PS2 Just read about GBCPC... what's the deal? :( When did the scene become that way?
I only learnt about this last Friday. :( Loïc, the maintainer of GBCPC, has posted a notice on the main GBCPC web site (http://www.cpc-power.com/gamebasecpc/) explaining the reasons behind his decision.
Title: Re: CPCWiki forum RSS feed
Post by: genesis8 on 21:05, 20 June 10
I use Magpie RSS (you can download it here : http://sourceforge.net/projects/magpierss/files/), very simple to use :

require('rss_fetch.inc');
$rss = fetch_rss($url);
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 08:45, 21 June 10
Hm, can you do me a favor? Do you have a page online with that code? If not, can you create one and give me the url?
Title: Re: CPCWiki forum RSS feed
Post by: genesis8 on 21:43, 21 June 10
Initially it was http://genesis8.free.fr/index.php, but I had to reverse, but you can test it at http://genesis8.free.fr/indexwiki.php
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 12:53, 22 June 10
I see two separate errors:

The one you mentioned:
Warning: MagpieRSS: Failed to fetch http://cpcwiki.eu/forum/index.php?type=rss;action=.xml (HTTP Response: HTTP/1.0 403 Forbidden ) in /mnt/160/sda/1/7/genesis8/magpierss072/rss_fetch.inc on line 238

and, indeed
Warning</b>:  Invalid argument supplied for foreach() in <b>/mnt/160/sda/1/7/genesis8/indexwiki.php</b> on line <b>152.

I wonder what's on these lines??
Title: Re: CPCWiki forum RSS feed
Post by: genesis8 on 21:01, 22 June 10
As the fetch didnt work, the for each cant show the RSS data, quite normal :

foreach ($rss->items as $item) {
  $href = $item['link'];
   $title = $item['title'];
   echo "<li><a href=$href>$title</a></li>\n";
}
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 08:05, 28 June 10
Still looking into it.. I have asked for help in the forum's forums (ahem), let's see if anyone's got any idea.

Cheers
T
Title: Re: CPCWiki forum RSS feed
Post by: remax on 09:48, 28 June 10
While you're at it, can you set the rss feed at more than the last 5 new posts? (say at least 10)

Thank's in advance :)
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 10:14, 28 June 10
That's an easy one - it's already there, and it's customizable by you; just add the following to the end of the URL you choose to parse:


;limit=xx


5 is both the default and the minimum, but you can specify, for instance:
http://cpcwiki.eu/forum/index.php?type=rss;action=.xml;limit=100

This will give you 100 posts.

And, by the way, I've upped the character limit from 255 to 350, what do you think about that?

Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 10:20, 28 June 10
While we're at it:

All of the XML content is accessed via the ".xml" action...
Other   formats can be achieved by adding one of the following to the URL:
;type=atom   - Atom (http://en.wikipedia.org/wiki/Atom_%28standard%29)
;type=rdf - RDF (http://en.wikipedia.org/wiki/Resource_Description_Framework)
;type=rss - RSS   0.91
;type=rss2 - RSS 2.0

The default feed is the 5 most recent   posts:
http://cpcwiki.eu/forum/index.php?type=rss;action=.xml (http://cpcwiki.eu/forum/index.php?type=rss;action=.xml)

There   are several "sub-actions" available to this action, specifying exactly   what to display:

Recent Posts (displays the most   recent posts that you can see)
"Sub-action": recent
Default:   Shows 5 most recent posts
Available options:
limit=x - display the   "x" most recent posts (if number is less than 5, it will display 5. If number   is larger than 255, it will display 255).
board=y - display only the   recent posts from board "y"
boards=x,y,z - display only the recent   posts from the specified boards
c=x or c=x,y,z - display only the   recent posts from boards in the specified category/categories
Example: http://cpcwiki.eu/forum/index.php?type=rss;action=.xml;sa=recent;board=72;limit=10 (http://cpcwiki.eu/forum/index.php?type=rss;action=.xml;sa=recent;board=72;limit=10)

News   (displays the first post from the most recent topics that you can see)
"Sub-action":   news
Available options:
limit=x - display only "x" items
board=y   - display only news topics from board "y"
boards=x,y,z - display   only news topics from the specified boards
c=x or c=x,y,z - display   only news topics from boards in the specified category/categories
Example: http://cpcwiki.eu/forum/index.php?type=rss;action=.xml; (http://cpcwiki.eu/forum/index.php?type=rss;action=.xml;)
sa=news;board=72;limit=10 (http://www.simplemachines.org/community/index.php?action=.xml;sa=news;board=72;limit=10)

Members   (displays most recent members):
"Sub-action": members
Available   options:
limit=x - display only the "x" most recent members
Example:
http://cpcwiki.eu/forum/index.php?type=rss;action=.xml; (http://cpcwiki.eu/forum/index.php?type=rss;action=.xml;)sa=members;limit=10 (http://www.simplemachines.org/community/index.php?action=.xml;sa=members;limit=10)

Profile   (displays the "profile summary" data in a nice XML feed for the   specified user)
"Sub-action": profile
Required option:
u=x -   display the profile info for user whose ID is "x"
Example:
http://cpcwiki.eu/forum/index.php?type=rss;action=.xml; (http://cpcwiki.eu/forum/index.php?type=rss;action=.xml;)sa=profile;u=150 (http://www.simplemachines.org/community/index.php?action=.xml;sa=profile;u=150)

Also, have you tried using CaRP (http://www.geckotribe.com/rss/carp/)?
Title: Re: CPCWiki forum RSS feed
Post by: remax on 10:22, 28 June 10
Thanks i didn't knew that. It's perfect!

For the character limit, well, personnaly i click directly on the title to see the post here, but it can't do no harm to have a higher limit i think (eventhough of course, it is still not enough to see some post entirely, but as i said it doesn't bother me).
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 11:49, 28 June 10
I think it may cause problems with some programs that aggregate feeds - like desktop widgets or IM proggies - that expect short texts, but otherwise it's ok.

Btw, I just noticed I've been talking to a different person :D Welcome then, remax (the real estate firm???)!!
Title: Re: CPCWiki forum RSS feed
Post by: remax on 14:25, 28 June 10
Thanks... well in fact remax has nothing to do with this firm. It is a contraction of two names (mine and my brother's) that i use as a nickname for ages. In france, noone knows this firm, but i learnt  about it when i first posted on forums where there are north american people, as it seems it is quite known there :D

But i'm going off topic  :P
Title: Re: CPCWiki forum RSS feed
Post by: genesis8 on 21:36, 07 August 10
Dont ask me why, but magpie RSS code now works when the page is online, not just when I test locally on my computer. So it's now added on both english and french main page of my web site.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 10:41, 08 August 10
Heheheh :D

Truth is, I tried finding some help on the forum's fora (er....), but noone had much of an idea... glad it's now working!
Title: Re: CPCWiki forum RSS feed
Post by: Grim on 03:57, 09 August 17
Not sure whether to create a new thread or necroposting. Oh well, necroposting it is! Muahaha!

I'm using the Recent Posts RSS feed but noticed it is frequently missing posts. I suspect it might be related to that other "forum grind to a halt" problem, but just in case it is something else, just reporting it here.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 15:58, 09 August 17
Ok, Necro Grim :D


This shouldn't happen. Even if the site went down for two weeks, assuming your RSS puller doesn't have very strict limits (like, in minutes) it shouldn't really matter... it just asks to fetch all the items since the last fetch or (in other cases) the last x items. So in both cases downtime shouldn't affect...


What RSS aggregator do you use?
Title: Re: CPCWiki forum RSS feed
Post by: Grim on 17:20, 09 August 17
I'm using FreshRSS (https://freshrss.org/). It's working OK on a bunch of other feeds I follow but, for some reasons, seems to be missing several posts a day on the feed here. Anyway, if the problem is on my end, I will get the candles and goat blood ready tonight! =)
Title: Re: CPCWiki forum RSS feed
Post by: Dubliner on 18:32, 09 August 17
Actually i have the same problem since forever. I use feedly.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 10:47, 10 August 17
Can you both give me the RSS address you're using?
Title: Re: CPCWiki forum RSS feed
Post by: Grim on 11:30, 10 August 17
Here : http://www.cpcwiki.eu/forum/.xml/?type=rss&limit=30
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 11:56, 10 August 17
Well, with limit=30 you're certain to miss posts when there's more of them...
Title: Re: CPCWiki forum RSS feed
Post by: Grim on 12:06, 10 August 17
The feed is fetched every hour. There are more than 30 posts / hour sometime? Darn!
I'm going to up the limit for a while. Will report back if it does not solve the missing posts issue.

Thanks!
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 12:37, 10 August 17
Normally, no, but it could happen - some threads seem to be on fire some times with reply after reply...


Let me know how it goes after you've changed it and if it persists I'll monitor it and let's cross-check our notes!
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 08:48, 18 August 17
Hey guys, do try the RSS icons next to each subforum at http://www.cpcwiki.eu/forum/forum/ :)
Title: Re: CPCWiki forum RSS feed
Post by: robcfg on 09:06, 18 August 17
I've never used RSS so all I can say is that I get a XML file which looks well formed, when I click on the RSS icons.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 09:13, 18 August 17
Heh :) Yes, I did check the xml, it appears valid so it should work... thanks!
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 08:31, 19 August 17
Check out the RSS feed icons next to each board's name in the main menu :)
Title: Re: CPCWiki forum RSS feed
Post by: AMSDOS on 12:19, 19 August 17
Quote from: Gryzor on 08:31, 19 August 17
Check out the RSS feed icons next to each board's name in the main menu :)


I subscribed to the Programming one, so I can see those when I click on the "@" symbol on the sidebar menu.
Title: Re: CPCWiki forum RSS feed
Post by: Gryzor on 16:55, 19 August 17
No idea what the "@" symbol refers to, I guess it's a browser thing, but as long as it works I'm happy :)
Powered by SMFPacks Menu Editor Mod