NOARCHIVE
At a weblogger's request, I've implemented the NOARCHIVE meta-tag explained here:
http://www.archive.org/robotexclusion.html
You place the NOARCHIVE meta-tag in any document that you don't want Daypop to cache. The name of the Daypop crawler is:
DAYPOPBOT
The tags are case-sensitive so you need to ALL CAPS the name and the content field.
 |
Comments disabled.
One day...
...but that's not a high priority right now. There are some Daypop problems that need to be addressed and then some features still to be added. I'd love to create something in the future that was database driven that could list by language, country, topic (maybe), etc in addition to alphabetically. I'd also like to figure out a way to get webloggers to provide this meta-information, probably in the form of meta-tags.
List of sources
Nothing to do with your latest post Dan.
Today I found out that the NME (leading British music mag) does not seem to be included in daypop. It would be easier to spot which news and weblog sites are missing if there would be the complete list online. Probably split on separate pages (e.g. A-Z) as 5,100 links on one page are a bit too much. Just my 2ct.
Alex
