Anyone have the solution to getting your posts indexed by spiders. I know the problem is with th "?" and the solution probably quite involved.<br /><br />Any takers? :)<br /><br />Jay<br /><A HREF="http://wwlive.net" target="_new">http://wwlive.net</A><br /> Online Magazine ala Controversial

I'm not sure that w3t posts can be indexed like that, due to their dynamic nature... that is, they are stored in the database until the perl script to display them on the users browsers... it's not like other systems that store the posts in html or flat-file format....<br /><br />Sorry!<br /><br />Matt<br /><br />

I would suggest creating a robots.txt file in your server root dirctory with a "disallow" line pointing to your wwwthreads path. <br /><br />[:red]<br /># go away<br />User-agent: *<br />Disallow: /cgi-bin/wwwthreads # point to your wwwthreads directory.<br /></font color=red><br /><br />This should work for most robots. I have testing it with our robot and it works,but sadly a few robots only work with META tags. <br /><br />The problem is that META tags need to be in the page header. I do not think you can do this with wwwthreads with out hacking the perl code. The header in the includes directory, comes after the html pages header so META tags will not work in this file. Maybe this is a feature that can be added.<br /><br />[:red]<br /><META NAME="ROBOTS"<br /> CONTENT="ALL | NONE | NOINDEX | NOFOLLOW"><br /></font color=red><br /> default = empty = "ALL"<br /> "NONE" = "NOINDEX, NOFOLLOW"<br /><br /> The filler is a comma separated list of terms:<br /> ALL, NONE, INDEX, NOINDEX, FOLLOW, NOFOLLOW.<br /><br /> Discussion: This tag is meant to provide users who cannot control<br /> the robots.txt file at their sites. It provides a last chance to<br /> keep their content out of search services. It was decided not to<br /> add syntax to allow robot specific permissions within the meta-tag.<br /><br /> INDEX means that robots are welcome to include this page in<br /> search services. <br /><br /> FOLLOW means that robots are welcome to follow links from this<br /> page to find other pages.<br /><br /> So a value of "NOINDEX" allows the subsidiary links to be explored,<br /> even though the page is not indexed. A value of "NOFOLLOW" allows the<br /> page to be indexed, but no links from the page are explored (this may<br /> be useful if the page is a free entry point into pay-per-view content,<br /> for example. A value of "NONE" tells the robot to ignore the page.<br /><br />-Ken Torbeck [:blue]WWW.INFOSITE.</font color=blue>[:red]ORG</font color=red> Special Needs & disAbilities Info. Center