Previous Thread
Next Thread
Print Thread
Rate Thread
Page 1 of 2 1 2
#313117 02/11/2007 12:38 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Name: UBB.Sitemaps
Author: James Corthell, VNC Web Services
Requirements: UBB.threads 7.x
Current Version: 20191222
Documentation: Up to date documentation is available at the UBB.Wiki entry UBB.Sitemaps


About:
This addon takes just moments to install, it gathers your forum topic links and exports them as a sitemap that you can add to Google, yahoo, or just about any search engine which utilizes sitemaps.

The configuration options allow you to specify which type of sitemap you wish to use and weather you wish to plugin threaded or flat view. The sitemap type and view type can both be set either hard coded or via url string.

Simply enter the URL to your sitemap install into your Google sitemap list (here) and google will automatically grab copies of your thread links every week.


What are the security aspects?:
Well, the sitemap will ignore threads in private forums (if a guest cannot *see* them then the sitemap will not publish the link). Also, threads that are not approved will not show either (same aspect as above).


What is a sitemap?:
A sitemap will take and provide all of your current threads to search engines, thus eliminating the wait of "new discovery" of new pages on your forums.

You can read about the benefits of using sitemaps via the below quoted article from Google Webmaster Tools.

Please note that this addon does not create a sitemap for your entire site, and only creates one for your forum.


Demo: As this addon doesn't utilize a cache, no active demo is available, however you can see example output via the attachment screen shots.


Install Instructions:
The install is quite simple, after receiving the software via email simply open the php file and place your MySQL connect information where indicated. Now upload the file to your web root (not your forum directory) and then simply open the script via the web and you'll see the default XML (google valid) sitemap.


Usage Instructions:
By default, the script uses flat mode and the XML map. These defaults can be easily changed from within the script itself.

As for web-based switches:
http://www.example.com/sitemap.php?type=&view=&se=
// Optional Parameter -- se=# Where # weather or not to use SE Friendly URLs (0/No, 1/Yes)
// Optional Parameter -- type=# Where # is a map type (1/XML, 2/Text, 3/html, 4/RSS, 5/ASP, 6/SitemapIndex)
// Optional Parameter -- view=# where # is your view type (1/ShowFlat, 2/ShowThreaded)
// Optional Parameter -- offsets=# where # is weather or not to use offsets.


Submissions:
Not all search engines will automagically re-check your sitemap; in fact, I've only noticed that Google will re-check on its own. You'll want to go to Yahoo or anyone else every couple of weeks and tell them to re-grab a copy of your map.


Attachment Information:
sitemap-xml.jpg - An XML map.
sitemap-rss.jpg - An RSS map.
sitemap-text.jpg - A simple "text link list" map.
sitemap-link.jpg - A simple "html link list" map.
sitemap-asp.jpg - An ASP style sitemap.
sitemap-index.jpg - A screen cap of the Sitemap Index feature.


Pricing: $80 per install (each separate install requires a separate license) which includes 1 year of free updates.


How to Buy: You can order via our Script Information page here (there is an order form towards the bottom for PayPal payments).


Notice:
This addon is not freeware, and as such you cannot freely provide it to others without prior written permission from its author(s). Permission was obtained from the UBB.Dev administration to post this non-free addon's information in advance.

Quoting Google's Webmaster Help
What is a sitemap, and why should I have one?
Quote
A Sitemap file lets you tell us about all the pages on your site, and optionally, information about those pages, such as which are most important and how often they change. By submitting a Sitemap file, you can take control of the first part of the crawling/indexing processes: our discovery of the pages.

This may be particularly helpful if your site has dynamic content, pages that aren't easily discovered by following links, or if your site is new and has few links to it.

Sitemaps help speed up the discovery of your pages, which is an important first step in crawling and indexing your pages, but there are many other factors that influence the crawling/indexing processes. Sitemaps lets you tell us information about your pages (which ones you think are most important, how often the pages change), so you can have a voice in these subsequent steps. Other factors include how many sites link to you, if your content is unique and relevant, if we can crawl the pages successfully, and everything outlined in our webmaster guidelines.

A Sitemap provides an additional view into your site (just as your home page and HTML site map do). This program does not replace our normal methods of crawling the web. Google still searches and indexes your sites the same way it has done in the past whether or not you use this program. Sites are never penalized for using this service. This is a beta program, so we cannot make any predictions or guarantees about when or if your URLs will be crawled or added to our index. Over time, we expect both coverage and time-to-index to improve as we refine our processes and better understand webmasters' needs.

Once you have created your Sitemap, you can add it to your Google Sitemaps account and update it as your site changes.

Licensed Sites: 34 (not including my own or ubbdev)
Attachments
2356-sitemap-xml.jpg (167.48 KB, 299 downloads)
2357-sitemap-rss.jpg (175.09 KB, 207 downloads)
2358-sitemap-link.jpg (59.06 KB, 231 downloads)
2359-sitemap-text.jpg (102.18 KB, 224 downloads)
2360-sitemap-asp.jpg (117.76 KB, 230 downloads)


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
1 member likes this: isaac
Sponsored Links
Gizmo #313118 02/11/2007 3:09 PM
Joined: Mar 2000
Posts: 21,079
Likes: 3
I type Like navaho
I type Like navaho
Joined: Mar 2000
Posts: 21,079
Likes: 3
Thanks Gizzy, should be a very worthwhile add-on thumbsup


- Allen wavey
- What Drives You?
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
hehe dankies allen wink... I've pretty much had it in private development and word of mouth for 2 months now; current users rather like it wink...

And eliminating the need for google to "discover" your links is definatley a plus... Helping them along should help get content listed much faster for users :nods:


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #313129 02/12/2007 2:22 AM
Joined: Feb 2002
Posts: 2,286
Veteran
Veteran
Joined: Feb 2002
Posts: 2,286
It would be ideal if it were to list pages, which are not forums, yet use the forum header / footer - i.e. articles.

I have around 200 of these pages, which will grow to 500 very soon.



Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....)
Ian_W #313130 02/12/2007 2:33 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Those are kind of out of scope I think, it's designed to just pull the threads themselves, not forum topic indexes (which will likely be in a future build).

I'd have to see how you're calling these extra pages (header/footer) to be able to give a for sure answer.

I'm pretty sure that I could make an index page which could take all files in a directory and build a sitemap for you; but keep in mind that if it's just a custom header and footer that google won't really care; you're not feeding your content to them, you're simply feeding urls of your threads to them; the feed does not include any post content (as they don't want it).

Another product i'll be coming out with soon is a simple sitemap lister that you can manually enter urls on your site; but I'm working on a couple of other projects until I can get to that.

I've been toying with Curl for building automagic sitemaps, I have something that works for the most part, but you have to think that php has an execute script limit which would make it die prematurely on large sites (or forums for example).


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Sponsored Links
Gizmo #313132 02/12/2007 11:52 AM
Joined: Feb 2002
Posts: 2,286
Veteran
Veteran
Joined: Feb 2002
Posts: 2,286
I am calling the pages with a script, template and php file.



Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....)
Ian_W #313135 02/12/2007 6:47 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
So, they're never actually *called* as their own page?

Keep in mind, literally, all a sitemap is would be the link to a topic/forum; there is no data presant, you're helping google/yahoo/etc with discovery, you're not feeding them content...

Since they're not actually *called* as data for yoru forum by themselves, theres no reason to have them in a sitemap...


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #313263 02/25/2007 11:41 AM
Joined: Oct 2001
Posts: 139
Journeyman
Journeyman
Joined: Oct 2001
Posts: 139
Outstanding!

Since I moved from 6.5 to 7.X Google has all but stopped crawling my threads/topics and as a result the numbber of new members I get has dropped dramatically! I hope this will help (should I decide to buy it)!

Thank!

Basil

Joined: Feb 2007
Posts: 2
Lurker
Lurker
Offline
Joined: Feb 2007
Posts: 2
i went thru all kinds of hell with google indexing my forum once i went to version 7. gizmo made it all beautiful again.... i thank him very much.

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
It turns out that Google allows a maximum of 50k links in a sitemap; so I'm working on v0.2 right now that will allow you to set an offset via the URL so that you can split links up for larger forums.

EX:
ubb.sitemap.php?type=1&se=2&offset=0 - Will display threads 1-25k
ubb.sitemap.php?type=1&se=2&offset=1 - Will display threads 25k-50k

You can set the max offset in the file up to 50k, I put 25k down as a default to help conserve some load.

BTW, this will be enabled by default in v0.2; but you can disable it for the classic behavior of loading everything at once. I've mainly coded this in for large forums lol...

Also, an example of how insanely huge 25-50k threads is... UBBDev only has about 36k threads.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Sponsored Links
Gizmo #313863 04/11/2007 5:21 PM
Joined: Nov 2003
Posts: 329
Beta Tester
Beta Tester
Offline
Joined: Nov 2003
Posts: 329
Google + Gizmo's Site Map smile

I Have recently moved my forums to a new Domain.
So it was important to me to get my site under its new Domain name back into google as soon as i could.

Gizmo has been raving about the site map program he made,
so it thought to my self (He seems like a nice chap)
I think i will give it a go and see if it really does work.

The answer is YES smile

21 days after i installed the site map Google has listed my
site under its new domain name with 6,000 + links.
Not all my forums are public

It is fair to say what would have happened if i didn't have
the site map installed? Well i cant answer that to be honest
as I'm now listed. I like to think that it has helped
in my situation where a Domain move for my forums.

The Site Map has worked for me, but if you have any questions
about it functionality then please contact Gizmo via PM
as i can only report back the results i have.

Gizmo's site map isn't free, but for my needs worth the money.
You will also need a Google web masters account.
It also works with Yahoo.

My Results Click Me After 21 days.


BOOM 7.6.+ rocks....
Mark_S #313866 04/12/2007 12:31 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Glad to hear that you've had good results mark smile.

Just for anyone wondering, with moving to a new domain with 0 data in Google for it, it'd likely take several months to allow discovery enough time to crawl this many links...



UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #314454 06/17/2007 6:58 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
v0.3 has been completed this morning. I've done a lot of code cleanup, on both a security and code standpoint. Instead of "assuming" data passed to the script from the database is "valid" for feeds, we run subjects through htmlentities (thus validating code) and we force "int" on fields which should only contain numbers.

I've repaired a problem with the offsets option introduced in 0.2 which allows you to split your one large sitemap into several easier to manage sitemaps (thus allowing you the opportunity to not go over the 50k link limit that some services enforce.

I have also built onto the offsets option and built in the ability to utilize a sitemap index which will list any "valid" sitemaps on from your forum (built using this script only); everything will be done automatically, all you need to do is submit the sitemap index into google (or a search engine which support them) and when you tell them to look at your site, they will grab your list of maps and work on them accordingly.

I have also set the "offsets" option to off by default; when I introduced it in 0.2 I set it to "on" by default.

Coming in 0.4:
I'm looking to add the ability to base "importance" to urls based on their date posted; this will allow the newer data to have a larger importance than the older data, thus allowing it to be crawled more often than older threads.

I'm also looking to allow the maximum thread inclusion to be adapted in the URL as well; however this ability will not be able to go over the scripts hardcoded 50k limit.

Also, if you've got a suggestion for expansion, please let me know, I'm always looking at new ideas.

If you're looking to upgrade, please email me (james[at]virtualnightclub[dot]net) with your licensed url's and I'll send off the new files.

If you're looking to purchase license please feel more than free to email me for more information.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #314457 06/17/2007 9:26 AM
Joined: Feb 2002
Posts: 2,286
Veteran
Veteran
Joined: Feb 2002
Posts: 2,286
If it could include custom pages, then I would buy it like a shot wink


Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....)
Ian_W #314460 06/17/2007 6:06 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Custom pages are out of scope for this (at least at this point), I COULD code it in but cost vs demand... There would have to be a way to add items into the map and since the current manner just auto-pulls data from the database there is no real "need" for the ability to add items (short of posting more content to your forums)

I do however have plans to write a separate sitemap utility for custom/standard pages; this script since i have to hop through hoops to cater to limitations (filesize and total links) it would be difficult to factor in custom pages, the next product will gear just towards your "standard site" items.

You could always try adding them to the sitemap manually (by hacking it in) so long as you're sure you won't bust over the 50k links/page limitation.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #314542 06/22/2007 3:16 PM
Joined: Oct 2002
Posts: 105
ehm Offline
Journeyman
Journeyman
Offline
Joined: Oct 2002
Posts: 105
Hello Gizmo,
Couple questions:
Can I 'select' which forums I want to include on the sitemap?
Like there are few forums that are more like 'chit-chat' and there is no need for them.

How is your upgrade police for your program versions and for UBB versions? I mean, if you upgrade your product, the registered users get it free? And how about if UBB upgrades?

Thank you

ehm #314549 06/22/2007 7:27 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Q. Can I 'select' which forums I want to include on the sitemap?
A. No, it takes any "public" forum and creates a map for posts in it.

There is a valid reason for this; either way google will eventually crawl all data, a sitemap just helps it along; either way the data will be there (sooner or later).

Q. How is your upgrade police for your program versions and for UBB versions
A. Upgrades, at this point, are free of charge to valid license holders; I upgrade as the UBB upgrades (for example, as the page variable was redundant, it was also purged in 0.3). The upgrade pricing may change in the future, but at this point I have no plans of charging for upgrades.
A. Upgrades are free for 1 year (365 days), after which you can purchase upgrades at $25/yr.

To receive an upgrade to the UBB.Sitemapper, all you need to is email me after there is one available and I'll email it back; however I do request that when emailing me you also email the site that you've purchased it for so i can do internal auditing (for a possible download manager in the future).


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #314571 06/23/2007 5:52 PM
Joined: Nov 2003
Posts: 329
Beta Tester
Beta Tester
Offline
Joined: Nov 2003
Posts: 329
Upgraded and working fine wink

Cheers


BOOM 7.6.+ rocks....
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Glad to hear it Mark


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #315825 09/25/2007 10:39 AM
Joined: Sep 2005
Posts: 136
Journeyman
Journeyman
Offline
Joined: Sep 2005
Posts: 136
Anyone try to make a literal site map for the forums on the board. Like a page that shows the forums, subs, subs in order on a flat summary like table?

Here's what I mean only I mean coming down instead of sideways, but sideways could work. (not my website).

http://www.darkobessions-rpg.com/sitemap.htm

Joined: Feb 2007
Posts: 329
Yarp™
Yarp™
Offline
Joined: Feb 2007
Posts: 329
We have something called a forum summary page that has all forums+subforums listed wink

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Ash, a SE doesn't care about the order; however, my script lists all items by id, which is in order.

My script is more geared towards SE's (eventhough it provides html output should you care to want to use it)


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #315843 09/25/2007 6:32 PM
Joined: Sep 2005
Posts: 136
Journeyman
Journeyman
Offline
Joined: Sep 2005
Posts: 136
My Forum Summary doesn't list the hidden forums and sub-sub forums because I choose not to display them to non-members or to clutter the front of my board system.

My board is more than a board, its an RPG game with sub world's, an html map would be brilliant for mapping it somewhere on the site so people can see what can't be seen.

Joined: Feb 2007
Posts: 329
Yarp™
Yarp™
Offline
Joined: Feb 2007
Posts: 329
I guess your board is so specific that just creating your very own html page with everything on it would be the best thing to do.

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Originally Posted by blaaskaak
I guess your board is so specific that just creating your very own html page with everything on it would be the best thing to do.
What I was thinking exactly


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #315859 09/26/2007 12:49 AM
Joined: Sep 2005
Posts: 136
Journeyman
Journeyman
Offline
Joined: Sep 2005
Posts: 136
Hey just looking out for the other rpg peeps out there bro.

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Definitely understandable hon, but I think it'd deserve its own addon as it definitely seems well out of the scope of this one wink


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #316901 05/01/2008 12:26 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Just rolled out an update for 7.3 compatibility (0.4 Final); please contact me if you've purchased the script and want it to run on your 7.3 board and I'll send you the new file.

Other updates include some minor code cleanup, the preview URLs which generate only 20 urls for testing (this was in 0.4a).


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #316902 05/01/2008 1:01 AM
Joined: Feb 2002
Posts: 2,286
Veteran
Veteran
Joined: Feb 2002
Posts: 2,286
Please smile


Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....)
Ian_W #316903 05/01/2008 2:13 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
, let me rephraise, please email me (james[at]virtualnightclub[dot]net) so I can send it to you wink...


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #317813 02/15/2009 9:37 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
I've been putting some finishing touches on 0.5; the current changelog is:
Quote
-- 0.5 --
Removed "Priority" tag as it was optional and providing duplicate errors from Google.
Removed some "test code" from the header of the script left in from 0.4.
Fixed a bugglet with the "read from config" option which was added in 0.4.
Added a "tick" to config which allows you to display the optional "changefreq" tag.
Added the ability to pull the community name from your ubb config as the feed name.
Updated the changelog format to fix spelling and grammatical errors introduced in 0.3.

If you've noticed an inconvenience or would like to see a change (or update) please let me know so I can get it in! Feel free to email me as well (james[at]virtualnightclub[dot]net)


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Joined: Mar 2007
Posts: 16
Newbie
Newbie
Offline
Joined: Mar 2007
Posts: 16
Gizmo, I have well over 100,000 threads. How does the program handle the overage? Does it look at the 50,000 newest, or ....?

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Use the sitemap index option, it'll create an index of x amount of sitemaps, each map would be X size based on the paramater in the sitemap script...

EX:
You have 100000 threads, you set 25k links in the sitemap, so the index would push out an index with 4 sitemaps, each sitemap would push an offset of 25k, so the first would be 0-25k, second 2501-50k, etc...

I'd recommend using no more than say 25k chunks however, makes the query a little easier to deal with lol...


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #317829 02/22/2009 4:55 PM
Joined: Mar 2007
Posts: 16
Newbie
Newbie
Offline
Joined: Mar 2007
Posts: 16
OK... I wasn't understanding how the index thing worked. I thought the total would still be 50k. Thanks.

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Well, the index is how to subvert the 50k limit; in actuality you don't really want to be generating a 50k link sitemap as it can bog down the server during the request...

So the index steps in, links to the smaller sitemaps, and the SE does the rest.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #317953 04/14/2009 9:13 AM
Joined: Oct 2007
Posts: 10
Newbie
Newbie
Offline
Joined: Oct 2007
Posts: 10
Hi Gizmo
2 Q's for you.

Q1 -I've just moved my site to a new host, and its now under a new domain with the old domains redirecting to it (for now at least).
However the new domain has 2 variants (a DOT com and a DOT co DOT uk) the later just points back to the former.
Do i need 2 licenses or 1?

Q2 - does it work on 7.5.2?

Cheers


I don't do a lot, but i do do this
Crasher #317954 04/14/2009 12:37 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
1. just install it for the primary; you really should have 1 domain with others directing to it for better results in engines (duplicate anything brings one down in points).

2. Yes, the script itself is completely separate from the UBB, as it only relies on standard data in the db it should be compatible with just about any install within v7.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #317957 04/15/2009 2:29 AM
Joined: Oct 2007
Posts: 10
Newbie
Newbie
Offline
Joined: Oct 2007
Posts: 10
Originally Posted by Gizmo
1. just install it for the primary; you really should have 1 domain with others directing to it for better results in engines (duplicate anything brings one down in points).

2. Yes, the script itself is completely separate from the UBB, as it only relies on standard data in the db it should be compatible with just about any install within v7.

Sweet smile
Point taken on the redirects - i've just moved a load of stuff over from another hosting company and registrar so things are a little disorganized at the moment. Ultimately everything will be redirected to a single point.


I don't do a lot, but i do do this
Joined: Mar 2007
Posts: 94
Power User
Power User
Joined: Mar 2007
Posts: 94
just installed this and am getting an error

Quote
XML Parsing Error: no element found
Location: http://www.vannin.com/ubb.sitemap.php
Line Number 3, Column 59:Unknown column 'FORUM_PERMISSION_CAN_READ' in 'field list'

also sent this to your email......

Joined: Mar 2007
Posts: 94
Power User
Power User
Joined: Mar 2007
Posts: 94
thanx for the email and fix

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Yeh, guess I need to push v0.5 out for production for 7.5+ installs..


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318017 06/22/2009 2:09 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
v0.5 is now available, changelog includes:
Quote
Removed "Priority" tag as it was optional and providing duplicate errors from Google.

Removed some "test code" from the header of the script left in from 0.4.

Fixed a bugglet with the "read from config" option which was added in 0.4.

Added a "tick" to config which allows you to display the optional "changefreq" tag.

Added the ability to pull the community name from your ubb config as the feed name.

Updated the changelog format to fix spelling and grammatical errors introduced in 0.3.

If you need an update (and qualify for updates (within 1 year of purchasing your license) please feel free to email me at james[at]virtualnightclub[dot]net. If it's been past a year since you purchased the script, you can renew at here


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318020 06/30/2009 11:30 AM
Joined: Mar 2000
Posts: 21,079
Likes: 3
I type Like navaho
I type Like navaho
Joined: Mar 2000
Posts: 21,079
Likes: 3
Hey Gizzy, I may have asked this years ago, but does this ping google, etc. when a new post is made or a new topic?


- Allen wavey
- What Drives You?
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
No, but I've actually found that Google (and some others) will re-check the sitemap periodically on their own.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318076 08/09/2009 2:36 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Starting this week, I will be working on v0.6 of the UBB.Sitemaps script. There will be several updates to the script that I've wanted to push out for some time and these features will be relating to the speed at which the script works.

I'll be adding options for:
1. GZip - Compressing the output of the file so that it is loaded faster by clients (Search Engines in this case).
2. Caching - Using an in-house script and not the UBB's code (as this script works as a standalone for compatibility reasons we don't rely on UBB code within the script). By default this will be set to 24 hours.
3. Expires Header - This will be another method that will allow clients to retrieve content only when you specify it is going to be new. By default this will be set to 24 hours.

Some of these items will not function with all servers; your provider will need to allow you to:
1. Write flat files via the webserver; some of these files may end up belonging to your webserver user, but will overwrite themselves when needed.
2. Use GZip to compress files.

You'll likely need to play with settings to ensure compatibility but if you can use gzip within the UBB you should be able to use it within the sitemap script.

I'll also be policing for some general code cleanup opportunities within the script as well; I'd highly recommend an upgrade for the new caching options to all users as it'll increase the speed of the script exponentially (especially if you're using the "one big file" method vs the "sitemap index" method (default)).

I'm unsure as to a specific date that the new version will be available however I'll announce here when it's available.

Please also note, if it's been longer than a year since you purchased a license of the script, you'll need to renew your license; you can do so via the information page.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318077 08/09/2009 5:57 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
I actually got most of the coding done this morning since I couldn't sleep; I need to finish some of the "new code cleanup" though tipsy


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318101 08/20/2009 8:01 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Going on track for testing of all systems for release tomorrow; going to go ahead and do a couple of final minute updates to the script tonight and package it up.

For those of you who've registered for the script within the last year (365 days) email me directly for an update (james[at]virtualnightclub[dot]net); for those of you who've registered past that please renew here and I'll ship off v0.6 with your payment verification.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318102 08/21/2009 12:28 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Just packaged 0.6 up and sent off the first copies to those in good standing that have requested it.

I have the caching section working on my server if you'd like to try the preview URL (here) note that I've been having some general speed issues with my server as of late so don't mistake any speed issues as an issue with the script (it should actually parse instantly when serving a cached page).


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318103 08/21/2009 6:01 PM
Joined: Mar 2007
Posts: 94
Power User
Power User
Joined: Mar 2007
Posts: 94
uploaded and seems to be working great so far

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Glad to hear it...

Are you using caching on it or just the default?


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318105 08/21/2009 8:11 PM
Joined: Mar 2007
Posts: 94
Power User
Power User
Joined: Mar 2007
Posts: 94
well, I don't fully understand what caching does for me,so I left it at default.

Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
Well, think of it like this...

You have it set to display in google and yahoo (or other sites), they send one request and the cache is built and the output is displayed. They send another request, and instead of rebuilding all data from the database (which can be intensive) it just reads out the cached file (until the cache expires).

Basically, makes it so unnecessary hits are dealt with in a manner as to not bog down system resources.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #318109 08/22/2009 12:07 PM
Joined: Mar 2007
Posts: 94
Power User
Power User
Joined: Mar 2007
Posts: 94
ok, so I enabled caching. :-)

badfrog #318270 10/31/2009 12:36 AM
Joined: Oct 2009
Posts: 1
Lurker
Lurker
Offline
Joined: Oct 2009
Posts: 1
Gizmo,

I have a question about the urls that are included in the sitemap being different from the ones that a search engine might discover on their own.

Could I be penalized by Google for having different links going to the same page?

for example:

Forum link (w/ SE friendly urls & .html extension):
mysite/forums/ubbthreads.php/topics/189951/1.html

Sitemap link to same page:
mysite/forums/ubbthreads.php?ubb=showflat&Number=189951

What do you think? (or did I do something wrong?)

Bill

ECNet #318290 11/04/2009 12:30 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
You won't be penalized anymore than you would if they crawled the UBB and found the URLs on their own; the script feeds them a URL and their crawler will hit pages that are linked off of that page itself to build its real index.

If you follow the example in the readme on what to give google it should actually build the URL the same as what you posted (as form link); the sitemap can be customized to build just about any format of url in just about any type of sitemap you'd want. The recommendation however is to build the sitemap as:
ubb.sitemap.php?type=1&se=2&offset=0

Which will build links as:
http://www.yoursite.tld/forum/ubbthreads.php?ubb=showflat&Number=49643

You could use:
ubb.sitemap.php?type=1&se=1&offset=0

Which would build links as:
http://www.yoursite.tld/forum/ubbthreads.php/ubb/showflat/Number/49644

Currently we don't have an option to build with SEO urls or the fake html extension; we just have se friendly urls and standard urls (which likely will change in the future).

The script primarily aids SE's by feeding content urls to the SE, it'll continue to crawl URLs as it finds them (specifically on links you feed to them), it'll build "new page" links and other links off of the pages your sitemap feeds into their systems.

What I'd like to see is possibly have the ubb gracefully forward URLs with a redirect (301/302 header) based on what URL schema the user chooses in the UBB we could eliminate duplicate urls alltogether (as any url accessed that wasn't on the default selected would send a redirect like what the redirector scripts do); but I'm unsure as to how easy/difficult that could be.

Last edited by Gizmo; 11/04/2009 3:15 PM.

UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #320903 04/02/2015 1:57 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
We're now at v0.9, folks! Changes in v0.9 (April 02, 2015) are as follows:
  • All configuration items are now stored in a $conf array.
  • ASP sitemaps no longer populate both the title and description tags as they where duplicated and thus added to the bulk of sitemap pages.
  • General script code cleanup, reformatting, and restructuring.
  • The test string is now type 0; previously, type 0 was not utilized and would cause errors if indicated. Type 7 no longer works for any type of generation.
  • We're now utilizing more current sitemap standards; previously we where utilizing earlier versions.
  • There is now support for v7.6.0 style SEO URLs
  • The site name parameter is no longer passed to the thread title as this just added a lot of extra bulk to the pages.
  • The last reply time of a topic is now utilized in XML sitemaps.
  • Utilization of an XML Stylesheet is now supported for type 1; see the supplied css/sitemap.css file for basic options.
  • For compatibility for users hosting their UBB.threads install in the web root, the $conf["folder"] variable now requires a trailing slash.
  • RSS Sitemaps now utilize the <ttl> tag which is fed from the $conf["cache"]["time"] variable.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #320904 04/06/2015 8:36 AM
Joined: Jan 2000
Posts: 254
Likes: 4
Beta Tester
Beta Tester
Joined: Jan 2000
Posts: 254
Likes: 4
Originally Posted by Gizmo
We're now at v0.9, folks! Changes in v0.9 (April 02, 2015) are as follows:
  • All configuration items are now stored in a $conf array.


Can you expand on this feature change?
As what happens to config.inc.php?

How does that impact upgrading or moving to a new server?


There is no such thing as stupid questions.
Just stupid answers.
Gizmo #320905 04/06/2015 9:45 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
The needed $config array lines from the config.inc.php file are formatted into the $conf array; really it won't affect things at all, if the user is using the UBB.threads config file (which is by default) the script sorts everything as it's needed.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323072 08/28/2018 9:21 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBB.Sitemaps 8/28/2018 Developer Notes (Release Announcement)
- No longer in Alpha as the script has been tested extensively on many server configurations.
- Added a listing of all forum names (type 7), which is linked from the Sitemap Index page.
- Added an option to not display the frequency line.
- Added an option to not display the lastmod line.
- Added an option to not display the .html extension for sitemap files.
- Added support to always produce HTTPS (SSL) URLs (useful for sites on a CDN where the local server may still try to produce non-HTTPS links when using wildcard HTTPS urls).
- Added support for including the UBB.threads configuration for sites running UBB.threads from the webroot (not in a folder).
- Added support for specifying a domain (useful if your UBB.threads install is on a subdomain and you wish to have UBB.SiteMaps located on your main domain).
- Added support for human readable permalinks with Apache Rewrite Rules
- Removed the need for a trailing slash in the folder config.
- Changed the MySQL database connection to utilize MySQLi for PHP7 support.
- Minor code changes for script performance.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323348 08/21/2019 10:11 AM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBB.Sitemaps 8/18/2019 Developer Notes (Release Announcement)
- Added: Support for UBB.threads Pages
- Changed: HTML Sitemaps no longer build in a table, instead they will build as a listing of links with a break
- Changed: Switching from Version Numbers to Build Dates (20190818)
- Changed: The HTML extension can now be disabled, and will respect the UBB.threads configuration value
- Fix: Code Cleanup and Reformatting
- Fix: The Forum Listing will check that the forum is enabled before displaying it


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323433 12/19/2019 1:35 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBB.Sitemaps 12/22/2019 Developer Notes
- Added: Debug mode (ubb.sitemap.php?debug=1) will allow you to see your UBB.Sitemaps settings and a forum overview in an easy to read page.
- Added: A new version check will display a version notice on the debug page.
- Added: A switch has been added for the beta group which will display if you're running a beta release or not. This will allow the new version check to be able to display notices for final builds.
- Added: The UBB.threads Pages display respects the private mode status within UBB.threads Pages.
- Fix: Fixed a bug in UBB.threads Pages detection.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323672 07/05/2022 12:08 PM
Joined: Jan 2000
Posts: 254
Likes: 4
Beta Tester
Beta Tester
Joined: Jan 2000
Posts: 254
Likes: 4
Using this on a site I noticed that the sitemap cache files are not deleting.
I have them back to 2019,2020,2021,2022.
Is this a manual process to clear out or do I need to correct something?

I do not see a version on the main script anywhere but it has been installed a few years as you can see.

Last edited by Ruben Rocha; 07/05/2022 12:16 PM. Reason: added comment.

There is no such thing as stupid questions.
Just stupid answers.
Gizmo #323673 07/05/2022 12:30 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
It is a simple cache system which should roll through updates in the $conf["cache"]["directory"] directory based on what URL is accessed (the file names are a SHA1 hash of the requested URI (bit after the site URL)) and is only cached for however many seconds $conf["cache"]["time"] is set to (default 86400); so basically its a hash of all requested URLs such as:
ubb.sitemap.php?type=6&se=1 (sitemap search engine index page)
ubb.sitemap.php?type=7 (Forum Listing)
ubb.sitemap.php?type=10 (UBB.threads Events [Mod])
ubb.sitemap.php?type=8 (UBB.threads Pages [Mod])
ubb.sitemap.php?type=9 (UBB.threads Reviews [Mod])


Then all of your offset pages based on how large a chunk $conf["offset"]["increment"] defines (default 10k, specified maximum of 50k):
ubb.sitemap.php?type=1&se=1&offset=0

If you see outdated cached files it's likely human error (someone attempting to craft custom URLs into the system).

As for the version, it is the $build and $release variables in the script, and should be viewable on all pages (including the debug page (ubb.sitemap.php?debug=1) if your version supports it) when you view the source (ie "view source" and not what is displayed to the browser (it's listed in a comment on the source)


In a nuttshell, the generated system urls should get auto updated, manually crafted URLs will only be updated when they're accessed again; nothing is auto purged (as an expected repository of data should contain the previous offset pages worth of data which should be auto updated)


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323674 07/05/2022 12:36 PM
Joined: Jan 2000
Posts: 254
Likes: 4
Beta Tester
Beta Tester
Joined: Jan 2000
Posts: 254
Likes: 4
Okay I found
$build = "20190818"


As far as cache files should I just delete any or all files.

Like older than 6 months?


There is no such thing as stupid questions.
Just stupid answers.
Gizmo #323676 07/05/2022 12:38 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
You shouldn't need to ever prune the files in the folder; but they should auto overwrite when the associated URL is accessed.

The cache is in place so that your backend database server doesn't get pinged to death with data requests, this cache by default is 24 hours, but if you for whatever reason wanted to have it update more often or less often you have the option to do so with offsetting the cache parameters previously mentioned.

If you have cache files from malformed user or bot requests you can purge them manually if you wish, but any request to that same url will generate a new cache file (or update said cache file) after the request completes.

Most of these files are mere bytes long, larger files for larger forum indexes. All we're really fetching are formatted URLs for existing content so I doubt it's going to make much of an impact to purge files.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323677 07/05/2022 12:47 PM
Joined: Jan 2000
Posts: 254
Likes: 4
Beta Tester
Beta Tester
Joined: Jan 2000
Posts: 254
Likes: 4
I understand but there are sitemap cache files dated back to 11/15/2019 that is what prompted my post.


There is no such thing as stupid questions.
Just stupid answers.
Gizmo #323678 07/05/2022 12:53 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
And again if a user or bot requests a malformed URL it'll generate a cache file for that request when caching is tuned on, a malformed request will generally just have the sitemap index data of a few lines; if it bothers you then remove them but again as previously mentioned:
- If a user or bot requests this URL again in the future a new cache file will be generated if caching is enabled
- The data in said file is of negligible size and won't save you any space
- Theres nothing you can do to stop this from happening as any request from the script will write a new file.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Gizmo #323679 07/05/2022 12:57 PM
Joined: Jan 2000
Posts: 254
Likes: 4
Beta Tester
Beta Tester
Joined: Jan 2000
Posts: 254
Likes: 4
Thats what I wanted to know I have a few thousand files in cache and I understand malformed requests cause some now.
For example

a29e6d14a542908ff2df1e197e9ee5deb90bf33a 1,529,625 each


There is no such thing as stupid questions.
Just stupid answers.
Gizmo #323680 07/05/2022 12:59 PM
Joined: Jan 2000
Posts: 5,833
Likes: 20
UBBDev / UBBWiki Owner
Time Lord
UBBDev / UBBWiki Owner
Time Lord
Joined: Jan 2000
Posts: 5,833
Likes: 20
If you deleted everything in the cache folder the files would get recreated on the next request through the sitemap script.

Larger files indicate a large payload, such as a forum listing; the amount of files will depend on how many links are displayed per page for each forum.


UBB.Dev - Putting Dev into UBB.threads
Company: VNC Web Services - UBB.threads Scripts and Scripting, Install and Upgrade Services, Site and Server Maintenance.
Forums: A Gardeners Forum, Scouters World, and UGN Security
UBB.Threads: My UBB Themes, My UBB Scripts
Page 1 of 2 1 2

Link Copied to Clipboard
Donate Today!
Donate via PayPal

Donate to UBBDev today to help aid in Operational, Server and Script Maintenance, and Development costs.

Please also see our parent organization VNC Web Services if you're in the need of a new UBB.threads Install or Upgrade, Site/Server Migrations, or Security and Coding Services.
Recommended Hosts
We have personally worked with and recommend the following Web Hosts:
Stable Host
bluehost
InterServer
Visit us on Facebook
Member Spotlight
isaac
isaac
California
Posts: 1,157
Joined: July 2001
Forum Statistics
Forums63
Topics37,573
Posts293,925
Members13,849
Most Online5,166
Sep 15th, 2019
Today's Statistics
Currently Online
Topics Created
Posts Made
Users Online
Birthdays
Top Posters
AllenAyres 21,079
JoshPet 10,369
LK 7,394
Lord Dexter 6,708
Gizmo 5,833
Greg Hard 4,625
Top Posters(30 Days)
Top Likes Received
isaac 82
Gizmo 20
Brett 7
WebGuy 2
Top Likes Received (30 Days)
None yet
The UBB.Developers Network (UBB.Dev/Threads.Dev) is ©2000-2024 VNC Web Services

 
Powered by UBB.threads™ PHP Forum Software 8.0.0
(Preview build 20221218)