Previous Thread
Next Thread
Print Thread
Rate Thread
Joined: Jul 2001
Posts: 1,157
Likes: 82
coffee and code
coffee and code
Joined: Jul 2001
Posts: 1,157
Likes: 82
Robots (Crawlers) List for UBB.threads - UPDATED 2022-07-10
formerly named "Search Engine Spiders List for UBB.threads"

About:
The advantage to using this list is that Robots (Crawlers and Search Engine Spiders) get put into the correct "Robots (Crawlers)" group when viewing your forum's Who's Online page.

This translation list is not used anywhere else in UBB.threads except on the Who's Online page at /ubbthreads.php/online. Having a long list of Robots will not slow down your forums.

Details:
Robots List: 2022-07-10
Total Agent Strings: 912
Sources:
https://udger.com/resources/ua-list/crawlers (2022-07-10) and
https://github.com/monperrus/crawler-user-agents (2022-05-03)
I've simply converted, combined, and cleaned the data for use with UBB.threads.

How to install:
1) Go to Control Panel > Display Options > Who's Online Settings.
2) Copy/paste the text from the newest list in to the "Robots (Crawlers)" box at the bottom of the page.
3) Click the "Update General Display Options" button.
done.

Notes:
Always use the newest list. Older lists contain old robots and Inactive crawlers.
Installs prior to 7.6.2 did not include a list of robot agents.
robots_20141014-UBBT762.txt Fresh Installs of UBB.threads 7.6.2 to 7.7.3 are pre-populated with this list.
robots_20200114-UBBT774.txt Fresh Installs of UBB.threads 7.7.4 are pre-populated with this list.
robots_20200924-UBBT775.txt Fresh Installs of UBB.threads 7.7.5 are pre-populated with this list.
robots_20220710-UBBT800.txt Fresh Installs of UBB.threads 8.0.0+ are pre-populated with this list.
robots_20220710-CATEGORIES.txt is the same robots list as the stock list, plus it includes a category name for many of the robots, such as Search, Marketing, Monitoring, Link Checker, Tool, etc.

Having problems using this list on an older version of UBB.threads? Remove any blank lines from the top/bottom of your copied list.
Attachments
robots_20141014-UBBT762.txt (13.87 KB, 0 downloads)
Fresh Installs of UBB.threads 7.6.2 to 7.7.3 are pre-populated with this
SHA1: dfe7ed85b91ad5b197e5926d845eb12bf71f0f74
robots_20200114-UBBT774.txt (24.31 KB, 0 downloads)
Fresh Installs of UBB.threads 7.7.4 are pre-populated with this
SHA1: 864216eace8eff40a05d56e2f2f21cde2714b602
robots_20200924-UBBT775.txt (18.71 KB, 3 downloads)
Fresh Installs of UBB.threads 7.7.5 are pre-populated with this
SHA1: 4c6dca844f125e1c4865f1c37b33e1add09e0b45
robots_20220710-UBBT800.txt (23.44 KB, 3 downloads)
Fresh Installs of UBB.threads 8.0.0+ are pre-populated with this
SHA1: e540578c7309298f824cc3e1b407918e153526ff
robots_20220710-CATEGORIES.txt (30.02 KB, 6 downloads)
SHA1: be349d4983a1358114a2f2de5340e9adcd6d510e

Last edited by isaac; 07/10/2022 10:41 AM. Reason: updated lists for 20220710

Current developer of UBB.threads PHP Forum Software
Current Release: UBBT 7.7.5 // Preview: UBBT 8.0.0
isaac @ id242.com // my forum @ CelicaHobby.com
2 members like this: isaac, Gizmo
Sponsored Links
Entire Thread
Subject Posted By Posted
[7.x] Robots (Crawlers) List for UBB.threads isaac 06/25/2014 11:45 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 06/25/2014 12:12 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Bill B 06/25/2014 12:47 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Mark J.Cairns 08/04/2014 6:20 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 10/14/2014 6:57 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Bill BB 10/30/2014 10:10 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Steve C 06/13/2015 3:15 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 06/13/2015 4:03 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Steve C 06/13/2015 5:11 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 06/13/2015 5:17 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Steve C 06/13/2015 5:50 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Gizmo 06/13/2015 6:46 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Steve C 06/14/2015 10:33 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Gizmo 06/14/2015 11:24 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Steve C 06/14/2015 11:57 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Gizmo 06/15/2015 11:40 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads Steve C 06/15/2015 11:18 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads Gizmo 06/16/2015 2:49 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 11/02/2015 11:57 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads SteveS 11/03/2015 5:21 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 11/03/2015 5:31 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads SteveS 11/03/2015 5:39 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 11/16/2019 10:58 PM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 01/14/2020 5:20 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 09/24/2020 7:41 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads Aaron101 04/06/2022 1:42 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 04/06/2022 2:05 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads Aaron101 04/07/2022 1:04 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 04/07/2022 1:07 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads Aaron101 04/07/2022 1:26 AM
Re: [7.x] Robots (Crawlers) List for UBB.threads isaac 07/09/2022 12:42 PM

Link Copied to Clipboard
Donate Today!
Donate via PayPal

Donate to UBBDev today to help aid in Operational, Server and Script Maintenance, and Development costs.

Please also see our parent organization VNC Web Services if you're in the need of a new UBB.threads Install or Upgrade, Site/Server Migrations, or Security and Coding Services.
Recommended Hosts
We have personally worked with and recommend the following Web Hosts:
Stable Host
bluehost
InterServer
Visit us on Facebook
Member Spotlight
Gizmo
Gizmo
Portland, OR, USA
Posts: 5,833
Joined: January 2000
Forum Statistics
Forums63
Topics37,573
Posts293,925
Members13,849
Most Online5,166
Sep 15th, 2019
Today's Statistics
Currently Online
Topics Created
Posts Made
Users Online
Birthdays
Top Posters
AllenAyres 21,079
JoshPet 10,369
LK 7,394
Lord Dexter 6,708
Gizmo 5,833
Greg Hard 4,625
Top Posters(30 Days)
Top Likes Received
isaac 82
Gizmo 20
Brett 7
WebGuy 2
Morgan 2
Top Likes Received (30 Days)
None yet
The UBB.Developers Network (UBB.Dev/Threads.Dev) is ©2000-2024 VNC Web Services

 
Powered by UBB.threads™ PHP Forum Software 8.0.0
(Preview build 20221218)