#259095 - 09/18/0304:03 PMRe: Any way to scrape a UBB Threads forum and create an import?
[Re: BrokenToy]
donJulio
Code Monkey
Registered: 06/17/02
Posts: 682
Loc: CA, USA
Since it has to be a writeable directory, it would have to be something like the /includes, /stylesheets, images/graemlins, or images/icons folders because you proabably can't change permissions any more w/o ftp or telnet. As long as you correctly set permissions at installation and haven't changed them, there should be several writeable directories in your ubbthreads tree. <br />EDIT: <br />If you have a directory for attatchments, that should also be writeable already as well <img src="/forum/images/graemlins/smile.gif" alt="" />
Edited by donJulio (09/18/0304:04 PM)
_________________________
Too many men. There's too many people making too many problems, and not much love to go around. Can't you see this is the Land of Confusion? <img src="http://www.ubbdev.com/forum/images/graemlins/confused.gif" alt="" />
#259097 - 09/18/0304:09 PMRe: Any way to scrape a UBB Threads forum and create an import?
[Re: sf49rminer]
donJulio
Code Monkey
Registered: 06/17/02
Posts: 682
Loc: CA, USA
I don't know how you do a backup from the admin control panel. Does it drop one table at a time? It looked that way from slayer's example. If so, get users and posts first. Then maybe forums and categories. That's assuming you can't just do the whole database at once. but it is a big site. Must be very sly....
_________________________
Too many men. There's too many people making too many problems, and not much love to go around. Can't you see this is the Land of Confusion? <img src="http://www.ubbdev.com/forum/images/graemlins/confused.gif" alt="" />
Registered: 06/14/03
Posts: 1185
Loc: New Boston, NH
It drops them as individual tables. It has a link to Backup all tables, but it still outputs them as individual tables. With a large site this will probally be best anyhow.
I personally don't see why he does not settle his dispute with the host. <br /> <br />Yes Threads Backup drops them one at a time. <br /> <br />Slayer is right as backing up the individual tables is alot better on bigger sites. I can't tell ya how many times I have seen PHPMyAdmin time out on larger databases trying to be backuped in a large chunk. <br />This process for him will be time consuming. <br /> <br />KYDD, <br /> <br />If any of this is over your head I suggest you post a post in our developer for hire forum and they may be able to do something for you.
Registered: 06/14/03
Posts: 1185
Loc: New Boston, NH
I don't what host he has or what the "dispute" is, but given that the host severed telnet(I've never had this) and FTP to hold the site hostage, there must be some seriously bad blood there for some reason. Could be a billing thing, could be a move to try to force him to renew for a year or whatever to keep him from moving. Those are the only specultations that I can offer that might be unresolvable.
Registered: 01/13/01
Posts: 47
Loc: Mt. Vernon, NY USA
Just to clarify, the dispute is not my doing. It's something that the billpayers and the current admin (not his hosting company) are hashing out and I was told that my task was to save as many of the threads & users as possible since we're locked out and the possibility of a mutual resolution (w/out legal proceedings) is slim and nil. <br /><br />I'm not worried about how long it'll take as long as I can get a good amount of the threads & users in. I'll give Slayer's idea a shot tonight.<br /><br />I just wanted to write that all of you guys are awesome. I've been making the transition from UBB Classic and perl to Threads so I'm taking the MySQL & PHP stuff slowly. Thanks again and I'll be back tomorrow to report what happens.
Registered: 01/13/01
Posts: 47
Loc: Mt. Vernon, NY USA
No we are absolutely the owner of the software, the license, the content, etc. The dispute is between the Sr. VP of our company and the current outsourced admin. Not sure about the details actually but it is $$ related.
IANAL - But in all reality they can not withhold your database as it is your property. Any legal issues between both parties would need to be settled in court if need be but keeping your data and causing downtime and other related incured costs wouldn't be a good idea on their part. This would be grounds for a counter suit. <br /> <br />But then again I have no idea... where's Lisa_P when ya need her... lol <img src="/forum/images/graemlins/grin.gif" alt="" />
you have ssh or telnet access on the new machine, but not the old?<br /><br />Here is a fast way to see if you have remote access to the old MySQL server<br /><br /><br />$bash 2.0> mysqldump -u username -p -h oldhostmachine.com --opt databasename > databasename.sql<br /><br />You will be promted for a password. then if it connects you're in luck.
Registered: 01/13/01
Posts: 47
Loc: Mt. Vernon, NY USA
[]navaho said:<br />you have ssh or telnet access on the new machine, but not the old?<br /><br />Here is a fast way to see if you have remote access to the old MySQL server<br /><br /><br />$bash 2.0> mysqldump -u username -p -h oldhostmachine.com --opt databasename > databasename.sql<br /><br />You will be promted for a password. then if it connects you're in luck. [/]<br /><br />Unfortunately to answer your 1st question--yep.<br /><br />As for the login attempt, using an educated guess on the correct variables from navaho's suggestion:<br /><br />
Code:
mysqldump: Got error: 1130: Host '69.42.xx.xx' is not allowed to connect to this MySQL server when trying to connect
<br /><br />I guess that implies SSH is not available from my IP and may be limited to an IP range or turned off. I have to use SSH since that's what the new server is using.
Then your only left variable would be backing the threads backup directory to within Threads directory in a directory which has write permissions. Your attachment directory is perfect and then downloading them one at a time via your browser. <br /> <br />Also while browsing your forum I see you are in violation of Infopop's copyright rules. You need to place the Infopop link back on your site. <img src="/forum/images/graemlins/wink.gif" alt="" />
Registered: 01/13/01
Posts: 47
Loc: Mt. Vernon, NY USA
[]slayer60 said:<br />In config in ubbThreads find this:<br />Directory to store database backups in. Only necessary for using the database backup/restore function in the admin section. This directory will need to be writeable by the webserver.<br /><br />Set this to a path within your html tree. Such as:<br />/home/wwwtsbiu/public_html/ubbthreads/<br />/home/wwwtsbiu/public_html/ubbthreads/images/<br /><br />You should be able to figure out what this needs to be based on your other paths in config.<br /><br />Save that, then go to DB Management and run the DB backup. Backing up all of your files.<br /><br />Then you should be able to type in the url to the sql files. Eg:<br /><br />http://www.2-pop.com/ubbthreads/devbo_Posts.sql<br /><br />That is what I would try. This is dependant on you have the correct value for:<br /> Path to mysql. Only necessary for using the database restore function in the admin section.<br /><br />I think that should work even if you don't PHPMyAdmin access. [/]<br /><br />Well I'm pretty sure I got all of the settings correct on the new box. But I'm trying to hunt down the url to the sql files. The 1 suggested above obviously doesn't work/ Any other suggestions?
You set the backup directory on the OLD BOX to something within the directory tree. <br /> <br />If you allow uploads into something like /uploads the web page would be http://www.2-pop.com/uploads/ <br /> <br />and the sql tables would backup there. <br /> <br />This would be on your current board not new one. <br /> <br />I have offered in private to help twice and you have ignored me in both instances. <br /> <br />Another Gentleman was having trouble with his forums and I got them up and running for him. Obviously you do not need any since you have ignored my attempts to help twice. <img src="/forum/images/graemlins/wink.gif" alt="" />
Registered: 01/13/01
Posts: 47
Loc: Mt. Vernon, NY USA
[]Omegatron said:<br />You set the backup directory on the OLD BOX to something within the directory tree.<br /><br />If you allow uploads into something like /uploads the web page would be http://www.2-pop.com/uploads/<br /><br />and the sql tables would backup there. <br /><br />This would be on your current board not new one. <br /><br />I have offered in private to help twice and you have ignored me in both instances.<br /><br />Another Gentleman was having trouble with his forums and I got them up and running for him. Obviously you do not need any since you have ignored my attempts to help twice. <img src="/forum/images/graemlins/wink.gif" alt="" /> [/]<br /><br />Sent you a PM...saw that you read it <img src="/forum/images/graemlins/grin.gif" alt="" /><br /><br />But I DO really appreciate your help and have been "studying" everyone's suggestions. Now I have to wait until AM to see if the admin still has admin privliges to set the current (i.e., soon to be old) board. And I'll have to make some educated guesses about the location of mysql or mysqldump. It's most likely the default or /usr/local/bin.
/usr/bin /usr/local/bin <br /> <br />usr/local/mysql/bin <br /> <br />usr/mysql/bin <br /> <br />I would just try the default <br /> <br />/usr/bin <br /> <br />I sent you a PM on this but just so your clear If I where you I would inquire at Infopop the true license holder. In a corporate structure like yours if so and so's name is on it then they are the rightful possessor. If it is held in a corporate name and they are no longer with the company then the company is the rightful heir. I would check to see how it was licensed.