Migrating Data from PHPNUKE 7.8 to RN76 2.02

Regular Joined: May 13, 2006 Posts: 89

I have just installed, on my "staging" server ( Only registered users can see links on this board! Get registered or login!) RN76 (2.02.00 Full). It is a clean install...at this point, only mod is the addition of my theme. Hereafter, I refer to this as the .org site. My overall goal was to get NSN Groups and Sentinel working and had been having issues with that on my production site.

I also have my "production" site, Only registered users can see links on this board! Get registered or login!, hereafter referred to as the .com site.

I have an existing site running PHPNUKE 7.8, with an associated DB. There have been some other mods added on that one, as well.

I would basically like to build the new site (.org) from the ground up, BUT, I would like to take the existing user and forum data from my .com site, and import it.

I realize that the phpnuke DB table structures do not exactly match the RN76 table structures. What is the safest/fastest way to export the data from one (phpnuke 7.8 site), and import just the tables/rows/content into the new RN76 Site/DB that are necessary? After a succuessful data migration, I would then re-add the existing mods to the staging (.org) server. Ideas on how best to do this?

My ultimate goal will be to push the entire .org staging content to overlay my production (.com) site, once I get it "perfect" in staging environment.

Any tips on how to do this, when the time comes, assuming I basically have to change all the domain references in the DB, etc. PWs will remain the same. I only want to change what HAS to change.

Anyway...thanks to Raven for referring me to your distro with the NSN groups. Now, just need to get my data transferred!

Spurt

Sells PC To Pay For Divorce Joined: Posts: 5661

as far as i know of there are a few changes....
to transfer your forum content as well its better to play safe and update your old site forum to the same version on ravennuke.
as for the users...
you should be able to INSERT that in the new nuke users table...

registered · Posted: Sat Jun 03, 2006 7:41 am

Quote:

I also have my "production" site, http://www.circle-of-tyrants.com, hereafter referred to as the .com site.

I have an existing site running PHPNUKE 7.8, with an associated DB. There have been some other mods added on that one, as well.

I just want to be clear, is the database (site) that you want to copy over the data from, this 7.8 site? If not, what is the nuke version of it?

Posted: Sat Jun 03, 2006 11:40 am

You are correct...the site I am exporting "from" is a phpnuke 7.8 site.

Theme Guru Joined: Nov 01, 2003 Posts: 1006

if that is the case then please run a full backup of your current database naming it dbbeforedowngrade. Then downgrade that site to a 7.6 site using the downgrade script available at www.nukescripts.com and then run another full backup of the database naming it something like dbafterdowngrade. Then once you do that. Go into the phpmyadmin and export a full copy of data only naming it dbdataonly.

Then theoreticly, once you have installed your virgin copy of raven nuke onto your server and run the installation. You can then simply open up the data only copy and grab the info from say, bb_topics bb_posts, bb_posts_text etc. the tables you want the info from, and run the sql querry of that data only and it should be fine.

One thing to be certain of is to do any upgrading of the forum on your old site, the 7.8 one, before you do any of this other work. If for instance your 7.8 site runs forums that are .18 or lower, you will want to upgrade those forums to 019 or .20 whichever the raven nuke uses. That way any table changes that need to be there for the new nuke site will be in place.

In theory, this should make things a smooth transition. Just remember, always backup things before you try this. Also, in my opinion as I have helped many a messed up site after a botched downgrade. PLEASE make a folder in your ftp called something like oldfiles. Load all of your sites files into it. Then load the raven nuke files. Then run the install. Then do your database fiddling. Then as tedious as it sounds go and load any "extra" blocks, modules, etc from your "oldfiles" folder into the new install location. This really saves people a great deal of trouble.

Posted: Sat Jun 03, 2006 6:02 pm

Thanks, I will give it a try...and let you know how it works out! Thanks for taking the time to respond! More to come....

SPurt

Posted: Sat Jun 03, 2006 11:19 pm

Well..it went "pretty" well, except that the nuke_user table format seems to be different than the RN76 format, so I am not able to load my users.

ALso, for whatever reason, the modules that I had added are not showing up either (the default stuff does, but not my add ons, even tho the modules still exist on the website..arg). I am assuming I am having to create a group in order to see them.

Still working on it, but any idea how I might be able to restore my users from the backups from the phpnuke 7.8 files?

Thanks
spurt

Posted: Sun Jun 04, 2006 12:01 am

Actually, I believe one small step was missed. We have to always keep in mind that RN76 comes with NSN Groups which alters several key core nuke tables. I think your module issue might be related to this.

Find the file rn76_nsngroups.sql under the INSTALLATION/sql folder and execute those statements on your old downgraded database and then you would want to reconcile the data within the old downgraded db to the new RN76 one:

nuke_blocks
nuke_message
nuke_modules

I would also check Raven's 2.02.02 post release patch forum and make sure you have done what it asks you to do (but read them all first to make sure you have the complete "picture")

Good luck!

Posted: Sun Jun 04, 2006 12:35 am

I think I got it all working....any thoughts on how to recover my users from the old DB? For whatever reason, the installation process seems to have dropped all of my users (the downgrade installation process).

Spurt

Posted: Sun Jun 04, 2006 12:43 am

I would be very surprised if the actual downgrade dropped your users. That downgrade script produces a working nuke7.6 installation. Had you made any changes to the nuke_users table when it was still 7.8?

Personally, I would dump the table structure from your old backed up original 7.8 database and compare it to RN76 and see what differences you can find. Or, you could post the 7.8 nuke_users table structure (NOT DATA) here so we can see what is different.

Posted: Sun Jun 04, 2006 10:09 am

The big difference is in the "after downgrade" nuke_users table, which has a large number of custom fields at the end. It looks like the downgrade script does not prune those other fields. What I did was load a copy of the "after downgrade db", and delete those extra fields from the structure, then create an export file, and imported it into my production db. It seems to have done the trick. I think (knock on wood) that I am operational. Now, just need to learn about NSN groups and how to make that work. Seems to be clear enough....but I have some "learnin" to do. Thanks for all the help. FYI...below are the DB structures showing what each looked like (Ravens, plus mine, after the downgrade). You guys are the best!

here is the structure from the RN76 nuke_users table:

--
-- Table structure for table `nuke_users`
--

CREATE TABLE `nuke_users` (
`user_id` int(11) NOT NULL auto_increment,
`name` varchar(60) NOT NULL default '',
`username` varchar(25) NOT NULL default '',
`user_email` varchar(255) NOT NULL default '',
`femail` varchar(255) NOT NULL default '',
`user_website` varchar(255) NOT NULL default '',
`user_avatar` varchar(255) NOT NULL default '',
`user_regdate` varchar(20) NOT NULL default '',
`user_icq` varchar(15) default NULL,
`user_occ` varchar(100) default NULL,
`user_from` varchar(100) default NULL,
`user_interests` varchar(150) NOT NULL default '',
`user_sig` varchar(255) default NULL,
`user_viewemail` tinyint(2) default NULL,
`user_theme` int(3) default NULL,
`user_aim` varchar(1 Cool

default NULL,
`user_yim` varchar(25) default NULL,
`user_msnm` varchar(25) default NULL,
`user_password` varchar(40) NOT NULL default '',
`storynum` tinyint(4) NOT NULL default '10',
`umode` varchar(10) NOT NULL default '',
`uorder` tinyint(1) NOT NULL default '0',
`thold` tinyint(1) NOT NULL default '0',
`noscore` tinyint(1) NOT NULL default '0',
`bio` tinytext NOT NULL,
`ublockon` tinyint(1) NOT NULL default '0',
`ublock` tinytext NOT NULL,
`theme` varchar(255) NOT NULL default '',
`commentmax` int(11) NOT NULL default '4096',
`counter` int(11) NOT NULL default '0',
`newsletter` int(1) NOT NULL default '0',
`user_posts` int(10) NOT NULL default '0',
`user_attachsig` int(2) NOT NULL default '0',
`user_rank` int(10) NOT NULL default '0',
`user_level` int(10) NOT NULL default '1',
`broadcast` tinyint(1) NOT NULL default '1',
`popmeson` tinyint(1) NOT NULL default '0',
`user_active` tinyint(1) default '1',
`user_session_time` int(11) NOT NULL default '0',
`user_session_page` smallint(5) NOT NULL default '0',
`user_lastvisit` int(11) NOT NULL default '0',
`user_timezone` tinyint(4) NOT NULL default '10',
`user_style` tinyint(4) default NULL,
`user_lang` varchar(255) NOT NULL default 'english',
`user_dateformat` varchar(14) NOT NULL default 'D M d, Y g:i a',
`user_new_privmsg` smallint(5) unsigned NOT NULL default '0',
`user_unread_privmsg` smallint(5) unsigned NOT NULL default '0',
`user_last_privmsg` int(11) NOT NULL default '0',
`user_emailtime` int(11) default NULL,
`user_allowhtml` tinyint(1) default '1',
`user_allowbbcode` tinyint(1) default '1',
`user_allowsmile` tinyint(1) default '1',
`user_allowavatar` tinyint(1) NOT NULL default '1',
`user_allow_pm` tinyint(1) NOT NULL default '1',
`user_allow_viewonline` tinyint(1) NOT NULL default '1',
`user_notify` tinyint(1) NOT NULL default '0',
`user_notify_pm` tinyint(1) NOT NULL default '0',
`user_popup_pm` tinyint(1) NOT NULL default '0',
`user_avatar_type` tinyint(4) NOT NULL default '3',
`user_sig_bbcode_uid` varchar(10) default NULL,
`user_actkey` varchar(32) default NULL,
`user_newpasswd` varchar(32) default NULL,
`points` int(10) default '0',
`last_ip` varchar(15) NOT NULL default '0',
PRIMARY KEY (`user_id`),
KEY `uname` (`username`),
KEY `user_session_time` (`user_session_time`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1 AUTO_INCREMENT=4 ;

Here is the structure from my "downgraded" DB backup (I assume this is the version you would want to see. Maybe where I went wrong was going through the "INSTALLATION" process for RN76? That might have wiped my user table (altho the downgraded backup occurred BEFORE the install). Here is structure:

CREATE TABLE `nuke_users` (
`user_id` int(11) NOT NULL auto_increment,
`name` varchar(60) NOT NULL default '',
`username` varchar(25) NOT NULL default '',
`user_email` varchar(255) NOT NULL default '',
`femail` varchar(255) NOT NULL default '',
`user_website` varchar(255) NOT NULL default '',
`user_avatar` varchar(255) NOT NULL default '',
`user_regdate` varchar(20) NOT NULL default '',
`user_icq` varchar(15) default NULL,
`user_occ` varchar(100) default NULL,
`user_from` varchar(100) default NULL,
`user_interests` varchar(150) NOT NULL default '',
`user_sig` varchar(255) default NULL,
`user_viewemail` tinyint(2) default NULL,
`user_theme` int(3) default NULL,
`user_aim` varchar(1 Cool

default NULL,
`user_yim` varchar(25) default NULL,
`user_msnm` varchar(25) default NULL,
`user_password` varchar(40) NOT NULL default '',
`storynum` tinyint(4) NOT NULL default '10',
`umode` varchar(10) NOT NULL default '',
`uorder` tinyint(1) NOT NULL default '0',
`thold` tinyint(1) NOT NULL default '0',
`noscore` tinyint(1) NOT NULL default '0',
`bio` tinytext NOT NULL,
`ublockon` tinyint(1) NOT NULL default '0',
`ublock` tinytext NOT NULL,
`theme` varchar(255) NOT NULL default '',
`commentmax` int(11) NOT NULL default '4096',
`counter` int(11) NOT NULL default '0',
`newsletter` int(1) NOT NULL default '0',
`user_posts` int(10) NOT NULL default '0',
`user_attachsig` int(2) NOT NULL default '0',
`user_rank` int(10) NOT NULL default '0',
`user_level` int(10) NOT NULL default '1',
`broadcast` tinyint(1) NOT NULL default '1',
`popmeson` tinyint(1) NOT NULL default '0',
`user_active` tinyint(1) default '1',
`user_session_time` int(11) NOT NULL default '0',
`user_session_page` smallint(5) NOT NULL default '0',
`user_lastvisit` int(11) NOT NULL default '0',
`user_timezone` tinyint(4) NOT NULL default '10',
`user_style` tinyint(4) default NULL,
`user_lang` varchar(255) NOT NULL default 'english',
`user_dateformat` varchar(14) NOT NULL default 'D M d, Y g:i a',
`user_new_privmsg` smallint(5) unsigned NOT NULL default '0',
`user_unread_privmsg` smallint(5) unsigned NOT NULL default '0',
`user_last_privmsg` int(11) NOT NULL default '0',
`user_emailtime` int(11) default NULL,
`user_allowhtml` tinyint(1) default '1',
`user_allowbbcode` tinyint(1) default '1',
`user_allowsmile` tinyint(1) default '1',
`user_allowavatar` tinyint(1) NOT NULL default '1',
`user_allow_pm` tinyint(1) NOT NULL default '1',
`user_allow_viewonline` tinyint(1) NOT NULL default '1',
`user_notify` tinyint(1) NOT NULL default '0',
`user_notify_pm` tinyint(1) NOT NULL default '0',
`user_popup_pm` tinyint(1) NOT NULL default '0',
`user_avatar_type` tinyint(4) NOT NULL default '3',
`user_sig_bbcode_uid` varchar(10) default NULL,
`user_actkey` varchar(32) default NULL,
`user_newpasswd` varchar(32) default NULL,
`points` int(10) default '0',
`last_ip` varchar(15) NOT NULL default '0',
`custom1` varchar(255) default NULL,
`custom2` varchar(255) default NULL,
`custom3` varchar(255) default NULL,
`custom4` varchar(255) default NULL,
`custom5` varchar(255) default NULL,
`custom6` varchar(255) default NULL,
`custom7` varchar(255) default NULL,
`custom8` varchar(255) default NULL,
`custom9` varchar(255) default NULL,
`custom10` varchar(255) default NULL,
`custom11` varchar(255) default NULL,
`custom12` varchar(255) default NULL,
`custom13` varchar(255) default NULL,
`custom14` varchar(255) default NULL,
`custom15` varchar(255) default NULL,
`custom16` varchar(255) default NULL,
`custom17` varchar(255) default NULL,
`custom18` varchar(255) default NULL,
`custom19` varchar(255) default NULL,
`custom20` varchar(255) default NULL,
`custom21` varchar(255) default NULL,
`custom22` varchar(255) default NULL,
`custom23` varchar(255) default NULL,
`custom24` varchar(255) default NULL,
`user_show_custom1` tinyint(2) NOT NULL default '1',
`user_show_custom2` tinyint(2) NOT NULL default '1',
`user_show_custom3` tinyint(2) NOT NULL default '1',
`user_show_custom4` tinyint(2) NOT NULL default '1',
`user_show_custom5` tinyint(2) NOT NULL default '1',
`user_show_custom6` tinyint(2) NOT NULL default '1',
`user_show_custom7` tinyint(2) NOT NULL default '1',
`user_show_custom8` tinyint(2) NOT NULL default '1',
`user_show_custom9` tinyint(2) NOT NULL default '1',
`user_show_custom10` tinyint(2) NOT NULL default '1',
`user_show_custom11` tinyint(2) NOT NULL default '1',
`user_show_custom12` tinyint(2) NOT NULL default '1',
`user_show_custom13` tinyint(2) NOT NULL default '1',
`user_show_custom14` tinyint(2) NOT NULL default '1',
`user_show_custom15` tinyint(2) NOT NULL default '1',
`user_show_custom16` tinyint(2) NOT NULL default '1',
`user_show_custom17` tinyint(2) NOT NULL default '1',
`user_show_custom18` tinyint(2) NOT NULL default '1',
`user_show_custom19` tinyint(2) NOT NULL default '1',
`user_show_custom20` tinyint(2) NOT NULL default '1',
`user_show_custom21` tinyint(2) NOT NULL default '1',
`user_show_custom22` tinyint(2) NOT NULL default '1',
`user_show_custom23` tinyint(2) NOT NULL default '1',
`user_show_custom24` tinyint(2) NOT NULL default '1',
PRIMARY KEY (`user_id`),
KEY `uid` (`user_id`),
KEY `uname` (`username`),
KEY `user_session_time` (`user_session_time`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1 AUTO_INCREMENT=39 ;

Posted: Sun Jun 04, 2006 11:35 am

if it was me....id make another database....and drop all the extra rows...as i see no reason for em at all... but u are the webmaster and must make sure that ur extra mods do not use these ...i honestly cant see a reason why...but check em

Posted: Sun Jun 04, 2006 11:44 am

The 'custom' and 'show_user_custom' fields look very much like additional fields installed by another module, possibly the 'Profile' or 'Add Fields' mods.

You may want to evaluate their use - do your users actually use them?
It is critical for your site to have these additional fields?

From what I understand of this thread, you no longer have any user data so I would remove those fields to get your ite up and running. If it is essentail that you have then you could re add them later using the instructions that came with the module.
FYI - it is usually considered undesirable to instal mods that require modifications of the core tables - as you have found out, it really mucks the job up when upgrading.

Posted: Sun Jun 04, 2006 11:49 am

i couldnt agree more...it also makes for more security risks...just a piece of advice

Posted: Sun Jun 04, 2006 11:54 am

Thanks, all..I have opted to run without them. They could be some leftover from some mod that I attempted to add at one point in my super-noob days (vs my current status of merely "noobie."

Anyway...I have not been able to find anything not working, so I am pretty stumped as to where they came from.

So, before I close this thread...maybe a recommendation from you experts....

- The only thing I have left to do is get a Teamspeak module added, and, perhaps, a shoutbox. Knowing I am now on RN76, would you have any guidance here (so I don't muck myself up further?????

Thanks, all!

Posted: Sun Jun 04, 2006 12:01 pm

personally i think shoutbox would have little to no conflicts with ravens nuke...although guardian would hold a bit more credibility with that...got their hands in on it.

go no experience with teamspeak...but i do believe raven and the team did their best to not sacrifice the users ability to install what u could install with regular nuke.

Security was the key but functionality was right up there...from what i can see out of the script.

Posted: Sun Jun 04, 2006 12:20 pm

I'm using the Quiecom shoutblock 2.4... is running like normal... I can't tell you much about security though ;(

Posted: Sun Jun 04, 2006 3:33 pm

I have never used a Teamspeak module or a Shoutbox add-on so have never evaluated one from a security aspect.

I am guessing that a TeamSpeak module would need access to an external server or source and for that reason alone it is worth doing some research.
You might want to check the aarchives at www.secunia.com for example to se if there are any known exploits.

Posted: Sun Jun 04, 2006 5:33 pm

Thanks...I will check these things out!

Posted: Sun Jun 04, 2006 5:59 pm

Also, check out Shoutbox over at ourscripts.net.

Posted: Sun Jun 04, 2006 6:32 pm

I tried downloading a Teamspeak block, and it does not show up in the dropdown list of available blocks in Admin. So, I thought there might be something wrong with the block, so I went and grabbed one of Raven's blocks that I like, WhoIsWhere, and I get the same affect.

How do you get visibility to a block once you put it on your site, so you can activate it?

Posted: Sun Jun 04, 2006 7:13 pm

Upload the block to your blocks directory, then go to your nuke administration panel - www.yoursite.com/admin.php and log in as an admin.
When the page refreshes, click on the 'blocks' icon near the top of the page.

You should then have a list off the currently running blocks and further down the page is where you activate new blocks.
In the field labeled 'Filename' select the block you want to use from the list and change the other settings to suit your needs.
Finally click the 'Create Block' link at the bottom of the page.

Posted: Sun Jun 04, 2006 7:34 pm

Sorry...I guess I was not very clear.....sorry about that.

When you note that you go further down the page into the area where you activate a new block, the new blocks for which I have moved a block-* file into the blocks directory does not show in the drop down list. That is what I meant I was trying to do...make it appear in that dropdown.

I see all the other files, for which there is a block- file in the block subdirectory, but not for the two add-ons for which I just ftp'd new files into there for.

Hope that is a little clearer....?

Posted: Sun Jun 04, 2006 7:51 pm

Yes thank you.
Out of curiosity, do you get the same problem when installing a new module?

No, forget that, you do not want to be installing modules for the sake of it.
Could you post a copy of the following table schema please;
nuke_blocks
nuke_modules
Just the schema not the actual data in them (just like you did before in a previous post).

Posted: Sun Jun 04, 2006 7:51 pm

It is..but its still not enough to make an accurate assesment of whats goin on...can u link one of us to the admin part of ur site...along with ftp so that we can see the exact problem...thanx.