Names are dumped garbled

Posted: Wed Apr 02, 2008 9:29 am

Hey all, currently trying to move someones db from one server to another and when doing the export of the existing database, it changes the names listed. I have tried zip compression along with gz with both entire db and with individual tables within the db by themselves with the same result. Looking at the dump files, it appears to be dumping from the first database with these character changes causing the names listed to be changed. Here are some screen shots. First is of existing install and the second one is from the new install. Should say also the existing install is one that is hosted by xampp, and they are looking to move it to their webhost.

http://www.fires-house.com/pics/pic1.jpg

http://www.fires-house.com/pics/pic2.jpg

Any ideas of how I can try and correct this would be appreciated....thanks

Posted: Wed Apr 02, 2008 9:49 am

Make sure the languages of both mysql systems are set the same.

Also, a good way to dump databases, is to bypass cpanel all together(requires root access).

I would run this from command line:

mysqldump -q --opt cpuser_database > /home/cpuser/public_html/database.sql

Remember cpuser is your cpanel username. You need to be logged in as root to run that command. But honestly, I would think this was a character set issue, but without looking at your system, I couldnt be positive.

Posted: Wed Apr 02, 2008 10:04 am

thanks gregexp, I checked and both db's are set english and the character set of the db that I am trying to dump to move is UTF8-unicode. With it being a xampp installation, there really isn't a cpanel involved. It seems to be a problem with the xampp side, since when I do the dump it appears the characters are changed when it is dumped.

Posted: Wed Apr 02, 2008 1:10 pm

Are you using phpmyadmin to dump (export) the stuff? How about try it with no compression on and I think you can dump it right to the screen and see immediately if the characters are getting garbled. Then if they are okay dump them to a file.

Posted: Wed Apr 02, 2008 2:57 pm

I have tried that fkelly, but the size of the db causes it to time out before finishing. I don't think I have tried that though with individual tables....lol...can't remember for sure. Have been working on this way to long I guess..... Smile

I will try that with individual tables with no compression and see what happens.

Posted: Wed Apr 02, 2008 3:42 pm

Oh I thought your suggestion fkelly, was going to do it. It is by far the closest I have gotten to being right. I have noticed since this last step that you suggested that they have hexed fonts in some of their names which dump out as ? instead of the character assuming that is because they have used hexed fonts in their names and they are not recognized by mysql or phpmyadmin causing it to show ? instead of the font they use. This is by far the best I have been able to get it so far. Thanks for that suggestion. Is my assumption a good possibility? Is there another way that I am not doing that would allow these hexed fonts to show correctly?

BTW...I did this on an individual table. There is still one table that was to large to show not using any compression. It would timeout.

Thanks all so far for the help. I have learn so much today on playing with mysql and phpmyadmin. lol.....I guess I like torture, because this is fun to me..... Very Happy

Posted: Wed Apr 02, 2008 4:01 pm

I'm not sure what this "hexed font" is. If you browse the table in PHPmyadmin what do you see in the username field of the users table? Or is this coming from some other table? It is hard for me to imagine a users table being too large to dump. What is the field type of the fields in question. You might be able to write a simple script to take the existing names and convert them to a plain text format and then update the tables storing the plain text (in a varchar field) format of the name. I would definitely want to get rid of (by that I mean convert) any fields that have strange encodings.

Posted: Wed Apr 02, 2008 4:22 pm

This is from other tables than users. This is from a software made to track online gaming stats. Kills, deaths, weapons used, etc.etc. Odd characters that people can put in their names when gaming are called hexed fonts. Instead of a normal t lets say it is more of a cross shape and a little larger. There is a name editor program someone came up with that allows you to add these different characters into your name over and above what a keyboard has on it. The software displays the name as it is in the game, but apparently trying to dump the data the way I am having to, either mysql or phpmyadmin doesn't recognize they characters and then puts a ? in the dump file for that character.

lol...I hope this makes sense. Smile

Posted: Wed Apr 02, 2008 5:43 pm

LOL, I see. On my site they would use A-Z and 0-9. Probably all lower case too. Smile

Good luck with it.

Posted: Wed Apr 02, 2008 6:53 pm

lol....mine too..... Smile