collapse

* Member Info

 
 
Welcome, Guest. Please login or register.
Did you miss your activation email?
I'm beginning to notice some improvement - Cellist Pablo Casals, when asked why, at the age of 93, he is still devoting 3 hrs a day for practicing

Author Topic: Server Upgrade, tonight, June 25th, 9pm Eastern time  (Read 3688 times)

0 Members and 1 Guest are viewing this topic.

Offline Stuart

  • Member
  • Posts: 3177
  • "The Voice of Almiqui"
Re: Server Upgrade, tonight, June 25th, 9pm Eastern time
« Reply #15 on: July 02, 2019, 07:57:14 AM »
Interesting. I'm looking at the raw converted data as well as the browser output.

Could be that the problem is with the server's software. It might be substituting the default code for ? in place of certain character codes in posts written before the upgrade. That's just a guess, but it is something the people at the server site would have to look into.

All we've been running for quite sometime now are beta versions (regardless of how they've been marketed), so it goes with the turf these days.
« Last Edit: July 02, 2019, 08:44:40 AM by Stuart »

Offline Rivers

  • Tech Support
  • Member
  • Posts: 7274
  • I like chicken pie
Re: Server Upgrade, tonight, June 25th, 9pm Eastern time
« Reply #16 on: July 02, 2019, 06:55:21 PM »
No, it's a literal '?' in the database, likely caused by codepage or CCSID differences as the data was copied between databases. We've been communicating with our host and their datacenter. There is no realtime substitution going on, the server is dishing up what's in the database.

We're working on it.

Offline Stuart

  • Member
  • Posts: 3177
  • "The Voice of Almiqui"
Re: Server Upgrade, tonight, June 25th, 9pm Eastern time
« Reply #17 on: July 02, 2019, 07:57:25 PM »
Hi Rivers: Yeah, it was early out here and I had a zillion things to do today, so I wasn't at my best when I wrote my post. Probably the egregious error was using "substituting" instead of its past tense. I'm sure software could be designed to convert in realtime, but it would be a clunky way to do things.

I think once the people at the site are aware of all the problems (problem characters) they can realign things and do the conversion again. With you guys running things behind the scenes, I'm certain there's a backup of the original database they can work from.


Offline Rivers

  • Tech Support
  • Member
  • Posts: 7274
  • I like chicken pie
Re: Server Upgrade, tonight, June 25th, 9pm Eastern time
« Reply #18 on: July 03, 2019, 09:51:48 AM »
You were dead-on correct though; when the tense of 'substitute' is corrected from your initial present continuous to the simple past. The conversion process substituted a literal '?' for all the characters it couldn't convert.

it was a distinct possibility though that the database was correct and the server I/O was replacing them on the way to the browser. After all web servers convert a whole lot of other stuff at runtime. That was one of the first things we had to eliminate, which I did by looking at some problem posts' data records. Charlottzweb data center findings were the same.

The problem is this though. They blew the old server away without a backup very soon after cutover! I'm very surprised but it is what it is.

They do have an image of the server made immediately before migration, but to use it they will need to deploy the whole image on a new temporary server. That would be great, we would be able to figure out what database settings were different, locate all the affected posts and fix them, all with 100% precision and the lowest possible level of risk.

I have asked them to get back to us with what that deployment would take.

I don't see any other professional way to fix this problem. Piecemeal mass sql updates is so error prone it makes me feel queasy. Will keep you posted on status.

Offline Stuart

  • Member
  • Posts: 3177
  • "The Voice of Almiqui"
Re: Server Upgrade, tonight, June 25th, 9pm Eastern time
« Reply #19 on: July 03, 2019, 04:11:30 PM »
Hi Rivers:  Thanks for the detailed reply. I haven't worked with converting databases / textbases on a server in the contemporary computer world, but I've done it with older files that require older equipment (like a 386 running DOS and its word processors such as WordPerfect 4.2; 5.1 & Word along with Windows 3.1 and Chinese Windows 3.1 and WinWord 2 and 6). People in academia often write something and then put it aside, only to find that many years later after they've upgraded several times and ditched their old equipment, they cannot read the files on their floppies and even if they can, they cannot access their files or convert them without losing formatting, Chinese characters (in Big 5; GB2312) when moving up to Unicode. Who wants to type this stuff all over again? (Providing one retained a hard copy or can remember it.) Once was one time too many, so they call on their crazy Ol' Uncle Stuie who never throws anything away and still knows a thing or two. But seriously, the point is that without the proper equipment and conversion software and filters, it's a real mess because unless things are set up correctly and done in proper sequence, text and formatting will not convert correctly.

If the server outfit saved an "image," that is, a sector-by-sector copy (using compression) of the media on which the WC database resided (usually a HDD or SSD--or part of industrial strength storage / memory), they should be able to restore it provided that the image isn't corrupted and the restoration software works correctly. Once they have the restored original, they can try converting small manageable chunks of the database that contain the problematic characters to try to identify the cause of the problem.

Anyway, thank you for all your hard work on this behind the scenes. It's time consuming and energy consuming and takes time away from listening to and playing music, something I think we'd all prefer you to be doing.

Over and Out,

Mr. Know-It-All  ;)


Offline Rivers

  • Tech Support
  • Member
  • Posts: 7274
  • I like chicken pie
Re: Server Upgrade, tonight, June 25th, 9pm Eastern time
« Reply #20 on: July 03, 2019, 05:25:42 PM »
Quote
Once they have the restored original, they can try converting small manageable chunks of the database that contain the problematic characters to try to identify the cause of the problem

They would be "we", as in "me", in all likelihood.  :)

Great post Stuart, can't disagree with anything you've said. What people fail to appreciate, because it's usually so seamless, is that people are tapping away in multiple languages, many with squiggly accented characters, on keyboards all over the planet, using an 8-bit character set and all the memory limitations that implies. I could dive deeper but won't, because it gives me a mild headache. We are a victim of history and lack of foresight.

The best solution is to throw out character sets and standardize planet earth on a single expanded character set. 32 bits would cover it today so 64 bit would be my recommendation this year. We might be invaded by klingons in 2036 and/or have to incorporate god knows what. 64 bits should cover it, but based on the history of computing probably not. So let's go 128 bits.

The good news is we can fix it. Just need the original data.
« Last Edit: July 03, 2019, 05:35:40 PM by Rivers »

Tags:
 


anything
SimplePortal 2.3.7 © 2008-2024, SimplePortal