Mike Neir's Page[ignignokt][err]
Mike should proofread his status updates better. (7 hours ago)
Viewing 5 posts tagged with 'mysql'
(Oldest First :: Newest First)
Show related: del.icio.us links, tags

Cached

Sunday, October 26 2008, 9:13 PM

As most people probably can discern by reading the backlog of content entries here, I'm a fan of Memcache. It makes database driven applications crazy fast when used properly, and can be damn simple to integrate if your code is set up properly. I integrated it with the monitoring system I wrote at work a while back to take some of the load off MySQL, and it's worked exceptionally well.

While checking something else out in the monitoring system, I ran a report on the current Memcache status, and was kind of blown away. The system currently consists of 16 servers, 15 of which have memcached running on them, with 512MB allocated on each. That's 7.5GB of cache memory, for those that don't like doing math. I'll let the report speak for itself...

192.168.0.2:11211
uptime: 563.945474537 days
read: 18097.7607219 GB
written: 19537.6376228 GB

192.168.0.3:11211
uptime: 563.944502315 days
read: 18373.8532251 GB
written: 19785.8979402 GB

192.168.0.4:11211
uptime: 429.195578704 days
read: 13156.7254652 GB
written: 14532.1054876 GB

192.168.0.5:11211
uptime: 563.944247685 days
read: 19168.9044306 GB
written: 20775.6700451 GB

192.168.0.6:11211
uptime: 563.944212963 days
read: 18374.297407 GB
written: 19933.5923319 GB

192.168.0.7:11211
uptime: 563.944178241 days
read: 17361.7501419 GB
written: 18974.0357142 GB

192.168.0.8:11211
uptime: 563.942581019 days
read: 17525.4281332 GB
written: 18935.3812126 GB

192.168.0.9:11211
uptime: 317.73099537 days
read: 11330.5213323 GB
written: 12179.3746607 GB

192.168.0.10:11211
uptime: 0.774074074074 days
read: 3.608856056 GB
written: 5.957609009 GB

192.168.0.11:11211
uptime: 270.114976852 days
read: 9460.02688244 GB
written: 10477.9305441 GB

192.168.0.12:11211
uptime: 446.070590278 days
read: 14058.0880373 GB
written: 15349.2392257 GB

192.168.0.13:11211
uptime: 433.269293981 days
read: 13117.9202484 GB
written: 14265.9189342 GB

192.168.0.14:11211
uptime: 288.806412037 days
read: 9547.86924515 GB
written: 10396.3484227 GB

192.168.0.15:11211
uptime: 98.0899074074 days
read: 3658.49374042 GB
written: 4026.71671353 GB

192.168.0.16:11211
uptime: 18.6412731481 days
read: 529.824877851 GB
written: 591.686248784 GB

uptime (total): 5686.35829861 days
bytes read (total): 183.765072745 TB
bytes written (total): 199.767492713 TB

In just the current running processes, there is over 15 years of combined uptime, with 9 memcached processes up for over a year... 183 terabytes of data read from the memcached processes and 199 terabytes written. That's a lot of uptime and a lot of data! I've got a couple of crash-happy servers in the cluster too. Without those, the numbers would be higher.

For those wondering, the write number is higher than the read number because the latest snapshot data is stored into memcache for easy retrieval each time data is collected. The read numbers are part of the snapshot storage process as well, and would also be higher if there was more activity on the web interface.

Tags:

A Public Service Message

Friday, May 05 2006, 4:49 PM

It is my recommendation to all system administrator types to NOT try a direct upgrade from mysql 4.0 to mysql 5.0. It's not a good idea, especially when your tables are still stored in a mysql 3.23.x format. I made the assumption that there would be some conversion utility that would upgrade tables easily. I didn't find one. Had I done a full SQL dump, I might have had an easier time. But no, I just made backups of the data files themselves.

All of this resulted in a large pain in my ass, as I did a full emerge of mysql 5.0 and php 4.4.2 only to find that mysql 5 didn't like my data. So I tried emerging back to 4.1, which worked somewhat, well enough to get things back to a read-only state, but it still didn't like the table format. In response to that, I copied my mysql data directory to another machine still running mysql 4.0, and did a full database dump, like I should have in the first place. I was able to import that dump successfully into mysql 4.1 since it actually blew away all the old tables and replaced them with the same data, only in the newer table format.

So if you happened to see that my website was down last night for around 9 hours last night, now you know why. Be ye not so stupid.

Tags:

We've reached our cruising altitude of 36,000 feet...

Monday, August 23 2004, 11:13 PM

Yah, that's what life seems like right now... just kinda cruising, everything is the same day in and day out. I guess that's what I can look forward to in the adult working world. It'd be nice if there was something new that could occupy some of my time. Oh well.

I was (somewhat painfully) reminded yesterday of how bad I used to be at PHP/MySQL coding. I did some updates to my music stats project that I started like 4 years ago, and holy crap is the code ugly. I guess I shouldn't be surprised, because I didn't know the stuff. That's not to say that I'm "good" now, but I can certainly make things cleaner and more efficient than that. Oh well.

I had another one of those rare guitar moments today, the kind that make me want to keep playing and learning. I had already played my loud stuff right after I got off work, but I was bored, so I went down later on in the evening just to doodle. The distortion was all off and I was just walking little patterns up and down the higher strings, but it sounded really cool. I had the gain on the clean channel turned up more than usual, and that combined with the neck-bridge pickup combination just made the guitar sing. I really need to pick up a power dampener so I can turn up the gain more without making the rig so loud that it makes the furnace resonate. I can't imagine that the neighbors or my roommates like that too much. Oh well.

I uploaded some pictures of the new place today. There are some pictures of the place barely moved in, somewhat moved in, and totally moved in. They're not labelled, so you'll have to imagine where they are. Oh well.

I should have named this post "Oh Well".

My server just hit 200 days of uptime the other day and that's pretty neat... Oh the joys of having a box in a stable environment with no heat or power problems. It also helps that I have Linux running on there... there's no way a windows server would have lasted even 1/3 as long. Windows blows. Oh well?

Tags:

Gaim goodness!

Friday, January 30 2004, 9:07 PM

Wow... work has sucked the past few days... it's been really busy the past few days, and it's been stressing me out pretty good. Yesterday I was the only person there until like 11:30 or so, which is definitely a pain in my ass... everybody seemed to have a legitimate reason for not being there, but shit. Other than that, it's just been really busy... lots of calls, lots of stupid live chats, lots of help desk tickets. It always seems like the combination of the three always seems to prevent any kind of consistent work. Every time I get started with something, the phone rings or a live chat appears and I get totally interrupted. It never fails. Oh well.

I also got the MySQL Gaim plugin all upgraded last night too, finally. It took an hour or two to dig through the very small amount of perl interface documentation that the Gaim developers provide and some source code for the perl interface. Once I got the interface made, converting the old code to the new interface was pretty easy. Just a lot of copying in pasting. It works pretty sweet, just like the old one. I'll probably post the interface sometime in the future... It took me a while to figure it out, so hopefully it'll help someone else.

After my programming victory, I went out with Joe and Shauna to Arts in Lansing. Joe got pretty tanked, and so did I. It was a pretty fun time, minus this morning's hangover. It was a good time. Pics in the Gallery.

Tags:

Midnight Madness

Tuesday, September 09 2003, 3:22 AM

Yah, it's 3:22am, and I'm at work. It's my week to work midnights, as it will be once every two months for the forseeable future. It's really not that bad. It's quite calm for the most part... very few phone calls or help desk tickets, so I can just catch up on work or just zone out... I've brought in my guitar the past couple nights to give me something to do while nothing else is going on, so that's cool. Just been doodling around with that.

Otherwise, not much is going on. I got my crashing problem on the new Gentoo install licked... I just had to change the boot display from AGP to PCI in the BIOS and it solved whatever hardware issue existed that caused the computer to lock up. Score. And I've got my MySQL logger plugin for Gaim working pretty well. Another couple features and it'll be done. There are a few other windows to linux conversions/imports I have to do still, but that will probably wait until I'm back on a normal time schedule.

Oh yah, before I forget, Amanda is awesome!

Tags:

Related Tags

                                   


RSS Feed | Comments RSS Feed | Valid HTML 4.01 | Valid CSS
Memcache: Hits: 63 Misses: 3 Updates: 3 Deletes: 0 LocalHits: 45 Time: 0.0141
MySQL: Selects: 8 Inserts: 4 Updates: 0 Deletes: 0 Time: 1.6569
Page Render Time: 1.8434 seconds