I think it's about time I got a second database server from my datacenter. We've tapped out this one I'm pretty sure. MyBB allows for master/slave replication where the slave will get all the SELECT queries which for this site is plenty.
I'll see how the next week or two goes but a new setup shouldn't be too hard as I only run MySQL on it and it's on the local loop.
Sorry that I'm turning off the site but I'm trying to adjust MySQL and clear up these locks.
Coolio, thanks for the update Omni... :)
For how long will HF be down?
I knew hackforums was big, but wow, two servers for SQL. Impressive.
~A
Thanks for letting us know. And yeah how long?
If more of us valued food and cheer and song above hoarded gold, it would be a merrier world
~Thorin Oakenshield
Sounds like a lot more pictures to be uploaded!
01000101
DO NOT DEAL WITH THIS MEMBER
Thanks for letting us know Omniscient, now I know why you haven't replied to my PM yet, your obviously busy. 😝
Once again, cheers for the update, hopefully it will make the forum run a bit faster. 😁
maybe we should have a thing if your not active for a year or something your account gets deleted or something
Sounds good. Maybe this will speed up the site a little
(Oct 13, 2010 11:30 AM)BuyOMC Wrote: maybe we should have a thing if your not active for a year or something your account gets deleted or something
I'm pretty sure that Omni already has a member pruning thing in place.
I hope we wont get the max users error anymore and yeah for how long?
Omni is working too hard for HF. Great job Omni, I apperciate that and everybody does.
The database is currently 5GB in size and we have 500 queries per second. The posts table is 2.5GB and the PM table is 1.8GB.
We had a DB crash yesterday and since then the server hasn't been so perfect. I know that a DB restart now can take 15-30 minutes before all the caching is set and it runs smoothly. So every restart has to be babysat.
I think right now I finally got it running normal but in a month or so when it crashes again I'm pretty sure that I'll need the 2nd DB. I've known this would get to that point for many months. HF gets bigger not smaller so more hardware will always be required. I've gone a long time on the one server though. I can probably stretch another month from it and get to a 6GB database but beyond that I think we're tapped out.
I've not yet run a master/slave MySQL DB but it doesn't appear too complicated or above my skillset.
I can do one of two things...either get master/slave config or upgrade the single DB server to a dual-quad with 16gb ram. It's actually cheaper to do the master/slave but it's of course slightly more complicated.
I know a few times per day we hit the max users error for the DB but it's not wise to make the limit higher than what I have. It's preventing the server from a complete crash and usually the connects clear up within 3-5 minutes which is way better than a crash and restart which could result in hours of downtime if I'm not around.
Just be aware of these issues and know I'm working on them.
DO NOT DEAL WITH THIS MEMBER
(Oct 13, 2010 11:35 AM)Omniscient Wrote: The database is currently 5GB in size and we have 500 queries per second. The posts table is 2.5GB and the PM table is 1.8GB.
We had a DB crash yesterday and since then the server hasn't been so perfect. I know that a DB restart now can take 15-30 minutes before all the caching is set and it runs smoothly. So every restart has to be babysat.
I think right now I finally got it running normal but in a month or so when it crashes again I'm pretty sure that I'll need the 2nd DB. I've known this would get to that point for many months. HF gets bigger not smaller so more hardware will always be required. I've gone a long time on the one server though. I can probably stretch another month from it and get to a 6GB database but beyond that I think we're tapped out.
I've not yet run a master/slave MySQL DB but it doesn't appear too complicated or above my skillset.
I can do one of two things...either get master/slave config or upgrade the single DB server to a dual-quad with 16gb ram. It's actually cheaper to do the master/slave but it's of course slightly more complicated.
I know a few times per day we hit the max users error for the DB but it's not wise to make the limit higher than what I have. It's preventing the server from a complete crash and usually the connects clear up within 3-5 minutes which is way better than a crash and restart which could result in hours of downtime if I'm not around.
Just be aware of these issues and know I'm working on them.
You should clear out the PM's table. Obviously you'd have to let the members know first though. 😝
Thanks for doing this Omniscient.
Thank you for keeping us all up to date.
|