+- Hack Forums (https://hackforums.net)
+-- Forum: Hack Forums Official Information (https://hackforums.net/forumdisplay.php?fid=1)
+--- Forum: Site News (https://hackforums.net/forumdisplay.php?fid=2)
+--- Thread: [News] Mass Pruning (/showthread.php?tid=6231582)
Mass Pruning - Omniscient - Jan 25, 2023
I'm deleting huge amounts of content older than 9 years on HF mainly in Social tab. Right now 350,000 threads are being deleted. I will likely continue huge pruning throughout the day along with recounts of member post count. Then also pruning of accounts with 0 posts or inactivity beyond a certain point. I'm purging lots of data today from the DB.
It's got no value anymore.
Thanks.
RE: Mass Pruning - Lrrr - Jan 25, 2023
well, rip to myfucking postcount I suppose, though it might be nice to clean up the forum a bit
RE: Mass Pruning - Zher0 - Jan 25, 2023
Yep... rip to the post counts. I was trying to hit 5k!
RE: Mass Pruning - Omniscient - Jan 25, 2023
Well looks like some choking in the pruning queries. Not fully happy with how it's going. Taking 1 minute to delete 1000 posts and doing 10,000 queries each time. To do a million posts will take 1000 minutes, which I'm guessing will take 15 hours to run.
Well, I'll just let it do the thing.
RE: Mass Pruning - Pancake Boat - Jan 25, 2023
How much is that storage wise? Or is this more about keeping the forum fresh?
RE: Mass Pruning - Omniscient - Jan 25, 2023
(Jan 25, 2023 12:42 PM)Caligio Wrote: How much is that storage wise? Or is this more about keeping the forum fresh?
Well, old data is kept partially for SEO purposes. But eventually the content is just old and takes up resources beyond that value. Even the default search engine of HF only goes back for threads up to 1 year.
When I delete the older posts and threads. This means some ancient inactive accounts now have 0 posts. So those get deleted too. Opens up potentially some OG usernames for new and active HF members.
RE: Mass Pruning - Dredd - Jan 25, 2023
I'll have to start posting more otherwise I'll never get the 24k award at this rate 😂
RE: Mass Pruning - Omniscient - Jan 25, 2023
(Jan 25, 2023 01:17 PM)Dredd Wrote: I'll have to start posting more otherwise I'll never get the 24k award at this rate 😂
I may have to eventually do an award for Old Fag accounts 10+ years that have made it without being closed. 😈
You're literally just week away from 10 years.
RE: Mass Pruning - Uriel Septim - Jan 25, 2023
(Jan 25, 2023 01:39 PM)Omniscient Wrote: I may have to eventually do an award for Old Fag accounts 10+ years that have made it without being closed. 😈
You're literally just week away from 10 years.
All these years of lurking will finaly pay off
RE: Mass Pruning - Cap - Jan 25, 2023
(Jan 25, 2023 01:39 PM)Omniscient Wrote: I may have to eventually do an award for Old Fag accounts 10+ years that have made it without being closed. 😈
You're literally just week away from 10 years.
That would be pretty cool to see actually.
RE: Mass Pruning - DashPHP - Jan 25, 2023
Ooooh. 10+ Year award sounds dope!
RE: Mass Pruning - Komodo - Jan 25, 2023
(Jan 25, 2023 01:39 PM)Omniscient Wrote: I may have to eventually do an award for Old Fag accounts 10+ years that have made it without being closed. 😈
You're literally just week away from 10 years.
Let’s make it 9 years, 10 is too rounded of a number.
Asking for a friend.
RE: Mass Pruning - Omniscient - Jan 25, 2023
(Jan 25, 2023 02:11 PM)Komodo Wrote: Let’s make it 9 years, 10 is too rounded of a number.
Asking for a friend.
It would be a reason for you to stay another year.
RE: Mass Pruning - Edge - Jan 25, 2023
(Jan 25, 2023 01:39 PM)Omniscient Wrote: I may have to eventually do an award for Old Fag accounts 10+ years that have made it without being closed. 😈
You're literally just week away from 10 years.
I second this idea. Just don't close me in the next 10 months.
RE: Mass Pruning - grady - Jan 25, 2023
(Jan 25, 2023 12:41 PM)Omniscient Wrote: Well looks like some choking in the pruning queries. Not fully happy with how it's going. Taking 1 minute to delete 1000 posts and doing 10,000 queries each time.
Is this just because it's cascading? Confused from a DB/MyBB perspective what'd cause 10 additional queries per post.