New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
@Francisco Happy festivus! Do you want me to bring you a pole?
I don't swing that way, sorry.
Francisco
:-(
Still having issues with the block storage. Sounds more than a FS broken but like an underlying device issue. My kernel says it got some I/O errors when accessing the device. So still waiting for Frans to solve the issue (if he's not asleep yet).
Hope you get better!
I'll get a reply in a few.
We had a interesting case that I bet is the same as yours related to QCOW images. The image simply...didn't know how big it was. A quick fix, but it would make it so the user would see the wrong size inside of their VM.
Francisco
@Francisco was transparent about the situation and was on top of the issue with my block storage. I feel like I should be paying him a lot more for the service I receive.
JUST DO IT!
Restore from backups? You do have backups, right?
My VPS was fine after the power outage, but my slab was corrupted to the point where it won't even mount any more. No worries, I do daily backups so I just restored from backup onto the VPS, and will wipe the slab, reformat it, and move everything back once I've got some free time.
If you don't have backups, maybe this is a wakeup call.
Quoted for truth.
Backups are for pussies. Real men take real risks and shed manly tears later.
Be a man and don't make backups.
Condoms are for pussies. Real men take real risks and shed manly tears later.
Be a (dead) man and gamble with your life.
Thanks all. The issue has been corrected! My data does not lose but it takes time to recover. I also got the 3-month credits. I use this VPS to backup other servers. I will consider doing a local backup on my computer for this VPS once a week.
Irony is, This one was my BACKUP server
And, It had backup of few of my sites that I terminated last week. I was going go live with this backups on new server after this holiday. Yesterday, I was going to download those backup on my local machine, and this had to happen.
I guess I need to keep backup of my backup.
I know I won't get any sympathy here, But can anybody suggest a hosting provider where I can store backup of my backup?
Get a cheap storage VPS, or use something like Backblaze B2.
https://www.lowendstorage.win/ is a good reference. Hetzner have some good storage boxes too, particularly if you want to store a lot of data.
Ideally you have a backup of the backup of the backup.
Yeah, use them the way God intented!
Mine didn't survive since the underlying device is gone due to some software bugs. I was offered compensation and I'm gonna move on and start recovering data from backups. Lost maybe a few days of data since last snapshot, but nothing was critical.
Also I'm gonna get a second volume so I can do a RAID-1 over it for extra safety.
The main issue we've learned is QCOW2 is just a mess when it comes to larger volumes and any sort of repairs to it.
We've been swapping people to RAW's and have actually converted a few people today from QCOW to RAW as well. It takes a bit of time, but in the off chance there's ever an issue, there's no funny business.
As I mentioned, the power changes are due this month if I can help it, start of January worst case, so that rules that out of the question.
Francisco
You want a condom during penetration tests to avoid SQL injection.
removed some unnecessary beefy reply
I'll take my lumps.
Some of it was QCOW being stupid. Some of it was me being in a panic and not having a procedure list laying out what we should do when shit hits the Fran. That list exists now, but it doesn't help in this case.
Still, we're adjusting where needed and i never want to see a repeat of this.
Francisco
Nice one.
I've grown to love self deprecating humor I mean, there's a site dedicated to it.
Francisco
I got an email within like 30 minutes or so of the power outage letting me know exactly what happened.
Some googling last night makes me wonder if the qcow2 problems affecting people here might be related to resizing the slabs (mine was resized at my request, and is corrupted now). Anyone have a scroggled one that was never resized?
My slabs weren't in use or partitioned at the time of the power outage, they seem fine though and my VPS is recognizing them - are they safe to use now? Thanks
You should ticket to see if yours are in qcow or raw format. I believe Fran started to convert people into raw, so if you haven't started using it, it's a good time to do so -- just a re-provision.
Mine is 256GB fresh volume and trashed.
Only had to run fsck on my slab after the outage and other then some random sluggishness, no major problems since.