Looking for a large storage server

Setsura

@simonindia said: setsura

try this will this one ok for you

https://my.redstation.com/server/custom-configurator.aspx?id=250,263,264,265,269,270,273,274,275,276&m=12

Interesting option for the UK, a bit expensive at 330EUR(from GBP), but I suppose that is the price for UK. Thank you.

@Awmusic12635 said: Not even close

Strange, I guess it is because I mostly know "techy" people who work at datacenters and telecoms, they all have a large home NAS usually.

simonindia

@setsura have a chat with their support team you can get better deals just have a conversation and are you ok with the specs

TarZZ92

Setsura said: Strange, I guess it is because I mostly know "techy" people who work at datacenters and telecoms, they all have a large home NAS usually.

yeh 5-10 or even 15TB but not 80TB :D

simonindia

@TarZZ92 said:

some fortunate ones have 80TB NAS in the home not ALL my friends friend have one 120+ but just to show off

Awmusic12635

Setsura said: Strange, I guess it is because I mostly know "techy" people who work at datacenters and telecoms, they all have a large home NAS usually.

Most I have is 12-16TB. Simply don't have the content to justify anything larger.

Hadriel

@MarkTurner said:

More interested in the storage VPS information. Thinking of dumping one of my Time4VPS storage vps.

MarkTurner

Hadriel said: More interested in the storage VPS information. Thinking of dumping one of my Time4VPS storage vps.

Let me know what you need, we've got some great storage VPS

I am playing with a 2TB one at the moment, some tests for you:

FIO (15 jobs / 1 depth):
write: io=31379MB, bw=3124.8MB/s, iops=3124, runt= 10042msec

FIO (20 jobs / 1 depth):
write: io=31749MB, bw=3167.4MB/s, iops=3167, runt= 10024msec

DD 64K:
dd if=/dev/zero of=/dev/vdb bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 3.27381 s, 328 MB/s

Junkless

80 TB home NAS is normal in 2015? And here I am, facepalming everytime I am asked by my friends "why the frack you need 6 TB of storage on your work PC?". I agree most of them can't distinguish between SATA and IDE or know what an SSD is, but still even with those who do (talking about the tech elites, gamers, world renowned overclockers) 80 TB home NAS is NOT normal here.

Couple of years back, a friend wanted a 48 TB media server for home and asked me to arrange one (I was working with a DC vendor at that time) and even that was a pretty amusing day at work.

singsing

This is America! You can have as many TB in your home NAS as you want.

Junkless

@singsing said: This is America! You can have as many TB in your home NAS as you want.

"CAN" is the word. Technically, I CAN dressup like powergirl (showing my moobs and hairy legs). But doesn't mean that it won't be amusing if I decide to go work dressed that way.

rm_

Junkless said: "CAN" is the word. Technically, I CAN dressup like powergirl (showing my moobs and hairy legs). But doesn't mean that it won't be amusing if I decide to go work dressed that way.

Depending on where you work.

As for home storage servers, personally I have a primary one with 10 TB of usable space (7x2TB RAID6), and a backup one with 6 TB (4x2TB RAID5). Also have some 2-3TB drives idle/empty, but as both RAIDs have about 1.5 TB free each, there's no need to expand further for the moment...

exception0x876

I wonder if this thing can store 80TB of data :D https://www.amazon.com/clouddrive/unlimited

Rolter

@exception0x876 said: I wonder if this thing can store 80TB of data :D https://www.amazon.com/clouddrive/unlimited

Someone on Reddit dumped around 32TB's on to it in like a week from their 1Gbit connection and amazon did not complain about it .

But amazon clouddrive has really messed up TOS (It basically says - "Ones you upload data to clouddrive, they can practically do anything with it and own the data.") . Which is one of the reasons OP wants a server , rather than object storage , to be the only one with access to his/her data.

exception0x876

@Rolter said: Which is one of the reasons OP wants a server , rather than object storage , to be the only one with access to his/her data.

OP also mentioned he is open to encrypting data before putting it to object storage

someSguy

@exception0x876 said: I wonder if this thing can store 80TB of data :D https://www.amazon.com/clouddrive/unlimited

I am using acdcli to store data in cloud drive in a encfs container. It's certainly not something stable. (FUSE write support is not 100%, etc..)

@MarkTurner : I suppose you are from delimiter? "Storage" VPS : max 500GB.. Most "storage vps" offers here on lowendtalk go about 3TB max..

GM2015

Do you think if you perma delete your files from there, you'll also erase it from ALL of their servers? I highly don't think so.

You made me read their TOS and it's like what you've said. Given they make backups of the data and manipulate the images to present them in multiple format, I doubt that even perma-deleting solves the issue.

Luckily, I only dumped free to use images and some project images as nth backup there. No longer.

Rolter said: But amazon clouddrive has really messed up TOS (It basically says - "Ones you upload data to clouddrive, they can practically do anything with it and own the data.")

bersy

Hadriel said: Still no pricing or details or link to order? Any idea on when?

I guess, @MarkTurner ?

MarkTurner

someSguy said: I suppose you are from delimiter? "Storage" VPS : max 500GB.. Most "storage vps" offers here on lowendtalk go about 3TB max..

Who said anything about 500GB? Delimiter's StorageVPS scale upto 100TB per disk

You can subdivide the storage as you need into separate disks, its very flexible.

MarkTurner

bersy said: I guess

These are not our modern storage VPS products, these are some antiquated thing from 2013/2014

MeAtExampleDotCom

@Setsura said: Backing up parts of my home NAS of 80~TB.

How good is your Internet connection at the source? Initially pushing stuff of the order of 10s of Tbyte is going to take some time unless you have a very nice fibre link, and pulling it all back down in case of a disaster requiring a full restore could be painful too. As most of it is likely static, you could be better off saving it to multiple external drives & storing them at friend's houses so they are off-site and only keeping the actively changing data to a truly remote location?

bersy

MarkTurner said: These are not our modern storage VPS products, these are some antiquated thing from 2013/2014

http://wiki.delimiter.com/display/DEL/StorageVPS:+Quick+Start is it modern one?

someSguy

@MarkTurner said:

Well, I can't find anything about storage vps on the delimiter.com website. Google only suggests this page; https://clients.delimitervps.com/cart.php?gid=63

MarkTurner

@bersy - this is the wiki article on it: http://wiki.delimiter.com/display/DEL/StorageVPS:+Quick+Start

The ones you mentioned are non-HA, just openvz containers backed by a pile of disks. The modern ones are full HA.

MarkTurner

For kicks - 100TB StorageVPS:

df -h:

raindog308

5% reserved for superuser really hurts at the 100TB scale :-)

How long did that mkfs take?

MarkTurner

raindog308 said: 5% reserved for superuser really hurts at the 100TB scale :-)

I know that whats I thought! Need to tune that.

How long did that mkfs take?

Just playing with software RAID0 to stripe across multiple disks, it helps performance as it uses the multipathing properly

Setsura

@exception0x876 said: I wonder if this thing can store 80TB of data :D https://www.amazon.com/clouddrive/unlimited

I'm currently trying to! Gonna be a while though.

@Rolter said: Someone on Reddit dumped around 32TB's on to it in like a week from their 1Gbit connection and amazon did not complain about it .

But amazon clouddrive has really messed up TOS (It basically says - "Ones you upload data to clouddrive, they can practically do anything with it and own the data.") . Which is one of the reasons OP wants a server , rather than object storage , to be the only one with access to his/her data.

I had read the TOS when I signed up and I thought it was mostly fine, I don't recall seeing anything about this, I'll have to re-read it. Thanks. And yes, I like the idea of being the only one(presumably) with access to the server, so even if my stuff is encrypted, in theory no one should have access to it to just "take a peak" or anything. At least not super easily anyway.

@exception0x876 said: OP also mentioned he is open to encrypting data before putting it to object storage

Indeed, that is certainly within the plan.

@MeAtExampleDotCom said: How good is your Internet connection at the source? Initially pushing stuff of the order of 10s of Tbyte is going to take some time unless you have a very nice fibre link, and pulling it all back down in case of a disaster requiring a full restore could be painful too. As most of it is likely static, you could be better off saving it to multiple external drives & storing them at friend's houses so they are off-site and only keeping the actively changing data to a truly remote location?

I only have 20mbps upload sadly(thanks America), but that is about 6TiB per month out if I go full all the time, which I usually am. I also have plans (mentioned on the first page somewhere) to colo either my NAS, or a secondary NAS nearby my home on a gbit connection and then I can bring drives over to the colo and plug them in and then backup from there.

MarkTurner

In case you wanted to know how 200TB (2 x 100TB in software RAID0) runs:

time mkfs.ext4 /dev/md0

real 3m7.465s user 1m26.982s sys 0m3.914s

df -h:

/dev/md0 195T 20K 185T 1% /mnt

And the infamous but compulsory dd test ;) :

dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync 16384+0 records in 16384+0 records out 1073741824 bytes (1.1 GB) copied, 2.61358 s, 411 MB/s

Fio is better as you can run parallel tests:

15 jobs/1MB blocks:

write: io=63751MB, bw=1061.2MB/s, iops=1061, runt= 60079msec

If we drop to 64KB blocks like the DD test, things getting pretty crazy:

write: io=76504MB, bw=1273.9MB/s, iops=20381, runt= 60058msec

20k IOPS is not bad

2bb3

MarkTurner said: this is the wiki article on it: http://wiki.delimiter.com/display/DEL/StorageVPS:+Quick+Start

Any way to know your pricing without signing up?

MarkTurner

2bb3 said: Any way to know your pricing without signing up?

The landing page isn't up yet, what storage do you need?

Rolter

@Setsura said: I had read the TOS when I signed up and I thought it was mostly fine, I don't recall seeing anything about this, I'll have to re-read it.

The TOS is like i said ,here are some references

http://www.zdnet.com/article/no-privacy-on-amazons-cloud-drive/

www.amazon.com/gp/help/customer/display.html?nodeId=201376540

I would only use it as a backup to another backup , even google drive is better in that sense , atleast for now.

raptorpeanutbuttr

keep in mind that bad attempt at humanity, dude from lostprophets that was convicted of raping a 1 yr old, had a 27tb collection.

@raindog308 said: Son, you've just stated you own 24TB of porn.

Maybe deciding where to store it isn't the real problem...

raindog308

raptorpeanutbuttr said: keep in mind that bad attempt at humanity, dude from lostprophets that was convicted of raping a 1 yr old, had a 27tb collection.

I prefer not to keep that in my mind.

Setsura

@raptorpeanutbuttr said: keep in mind that bad attempt at humanity, dude from lostprophets that was convicted of raping a 1 yr old, had a 27tb collection.

Interesting factoid you know. English is not my first language, so I'm not sure I understand the relevance of this though?

Also, I don't really feel like talking about the subject, but who finds 1 y/o attractive? That is like, idk, weird.

raptorpeanutbuttr

@Setsura said: Also, I don't really feel like talking about the subject, but who finds 1 y/o attractive? That is like, idk, weird. yes. It was close to 24tb and a porn collection and I had recently re-read the news about the trial and the 27tb was a new fact for me. "keep in mind".well,I get the next pixelsmack

4n0nx

https://www.hetzner.de/de/hosting/produkte_rootserver/sx131

bigcat

Setsura said: but who finds 1 y/o attractive? That is like, idk, weird.

Understatement of the year right here

KeithVPS

Colocrossing server or backupsy.

someSguy

@KeithVPS said: Colocrossing server or backupsy.

Backupsy: 2TB for $80.. Colocrossing: max 4x1TB..

Setsura

@4n0nx said: https://www.hetzner.de/de/hosting/produkte_rootserver/sx131

Was mention on the first page, but thank you anyway.

@bigcat said: Understatement of the year right here

Yeah, I don't know any better word for it. I don't believe it is my place to attach labels like "sick" or something, that is for people who are my betters, like a court judge, to decide.

4n0nx

Setsura said: Was mention on the first page, but thank you anyway.

o sorry

Falzo

MarkTurner said: raindog308 said: 5% reserved for superuser really hurts at the 100TB scale :-)

I know that whats I thought! Need to tune that.

http://www.lowendtalk.com/discussion/33817/reclaim-some-free-space-on-your-server-with-this-weird-trick-kvm-xen-dedi-only

MarkTurner

@Falzo - need to be a little careful with that. Unfortunately my VPS got purged, I got it to 5 x 100TB before my test was cancelled as 'excessive'.

But it worked and performed great until then. 500TB should cover most peoples porn ISO collection, so we'll have to wait until someone gets close to that and run a new test with a couple of PB.

Falzo

@MarkTurner thanks for sharing those infos, do you have any kind of information regarding prices to expect for that range or some ETA ? ;-)

MarkTurner

@Falzo - HA-KVM based StorageVPS are now available:

https://cc.delimiter.com/cart/cloudstorage-vps/

tommy

I still prefer time4vps vs HA-KVM :D

No one can guarantee everything working until something broken.

K4Y5

@tommy said: I still prefer time4vps vs HA-KVM :D

No one can guarantee everything working until something broken.

I had to cancel a VPS with them as internal transfer speeds between 2 of my 2TB storage VPS didn't exceed 200KB/s for close to 12 hours while moving some data around.

When I tried uploading some files to other servers that I had initially downloaded the same backed up files from, the speeds were more or less the same. A far cry from the 400mbit connection they advertise on their website, and later confirmed over a support ticket.

I tried everything from FTP /FTPS/ SCP / SFTP / rsync, but the speed simply wouldn't go beyond 200KB/s. What surprised me was that I received sustained transfer speeds of at least 10MB/s while backing up (Downloading) the data to the storage server from other servers that I have in EU.

When I raised a ticket, they simply responded that the issue was probably due to IOPS restrictions. Had that been the case, it should have affected the download speeds as well, right?

Anyway, long story short, my experience wasn't all that great. I am down to one storage VPS now, and have no option but to keep it for another 2 months, as they apparently can't refund BitCoins (BitPay ALLOWS refunds, when initiated by the Merchant). https://support.bitpay.com/hc/en-us/articles/203324093-Can-I-issue-refunds-directly-to-purchasers- | https://support.bitpay.com/hc/en-us/articles/203411523-Can-BitPay-refund-my-order-

I'd recommend you pay a little extra and look elsewhere for backing up your data, unless you can afford to wait for a couple of months to restore your data from a backup server at 200KB/s.

@time4vps I'd like nothing better but to see you fix the issue, and maybe stay as a customer. Afterall, what is the point of advertising 400mbit port speed and 8TB of bandwidth when it simply can't be used or reached because of superficial bottlenecks and restrictions that seriously inhibit the usability of the service that you advertise and sell?

Your price point is pretty effin good, but the implementation left a lot to be desired.

Maybe it was just an isolated incident. But, after opening a bunch of tickets and observing a rather nonchalant support team respond casually and still NOT resolve the issue, I have my doubts about it.

time4vps

K4Y5 said: <...>

Hello, we will contact you today regarding this incident. Our goal - happy customer, nonetheless, we will try to find an acceptable solution for you.

someSguy

@MarkTurner said: Falzo - HA-KVM based StorageVPS are now available:

https://cc.delimiter.com/cart/cloudstorage-vps/

Phew, $193.20 for 10TB.. you can get 10TB ZFS netto for 50 EUR at https://www.transip.be/vps/big-storage/

FYI, the billing cycle box does not update:

K4Y5

@time4vps said: Hello, we will contact you today regarding this incident. Our goal - happy customer, nonetheless, we will try to find an acceptable solution for you.

@time4vps I have already re-opened and replied to support ticket #11219407.

I have also submitted results of a fio benchmark that clearly displays the problem of throttling at 200KB/s and 50 IOPS on your storage boxes, thus confirming and substantiating the throttling issues that have basically rendered my 2TB storage VPS on 400mbit port with 8TB bandwidth useless.

Regardless, I really look forward to hearing from you, and hopefully work this significant issue out ASAP.