DIY personal backup solution
This is going to be quite a long post, but it should be interesting!
I've been thinking about doing remote backups of my home computer with bup.
At first, I used Google's Compute Engine, since their persistent disk storage was cheap and features seemed a bit better than AWS, especially with regard to performance. However, with the VM at $4/mo (and bad specs/perf), and storage at $0.04/GB (also quite bad perf), it didn't really seem worth it.
OK, next try. A small SpeedyKVM VPS in Seattle (which I already had), connected to S3 with s3backer (which basically turns and S3 bucket into a mountable block device). VPS is still $4/mo but performance (CPU-wise) is better, in addition to it being closer to home (Vancouver). s3backer is actually faster than I expected and works well with bup. One advantage of persistence in S3 directly (vs EBS or Google Persistent Disk) is that it's much much more reliable; however, using s3backer reduces this reliability by a bit (because of caching, etc). So I would say durability would be around the same, maybe a bit worse than EBS with snapshots. The real benefit here is cost: S3 is half the price of EBS per GB. Even with the added costs of bandwidth and requests, it should come out to be a bit cheaper. Another advantage is that it has basically unlimited scalability.
That solution is pretty good, but it's still far from perfect. What I'm looking for is:
- Very high durability
- Low cost (around the same cost of 2nd solution above: $3-5/mo fixed costs, then $0.02-0.03 per GB; I'm looking for around 500GB - 1TB; scalability is a bonus)
- Good performance (ideally multiple 10's of MB/s)
- Good network performance (especially from home; should be located in US west)
To elaborate on durability, above: something like the EBS + snapshot is acceptable. While EBS is not extremely durable, snapshots stored in S3 are, so this is OK.
All things considered, I was thinking of something like a storage VPS, with periodic snapshots (incremental?) uploaded to Google Drive (I have Apps unlimited, so unlimited storage there). My worry is that from what I've seen, decent storage VPS's are quite expensive for the storage, since there are definitely economies of scale in terms of storage.