Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Advertise on LowEndTalk.com
Looking for a solution to host files and serve to the users
New on LowEndTalk? Please read our 'Community Rules' by clicking on it in the right menu!

Looking for a solution to host files and serve to the users

adorador Member
edited May 13 in Help

Hello! I maintain an open source project Energized Protection (https://github.com/EnergizedProtection/block) on Github. But due to increasing number of users, and heavy usage pressure on Github, they won't allow us to host the files there and serve to the users. Now I am looking for a cheap and best solution to host 1GB (apx.) text files and serve it to the users.

I need more than 3TB/unlimited bandwidth with better download speed. Now which solution or service would be best? Need your suggestions guys.

Thanks.

EDIT:

Requirements -

  • More than 3TB/Unlimited BW
  • Fast download speed.

Comments

  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    If I am not wrong, you can use Github's release files which is designed for distributing purpose. Some npm libraries like node-sass used this method to distribute their binary.

    Make LET great again

  • adorador Member

    @Ympker said:
    1Fichier 15€/year 2TB. Or GDrive?

    No. Need something that would support custom domain and direct linking to the file on the server. Like this https://example.com/folder/file.txt something like this. And, more bandwidth is a must!

  • defaultdefault Member

    A simple VPS with unlimited bandwidth, and a domain, can do this. Check my signature.

    Fastmako (aff) - great VPS for your needs.

  • adorador Member

    @FAT32 said:
    If I am not wrong, you can use Github's release files which is designed for distributing purpose. Some npm libraries like node-sass used this method to distribute their binary.

    Yes. But they won't support all the apps/softwares users are gonna use! Mainly direct link support.

  • adorador Member

    @default said:
    A simple VPS with unlimited bandwidth, and a domain, can do this. Check my signature.

    That's nice. But a bit expensive. I can't really afford that much. Need something, that's cheap and provides quality service.

  • Dare I say ....... Hetzner

  • defaultdefault Member

    @ador - Actually, what is your budget?

    Fastmako (aff) - great VPS for your needs.

  • cazrzcazrz Member

    @default said:
    @ador - Actually, what is your budget?

    Looks like he is looking for $1 or a free one or a sponsor.

  • adorador Member

    @default said:
    @ador - Actually, what is your budget?

    around $25/30year.

  • adorador Member

    @cazrz said:

    @default said:
    @ador - Actually, what is your budget?

    Looks like he is looking for $1 or a free one or a sponsor.

    This is an open source project, and I have to spend my own. And, being a student won't get you that much, that's why I am looking for something cheap. Infact, if anyone here sponsors the project that would be nice too. Our production is off and we need one soon.

  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire
    edited May 13

    @ador said:
    Yes. But they won't support all the apps/softwares users are gonna use! Mainly direct link support.

    Are you sure? The S3 link is direct link.

    Make LET great again

  • adorador Member

    @FAT32 said:

    @ador said:

    Yes. But they won't support all the apps/softwares users are gonna use! Mainly direct link support.

    Are you sure? It is direct link.

    Yes. I have already tried that.

  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    @ador said:
    Yes. I have already tried that.

    With what? You can even download with script without any cookies set.

    Make LET great again

  • AC_FanAC_Fan Member

    GDrive has 15GB free space, 10TB daily download quota, and direct links for files upto 50MB in size. Share the files to public in GDrive, then use this format to offer a direct link: https://drive.google.com/uc?export=download&id={id} . ID is available in the shared link.

  • adorador Member

    @AC_Fan said:
    GDrive has 15GB free space, 10TB daily download quota, and direct links for files upto 50MB in size. Share the files to public in GDrive, then use this format to offer a direct link: https://drive.google.com/uc?export=download&id={id} . ID is available in the shared link.

    Thanks for this idea. But we need something like this https://example.com/folder/file.txt to link to the files on the server.

  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    Make LET great again

  • defaultdefault Member
    edited May 13

    Recap: OP needs a shared hosting with unlimited bandwidth and 2gb storage, in $25-$30/yer. This thread is becoming long, because the person did not state at the beginning all requirement and budget.

    Maybe some Shared Hosting Provider can come up with an offer. @SmallWeb and @MikePT can you help him with some Shared Hosting of 2GB storage and unlimited bandwidth, in $25-$30/year range?

    Thanked by 4ador Ympker FAT32 MikePT

    Fastmako (aff) - great VPS for your needs.

  • adorador Member

    @FAT32 said:

    @ador said:
    Yes. I have already tried that.

    With what? You can even download with script without any cookies set.

    @FAT32 said:
    I saw you are testing. Just use "https://github.com/EnergizedProtection/energized.github.io/releases/download/Test/hosts.txt" and it will work.

    It gives error on a software for Windows (Hostsman), which users basically use on windows for this project. Previously we used to serve files directly from the repo using a custom domain connected to Github repo. That used to work fine on every platform.

  • cazrzcazrz Member

    What is your preffered dc locarion?

  • defaultdefault Member

    @cazrz said:
    What is your preffered dc locarion?

    He is from India. So most likely he would prefer India. We are all guessing the information along the way.

    Fastmako (aff) - great VPS for your needs.

  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    @ador said:
    It gives error on a software for Windows (Hostsman), which users basically use on windows for this project. Previously we used to serve files directly from the repo using a custom domain connected to Github repo. That used to work fine on every platform.

    You are right. I just tested and Github doesn't allow sending HEAD request to that endpoint, whereas Hostsman send a HEAD request before the GET request.

    Thanked by 1ador

    Make LET great again

  • adorador Member

    @cazrz said:
    What is your preffered dc locarion?

    I am from Bangladesh. But any server that's fast would be good enough for us, because we have users from around the world.

  • defaultdefault Member

    @ador - May I ask why you use "us" and "we", as in plural, when you are the only contributor and maintainer of that Github project? And yet, you need unlmited bandwidth because of "heavy usage pressure".

    Fastmako (aff) - great VPS for your needs.

  • cazrzcazrz Member

    @ador said:

    @cazrz said:
    What is your preffered dc locarion?

    I am from Bangladesh. But any server that's fast would be good enough for us, because we have users from around the world.

    Have you tried backblaze with cloudflare? But yeah i think cf wont really give you that 3tb bandwidth specially in asia.

  • adorador Member

    @default said:
    @ador - May I ask why you use "us" and "we", as in plural, when you are the only contributor and maintainer of that Github project? And yet, you need unlmited bandwidth because of "heavy usage pressure".

    I am the lead maintainer, but we are a team of 3 members to manage repos, blocklists, modules and servers.

  • adorador Member

    @cazrz said:

    @ador said:

    @cazrz said:
    What is your preffered dc locarion?

    I am from Bangladesh. But any server that's fast would be good enough for us, because we have users from around the world.

    Have you tried backblaze with cloudflare? But yeah i think cf wont really give you that 3tb bandwidth specially in asia.

    No I haven't tried that yet. Is that budget friendly service? I am on a tight budget, that's why looking for cheap ones with quality service.

  • cazrzcazrz Member

    3TB bandwidth per month is not acceptable in many providers that offer "unlimited bandwidth". Specially if the plan is below $5/mo. That is why even the giants like AWS, Azure and Google wont give you that unless you have millions of real traffic that could bring them traffic in return. In your site you have clients and sponsor/s. What are those?

  • SaahibSaahib Member
    edited May 13

    Well, I have seen similar use case, the solution was to use free CDN with a basic VPS.

  • adorador Member

    @cazrz said:
    3TB bandwidth per month is not acceptable in many providers that offer "unlimited bandwidth". Specially if the plan is below $5/mo. That is why even the giants like AWS, Azure and Google wont give you that unless you have millions of real traffic that could bring them traffic in return. In your site you have clients and sponsor/s. What are those?

    Clients are apps, softwares and services to use with our services. And, sponsors are the ones who support us. Although, we have only one sponsor who are letting us host the website for free! I have seen few LEB special offers from RackNerd VPS, would those be better?

    Thanked by 1dustinc
  • MikePTMikePT Member, Provider

    @default said:
    Recap: OP needs a shared hosting with unlimited bandwidth and 2gb storage, in $25-$30/yer. This thread is becoming long, because the person did not state at the beginning all requirement and budget.

    Maybe some Shared Hosting Provider can come up with an offer. @SmallWeb and @MikePT can you help him with some Shared Hosting of 2GB storage and unlimited bandwidth, in $25-$30/year range?

    2 GB Unmetered @ 10 EUR / year :D

    Thanked by 1default
  • NyrNyr Member

    cazrz said: Have you tried backblaze with cloudflare? But yeah i think cf wont really give you that 3tb bandwidth specially in asia.

    This is the easiest/cheapest suggestion by far.

    B2 is going to cost him next to nothing. Cloudflare can be configured to cache everything from B2 for free, as long as the files are not bigger than 100MB each.

    And they'll absolutely pay for 3TB of bandwidth, no problem with that.

    Thanked by 2ador raindog308
  • cazrzcazrz Member

    Yep, 10gb storage in b2 is free, then you just serve it via cloudflare as backblaze is their bandwidth alliance.

  • someshzsomeshz Member, Provider

    Why don't you try Hetzner Auction servers?

    Thanked by 1ador

    Nexa Racks - Reliable Web Hosting Company (India SSD KVM VPS | USA SSD KVM VPS)

  • dustincdustinc Member, Provider

    @ador said:

    @cazrz said:
    3TB bandwidth per month is not acceptable in many providers that offer "unlimited bandwidth". Specially if the plan is below $5/mo. That is why even the giants like AWS, Azure and Google wont give you that unless you have millions of real traffic that could bring them traffic in return. In your site you have clients and sponsor/s. What are those?

    Clients are apps, softwares and services to use with our services. And, sponsors are the ones who support us. Although, we have only one sponsor who are letting us host the website for free! I have seen few LEB special offers from RackNerd VPS, would those be better?

    Thanks for the mention, and also for considering us! If you choose to host with us @ador just send me an email [email protected] and I'll add two months free as a thank you!

    Thanked by 2ador SCAM_AlphaRacks

    RackNerd LLC - Introducing Infrastructure Stability
    Dedicated Servers, Private Cloud, DRaaS, Colocation, VPS, DDoS Mitigation, Shared & Reseller Hosting

  • FranciscoFrancisco Top Provider

    Slice + Slab?

    Francisco

    Thanked by 1netomx
    BuyVM - Free DirectAdmin, Softaculous, & Blesta! / Anycast Support! / Windows 2008, 2012, & 2016! / Unmetered Bandwidth!
    BuyShared - Shared & Reseller Hosting / cPanel + Softaculous + CloudLinux / Pure SSD! / Free Dedicated IP Address
  • vimalwarevimalware Member

    A 2.5 Euro hetzner entry level KVM is the closest fit.

    Thanked by 1ador

    Tired of LET scams?
    A Moderated forum : https://talk.lowendspirit.com/

  • BetaRacksBetaRacks Member
    edited May 14

    @ador said:

    @AC_Fan said:
    GDrive has 15GB free space, 10TB daily download quota, and direct links for files upto 50MB in size. Share the files to public in GDrive, then use this format to offer a direct link: https://drive.google.com/uc?export=download&id={id} . ID is available in the shared link.

    Thanks for this idea. But we need something like this https://example.com/folder/file.txt to link to the files on the server.

    cloudflare worker+google drive

  • jcalebjcaleb Moderator

    The Slice 512mb looks like within budget

    Thanked by 2netomx Francisco
  • duckeeyuckduckeeyuck Member
    edited May 14

    Is everyone retarded? According to op's specs where he just needs a link to his file tree w.e

    Just install nginx, add a vhost, pull all files there....

    Problem solved.

    Bandwidth is cheap lol, and for what you want, as I see on the repo, black lists? nginx gzip should help a lot, cloudflare will cache most of them for free....... So you don't even need to worry about this tbh..
    Use a normal vps/server with nginx, put cloudflare, ezpz, bandwidth usage goes from 3tb to < 1tb

    Thanked by 2ador vimalware
  • MadSpriteMadSprite Member

    Use Github Pages with your custom domain. That what I use for direct link folder organized files.

  • I'm surprised nobody has suggested Gullo's hosting with Cloudflare IPv6 to IPv4 forwarding. When there's a sale, you can pick up the 512MB NAT (with 500GB monthly bandwidth) for $8 annually. Links below ->

    https://hosting.gullo.me/pricing

    I don't work for them or anything, it's just a good service

  • SaahibSaahib Member

    @Saahib said:
    Well, I have seen similar use case, the solution was to use free CDN with a basic VPS.

    Already suggested best and cheap solution and its working with a project where large files needed to delivered, CDN takes care of that.

  • BertieBertie Member
    edited May 14

    Backblaze B2, with Cloudflare Bandwidth Alliance. Unmetered bandwidth, $5/month/TB.

  • If you can get a LETBOX special, that'll be 125GB of storage and 5TB of monthly traffic for something like $30.32 USD/year in LA.

    But man, you really need to be compressing these text files instead of providing them all uncompressed. Not just to reduce your resources, but to reduce download times. For example, a 38MB RAW file zips to under 8MB.

Sign In or Register to comment.