Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


What is normal or acceptable disk speed on Hetzner auction server?
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

What is normal or acceptable disk speed on Hetzner auction server?

JohnRoeJohnRoe Member
edited March 2020 in General

Hi. Recently I grabbed i7-4770 32GB 2x4TB for 32EUR. So on the the fresh installed server, I tested its disks speed

dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync

and I got like 80-90 MB/s

Then I tested my current server with same spec and price except 2x3TB for the disk and got 170-270 MB/s.

So, I cancelled that new server. Was that a right decision? Because I don't know what speed I should be expecting and I got multiple times of speed on my current server.

Edit: Both have Raid 0

Thanks!

Comments

  • jarjar Patron Provider, Top Host, Veteran

    A sequential write isn't going to tell you a whole lot, but that seems perfectly fine to me.

    Thanked by 2pike Hetzner_OL
  • Assuming radi1, seems fine here.

    Thanked by 1Hetzner_OL
  • JohnRoeJohnRoe Member
    edited March 2020

    @jar said:
    A sequential write isn't going to tell you a whole lot, but that seems perfectly fine to me.

    So i wasted that rare opportunity? I don't think I will ever found that specs for the 32EUR anymore.
    Also why my current server is much faster in operation compared to the fresh installed server?

    @seriesn said:
    Assuming radi1, seems fine here.

    Raid 0

  • FalzoFalzo Member

    Yes wasted. Either raid 1 instead 0 or more likely just the initial sync still in progress.

    Sorry to say, but sometimes it feels deserved, when people need to learn the hard way. dd has never been something to rely on for such decisions...

  • LeeLee Veteran

    80-90 mb/s appears fine for a single disk of that type, are you sure as mentioned above the sync was not still in progress, did you configure it properly. Seems a bit silly to cancel based on a dd result.

    Thanked by 1Hetzner_OL
  • Seems absolutely fine especially considering most of the auction servers aren't enterprise HDDs either...

    Thanked by 1Hetzner_OL
  • Hetzner_OLHetzner_OL Member, Top Host

    @JohnRoe - Next time, if you have a question like this, you can always ask people in a forum like this one first or even in our own Hetzner Diskussionforum https://forum.hetzner.com/ . Or you can write us a support ticket. If you cancel too many orders, especially as a new customer, you may not be allowed to make new orders. --Katie

  • @Falzo said:
    Yes wasted. Either raid 1 instead 0 or more likely just the initial sync still in progress.

    Sorry to say, but sometimes it feels deserved, when people need to learn the hard way. dd has never been something to rely on for such decisions...

    This will be a good lesson for me. I made the decision based on my current server which have triple of speed. Also based on my usage which have a lot of file writing and reading.

    @Lee said:
    80-90 mb/s appears fine for a single disk of that type, are you sure as mentioned above the sync was not still in progress, did you configure it properly. Seems a bit silly to cancel based on a dd result.

    Sorry, but what is the "sync" you are talking about?

  • @Hetzner_OL said:
    @JohnRoe - Next time, if you have a question like this, you can always ask people in a forum like this one first or even in our own Hetzner Diskussionforum https://forum.hetzner.com/ . Or you can write us a support ticket. If you cancel too many orders, especially as a new customer, you may not be allowed to make new orders. --Katie

    Hi. I actually contacted support and they said the disks are fine. So I made the decision based on my current disk speed. I use disk heavily especially MySQL database.
    My bad, but it is a good lesson.
    Thanks.
    Also I have been your customer since 2018 and hardly cancelled any servers.

  • So raid 0 is best than raid 1 then so on ...........?

  • JohnRoe said: I use disk heavily especially MySQL database.

    You should be using SSD's for that.

    Thanked by 1cazrz
  • cazrzcazrz Member

    @willie said:

    JohnRoe said: I use disk heavily especially MySQL database.

    You should be using SSD's for that.

    raid1 NVMe

  • @willie said:

    JohnRoe said: I use disk heavily especially MySQL database.

    You should be using SSD's for that.

    My current server is already enough to handle, also much cheaper than SSD :)

  • Hetzner_OLHetzner_OL Member, Top Host

    Hi @JohnRoe, Okay, glad to know that you've been with us for awhile and that you only have a few cancellations. :D --Katie

    Thanked by 1JohnRoe
  • I don't know what to say. I got the same deal, again.

    Everything went quite well at first, I did dd test with result of something like 100-200 MB/s.

    Then I moved almost all my files (a few Terabytes) then start to activate website and stuff.
    Then somehow it get so slow, like really slow.

    Then I run dd check and g0t 17MB/s. Then I ran dd test again for a few times and out of 2 were around ~10MB/s and the other 3 tests were 100-150MB/s

    Honestly I don't know what to believe anymore. I migrated large portion of my services into this new server already. I don't know if I should continue or spend another day to migrate back to the old one.

    I know you guys said don't depend on dd tests, but what you would advice me after this scenario?

    Thanks.

  • I think would just use it for a month. A price that I am willing to pay to see if it true that the dd result doesn't really affect much . I hope I don't get that 10MB/s speed anymore. Anyway It feels much slower than my previous server. I can feel it when starting/restarting systemd service, copying files, starting VNC session, although my previous server have much more running processes.

  • FalzoFalzo Member

    if benchmarking at all, how about start using something more sophisticated like fio? did you check if your raid sync has finishied yet? what does the smart data of the disks look like?

    Thanked by 1mehargags
  • if its a cheap deal, you can always choose to put in an extra SSD for 4/5 euros..

    put ur DB/website stuff on that and slow storage on the rotationals

    Thanked by 1JohnRoe
  • @Falzo said:
    if benchmarking at all, how about start using something more sophisticated like fio? did you check if your raid sync has finishied yet? what does the smart data of the disks look like?

    But before that, if you can see, I don't have much knowledge in this area. So bare with me, because I am trying to learn.
    Thanks.

    Also does RAID 0 sync too? If so, how do I check? There is no helpful resources on the net regarding this.

    This is the result of my smart.

    $ sudo smartctl -a /dev/sda
    smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-91-generic] (local build)
    Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
    
    === START OF INFORMATION SECTION ===
    Model Family:     HGST MegaScale 4000
    Device Model:     HGST HMS5C4040BLE640
    Serial Number:    PL2331LAGUTP6J
    LU WWN Device Id: 5 000cca 22ecbb9f0
    Firmware Version: MPAOA5D0
    User Capacity:    4,000,787,030,016 bytes [4.00 TB]
    Sector Sizes:     512 bytes logical, 4096 bytes physical
    Rotation Rate:    5700 rpm
    Form Factor:      3.5 inches
    Device is:        In smartctl database [for details use: -P show]
    ATA Version is:   ATA8-ACS T13/1699-D revision 4
    SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
    Local Time is:    Tue Mar 24 17:18:38 2020 +08
    SMART support is: Available - device has SMART capability.
    SMART support is: Enabled
    
    === START OF READ SMART DATA SECTION ===
    SMART overall-health self-assessment test result: PASSED
    
    General SMART Values:
    Offline data collection status:  (0x84) Offline data collection activity
                                            was suspended by an interrupting command from host.
                                            Auto Offline Data Collection: Enabled.
    Self-test execution status:      (   0) The previous self-test routine completed
                                            without error or no self-test has ever
                                            been run.
    Total time to complete Offline
    data collection:                (   28) seconds.
    Offline data collection
    capabilities:                    (0x5b) SMART execute Offline immediate.
                                            Auto Offline data collection on/off support.
                                            Suspend Offline collection upon new
                                            command.
                                            Offline surface scan supported.
                                            Self-test supported.
                                            No Conveyance Self-test supported.
                                            Selective Self-test supported.
    SMART capabilities:            (0x0003) Saves SMART data before entering
                                            power-saving mode.
                                            Supports SMART auto save timer.
    Error logging capability:        (0x01) Error logging supported.
                                            General Purpose Logging supported.
    Short self-test routine
    recommended polling time:        (   1) minutes.
    Extended self-test routine
    recommended polling time:        ( 706) minutes.
    SCT capabilities:              (0x003d) SCT Status supported.
                                            SCT Error Recovery Control supported.
                                            SCT Feature Control supported.
                                            SCT Data Table supported.
    
    SMART Attributes Data Structure revision number: 16
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
      1 Raw_Read_Error_Rate     0x000b   100   100   016    Pre-fail  Always       -       0
      2 Throughput_Performance  0x0005   134   134   054    Pre-fail  Offline      -       102
      3 Spin_Up_Time            0x0007   136   136   024    Pre-fail  Always       -       562 (Average 467)
      4 Start_Stop_Count        0x0012   100   100   000    Old_age   Always       -       23
      5 Reallocated_Sector_Ct   0x0033   100   100   005    Pre-fail  Always       -       0
      7 Seek_Error_Rate         0x000b   100   100   067    Pre-fail  Always       -       0
      8 Seek_Time_Performance   0x0005   113   113   020    Pre-fail  Offline      -       42
      9 Power_On_Hours          0x0012   095   095   000    Old_age   Always       -       38316
     10 Spin_Retry_Count        0x0013   100   100   060    Pre-fail  Always       -       0
     12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       22
    192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       961
    193 Load_Cycle_Count        0x0012   100   100   000    Old_age   Always       -       961
    194 Temperature_Celsius     0x0002   171   171   000    Old_age   Always       -       35 (Min/Max 24/43)
    196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
    197 Current_Pending_Sector  0x0022   100   100   000    Old_age   Always       -       0
    198 Offline_Uncorrectable   0x0008   100   100   000    Old_age   Offline      -       0
    199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       0
    
    SMART Error Log Version: 1
    No Errors Logged
    
    SMART Self-test log structure revision number 1
    Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
    # 1  Extended offline    Completed without error       00%     38259         -
    # 2  Extended offline    Completed without error       00%     38235         -
    # 3  Extended offline    Completed without error       00%     29984         -
    # 4  Extended offline    Completed without error       00%     29961         -
    # 5  Extended offline    Completed without error       00%     16686         -
    # 6  Extended offline    Completed without error       00%     16663         -
    # 7  Extended offline    Completed without error       00%     16513         -
    # 8  Extended offline    Completed without error       00%     16490         -
    # 9  Extended offline    Completed without error       00%     16409         -
    #10  Short offline       Completed without error       00%     16392         -
    #11  Extended offline    Completed without error       00%     12164         -
    #12  Extended offline    Completed without error       00%     12146         -
    #13  Extended offline    Completed without error       00%     12104         -
    #14  Extended offline    Completed without error       00%     12080         -
    #15  Extended offline    Completed without error       00%      9611         -
    #16  Extended offline    Completed without error       00%      9587         -
    
    SMART Selective self-test log data structure revision number 1
     SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
        1        0        0  Not_testing
        2        0        0  Not_testing
        3        0        0  Not_testing
        4        0        0  Not_testing
        5        0        0  Not_testing
    Selective self-test flags (0x0):
      After scanning selected spans, do NOT read-scan remainder of disk.
    If Selective self-test is pending on power-up, resume after 0 minute delay.
    
    $ sudo smartctl -a /dev/sdb
    smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-91-generic] (local build)
    Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
    
    === START OF INFORMATION SECTION ===
    Model Family:     HGST MegaScale 4000
    Device Model:     HGST HMS5C4040BLE640
    Serial Number:    PL2331LAGYBZBJ
    LU WWN Device Id: 5 000cca 22ecd5bbb
    Firmware Version: MPAOA5D0
    User Capacity:    4,000,787,030,016 bytes [4.00 TB]
    Sector Sizes:     512 bytes logical, 4096 bytes physical
    Rotation Rate:    5700 rpm
    Form Factor:      3.5 inches
    Device is:        In smartctl database [for details use: -P show]
    ATA Version is:   ATA8-ACS T13/1699-D revision 4
    SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
    Local Time is:    Tue Mar 24 17:21:28 2020 +08
    SMART support is: Available - device has SMART capability.
    SMART support is: Enabled
    
    === START OF READ SMART DATA SECTION ===
    SMART overall-health self-assessment test result: PASSED
    
    General SMART Values:
    Offline data collection status:  (0x84) Offline data collection activity
                                            was suspended by an interrupting command from host.
                                            Auto Offline Data Collection: Enabled.
    Self-test execution status:      (   0) The previous self-test routine completed
                                            without error or no self-test has ever
                                            been run.
    Total time to complete Offline
    data collection:                (   28) seconds.
    Offline data collection
    capabilities:                    (0x5b) SMART execute Offline immediate.
                                            Auto Offline data collection on/off support.
                                            Suspend Offline collection upon new
                                            command.
                                            Offline surface scan supported.
                                            Self-test supported.
                                            No Conveyance Self-test supported.
                                            Selective Self-test supported.
    SMART capabilities:            (0x0003) Saves SMART data before entering
                                            power-saving mode.
                                            Supports SMART auto save timer.
    Error logging capability:        (0x01) Error logging supported.
                                            General Purpose Logging supported.
    Short self-test routine
    recommended polling time:        (   1) minutes.
    Extended self-test routine
    recommended polling time:        ( 716) minutes.
    SCT capabilities:              (0x003d) SCT Status supported.
                                            SCT Error Recovery Control supported.
                                            SCT Feature Control supported.
                                            SCT Data Table supported.
    
    SMART Attributes Data Structure revision number: 16
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
      1 Raw_Read_Error_Rate     0x000b   100   100   016    Pre-fail  Always       -       0
      2 Throughput_Performance  0x0005   134   134   054    Pre-fail  Offline      -       103
      3 Spin_Up_Time            0x0007   135   135   024    Pre-fail  Always       -       562 (Average 470)
      4 Start_Stop_Count        0x0012   100   100   000    Old_age   Always       -       23
      5 Reallocated_Sector_Ct   0x0033   100   100   005    Pre-fail  Always       -       0
      7 Seek_Error_Rate         0x000b   100   100   067    Pre-fail  Always       -       0
      8 Seek_Time_Performance   0x0005   113   113   020    Pre-fail  Offline      -       42
      9 Power_On_Hours          0x0012   095   095   000    Old_age   Always       -       38885
     10 Spin_Retry_Count        0x0013   100   100   060    Pre-fail  Always       -       0
     12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       23
    192 Power-Off_Retract_Count 0x0032   099   099   000    Old_age   Always       -       1315
    193 Load_Cycle_Count        0x0012   099   099   000    Old_age   Always       -       1315
    194 Temperature_Celsius     0x0002   171   171   000    Old_age   Always       -       35 (Min/Max 23/40)
    196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
    197 Current_Pending_Sector  0x0022   100   100   000    Old_age   Always       -       0
    198 Offline_Uncorrectable   0x0008   100   100   000    Old_age   Offline      -       0
    199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       0
    
    SMART Error Log Version: 1
    No Errors Logged
    
    SMART Self-test log structure revision number 1
    Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
    # 1  Extended offline    Completed without error       00%     38828         -
    # 2  Extended offline    Completed without error       00%     38805         -
    # 3  Extended offline    Completed without error       00%     30554         -
    # 4  Extended offline    Completed without error       00%     30530         -
    # 5  Extended offline    Completed without error       00%     17256         -
    # 6  Extended offline    Completed without error       00%     17233         -
    # 7  Extended offline    Completed without error       00%     17083         -
    # 8  Extended offline    Completed without error       00%     17059         -
    # 9  Extended offline    Completed without error       00%     17005         -
    #10  Short offline       Completed without error       00%     16989         -
    #11  Extended offline    Completed without error       00%     16978         -
    #12  Extended offline    Completed without error       00%     16955         -
    
    SMART Selective self-test log data structure revision number 1
     SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
        1        0        0  Not_testing
        2        0        0  Not_testing
        3        0        0  Not_testing
        4        0        0  Not_testing
        5        0        0  Not_testing
    Selective self-test flags (0x0):
      After scanning selected spans, do NOT read-scan remainder of disk.
    If Selective self-test is pending on power-up, resume after 0 minute delay.
    
    
  • JohnRoeJohnRoe Member
    edited March 2020
    $ curl -sL yabs.sh | bash
    # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #
    #              Yet-Another-Bench-Script              #
    #                     v2020-02-10                    #
    # https://github.com/masonr/yet-another-bench-script #
    # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #
    
    Tue Mar 24 17:38:19 +08 2020
    
    Basic System Information:
    ---------------------------------
    Processor  : Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
    CPU cores  : 8 @ 3580.694 MHz
    AES-NI     : ✔ Enabled
    VM-x/AMD-V : ✔ Enabled
    RAM        : 31G
    Swap       : 31G
    Disk       : 7.2T
    
    fio Disk Speed Tests (Mixed R/W 50/50):
    ---------------------------------
    Block Size | 4kb           (IOPS) | 64kb          (IOPS)
      ------   | ---            ----  | ----           ----
    Read       | 644.00 KB/s    (161) | 9.40 MB/s      (146)
    Write      | 675.00 KB/s    (168) | 9.86 MB/s      (154)
    Total      | 1.31 MB/s      (329) | 19.27 MB/s     (300)
               |                      |
    Block Size | 512kb         (IOPS) | 1mb           (IOPS)
      ------   | -----          ----  | ---            ----
    Read       | 43.93 MB/s      (85) | 39.17 MB/s      (38)
    Write      | 46.50 MB/s      (90) | 41.77 MB/s      (40)
    Total      | 90.43 MB/s     (175) | 80.95 MB/s      (78)
    chmod: cannot access './2020-03-24T17_38_19+08_00/iperf/iperf3': No such file or directory
    
    iperf3 Network Speed Tests (IPv4):
    ---------------------------------
    Provider                  | Location (Link)           | Send Speed      | Recv Speed
                              |                           |                 |
    Bouygues Telecom          | Paris, FR (10G)           | busy            | busy
    Online.net                | Paris, FR (10G)           | busy            | busy
    WorldStream               | The Netherlands (10G)     | busy            | busy
    wilhelm.tel               | Hamburg, DE (10G)         | busy            | busy
    Biznet                    | Bogor, Indonesia (1G)     | busy            | busy
    Hostkey                   | Moscow, RU (1G)           | busy            | busy
    Velocity Online           | Tallahassee, FL, US (10G) | busy            | busy
    Airstream Communications  | Eau Claire, WI, US (10G)  | busy            | busy
    Hurricane Electric        | Fremont, CA, US (10G)     | busy            | busy
    
    iperf3 Network Speed Tests (IPv6):
    ---------------------------------
    Provider                  | Location (Link)           | Send Speed      | Recv Speed
                              |                           |                 |
    Bouygues Telecom          | Paris, FR (10G)           | busy            | busy
    Online.net                | Paris, FR (10G)           | busy            | busy
    WorldStream               | The Netherlands (10G)     | busy            | busy
    wilhelm.tel               | Hamburg, DE (10G)         | busy            | busy
    Airstream Communications  | Eau Claire, WI, US (10G)  | busy            | busy
    Hurricane Electric        | Fremont, CA, US (10G)     | busy            | busy
    
    Geekbench 5 Benchmark Test:
    ---------------------------------
    Test            | Value
                    |
    Single Core     | 582
    Multi Core      | 1805
    Full Test       | https://browser.geekbench.com/v5/cpu/1553672
    
    
  • JohnRoeJohnRoe Member
    edited March 2020

    So after a few more hours of usage, I got these issues

    • ls and cd command sometimes takes a few seconds
    • pip takes a while to print first line of output
    • ffprobe takes ages
    • openresty intermittently taking many seconds to serve a webpage request even that page is an empty index.php
    • Monitoring services that I am using to monitor my websites are hammering my inbox telling my websites are down and the next minute are up (sometimes many minutes)
    • I intermittently getting MySQL has gone away which I never got on my previous server
    • Getting a lot of Lock wait timeout exceeded; try restarting transaction from MySQL because PHP script which should finish instantly, taking a lot more time to complete

    These are what I can recall and what is happening right now.

    Edit:

    • Currently my dd speed is ~50 MB/s
    • I am downloading a 20GB test file from itself and my reported Actual DISK WRITE is ranging from 1000K/s to 70M/s (from iotop). The download starts high then significantly reducing to around 10MB/s.
    • removing hundreds mebibytes of file sometimes took so long.
Sign In or Register to comment.