New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Atom SSD as MySQL Server?
hi there guys, just got an email from one of the DC's i use about some Atom Servers..
im in the Process of downsizing one of my servers.
what is thoughts of using a Atom server (D2550) with an SSD Drive as a SQL Server.
i would think it would be better as a sql server then an atom server with a normal SATA drive.
but the fact of the matter is, all my server is doing at the moment is just Crawling the web and putting results into SQL.
So was going to get 2 of them, one for web one for sql.
Ideas?..
and before you say it.. that atoms are crap.. i know this, but it's better then paying €120 for a server that is maybe getting used 10% capacity.
Comments
Depends on the CPU usage I suppose obviously I/O won't be much of a problem when using SSDs but the CPU can bottle neck that sometimes.
How large is your DB? How hard are you hitting it?
You'll probably be better off with a decently beefy VPS, if you're just crawling and storing and not actually really hitting the DB SSD isn't going to help that much, although it always helps. If you're using the DB often, put it in memory and take IO out of the equation.
I've got a 128MB RamNode SSD running a very active Observium install, so an Atom + SSD may work fine for you.
You can also give a try and see if this works, also you can ask your datacenter for 24-48 hours test and move the application sql to runn on the atom till period of test ends and see if is better to take it or not take it.
@nunim - My DB is Currently 42GB (yes it's pretty damn huge) on my current server i have 16 of my crawlers going at any one time.
and if my maths is correct..
my current SQL Uptime is: 5 Days 3 Hours, with 10,840,696 queries sent.
so...
5*24+3=123 Hours Uptime
10,840,696/123 = 88135 Queries Per Hour
88135/60 = 1468.93 Queries Per Second
if i don't say so that's a lot of queries...
considering cybermarkt's sql says
542,467 queries in 7 Days
Make some stats on your current server - see how much CPU it is using and how much IO. You can then decide.
I mean run top and iostat for some time.
Just curious, what are you crawling?
@taronyu - try and guess.. and no it's not porn lol
@rds100 - sure will do that for a while and see what happens
but i know running all 16 crawlers would murder a atom, that's why i would probably only run 8, but i've got plenty of time.. just i like to see my numbers increase lol
oh god.. (haven't iopinged for a fair while now.. but the results are scary)
Load is fluctuating from 5.20 to 8.00
Cores are all over the place, 40-80%
So what are the specs of your current server?
E3-1275v2 /32gb / 2x1tb (swraid0) / 100tb @ 1gbit
i got the feeling the atom will be murdered... unless i run 1-2 crawlers only
@rds100
lol, or i could be an ass like so many others and put it on a Waveride vps :P (or GVH) lol
How much of the CPU of this E3-1275v2 is used?
^^^ After Dropping Caches
^^ about 10mins after
have you tried to optimize your table and query? bad queries really take a big toll in the performance
Is it just inserts? I wrote a script to insert 1 million rows into a DB and it took < 1 minute with 512mb RAM on a VPS. about 1 minute 45 with just 128mb RAM and server load hardly went up.
@wcypierre - Last time i optimized it was when the mysql server got reset.
@hostnoob - Inserts (up to about 120 per crawled page), Updates (up to about 20 per crawled page) and 1 sum of the updates
^^ After 1.5 months of crawling and including 7 days of downtime of mysql server when i was in hospital
how are you inserting it? mind posting a pseudo query?
@wcypierre well, im self taught.. and i haven't got the hang of anything except php and straight mysql soooo...
and db_query function is just
"; if ($die_on_debug) die; } $qid = mysql_query($query); if (! $qid && ! $silent) { if ($DB_DEBUG) { echo "Can't execute query
"; echo " "; echo "MySQL Error: ", mysql_error(); } else { echo "
Database error encountered
"; } if ($DB_DIE_ON_FAIL) { echo "This script cannot continue, terminating."; die(); } } return $qid; } } }
Depends on which atom, you can get Intel Atom dedis with 8 Cores or 4 Cores.
if you don't mind, please paste it at pastebin and post the link, can't really stand it.
@infinity580 - http://ark.intel.com/products/65470
@wcypierre - will inbox it to you
I'm afraid this Atom will not cope with your CPU load, even if you improve the IO with a SSD.
hmm.. @rds100 ..
http://www.cpubenchmark.net/cpu.php?cpu=AMD+FX-4100+Quad-Core maybe?
16gb ram and 2x120gb ssd? might be better? only cost me an extra 10 euro?
since its just a small project i wanted to stay with low costs
@AutoSnipe yes, this should work well. Rent it on a monthly basis just in case.
Thanks @rds100
i dare say with the power usage from my server people would think im Mining :P
If you were mining it would be 100% on all cores all the time, not like 60% max
hahah true.. i might be limiting a core off though :P
How should I know? :P
If your doing a write only workload and you have no indexes the atom "should" be able to handle the workload. This is assuming the atom Mobo supports sata3. Now depending on the number of indexes you have the atom will chocke on having to move and grow indexes. The same goes for reads but this depends if you have some complex queries. If your reading from index only then it will be fine but you may get overwhelmed by inserting into that index
D2550 has no SATA3 support and the cpu/chipset combo is too slow to handle reasonable speeds anyway. Better stick to a cheap haswell (Intel Celeron G1820 for example) along with a cheap mobo (e.g. ASRock H81M-VG4 if 2 ram slots are enough, ASRock B85M Pro4 otherwise) which should offer much more performance for nearly the same bucks.