June 25, 2010 at 11:2120 terabytes do it yourself
Not so long ago in LJ, one cinema company asked how they could make 20 terabytes of network storage so cunningly, and they don’t
fit the videos ... What people advised them to do with some kind of super-duper professional solutions worth hundreds of thousands of rubles, which, of course, cool, but ...
For my part, I gave the layout according to the server that I made for myself three years ago and successfully use it ...
The server contains 11 hard disks, one of which is bootable and 10 are file-based.
It is not difficult to calculate, 10 disks of 2 terabytes each will give the desired 20 terabytes!
How to achieve this?
I'll tell you now!
PySy This is a transfer of my article from the Sandbox. From the moment of its writing, I found out a couple of “funny” things that were added here.
PySySy This is an amateur decision to stuff such a horde of disks into one computer.
Reliability is realized on the assumption that with such a number of disks - you can put a part in RAID, and if necessary - easily and unconstrainedly replace the crashed one!
Perhaps one of the main problems with stuffing so many disks into one computer.
I tried several options, including a home-made rack for 10 disks from the corners of the Merlenovsky, but it was all uncomfortable ...
As a result, I settled on a "simple" case for 9 pieces of five-inch slots.
You can take 10, but there isn’t much sense ...
In my case, the choice fell on Silver Stone with a door, but in bulk options!
Something similar - it will cost thousands of 2-3 rubles.
I took two pieces of MOBILE RACK SATA METALL ST-3051.
This is a device that clogs itself with three five-inch slots, in return giving the opportunity to install 5 SATA drives each.
You can buy one for about 4357 rubles.
I took it before the crisis, so I saved it decently ...
A small detail - the way it looks in the picture is not quite right: in practice, to get into these three five-inch windows, you need to put it on its side ...
On the rear panel there are five SATA connectors, 2 SATA -nourishment and three molecules (for the most part MUCH they do not really need, but ...). Plus a fan of 80 mm.
On the front are performance indicators.
Each disk is put into the “basket”, slid into the “basket” until it gets into the connectors on the basket board with its own SATA contacts, after which the basket handle is pressed and latched.
The plus is that, as I recently found out (in three years!), The device has a "Hot Swap" normally working !!!
We put two of these baskets in the bottom of the case, scoring six of the nine slots (just so as not to outweigh the top!).
Now we are ready to put as many as 10 pieces of discs!
UPD In front of the baskets there is a power switch in the form of buttons. Buttons must be pressed! And then yesterday I cursed everything - part of the disks does not see and that's it! While I did not remember about these buttons - I was tormented
The other day I upgraded to 600 watts a thousand for two rubles.
Previously, I worked with 350 and it’s normal, but recently, the power supply began to “dope” ...
Absolutely useless thing on a file-washer!
You can put it, but in practice - it’s easier to take a USB drive and connect it only when installing the system!
As correctly noted in the comments - in principle, you can put a system from a flash drive!
In principle - if you put a script for automatically copying images published somewhere here on the server - it can be useful and bring it - to choose from!
From the connection options: if you do it by analogy, you will have the choice of either 2 SATA or 1 IDE. So - there is where to connect!
Any!
In practice, a few tips:
The rest is optional.
Caution against buying the ASUS P5Q Premium - I almost burst the other day when I thought about an upgrade.
It would seem that 10 SATA - what more could you want ?!
In practice - it turned out that there are not 10, but 6 + 4 ...
That is 6 - normal, and 4 - “two double”, when the drives stuck in them are forcibly combined in pairs into “raids” ...
So it’s better to take the motherboard to 6 (4) ordinary SATA, “finishing off” the remaining expansion cards!
UPD I had to upgrade the socket to the 775 when upgrading. As a result, I was tormented by aaaa ... Or 6 SATA, or built-in vidyuha. In more modern chipsets, the problem is not so acute ...
As a result, when upgrading, I took it from 4 SATA: I already had controller boards for PCI, there were 2 pieces of PCI on my mother, so I decided that it would be cheaper than buying additional video cards ...
(The reason for the upgrade is idiotic ... 11th drive ... While it was 10 - everything was normal. I stuck 11 - so the old mother stubbornly did not see the second SATA! I had to upgrade my mother.
IMHO - I just had to click the power buttons on the rivers with micro-buttons, but ... We all think in hindsight! In the plus - now not 2, and 4 disks can work in 3GB mode!)
Adaptec AAR-1430SA, for example.
It is placed in the “short” PSI-E and provides 4 SATA ports.
It will cost about a thousand in 4 ...
At one time, I bought some on simple PCI on Budenovsky, (the legacy of the memorable mother from VIA - there were no PCI-E there), but they only pull the "first" SATA speed ...
Sometimes the network built into the motherboard “dies”, so it’s better to immediately provide a place on your mother and a scarf to replace the network!
Of your choice. You can put, you can - no.
There is a place for placement in the case for it ...
I set it up - it was originally resistor, now it has a display and touch controls. The plus is that you can significantly muffle the noise of the fans!
PySy Estheta put "Dropsy", but it's not so cheap ...
Someone will say, “Why do we need shoelace advice ?!” and it’s not quite right ...
The fact is that you won’t be able to insert the “angular” SATA connectors into the basket - like this, the bulge from the fan sticks out foolishly there!
In the motherboard - most often the “corner” ones will also interfere: most often they are placed in pairs, as a result they interfere with each other if the “bent” connector on the cord.
So “Our Choice” - “straight” shoelaces!
A couple of tips:
I settled on Ubuntu - how to put in a server configuration on Habré written many articles!
In particular, I can advise Do-it-yourself Linux home server
These are the pies.
Relatively easy and expensive it is possible to assemble a STRONGLY multi-disk system ...
If you put additional SATA-controllers and another basket, then the number of disks can be brought up to 15 calmly, which will give all 30 ter with two-terabyte disks!
* dreamily * But after all, three terabytes will someday appear ...
And may the Force come with you! Fortunately, in such volumes of this Force it will be possible to cram very much!
fit the videos ... What people advised them to do with some kind of super-duper professional solutions worth hundreds of thousands of rubles, which, of course, cool, but ...
For my part, I gave the layout according to the server that I made for myself three years ago and successfully use it ...
The server contains 11 hard disks, one of which is bootable and 10 are file-based.
It is not difficult to calculate, 10 disks of 2 terabytes each will give the desired 20 terabytes!
How to achieve this?
I'll tell you now!
PySy This is a transfer of my article from the Sandbox. From the moment of its writing, I found out a couple of “funny” things that were added here.
PySySy This is an amateur decision to stuff such a horde of disks into one computer.
Reliability is realized on the assumption that with such a number of disks - you can put a part in RAID, and if necessary - easily and unconstrainedly replace the crashed one!
Housing
Perhaps one of the main problems with stuffing so many disks into one computer.
I tried several options, including a home-made rack for 10 disks from the corners of the Merlenovsky, but it was all uncomfortable ...
As a result, I settled on a "simple" case for 9 pieces of five-inch slots.
You can take 10, but there isn’t much sense ...
In my case, the choice fell on Silver Stone with a door, but in bulk options!
Something similar - it will cost thousands of 2-3 rubles.
Hard Drive Basket
I took two pieces of MOBILE RACK SATA METALL ST-3051.
This is a device that clogs itself with three five-inch slots, in return giving the opportunity to install 5 SATA drives each.
You can buy one for about 4357 rubles.
I took it before the crisis, so I saved it decently ...
A small detail - the way it looks in the picture is not quite right: in practice, to get into these three five-inch windows, you need to put it on its side ...
On the rear panel there are five SATA connectors, 2 SATA -nourishment and three molecules (for the most part MUCH they do not really need, but ...). Plus a fan of 80 mm.
On the front are performance indicators.
Each disk is put into the “basket”, slid into the “basket” until it gets into the connectors on the basket board with its own SATA contacts, after which the basket handle is pressed and latched.
The plus is that, as I recently found out (in three years!), The device has a "Hot Swap" normally working !!!
We put two of these baskets in the bottom of the case, scoring six of the nine slots (just so as not to outweigh the top!).
Now we are ready to put as many as 10 pieces of discs!
UPD In front of the baskets there is a power switch in the form of buttons. Buttons must be pressed! And then yesterday I cursed everything - part of the disks does not see and that's it! While I did not remember about these buttons - I was tormented
Power Supply
The other day I upgraded to 600 watts a thousand for two rubles.
Previously, I worked with 350 and it’s normal, but recently, the power supply began to “dope” ...
CD-DVD drive
Absolutely useless thing on a file-washer!
You can put it, but in practice - it’s easier to take a USB drive and connect it only when installing the system!
As correctly noted in the comments - in principle, you can put a system from a flash drive!
In principle - if you put a script for automatically copying images published somewhere here on the server - it can be useful and bring it - to choose from!
From the connection options: if you do it by analogy, you will have the choice of either 2 SATA or 1 IDE. So - there is where to connect!
Motherboard percent
Any!
In practice, a few tips:
- Do not take frankly weak! At first, I had a mini motherboard from VIA, as a result, the network worked through the stump of the deck!
- The network is better gigabit!
- 6 SATA pieces on the motherboard, but 4 is possible
- Built-in video adapter: we will manage through the network, but sometimes you need to configure something on the machine itself and stick a video card for this - it’s somehow not a hunt!
- PCI-E - desirable, and better, more "short"
The rest is optional.
Caution against buying the ASUS P5Q Premium - I almost burst the other day when I thought about an upgrade.
It would seem that 10 SATA - what more could you want ?!
In practice - it turned out that there are not 10, but 6 + 4 ...
That is 6 - normal, and 4 - “two double”, when the drives stuck in them are forcibly combined in pairs into “raids” ...
So it’s better to take the motherboard to 6 (4) ordinary SATA, “finishing off” the remaining expansion cards!
UPD I had to upgrade the socket to the 775 when upgrading. As a result, I was tormented by aaaa ... Or 6 SATA, or built-in vidyuha. In more modern chipsets, the problem is not so acute ...
As a result, when upgrading, I took it from 4 SATA: I already had controller boards for PCI, there were 2 pieces of PCI on my mother, so I decided that it would be cheaper than buying additional video cards ...
(The reason for the upgrade is idiotic ... 11th drive ... While it was 10 - everything was normal. I stuck 11 - so the old mother stubbornly did not see the second SATA! I had to upgrade my mother.
IMHO - I just had to click the power buttons on the rivers with micro-buttons, but ... We all think in hindsight! In the plus - now not 2, and 4 disks can work in 3GB mode!)
SATA controller
Adaptec AAR-1430SA, for example.
It is placed in the “short” PSI-E and provides 4 SATA ports.
It will cost about a thousand in 4 ...
At one time, I bought some on simple PCI on Budenovsky, (the legacy of the memorable mother from VIA - there were no PCI-E there), but they only pull the "first" SATA speed ...
Redundant Ethernet
Sometimes the network built into the motherboard “dies”, so it’s better to immediately provide a place on your mother and a scarf to replace the network!
Fan controller aka Reobas
Of your choice. You can put, you can - no.
There is a place for placement in the case for it ...
I set it up - it was originally resistor, now it has a display and touch controls. The plus is that you can significantly muffle the noise of the fans!
PySy Estheta put "Dropsy", but it's not so cheap ...
SATA Shoelaces
Someone will say, “Why do we need shoelace advice ?!” and it’s not quite right ...
The fact is that you won’t be able to insert the “angular” SATA connectors into the basket - like this, the bulge from the fan sticks out foolishly there!
In the motherboard - most often the “corner” ones will also interfere: most often they are placed in pairs, as a result they interfere with each other if the “bent” connector on the cord.
So “Our Choice” - “straight” shoelaces!
Assembly
A couple of tips:
- Manufacturers of cases at five inches make either small corners around the edges, or a "pallet" for the "convenience" of installation. When choosing a case, do not burst with "pallets" - they will interfere! Corners - it is necessary to bend.
- It is better to tighten SATA shoelaces with ties into bundles of 4 pieces - otherwise they will occupy half-cases! If you get into the basket fan - the basket will yell loudly at such a mockery by the speaker! At home, I spread 2 to 2 wires from the mother to the first and the second basket + two to three - to the other connectors. It turned out quite compact.
And finally, SYSTEM!
I settled on Ubuntu - how to put in a server configuration on Habré written many articles!
In particular, I can advise Do-it-yourself Linux home server
Conclusion
These are the pies.
Relatively easy and expensive it is possible to assemble a STRONGLY multi-disk system ...
If you put additional SATA-controllers and another basket, then the number of disks can be brought up to 15 calmly, which will give all 30 ter with two-terabyte disks!
* dreamily * But after all, three terabytes will someday appear ...
And may the Force come with you! Fortunately, in such volumes of this Force it will be possible to cram very much!