Testing Fusion-io ioDrive2

    В первом квартале этого года наша компания ADVANSERV стала первым авторизованным представителем компании Fusion-io в России.
    Вместе с красивым сертификатом и официальным статусом мы получили карту Fusion-io ioDrive2, как говорится «на пощупать» нашим техническим специалистам, и мы в свою очередь уже активно даём его для проведения тестов нашим клиентам.



    Нашим тестовым экземпляром была плата объёмом 1,2Tb на MLC памяти. Да, плата не из самых новых-передовых, но вполне, пожалуй, достойна детального разбора. Заявленные производителем характеристики выглядят следующим образом:



    In general, we don’t see anything special for modern PCI-E SSDs, but our task is not only to look at the numbers offered by the manufacturer, but also to check how much they differ from the real performance indicators, because both the tasks and the testing methods everyone is very different. We mocked the board a bit, having completely disassembled it, in order to look and see what is inside.



    An autopsy showed that it was built using the next generation FPGA board for flash control - Virtex-6 manufactured by Xilinx.



    But the implementation of memory modules on the board pleasantly surprised (although it is difficult to say the practical application of this solution), they are not just soldered on the board, they are inserted into special connectors by several modules.



    Но сами модули выглядят следующим образом (а снизу соответственно две продольные ножки, которыми эти модули вставляются в слоты).



    К сожалению, у нас не нашлось второй такой платы, чтобы проверить взаимозаменяемость этих модулей, возможно, в случае выхода из строя какого-то из наборов памяти, это облегчит гарантийный ремонт платы, так как не придётся заменять её целиком. Тут, к сожалению, как и в обзоре Fusion-io ioDrive Duo нас постигло разочарование — несмотря на использование нескольких отдельных модулей, ни о каком аппаратном RAID`е речи не идёт. Возможно это задел на будущее, так как для работы на таких скоростях требуются достаточно большие вычислительные мощности и как следствие — охлаждение, но хочется всё-таки надеяться, что когда-нибудь мы сможем оценить прелести аппаратного RAID при использовании PCI-E SSD устройств.
    Ну что же, давайте перейдём непосредственно к тестам. Прежде чем говорить о железной составляющей нашей тестовой машины, хотелось бы уточнить один момент, который не был озвучен в обзоре Fusion-io ioDrive Duo — требование к объёму оперативной памяти. По словам производителя (при использовании блоков 4096b) на каждые 100Gb объёма накопителя требуется 530MB оперативной памяти. Соответственно, для того что бы накопитель на 1,2Tb работал «правильно», требуется минимум ~6,5GB оперативной памяти.

    Конфигурация тестового стенда:
    Платформа — www.advanserv.ru/products/servery/prodution/hp-proliant-dl380-g7
    Процессор — Xeon E5606
    Память — 8 Гб
    Жесткие диски — 2xSAS 146Гб 10k

    После нескольких наших статей по накопителям в прошлом году и по отзывам к ним мы немного изменили набор проводимых нами тестов и теперь он выглядит следующим образом:
    • AS SSD Benchmark
    • ATTO Disk Benchmark
    • CrystalDiskMark 3
    • Fio
    • Iometr
    • SQLIO


    ATTO Disk Benchmark
    We tested with the following parameters:
    Total Length = 256 Mb
    Queue Depth = 2-10





    AS SSD Benchmark IOPS

    AS SSD Benchmark MB / S

    AS SSD Copy-Benchmark


    You can already compare the results with the predecessor ioDrive Duo and see almost a twofold increase in performance . Let's continue with synthetic tests:
    CrystalDiskMark


    Here we see a 50% performance increase in sequential read / write and when working with large blocks in 512k.
    Iometr
    For testing, a set of patterns, already tested by us, was selected:
    • Database
    • File server
    • Workstation
    • Webserver

    The maximum results obtained during testing were selected as the results.


    Fio
    The fio test in our reviews appeared after the article “How to correctly measure disk performance” was published on habrahabr, which has become a kind of benchmark for testing various storage systems.





    For those who want to see all the numbers with their own eyes, I suggest a test log:
    iodepth = 2.txt (3 kB)
    readtest: (groupid=0, jobs=1): err= 0: pid=1272: Thu Feb 7 09:11:17 2013
    read: io=34234MB, bw=17159KB/s, iops=4289, runt=2042984msec
    slat (usec): min=4, max=76123, avg=22.70, stdev=27.60
    clat (usec): min=1, max=523598, avg=296.87, stdev=1211.17
    lat (usec): min=68, max=523636, avg=320.13, stdev=1222.19
    clat percentiles (usec):
    | 1.00th=[ 56], 5.00th=[ 62], 10.00th=[ 63], 20.00th=[ 67],
    | 30.00th=[ 75], 40.00th=[ 78], 50.00th=[ 81], 60.00th=[ 84],
    | 70.00th=[ 93], 80.00th=[ 115], 90.00th=[ 231], 95.00th=[ 1512],
    | 99.00th=[ 5664], 99.50th=[ 6688], 99.90th=[ 7904], 99.95th=[11072],
    | 99.99th=[29824]
    bw (KB/s): min= 184, max=75760, per=100.00%, avg=17264.19, stdev=20668.46
    lat (usec): 2=0.01%, 20=0.01%, 50=0.11%, 100=74.44%, 250=15.81%
    lat (usec): 500=1.60%, 750=1.40%, 1000=0.37%
    lat (msec): 2=3.08%, 4=1.44%, 10=1.69%, 20=0.04%, 50=0.01%
    lat (msec): 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
    cpu: usr=2.68%, sys=12.28%, ctx=7690923, majf=269391, minf=96413
    IO depths: 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=8763833/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid=0, jobs=1): err= 0: pid=1273: Thu Feb 7 09:11:17 2013
    write: io=125704MB, bw=63005KB/s, iops=15751, runt=2043030msec
    slat (usec): min=5, max=76204, avg=13.32, stdev=14.17
    clat (usec): min=2, max=330078, avg=73.19, stdev=632.83
    lat (usec): min=27, max=330091, avg=86.90, stdev=636.87
    clat percentiles (usec):
    | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 29],
    | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 34], 60.00th=[ 35],
    | 70.00th=[ 36], 80.00th=[ 38], 90.00th=[ 43], 95.00th=[ 50],
    | 99.00th=[ 135], 99.50th=[ 3568], 99.90th=[ 7072], 99.95th=[ 7648],
    | 99.99th=[13760]
    bw (KB/s): min= 197, max=174672, per=100.00%, avg=63411.79, stdev=76086.74
    lat (usec): 4=0.01%, 20=0.59%, 50=94.24%, 100=3.79%, 250=0.59%
    lat (usec): 500=0.01%, 750=0.02%, 1000=0.02%
    lat (msec): 2 = 0.06%, 4 = 0.22%, 10 = 0.43%, 20 = 0.02%, 50 = 0.01%
    lat (msec): 100 = 0.01%, 250 = 0.01%, 500 = 0.01%
    cpu: usr = 7.66%, sys = 25.35%, ctx = 16456563, majf = 260237, minf = 130862
    IO depths: 1 = 0.1%, 2 = 100.0%, 4 = 0.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
    submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
    complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
    issued: total = r = 0 / w = 32180125 / d = 0, short = r = 0 / w = 0 / d = 0

    Run status group 0 (all jobs):
    READ: io = 34234MB, aggrb = 17158KB / s, minb = 17158KB / s, maxb = 17158KB / s, mint = 2042984msec, maxt = 2042984msec
    WRITE: io = 125704MB, aggrb = 63004KB / s, minb = 63004KB / s, maxb = 63004KB / s, mint = 2043030msec, maxt = 2043030msec

    Disk stats (read / write):
    fioa: ios = 8763830/32180122, merge = 0/0, ticks = 1366258/1005521, in_queue = 992386, util = 33.54

    iodepth = 4.txt (2 kB)
    readtest: (groupid = 0, jobs = 1): err = 0: pid = 26270: Wed Feb 6 17:46:57 2013
    read: io = 26865MB, bw = 13782KB / s, iops = 3445, runt = 1996032msec
    slat ( usec): min = 4, max = 93411, avg = 26.35, stdev = 61.61
    clat (usec): min = 42, max = 434738, avg = 916.17, stdev = 2997.70
    lat (usec): min = 70, max = 434777 , avg = 943.11, stdev = 2999.40
    clat percentiles (usec):
    | 1.00th = [67], 5.00th = [78], 10.00th = [83], 20.00th = [92],
    | 30.00th = [100], 40.00th = [108], 50.00th = [118], 60.00th = [135],
    | 70.00th = [175], 80.00th = [506], 90.00th = [1384], 95.00th = [5536],
    | 99.00th = [15296], 99.50th = [18816], 99.90th = [30336], 99.95th = [35584],
    | 99.99th = [48896]
    bw (KB / s): min = 230, max = 102144, per = 100.00%, avg = 13854.58, stdev = 21679.39
    lat (usec): 50=0.01%, 100=28.88%, 250=47.54%, 500=3.46%, 750=4.38%
    lat (usec): 1000=1.71%
    lat (msec): 2=6.63%, 4=1.79%, 10=2.75%, 20=2.46%, 50=0.39%
    lat (msec): 100=0.01%, 250=0.01%, 500=0.01%
    cpu: usr=1.80%, sys=8.62%, ctx=5676226, majf=295816, minf=64814
    IO depths: 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=6877537/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid=0, jobs=1): err= 0: pid=26271: Wed Feb 6 17:46:58 2013
    write: io=126535MB, bw=64913KB/s, iops=16228, runt=1996082msec
    slat (usec): min=4, max=68903, avg=12.08, stdev=12.62
    clat (usec): min=21, max=410639, avg=187.46, stdev=1418.54
    lat (usec): min=29, max=410669, avg=199.89, stdev=1419.72
    clat percentiles (usec):
    | 1.00th=[ 38], 5.00th=[ 43], 10.00th=[ 44], 20.00th=[ 45],
    | 30.00th=[ 46], 40.00th=[ 46], 50.00th=[ 46], 60.00th=[ 47],
    | 70.00th=[ 48], 80.00th=[ 52], 90.00th=[ 61], 95.00th=[ 74],
    | 99.00th=[ 5472], 99.50th=[10816], 99.90th=[19840], 99.95th=[24448],
    | 99.99th=[37632]
    bw (KB/s): min= 234, max=261816, per=100.00%, avg=65267.74, stdev=104638.82
    lat (usec): 50=76.70%, 100=20.89%, 250=0.45%, 500=0.28%, 750=0.08%
    lat (usec): 1000=0.28%
    lat (msec): 2=0.08%, 4=0.13%, 10=0.56%, 20=0.47%, 50=0.09%
    lat (msec): 100=0.01%, 250=0.01%, 500=0.01%
    cpu: usr=6.24%, sys=20.44%, ctx=1241588, majf=288943, minf=64983
    IO depths: 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=0/w=32393048/d=0, short=r=0/w=0/d=0

    Run status group 0 (all jobs):
    READ: io=26865MB, aggrb=13782KB/s, minb=13782KB/s, maxb=13782KB/s, mint=1996032msec, maxt=1996032msec
    WRITE: io=126535MB, aggrb=64913KB/s, minb=64913KB/s, maxb=64913KB/s, mint=1996082msec, maxt=1996082msec

    Disk stats (read/write):
    fioa: ios=6877523/32393027, merge=0/0, ticks=1709603/1045836, in_queue=1190418, util=28.45%

    iodepth=8.txt (2 kB)
    readtest: (groupid = 0, jobs = 1): err = 0: pid = 23180: Wed Feb 6 16:32:33 2013
    read: io = 31125MB, bw = 17537KB / s, iops = 4384, runt = 1817381msec
    slat ( usec): min = 4, max = 46635, avg = 26.29, stdev = 54.70
    clat (usec): min = 48, max = 447157, avg = 1633.76, stdev = 5775.74
    lat (usec): min = 79, max = 447179 , avg = 1660.60, stdev = 5777.05
    clat percentiles (usec):
    | 1.00th = [159], 5.00th = [179], 10.00th = [191], 20.00th = [207],
    | 30.00th = [221], 40.00th = [235], 50.00th = [253], 60.00th = [290],
    | 70.00th = [604], 80.00th = [972], 90.00th = [1928], 95.00th = [7840],
    | 99.00th = [28032], 99.50th = [33024], 99.90th = [51968], 99.95th = [64768],
    | 99.99th = [156672]
    bw (KB / s): min = 119, max = 67200, per = 100.00%, avg = 17638.27, stdev = 25556.94
    lat (usec): 50=0.01%, 100=0.01%, 250=48.12%, 500=19.17%, 750=8.89%
    lat (usec): 1000=3.99%
    lat (msec): 2=10.32%, 4=4.09%, 10=0.70%, 20=2.15%, 50=2.43%
    lat (msec): 100=0.10%, 250=0.01%, 500=0.01%
    cpu: usr=2.10%, sys=10.26%, ctx=5996516, majf=264239, minf=72080
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=7968035/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid=0, jobs=1): err= 0: pid=23181: Wed Feb 6 16:32:33 2013
    write: io=126358MB, bw=71199KB/s, iops=17799, runt=1817308msec
    slat (usec): min=4, max=46586, avg=12.00, stdev=15.15
    clat (usec): min=64, max=497418, avg=396.45, stdev=2909.44
    lat (usec): min=72, max=497430, avg=408.79, stdev=2910.65
    clat percentiles (usec):
    | 1.00th=[ 91], 5.00th=[ 98], 10.00th=[ 101], 20.00th=[ 103],
    | 30.00th=[ 104], 40.00th=[ 105], 50.00th=[ 106], 60.00th=[ 107],
    | 70.00th=[ 110], 80.00th=[ 116], 90.00th=[ 127], 95.00th=[ 147],
    | 99.00th=[11840], 99.50th=[22144], 99.90th=[36096], 99.95th=[42752],
    | 99.99th=[68096]
    bw (KB/s): min= 132, max=262840, per=100.00%, avg=71623.12, stdev=104914.13
    lat (usec): 100=7.53%, 250=88.75%, 500=0.29%, 750=0.92%, 1000=0.36%
    lat (msec): 2=0.79%, 4=0.05%, 10=0.22%, 20=0.48%, 50=0.57%
    lat (msec): 100=0.03%, 250=0.01%, 500=0.01%
    cpu: usr=6.83%, sys=21.93%, ctx=592120, majf=257281, minf=74722
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=0/w=32347600/d=0, short=r=0/w=0/d=0

    Run status group 0 (all jobs):
    READ: io=31125MB, aggrb=17537KB/s, minb=17537KB/s, maxb=17537KB/s, mint=1817381msec, maxt=1817381msec
    WRITE: io=126358MB, aggrb=71198KB/s, minb=71198KB/s, maxb=71198KB/s, mint=1817308msec, maxt=1817308msec

    Disk stats (read/write):
    fioa: ios=7968027/32347598, merge=0/0, ticks=3221157/1578678, in_queue=1672519, util=31.56%

    iodepth=16.txt (3 kB)
    Jobs: 2 (f=2): [rw] [3.7% done] [1608K/1424K/0K /s] [402 /356 /0 iops] [eta 11h:34m:11s]
    readtest: (groupid=0, jobs=1): err= 0: pid=20314: Wed Feb 6 15:23:21 2013
    read: io=42920MB, bw=27204KB/s, iops=6800, runt=1615603msec
    slat (usec): min=4, max=78043, avg=22.41, stdev=43.93
    clat (usec): min=67, max=902063, avg=2233.41, stdev=8952.49
    lat (usec): min=94, max=902091, avg=2256.34, stdev=8954.33
    clat percentiles (usec):
    | 1.00th=[ 306], 5.00th=[ 350], 10.00th=[ 382], 20.00th=[ 422],
    | 30.00th=[ 454], 40.00th=[ 482], 50.00th=[ 524], 60.00th=[ 620],
    | 70.00th=[ 780], 80.00th=[ 1704], 90.00th=[ 2160], 95.00th=[ 2448],
    | 99.00th=[49920], 99.50th=[61184], 99.90th=[97792], 99.95th=[117248],
    | 99.99th=[166912]
    bw (KB/s): min= 19, max=93688, per=100.00%, avg=27333.96, stdev=34656.29
    lat (usec): 100=0.01%, 250=0.09%, 500=44.48%, 750=23.93%, 1000=5.03%
    lat (msec): 2=13.52%, 4=9.72%, 10=0.19%, 20=0.20%, 50=1.84%
    lat (msec): 100=0.91%, 250=0.09%, 500=0.01%, 750=0.01%, 1000=0.01%
    cpu: usr=3.02%, sys=13.27%, ctx=6868530, majf=205686, minf=64110
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=10987596/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid=0, jobs=1): err= 0: pid=20315: Wed Feb 6 15:23:21 2013
    write: io=123008MB, bw=77968KB/s, iops=19491, runt=1615549msec
    slat (usec): min=4, max=77919, avg=12.51, stdev=15.71
    clat (usec): min=112, max=813907, avg=774.02, stdev=4696.75
    lat (usec): min=137, max=813922, avg=786.88, stdev=4697.77
    clat percentiles (usec):
    | 1.00th=[ 209], 5.00th=[ 217], 10.00th=[ 221], 20.00th=[ 225],
    | 30.00th=[ 227], 40.00th=[ 231], 50.00th=[ 237], 60.00th=[ 241],
    | 70.00th=[ 251], 80.00th=[ 262], 90.00th=[ 326], 95.00th=[ 1032],
    | 99.00th=[20608], 99.50th=[36608], 99.90th=[61696], 99.95th=[75264],
    | 99.99th=[116224]
    bw (KB/s): min= 50, max=264272, per=100.00%, avg=78360.68, stdev=98746.21
    lat (usec): 250=69.58%, 500=21.53%, 750=1.68%, 1000=2.10%
    lat (msec): 2=3.44%, 4=0.07%, 10=0.25%, 20=0.33%, 50=0.81%
    lat (msec): 100=0.19%, 250=0.02%, 500=0.01%, 750=0.01%, 1000=0.01%
    cpu: usr=7.52%, sys=24.70%, ctx=947303, majf=200590, minf=86409
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued: total=r=0/w=31490162/d=0, short=r=0/w=0/d=0

    Run status group 0 (all jobs):
    READ: io=42920MB, aggrb=27203KB/s, minb=27203KB/s, maxb=27203KB/s, mint=1615603msec, maxt=1615603msec
    WRITE: io=123008MB, aggrb=77967KB/s, minb=77967KB/s, maxb=77967KB/s, mint=1615549msec, maxt=1615549msec

    Disk stats (read/write):
    fioa: ios=10987556/31490135, merge=0/0, ticks=6927819/3309326, in_queue=3479998, util=38.51%

    iodepth=32.txt (3 kB)
    readtest: (groupid=0, jobs=1): err= 0: pid=17571: Wed Feb 6 14:08:19 2013
    read: io=51223MB, bw=33318KB/s, iops=8329, runt=1574274msec
    slat (usec): min=2, max=199530, avg=12.18, stdev=83.08
    clat (usec): min=70, max=3926.3K, avg=3750.49, stdev=19681.75
    lat (usec): min=86, max=3926.3K, avg=3762.95, stdev=19687.15
    clat percentiles (usec):
    | 1.00th=[ 386], 5.00th=[ 462], 10.00th=[ 516], 20.00th=[ 660],
    | 30.00th=[ 844], 40.00th=[ 964], 50.00th=[ 1080], 60.00th=[ 1720],
    | 70.00th=[ 1992], 80.00th=[ 2256], 90.00th=[ 2512], 95.00th=[ 2704],
    | 99.00th=[86528], 99.50th=[113152], 99.90th=[254976], 99.95th=[329728],
    | 99.99th=[536576]
    bw (KB/s): min= 52, max=114504, per=100.00%, avg=33638.01, stdev=43487.39
    lat (usec): 100=0.01%, 250=0.01%, 500=8.28%, 750=15.94%, 1000=19.16%
    lat (msec): 2=26.73%, 4=26.69%, 10=0.34%, 20=0.25%, 50=0.68%
    lat (msec): 100=1.23%, 250=0.58%, 500=0.09%, 750=0.01%, 1000=0.01%
    lat (msec): 2000=0.01%, >=2000=0.01%
    cpu: usr=2.32%, sys=9.77%, ctx=6302812, majf=178282, minf=83315
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
    issued: total=r=13112981/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid = 0, jobs = 1): err = 0: pid = 17572: Wed Feb 6 14:08:19 2013
    write: io = 117583MB, bw = 76485KB / s, iops = 19121, runt = 1574222msec
    slat ( usec): min = 3, max = 199706, avg = 8.97, stdev = 46.54
    clat (usec): min = 38, max = 3624.5K, avg = 1629.47, stdev = 13108.63
    lat (usec): min = 47, max = 3624.5K, avg = 1638.67, stdev = 13110.83
    clat percentiles (usec):
    | 1.00th = [266], 5.00th = [274], 10.00th = [282], 20.00th = [294],
    | 30.00th = [310], 40.00th = [334], 50.00th = [370], 60.00th = [414],
    | 70.00th = [466], 80.00th = [612], 90.00th = [1624], 95.00th = [1944],
    | 99.00th = [34560], 99.50th = [77312], 99.90th = [171008], 99.95th = [244736],
    | 99.99th = [444416]
    bw (KB/s): min= 70, max=411304, per=100.00%, avg=77222.16, stdev=101662.66
    lat (usec): 50=0.01%, 100=0.01%, 250=0.07%, 500=74.77%, 750=6.44%
    lat (usec): 1000=0.32%
    lat (msec): 2=14.73%, 4=2.35%, 10=0.06%, 20=0.09%, 50=0.34%
    lat (msec): 100=0.52%, 250=0.25%, 500=0.04%, 750=0.01%, 1000=0.01%
    lat (msec): 2000=0.01%, >=2000=0.01%
    cpu: usr=4.74%, sys=16.38%, ctx=6184005, majf=177095, minf=74673
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
    issued: total=r=0/w=30101173/d=0, short=r=0/w=0/d=0

    Run status group 0 (all jobs):
    READ: io=51223MB, aggrb=33318KB/s, minb=33318KB/s, maxb=33318KB/s, mint=1574274msec, maxt=1574274msec
    WRITE: io=117583MB, aggrb=76485KB/s, minb=76485KB/s, maxb=76485KB/s, mint=1574222msec, maxt=1574222msec

    Disk stats (read/write):
    fioa: ios=13113097/30101167, merge=0/0, ticks=16627330/11698980, in_queue=11738292, util=36.46%

    iodepth=64.txt (3 kB)
    readtest: (groupid = 0, jobs = 1): err = 0: pid = 17090: Wed Feb 6 12:53:37 2013
    read: io = 140746MB, bw = 49947KB / s, iops = 12486, runt = 2885517msec
    slat ( usec): min = 2, max = 64665, avg = 12.31, stdev = 41.15
    clat (usec): min = 115, max = 1327.2K, avg = 5053.06, stdev = 29498.91
    lat (usec): min = 122, max = 1327.2K, avg = 5065.67, stdev = 29502.49
    clat percentiles (usec):
    | 1.00th = [524], 5.00th = [684], 10.00th = [772], 20.00th = [884],
    | 30.00th = [964], 40.00th = [1032], 50.00th = [1096], 60.00th = [1192],
    | 70.00th = [1432], 80.00th = [2040], 90.00th = [2512], 95.00th = [3248],
    | 99.00th = [187392], 99.50th = [230400], 99.90th = [342016], 99.95th = [419840],
    | 99.99th = [634880]
    bw (KB/s): min= 66, max=253960, per=100.00%, avg=50307.56, stdev=80694.65
    lat (usec): 250=0.01%, 500=0.65%, 750=7.82%, 1000=27.21%
    lat (msec): 2=43.49%, 4=17.37%, 10=1.48%, 20=0.05%, 50=0.08%
    lat (msec): 100=0.28%, 250=1.23%, 500=0.32%, 750=0.02%, 1000=0.01%
    lat (msec): 2000=0.01%
    cpu: usr=2.95%, sys=12.40%, ctx=28019337, majf=401978, minf=142817
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
    issued: total=r=36031041/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid=0, jobs=1): err= 0: pid=17091: Wed Feb 6 12:53:37 2013
    write: io=116908MB, bw=41489KB/s, iops=10372, runt=2885455msec
    slat (usec): min=2, max=64713, avg= 9.19, stdev=23.68
    clat (usec): min=23, max=1392.8K, avg=6089.22, stdev=31651.84
    lat (usec): min=41, max=1392.8K, avg=6098.65, stdev=31654.10
    clat percentiles (usec):
    | 1.00th=[ 572], 5.00th=[ 644], 10.00th=[ 700], 20.00th=[ 772],
    | 30.00th=[ 844], 40.00th=[ 932], 50.00th=[ 1208], 60.00th=[ 1608],
    | 70.00th=[ 2224], 80.00th=[ 2768], 90.00th=[ 3568], 95.00th=[ 4832],
    | 99.00th=[193536], 99.50th=[232448], 99.90th=[354304], 99.95th=[436224],
    | 99.99th=[643072]
    bw (KB/s): min= 30, max=295456, per=100.00%, avg=41763.22, stdev=66601.96
    lat (usec): 50=0.01%, 100=0.01%, 250=0.01%, 500=0.10%, 750=16.37%
    lat (usec): 1000=27.80%
    lat (msec): 2=22.19%, 4=25.57%, 10=5.46%, 20=0.06%, 50=0.12%
    lat (msec): 100=0.37%, 250=1.59%, 500=0.33%, 750=0.02%, 1000=0.01%
    lat (msec): 2000=0.01%
    cpu: usr=2.60%, sys=8.97%, ctx=13311550, majf=404077, minf=151007
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
    issued: total=r=0/w=29928361/d=0, short=r=0/w=0/d=0

    Run status group 0 (all jobs):
    READ: io=140746MB, aggrb=49947KB/s, minb=49947KB/s, maxb=49947KB/s, mint=2885517msec, maxt=2885517msec
    WRITE: io=116908MB, aggrb=41488KB/s, minb=41488KB/s, maxb=41488KB/s, mint=2885455msec, maxt=2885455msec

    Disk stats (read/write):
    fioa: ios=36030985/29928332, merge=0/0, ticks=36574787/43511582, in_queue=43280929, util=28.05%

    iodepth=128.txt (3 kB)
    readtest: (groupid = 0, jobs = 1): err = 0: pid = 4391: Thu Feb 7 10:33:04 2013
    read: io = 116497MB, bw = 44411KB / s, iops = 11102, runt = 2686108msec
    slat ( usec): min = 4, max = 283206, avg = 19.25, stdev = 89.56
    clat (usec): min = 211, max = 3040.6K, avg = 11442.21, stdev = 60229.01
    lat (usec): min = 241, max = 3040.7K, avg = 11461.96, stdev = 60234.42
    clat percentiles (usec):
    | 1.00th = [1960], 5.00th = [2320], 10.00th = [2544], 20.00th = [2800],
    | 30.00th = [2960], 40.00th = [3088], 50.00th = [3216], 60.00th = [3344],
    | 70.00th = [3472], 80.00th = [3696], 90.00th = [4192], 95.00th = [4832],
    | 99.00th = [403456], 99.50th = [473088], 99.90th = [618496], 99.95th = [716800],
    | 99.99th = [1105920]
    bw (KB/s): min= 7, max=163808, per=100.00%, avg=44697.18, stdev=69457.02
    lat (usec): 250=0.01%, 750=0.01%, 1000=0.01%
    lat (msec): 2=1.24%, 4=86.07%, 10=10.35%, 20=0.08%, 50=0.08%
    lat (msec): 100=0.09%, 250=0.39%, 500=1.32%, 750=0.32%, 1000=0.03%
    lat (msec): 2000=0.01%, >=2000=0.01%
    cpu: usr=4.24%, sys=17.26%, ctx=19748583, majf=381996, minf=117598
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
    issued: total=r=29823140/w=0/d=0, short=r=0/w=0/d=0
    writetest: (groupid=0, jobs=1): err= 0: pid=4392: Thu Feb 7 10:33:04 2013
    write: io=123778MB, bw=47188KB/s, iops=11796, runt=2686057msec
    slat (usec): min=4, max=410883, avg=14.17, stdev=84.54
    clat (usec): min=124, max=2139.5K, avg=10773.34, stdev=53260.36
    lat (usec): min=153, max=2139.5K, avg=10787.94, stdev=53262.99
    clat percentiles (usec):
    | 1.00th=[ 1784], 5.00th=[ 1944], 10.00th=[ 2024], 20.00th=[ 2160],
    | 30.00th=[ 2288], 40.00th=[ 2704], 50.00th=[ 2832], 60.00th=[ 2928],
    | 70.00th=[ 3344], 80.00th=[ 4448], 90.00th=[ 5536], 95.00th=[ 6112],
    | 99.00th=[350208], 99.50th=[415744], 99.90th=[544768], 99.95th=[634880],
    | 99.99th=[962560]
    bw (KB/s): min= 27, max=259280, per=100.00%, avg=47471.80, stdev=72490.85
    lat (usec): 250=0.01%
    lat (msec): 2=8.35%, 4=68.91%, 10=19.91%, 20=0.15%, 50=0.23%
    lat (msec): 100=0.22%, 250=0.63%, 500=1.44%, 750=0.14%, 1000=0.02%
    lat (msec): 2000=0.01%, >=2000=0.01%
    cpu: usr=4.51%, sys=15.40%, ctx=10917747, majf=379874, minf=152643
    IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
    submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
    issued: total=r=0/w=31687117/d=0, short=r=0/w=0/d=0

    Run status group 0 (all jobs):
    READ: io=116497MB, aggrb=44410KB/s, minb=44410KB/s, maxb=44410KB/s, mint=2686108msec, maxt=2686108msec
    WRITE: io=123778MB, aggrb=47187KB/s, minb=47187KB/s, maxb=47187KB/s, mint=2686057msec, maxt=2686057msec

    Disk stats (read/write):
    fioa: ios=29823127/31687097, merge=0/0, ticks=36457022/56877685, in_queue=56655086, util=29.92%.txt


    И последний, лишь в этом тестировании, но не по значимости
    SQLIO Random Reads Test iops


    SQLIO Random Reads Test mbps


    SQLIO Random Writes Test iops


    SQLIO Random Writes Test mbps


    SQLIO Sequential Reads Test iops


    SQLIO Sequential Reads Test mbps


    SQLIO Sequential Writes Test iops


    SQLIO Sequential Writes Test mbps


    Опять-таки для любителей информации в текстовом варианте, предлагаю логи тестов:
    Random Reads Test.txt (5 kB)
    E:\sqlio.exe -BH -kR -frandom -t1 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 1 thread (0) using mask 0x0 (0)
    1 thread reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 5690.59
    MBs/sec: 355.66

    E:\sqlio.exe -BH -kR -frandom -t2 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
    2 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 12537.13
    MBs/sec: 783.57

    E:\sqlio.exe -BH -kR -frandom -t4 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
    4 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 18749.28
    MBs/sec: 1171.83

    E:\sqlio.exe -BH -kR -frandom -t8 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 19686.22
    MBs/sec: 1230.38

    E:\sqlio.exe -BH -kR -frandom -t8 -o2 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 2 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22332.76
    MBs/sec: 1395.79

    E:\sqlio.exe -BH -kR -frandom -t8 -o4 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 4 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22416.67
    MBs/sec: 1401.04

    E:\sqlio.exe -BH -kR -frandom -t8 -o8 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 8 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22558.90
    MBs/sec: 1409.93

    E:\sqlio.exe -BH -kR -frandom -t8 -o16 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 16 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22571.73
    MBs/sec: 1410.73

    E:\sqlio.exe -BH -kR -frandom -t8 -o32 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 32 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22572.42
    MBs/sec: 1410.77

    E:\sqlio.exe -BH -kR -frandom -t8 -o64 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 64 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22572.59
    MBs/sec: 1410.78

    Random Writes Test.txt (4 kB)
    E:\sqlio.exe -BH -kW -frandom -t1 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 1 thread (0) using mask 0x0 (0)
    1 thread writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 8547.96
    MBs/sec: 534.24

    E:\sqlio.exe -BH -kW -frandom -t2 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
    2 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 14972.08
    MBs/sec: 935.75

    E:\sqlio.exe -BH -kW -frandom -t4 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
    4 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 14946.20
    MBs/sec: 934.13

    E:\sqlio.exe -BH -kW -frandom -t8 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 14914.31
    MBs/sec: 932.14

    E:\sqlio.exe -BH -kW -frandom -t8 -o2 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 2 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 15007.10
    MBs/sec: 937.94

    E:\sqlio.exe -BH -kW -frandom -t8 -o4 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 4 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 15031.48
    MBs/sec: 939.46

    E:\sqlio.exe -BH -kW -frandom -t8 -o8 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 8 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 15054.59
    MBs/sec: 940.91

    E:\sqlio.exe -BH -kW -frandom -t8 -o16 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 64KB random IOs
    enabling multiple I/Os per thread with 16 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 15106.66
    MBs/sec: 944.16

    Sequential Reads Test.txt (6 kB)
    E:\sqlio.exe -BH -kR -fsequential -t1 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 1 thread (0) using mask 0x0 (0)
    1 thread reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    size of file e:\testfile.dat needs to be: 85899345920 bytes
    current file size: 0 bytes
    need to expand by: 85899345920 bytes
    expanding e:\testfile.dat… done.
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 5713.29
    MBs/sec: 357.08

    E:\sqlio.exe -BH -kR -fsequential -t2 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
    2 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 11005.13
    MBs/sec: 687.82

    E:\sqlio.exe -BH -kR -fsequential -t4 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
    4 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 12545.57
    MBs/sec: 784.09

    E:\sqlio.exe -BH -kR -fsequential -t8 -o1 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 13113.38
    MBs/sec: 819.58

    E:\sqlio.exe -BH -kR -fsequential -t8 -o2 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 2 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 17678.70
    MBs/sec: 1104.91

    E:\sqlio.exe -BH -kR -fsequential -t8 -o4 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 4 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22461.32
    MBs/sec: 1403.83

    E:\sqlio.exe -BH -kR -fsequential -t8 -o8 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 8 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22773.68
    MBs/sec: 1423.35

    E:\sqlio.exe -BH -kR -fsequential -t8 -o16 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 16 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22780.01
    MBs/sec: 1423.75

    E:\sqlio.exe -BH -kR -fsequential -t8 -o32 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 32 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22773.12
    MBs/sec: 1423.32

    E:\sqlio.exe -BH -kR -fsequential -t8 -o64 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 64 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22774.44
    MBs/sec: 1423.40

    E:\sqlio.exe -BH -kR -fsequential -t8 -o128 -s600 -b64 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads reading for 600 secs from file e:\testfile.dat
    using 64KB sequential IOs
    enabling multiple I/Os per thread with 128 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 22773.53
    MBs/sec: 1423.34

    Sequential Writes Test.txt (5 kB)
    E:\sqlio.exe -BH -kW -fsequential -t1 -o1 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 1 thread (0) using mask 0x0 (0)
    1 thread writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 21035.64
    MBs/sec: 164.34

    E:\sqlio.exe -BH -kW -fsequential -t2 -o1 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
    2 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 40578.72
    MBs/sec: 317.02

    E:\sqlio.exe -BH -kW -fsequential -t4 -o1 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
    4 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 79657.20
    MBs/sec: 622.32

    E:\sqlio.exe -BH -kW -fsequential -t8 -o1 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 1 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 111699.03
    MBs/sec: 872.64

    E:\sqlio.exe -BH -kW -fsequential -t8 -o2 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 2 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 116989.70
    MBs/sec: 913.98

    E:\sqlio.exe -BH -kW -fsequential -t8 -o4 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 4 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 117498.66
    MBs/sec: 917.95

    E:\sqlio.exe -BH -kW -fsequential -t8 -o8 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 8 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 120349.05
    MBs/sec: 940.22

    E:\sqlio.exe -BH -kW -fsequential -t8 -o16 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 16 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 115321.86
    MBs/sec: 900.95

    E:\sqlio.exe -BH -kW -fsequential -t8 -o32 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 32 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 119766.92
    MBs/sec: 935.67

    E:\sqlio.exe -BH -kW -fsequential -t8 -o64 -s600 -b8 -FE:\param.txt
    sqlio v1.5.SG
    parameter file used: E:\param.txt
    file e:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
    8 threads writing for 600 secs to file e:\testfile.dat
    using 8KB sequential IOs
    enabling multiple I/Os per thread with 64 outstanding
    buffering set to use hardware disk cache (but not file cache)
    using specified size: 81920 MB for file: e:\testfile.dat
    initialization done
    CUMULATIVE DATA:
    throughput metrics:
    IOs/sec: 119961.98
    MBs/sec: 937.20


    Теперь немного слов о ПО идущем в комплекте. Тут по-прежнему есть 2 варианта: Dell IO Manager или HP IO Accelerator Management Server. Я уже по-привычке пользуюсь web-интерфейсом от HP, он не притерпел никаких изменений по сравнению с версией идущей с ioDrive Duo. Настройка, перепрошивка, подключение дисков, информация об ошибках и т.д. прекрасно представлены, с утилитой удобно и просто работать.

    Отдельно хотелось бы коснуться темы перепрошивки — в тесте ioDrive Duo мы лично уже убедились, что от прошивки зависит очень многое, в том числе и скоростные характеристики устройства, но тут есть и обратная сторона. При обновлении драйверов для устройства, необходимо каждый раз возвращать старую прошивку, идущую в комплекте с данным драйвером. Процесс этот конечно несложный, но времязатратный (для моделей большого объёма), и, что самое главное, после перепрошивки карты форматируется. Этот не совсем очевидный момент может сыграть большую роль при выборе устройства.

    On my own, I want to add that when installing the card under linux, I had to play quite excitingly with drivers and firmware before I managed to get the device to work. And, although the installation and configuration process is not so complicated, I repeat, it can take a certain amount of time.

    There is a possibility of the card working in two versions: through the standard linux device manager - udev, or by starting the card driver as a service.

    On this I want to finish today's testing. I believe the updated ioDrive line of cards вполне удачна, она имеет заметное преимущество перед картами предыдущего поколения, компания постоянно работает над прошивками и драйверами к своим устройствам, выпускает новые модели (за обзором которых мы конечно охотимся очень активно, но карты приезжают к нам с некоторым запозданием) и работает над развитием технологий. Многие компании уже обратили внимание и на саму технологию PCI-E SSD и на решения от компании Fusion-io и активно внедряют их в своей инфраструктуре.

    Напоминаю, что вы можете получить в demo данно карту, или мы предоставим удалённый сервер с установленной платой, сконфигурированный для ваших целей, и вы сможете провести тестирование удалённо. Для приобретения Fusion-io или запроса demo просьба обращаться к руководителю направления Алексею Котову.

    Posted by KorP

    Also popular now: