test: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=rbd, iodepth=16 fio-3.12 Starting 1 process test: (groupid=0, jobs=1): err= 0: pid=8650: Mon Jan 18 14:40:04 2021 write: IOPS=35, BW=143MiB/s (150MB/s)(2048MiB/14306msec); 0 zone resets slat (usec): min=570, max=2004, avg=826.98, stdev=264.51 clat (msec): min=91, max=1135, avg=445.20, stdev=181.58 lat (msec): min=92, max=1136, avg=446.03, stdev=181.59 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 194], 10.00th=[ 228], 20.00th=[ 292], | 30.00th=[ 338], 40.00th=[ 380], 50.00th=[ 422], 60.00th=[ 460], | 70.00th=[ 523], 80.00th=[ 584], 90.00th=[ 684], 95.00th=[ 810], | 99.00th=[ 927], 99.50th=[ 961], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min=65536, max=180224, per=99.18%, avg=145396.29, stdev=29370.91, samples=28 iops : min= 16, max= 44, avg=35.46, stdev= 7.15, samples=28 lat (msec) : 100=0.39%, 250=13.09%, 500=53.32%, 750=26.37%, 1000=6.45% cpu : usr=2.53%, sys=0.54%, ctx=473, majf=0, minf=26678 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=97.1%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,512,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): WRITE: bw=143MiB/s (150MB/s), 143MiB/s-143MiB/s (150MB/s-150MB/s), io=2048MiB (2147MB), run=14306-14306msec Disk stats (read/write): dm-0: ios=0/34, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/34, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00% md0: ios=0/34, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/30, aggrmerge=0/21, aggrticks=0/3, aggrin_queue=0, aggrutil=0.00% sdb: ios=0/30, merge=0/21, ticks=0/3, in_queue=0, util=0.00% sda: ios=0/30, merge=0/21, ticks=0/3, in_queue=0, util=0.00%