[2024-12-09 03:59:15.563192] Starting SPDK v25.01-pre git sha1 c4269c6e2 / DPDK 24.03.0 initialization... [2024-12-09 03:59:15.563523] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3028695 ] Set seed to 1733713155555991 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 03:59:15.716945] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 03:59:15.820579] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 03:59:15.820636] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3028695' to capture a snapshot of events at runtime. [2024-12-09 03:59:15.820650] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 03:59:15.820664] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 03:59:15.820675] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3028695 for offline analysis/debug. [2024-12-09 03:59:15.821900] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 03:59:18 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/09-03:59:25 ... thread 0: (1000000,1000000) ops and (158139.7,158139.7) ops/second in (6.323524,6.323524) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.07 GB 37.6 0.2 0.0 0.2 1.1 0.9 0.0 1.3 33.1 148.8 7.60 3.96 12 0.633 255K 1252 0.0 0.0 L1 8/8 1004.28 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 85.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/3 1.10 GB 1.0 2.0 1.1 0.9 1.9 1.0 0.0 1.7 123.6 118.2 16.55 10.00 9 1.839 1317K 9938 0.0 0.0 L4 141/9 10.39 GB 1.0 2.8 1.6 1.2 2.6 1.5 0.3 1.7 117.9 112.0 24.13 14.24 12 2.011 607K 0 0.0 0.0 L5 128/0 10.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 315/31 24.14 GB 0.0 5.0 2.7 2.3 5.7 3.4 1.3 6.6 106.5 119.9 48.27 28.20 33 1.463 2181K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 2.7 2.3 5.7 3.4 1.3 6.6 106.5 119.9 48.27 28.20 33 1.463 2181K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 2.7 2.3 4.8 2.5 0.0 0.0 121.0 115.4 42.52 25.57 22 1.933 2181K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 152.9 5.76 2.63 11 0.523 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.4 total, 6.3 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.65 GB write, 905.28 MB/s write, 5.02 GB read, 804.30 MB/s read, 48.3 seconds Interval compaction: 5.65 GB write, 915.01 MB/s write, 5.02 GB read, 812.95 MB/s read, 48.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 90377 Average: 81.1549 StdDev: 575.71 Min: 1 Median: 2.1713 Max: 49427 Percentiles: P50: 2.17 P75: 3.51 P99: 1408.94 P99.9: 4874.94 P99.99: 13468.18 ------------------------------------------------------ [ 0, 1 ] 2626 2.906% 2.906% # ( 1, 2 ] 38731 42.855% 45.761% ######### ( 2, 3 ] 22373 24.755% 70.516% ##### ( 3, 4 ] 8018 8.872% 79.387% ## ( 4, 6 ] 8265 9.145% 88.532% ## ( 6, 10 ] 1832 2.027% 90.560% ( 10, 15 ] 435 0.481% 91.041% ( 15, 22 ] 49 0.054% 91.095% ( 22, 34 ] 5 0.006% 91.101% ( 34, 51 ] 7 0.008% 91.108% ( 51, 76 ] 5 0.006% 91.114% ( 76, 110 ] 8 0.009% 91.123% ( 110, 170 ] 83 0.092% 91.215% ( 170, 250 ] 688 0.761% 91.976% ( 250, 380 ] 1654 1.830% 93.806% ( 380, 580 ] 2388 2.642% 96.448% # ( 580, 870 ] 1779 1.968% 98.417% ( 870, 1300 ] 497 0.550% 98.967% ( 1300, 1900 ] 172 0.190% 99.157% ( 1900, 2900 ] 272 0.301% 99.458% ( 2900, 4400 ] 384 0.425% 99.883% ( 4400, 6600 ] 77 0.085% 99.968% ( 6600, 9900 ] 14 0.015% 99.983% ( 9900, 14000 ] 8 0.009% 99.992% ( 14000, 22000 ] 15 0.017% 100.009% ( 22000, 33000 ] 8 0.009% 100.018% ( 33000, 50000 ] 4 0.004% 100.022% ** Level 1 read latency histogram (micros): Count: 194298 Average: 16.5911 StdDev: 258.77 Min: 1 Median: 2.3155 Max: 34280 Percentiles: P50: 2.32 P75: 3.28 P99: 36.49 P99.9: 3314.26 P99.99: 9327.26 ------------------------------------------------------ [ 0, 1 ] 1374 0.707% 0.707% ( 1, 2 ] 76173 39.204% 39.911% ######## ( 2, 3 ] 62133 31.978% 71.890% ###### ( 3, 4 ] 21256 10.940% 82.829% ## ( 4, 6 ] 23954 12.328% 95.158% ## ( 6, 10 ] 5872 3.022% 98.180% # ( 10, 15 ] 1334 0.687% 98.867% ( 15, 22 ] 196 0.101% 98.968% ( 22, 34 ] 51 0.026% 98.994% ( 34, 51 ] 82 0.042% 99.036% ( 51, 76 ] 28 0.014% 99.050% ( 76, 110 ] 11 0.006% 99.056% ( 110, 170 ] 18 0.009% 99.065% ( 170, 250 ] 90 0.046% 99.112% ( 250, 380 ] 251 0.129% 99.241% ( 380, 580 ] 386 0.199% 99.440% ( 580, 870 ] 386 0.199% 99.638% ( 870, 1300 ] 205 0.106% 99.744% ( 1300, 1900 ] 108 0.056% 99.799% ( 1900, 2900 ] 154 0.079% 99.879% ( 2900, 4400 ] 151 0.078% 99.956% ( 4400, 6600 ] 54 0.028% 99.984% ( 6600, 9900 ] 14 0.007% 99.991% ( 9900, 14000 ] 7 0.004% 99.995% ( 14000, 22000 ] 11 0.006% 100.001% ( 22000, 33000 ] 2 0.001% 100.002% ( 33000, 50000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 197296 Average: 12.6035 StdDev: 203.91 Min: 1 Median: 2.2290 Max: 31910 Percentiles: P50: 2.23 P75: 3.12 P99: 13.22 P99.9: 1714.62 P99.99: 3388.28 ------------------------------------------------------ [ 0, 1 ] 1887 0.956% 0.956% ( 1, 2 ] 82862 41.999% 42.955% ######## ( 2, 3 ] 60688 30.760% 73.715% ###### ( 3, 4 ] 20587 10.435% 84.150% ## ( 4, 6 ] 22965 11.640% 95.790% ## ( 6, 10 ] 5463 2.769% 98.559% # ( 10, 15 ] 1352 0.685% 99.244% ( 15, 22 ] 230 0.117% 99.360% ( 22, 34 ] 44 0.022% 99.383% ( 34, 51 ] 72 0.036% 99.419% ( 51, 76 ] 24 0.012% 99.431% ( 76, 110 ] 13 0.007% 99.438% ( 110, 170 ] 12 0.006% 99.444% ( 170, 250 ] 44 0.022% 99.466% ( 250, 380 ] 131 0.066% 99.533% ( 380, 580 ] 243 0.123% 99.656% ( 580, 870 ] 271 0.137% 99.793% ( 870, 1300 ] 134 0.068% 99.861% ( 1300, 1900 ] 111 0.056% 99.917% ( 1900, 2900 ] 99 0.050% 99.968% ( 2900, 4400 ] 136 0.069% 100.036% ( 4400, 6600 ] 45 0.023% 100.059% ( 6600, 9900 ] 6 0.003% 100.062% ( 9900, 14000 ] 5 0.003% 100.065% ( 14000, 22000 ] 5 0.003% 100.067% ( 22000, 33000 ] 2 0.001% 100.068% ** Level 3 read latency histogram (micros): Count: 503240 Average: 14.7544 StdDev: 258.45 Min: 1 Median: 2.3088 Max: 44962 Percentiles: P50: 2.31 P75: 3.25 P99: 13.97 P99.9: 1141.72 P99.99: 2171.30 ------------------------------------------------------ [ 0, 1 ] 3616 0.719% 0.719% ( 1, 2 ] 197969 39.339% 40.057% ######## ( 2, 3 ] 162037 32.199% 72.256% ###### ( 3, 4 ] 55268 10.982% 83.239% ## ( 4, 6 ] 62049 12.330% 95.569% ## ( 6, 10 ] 14917 2.964% 98.533% # ( 10, 15 ] 2960 0.588% 99.121% ( 15, 22 ] 423 0.084% 99.205% ( 22, 34 ] 119 0.024% 99.229% ( 34, 51 ] 158 0.031% 99.260% ( 51, 76 ] 103 0.020% 99.280% ( 76, 110 ] 36 0.007% 99.288% ( 110, 170 ] 73 0.015% 99.302% ( 170, 250 ] 208 0.041% 99.343% ( 250, 380 ] 578 0.115% 99.458% ( 380, 580 ] 1083 0.215% 99.674% ( 580, 870 ] 887 0.176% 99.850% ( 870, 1300 ] 400 0.079% 99.929% ( 1300, 1900 ] 227 0.045% 99.974% ( 1900, 2900 ] 290 0.058% 100.032% ( 2900, 4400 ] 358 0.071% 100.103% ( 4400, 6600 ] 97 0.019% 100.122% ( 6600, 9900 ] 20 0.004% 100.126% ( 9900, 14000 ] 11 0.002% 100.129% ( 14000, 22000 ] 31 0.006% 100.135% ( 22000, 33000 ] 12 0.002% 100.137% ( 33000, 50000 ] 1 0.000% 100.137% ** Level 4 read latency histogram (micros): Count: 416850 Average: 33.7858 StdDev: 421.64 Min: 1 Median: 2.3313 Max: 49543 Percentiles: P50: 2.33 P75: 3.36 P99: 659.41 P99.9: 2693.69 P99.99: 3412.33 ------------------------------------------------------ [ 0, 1 ] 3038 0.729% 0.729% ( 1, 2 ] 161748 38.802% 39.531% ######## ( 2, 3 ] 131703 31.595% 71.126% ###### ( 3, 4 ] 45251 10.855% 81.982% ## ( 4, 6 ] 49099 11.779% 93.760% ## ( 6, 10 ] 11884 2.851% 96.611% # ( 10, 15 ] 2575 0.618% 97.229% ( 15, 22 ] 297 0.071% 97.300% ( 22, 34 ] 80 0.019% 97.319% ( 34, 51 ] 112 0.027% 97.346% ( 51, 76 ] 93 0.022% 97.368% ( 76, 110 ] 37 0.009% 97.377% ( 110, 170 ] 144 0.035% 97.412% ( 170, 250 ] 757 0.182% 97.593% ( 250, 380 ] 1950 0.468% 98.061% ( 380, 580 ] 3219 0.772% 98.833% ( 580, 870 ] 2540 0.609% 99.443% ( 870, 1300 ] 1008 0.242% 99.685% ( 1300, 1900 ] 465 0.112% 99.796% ( 1900, 2900 ] 547 0.131% 99.927% ( 2900, 4400 ] 768 0.184% 100.112% ( 4400, 6600 ] 187 0.045% 100.156% ( 6600, 9900 ] 32 0.008% 100.164% ( 9900, 14000 ] 15 0.004% 100.168% ( 14000, 22000 ] 13 0.003% 100.171% ( 22000, 33000 ] 26 0.006% 100.177% ( 33000, 50000 ] 17 0.004% 100.181% ** Level 5 read latency histogram (micros): Count: 8571 Average: 997.4207 StdDev: 1621.86 Min: 94 Median: 561.8145 Max: 49758 Percentiles: P50: 561.81 P75: 890.64 P99: 6008.60 P99.9: 24245.57 P99.99: 45143.10 ------------------------------------------------------ ( 76, 110 ] 6 0.070% 0.070% ( 110, 170 ] 69 0.805% 0.875% ( 170, 250 ] 544 6.347% 7.222% # ( 250, 380 ] 1442 16.824% 24.046% ### ( 380, 580 ] 2447 28.550% 52.596% ###### ( 580, 870 ] 1883 21.969% 74.565% #### ( 870, 1300 ] 776 9.054% 83.619% ## ( 1300, 1900 ] 320 3.734% 87.353% # ( 1900, 2900 ] 361 4.212% 91.565% # ( 2900, 4400 ] 532 6.207% 97.772% # ( 4400, 6600 ] 144 1.680% 99.452% ( 6600, 9900 ] 26 0.303% 99.755% ( 9900, 14000 ] 2 0.023% 99.778% ( 14000, 22000 ] 9 0.105% 99.883% ( 22000, 33000 ] 7 0.082% 99.965% ( 33000, 50000 ] 3 0.035% 100.000% ** DB Stats ** Uptime(secs): 6.4 total, 6.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 153.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.589 H:M:S, 24.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.589 H:M:S, 25.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/09-03:59:29 ... thread 0: (1000000,2000000) ops and (248801.8,193371.5) ops/second in (4.019263,10.342787) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 1.99 GB 137.8 1.0 0.0 1.0 2.8 1.8 0.0 1.6 70.3 189.7 15.22 10.04 30 0.507 1085K 5533 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 1.0 0.1 1.0 1.0 0.0 1.1 142.6 140.5 7.64 5.48 1 7.642 1106K 16K 0.0 0.0 L3 25/4 1.17 GB 1.0 2.6 1.7 0.9 2.5 1.6 0.5 1.5 135.6 130.8 19.77 12.99 11 1.798 1948K 12K 0.0 0.0 L4 141/12 9.88 GB 0.9 4.4 2.3 2.2 4.1 2.0 0.6 1.8 134.5 124.3 33.83 21.80 20 1.692 1380K 4867 0.0 0.0 L5 144/0 11.81 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 328/26 24.84 GB 0.0 9.2 5.0 4.2 10.5 6.3 3.4 5.9 122.8 140.6 76.47 50.31 62 1.233 5522K 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.2 5.0 4.2 10.5 6.3 3.4 5.9 122.8 140.6 76.47 50.31 62 1.233 5522K 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.2 5.0 4.2 8.7 4.5 0.0 0.0 140.3 133.4 66.93 44.93 36 1.859 5522K 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 191.2 9.54 5.38 26 0.367 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.4 total, 10.3 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.50 GB write, 1032.57 MB/s write, 9.17 GB read, 901.87 MB/s read, 76.5 seconds Interval compaction: 10.50 GB write, 1039.35 MB/s write, 9.17 GB read, 907.80 MB/s read, 76.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 359618 Average: 40.0030 StdDev: 350.68 Min: 1 Median: 1.9072 Max: 49427 Percentiles: P50: 1.91 P75: 2.88 P99: 718.29 P99.9: 3465.85 P99.99: 4328.17 ------------------------------------------------------ [ 0, 1 ] 16122 4.483% 4.483% # ( 1, 2 ] 180425 50.171% 54.654% ########## ( 2, 3 ] 82794 23.023% 77.677% ##### ( 3, 4 ] 26457 7.357% 85.034% # ( 4, 6 ] 25378 7.057% 92.091% # ( 6, 10 ] 5155 1.433% 93.525% ( 10, 15 ] 908 0.252% 93.777% ( 15, 22 ] 113 0.031% 93.808% ( 22, 34 ] 10 0.003% 93.811% ( 34, 51 ] 21 0.006% 93.817% ( 51, 76 ] 13 0.004% 93.821% ( 76, 110 ] 38 0.011% 93.831% ( 110, 170 ] 1337 0.372% 94.203% ( 170, 250 ] 5388 1.498% 95.701% ( 250, 380 ] 5685 1.581% 97.282% ( 380, 580 ] 4865 1.353% 98.635% ( 580, 870 ] 2753 0.766% 99.400% ( 870, 1300 ] 767 0.213% 99.614% ( 1300, 1900 ] 256 0.071% 99.685% ( 1900, 2900 ] 561 0.156% 99.841% ( 2900, 4400 ] 563 0.157% 99.997% ( 4400, 6600 ] 94 0.026% 100.024% ( 6600, 9900 ] 17 0.005% 100.028% ( 9900, 14000 ] 13 0.004% 100.032% ( 14000, 22000 ] 19 0.005% 100.037% ( 22000, 33000 ] 11 0.003% 100.040% ( 33000, 50000 ] 6 0.002% 100.042% ** Level 1 read latency histogram (micros): Count: 256910 Average: 14.2936 StdDev: 229.88 Min: 1 Median: 2.2069 Max: 34280 Percentiles: P50: 2.21 P75: 3.04 P99: 151.03 P99.9: 2777.10 P99.99: 7327.98 ------------------------------------------------------ [ 0, 1 ] 2988 1.163% 1.163% ( 1, 2 ] 108942 42.405% 43.568% ######## ( 2, 3 ] 79868 31.088% 74.656% ###### ( 3, 4 ] 25261 9.833% 84.488% ## ( 4, 6 ] 27985 10.893% 95.381% ## ( 6, 10 ] 7324 2.851% 98.232% # ( 10, 15 ] 1484 0.578% 98.810% ( 15, 22 ] 213 0.083% 98.893% ( 22, 34 ] 56 0.022% 98.914% ( 34, 51 ] 87 0.034% 98.948% ( 51, 76 ] 28 0.011% 98.959% ( 76, 110 ] 16 0.006% 98.965% ( 110, 170 ] 130 0.051% 99.016% ( 170, 250 ] 475 0.185% 99.201% ( 250, 380 ] 461 0.179% 99.380% ( 380, 580 ] 466 0.181% 99.562% ( 580, 870 ] 409 0.159% 99.721% ( 870, 1300 ] 207 0.081% 99.801% ( 1300, 1900 ] 111 0.043% 99.845% ( 1900, 2900 ] 162 0.063% 99.908% ( 2900, 4400 ] 154 0.060% 99.968% ( 4400, 6600 ] 54 0.021% 99.989% ( 6600, 9900 ] 15 0.006% 99.995% ( 9900, 14000 ] 7 0.003% 99.997% ( 14000, 22000 ] 12 0.005% 100.002% ( 22000, 33000 ] 2 0.001% 100.003% ( 33000, 50000 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 469608 Average: 8.2831 StdDev: 142.58 Min: 0 Median: 2.1539 Max: 31910 Percentiles: P50: 2.15 P75: 2.94 P99: 10.27 P99.9: 575.32 P99.99: 992.17 ------------------------------------------------------ [ 0, 1 ] 3145 0.670% 0.670% ( 1, 2 ] 208777 44.458% 45.127% ######### ( 2, 3 ] 148636 31.651% 76.779% ###### ( 3, 4 ] 45772 9.747% 86.525% ## ( 4, 6 ] 46870 9.981% 96.506% ## ( 6, 10 ] 11588 2.468% 98.974% ( 10, 15 ] 2306 0.491% 99.465% ( 15, 22 ] 319 0.068% 99.533% ( 22, 34 ] 68 0.014% 99.547% ( 34, 51 ] 126 0.027% 99.574% ( 51, 76 ] 34 0.007% 99.581% ( 76, 110 ] 16 0.003% 99.585% ( 110, 170 ] 91 0.019% 99.604% ( 170, 250 ] 367 0.078% 99.682% ( 250, 380 ] 581 0.124% 99.806% ( 380, 580 ] 453 0.096% 99.902% ( 580, 870 ] 368 0.078% 99.981% ( 870, 1300 ] 155 0.033% 100.014% ( 1300, 1900 ] 121 0.026% 100.039% ( 1900, 2900 ] 125 0.027% 100.066% ( 2900, 4400 ] 156 0.033% 100.099% ( 4400, 6600 ] 48 0.010% 100.109% ( 6600, 9900 ] 7 0.001% 100.111% ( 9900, 14000 ] 5 0.001% 100.112% ( 14000, 22000 ] 5 0.001% 100.113% ( 22000, 33000 ] 3 0.001% 100.114% ** Level 3 read latency histogram (micros): Count: 581401 Average: 15.4286 StdDev: 254.53 Min: 1 Median: 2.2985 Max: 44962 Percentiles: P50: 2.30 P75: 3.23 P99: 174.38 P99.9: 1186.13 P99.99: 2321.74 ------------------------------------------------------ [ 0, 1 ] 4329 0.745% 0.745% ( 1, 2 ] 230840 39.704% 40.449% ######## ( 2, 3 ] 186054 32.001% 72.450% ###### ( 3, 4 ] 63159 10.863% 83.313% ## ( 4, 6 ] 69935 12.029% 95.342% ## ( 6, 10 ] 16751 2.881% 98.223% # ( 10, 15 ] 3273 0.563% 98.786% ( 15, 22 ] 458 0.079% 98.864% ( 22, 34 ] 127 0.022% 98.886% ( 34, 51 ] 175 0.030% 98.916% ( 51, 76 ] 116 0.020% 98.936% ( 76, 110 ] 41 0.007% 98.943% ( 110, 170 ] 275 0.047% 98.991% ( 170, 250 ] 986 0.170% 99.160% ( 250, 380 ] 1259 0.217% 99.377% ( 380, 580 ] 1580 0.272% 99.649% ( 580, 870 ] 1119 0.192% 99.841% ( 870, 1300 ] 466 0.080% 99.921% ( 1300, 1900 ] 259 0.045% 99.966% ( 1900, 2900 ] 334 0.057% 100.023% ( 2900, 4400 ] 398 0.068% 100.092% ( 4400, 6600 ] 102 0.018% 100.109% ( 6600, 9900 ] 23 0.004% 100.113% ( 9900, 14000 ] 11 0.002% 100.115% ( 14000, 22000 ] 33 0.006% 100.121% ( 22000, 33000 ] 13 0.002% 100.123% ( 33000, 50000 ] 2 0.000% 100.123% ** Level 4 read latency histogram (micros): Count: 692280 Average: 32.1792 StdDev: 369.39 Min: 0 Median: 2.3319 Max: 49543 Percentiles: P50: 2.33 P75: 3.41 P99: 567.34 P99.9: 2144.30 P99.99: 2849.91 ------------------------------------------------------ [ 0, 1 ] 5177 0.748% 0.748% ( 1, 2 ] 269982 38.999% 39.747% ######## ( 2, 3 ] 213845 30.890% 70.637% ###### ( 3, 4 ] 74472 10.757% 81.394% ## ( 4, 6 ] 79035 11.417% 92.811% ## ( 6, 10 ] 19662 2.840% 95.651% # ( 10, 15 ] 4010 0.579% 96.230% ( 15, 22 ] 468 0.068% 96.298% ( 22, 34 ] 106 0.015% 96.313% ( 34, 51 ] 185 0.027% 96.340% ( 51, 76 ] 143 0.021% 96.361% ( 76, 110 ] 74 0.011% 96.371% ( 110, 170 ] 1460 0.211% 96.582% ( 170, 250 ] 5366 0.775% 97.357% ( 250, 380 ] 5961 0.861% 98.218% ( 380, 580 ] 5778 0.835% 99.053% ( 580, 870 ] 3675 0.531% 99.584% ( 870, 1300 ] 1372 0.198% 99.782% ( 1300, 1900 ] 602 0.087% 99.869% ( 1900, 2900 ] 883 0.128% 99.997% ( 2900, 4400 ] 1000 0.144% 100.141% ( 4400, 6600 ] 233 0.034% 100.175% ( 6600, 9900 ] 44 0.006% 100.181% ( 9900, 14000 ] 19 0.003% 100.184% ( 14000, 22000 ] 19 0.003% 100.186% ( 22000, 33000 ] 34 0.005% 100.191% ( 33000, 50000 ] 20 0.003% 100.194% ** Level 5 read latency histogram (micros): Count: 19815 Average: 673.3103 StdDev: 1274.10 Min: 94 Median: 375.1142 Max: 49758 Percentiles: P50: 375.11 P75: 631.90 P99: 4613.53 P99.9: 18790.00 P99.99: 41578.62 ------------------------------------------------------ ( 76, 110 ] 32 0.161% 0.161% ( 110, 170 ] 1114 5.622% 5.783% # ( 170, 250 ] 4421 22.311% 28.095% #### ( 250, 380 ] 4510 22.761% 50.855% ##### ( 380, 580 ] 4310 21.751% 72.607% #### ( 580, 870 ] 2650 13.374% 85.980% ### ( 870, 1300 ] 968 4.885% 90.866% # ( 1300, 1900 ] 389 1.963% 92.829% ( 1900, 2900 ] 547 2.761% 95.589% # ( 2900, 4400 ] 661 3.336% 98.925% # ( 4400, 6600 ] 153 0.772% 99.697% ( 6600, 9900 ] 30 0.151% 99.849% ( 9900, 14000 ] 3 0.015% 99.864% ( 14000, 22000 ] 12 0.061% 99.924% ( 22000, 33000 ] 11 0.056% 99.980% ( 33000, 50000 ] 4 0.020% 100.000% ** DB Stats ** Uptime(secs): 10.4 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 189.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.617 H:M:S, 15.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.028 H:M:S, 0.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/09-03:59:34 ... thread 0: (1000000,3000000) ops and (185313.7,190608.8) ops/second in (5.396255,15.739042) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 3.02 GB 187.8 2.3 0.0 2.3 5.1 2.8 0.0 1.8 99.0 218.4 24.14 18.25 51 0.473 2427K 12K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 1.0 0.1 1.0 1.0 0.0 1.1 142.6 140.5 7.64 5.48 1 7.642 1106K 16K 0.0 0.0 L3 21/0 986.90 MB 1.0 2.6 1.7 0.9 2.5 1.6 0.5 1.5 135.6 130.8 19.77 12.99 11 1.798 1948K 12K 0.0 0.0 L4 141/0 9.51 GB 1.0 5.6 2.5 3.1 5.1 2.0 0.6 2.0 143.1 129.3 40.32 26.76 24 1.680 1594K 4867 0.0 0.0 L5 148/0 12.18 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 329/10 25.67 GB 0.0 11.7 5.2 6.5 13.8 7.3 3.8 4.9 129.9 153.9 91.87 63.49 87 1.056 7077K 45K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.7 5.2 6.5 13.8 7.3 3.8 4.9 129.9 153.9 91.87 63.49 87 1.056 7077K 45K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.7 5.2 6.5 11.0 4.5 0.0 0.0 151.2 142.6 78.92 55.14 45 1.754 7077K 45K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 223.4 12.95 8.34 42 0.308 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.7 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.81 GB write, 894.63 MB/s write, 11.65 GB read, 754.66 MB/s read, 91.9 seconds Interval compaction: 13.81 GB write, 898.50 MB/s write, 11.65 GB read, 757.92 MB/s read, 91.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 15, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 707683 Average: 33.0602 StdDev: 258.04 Min: 1 Median: 1.7229 Max: 49427 Percentiles: P50: 1.72 P75: 2.65 P99: 511.04 P99.9: 2210.47 P99.99: 3506.82 ------------------------------------------------------ [ 0, 1 ] 85989 12.151% 12.151% ## ( 1, 2 ] 370537 52.359% 64.510% ########## ( 2, 3 ] 114178 16.134% 80.644% ### ( 3, 4 ] 35243 4.980% 85.624% # ( 4, 6 ] 31437 4.442% 90.066% # ( 6, 10 ] 6652 0.940% 91.006% ( 10, 15 ] 1206 0.170% 91.177% ( 15, 22 ] 170 0.024% 91.201% ( 22, 34 ] 29 0.004% 91.205% ( 34, 51 ] 23 0.003% 91.208% ( 51, 76 ] 14 0.002% 91.210% ( 76, 110 ] 525 0.074% 91.284% ( 110, 170 ] 13304 1.880% 93.164% ( 170, 250 ] 27804 3.929% 97.093% # ( 250, 380 ] 9494 1.342% 98.435% ( 380, 580 ] 6107 0.863% 99.298% ( 580, 870 ] 3008 0.425% 99.723% ( 870, 1300 ] 805 0.114% 99.836% ( 1300, 1900 ] 269 0.038% 99.874% ( 1900, 2900 ] 584 0.083% 99.957% ( 2900, 4400 ] 579 0.082% 100.039% ( 4400, 6600 ] 94 0.013% 100.052% ( 6600, 9900 ] 17 0.002% 100.054% ( 9900, 14000 ] 13 0.002% 100.056% ( 14000, 22000 ] 21 0.003% 100.059% ( 22000, 33000 ] 11 0.002% 100.061% ( 33000, 50000 ] 6 0.001% 100.062% ** Level 1 read latency histogram (micros): Count: 256910 Average: 14.2936 StdDev: 229.88 Min: 1 Median: 2.2069 Max: 34280 Percentiles: P50: 2.21 P75: 3.04 P99: 151.03 P99.9: 2777.10 P99.99: 7327.98 ------------------------------------------------------ [ 0, 1 ] 2988 1.163% 1.163% ( 1, 2 ] 108942 42.405% 43.568% ######## ( 2, 3 ] 79868 31.088% 74.656% ###### ( 3, 4 ] 25261 9.833% 84.488% ## ( 4, 6 ] 27985 10.893% 95.381% ## ( 6, 10 ] 7324 2.851% 98.232% # ( 10, 15 ] 1484 0.578% 98.810% ( 15, 22 ] 213 0.083% 98.893% ( 22, 34 ] 56 0.022% 98.914% ( 34, 51 ] 87 0.034% 98.948% ( 51, 76 ] 28 0.011% 98.959% ( 76, 110 ] 16 0.006% 98.965% ( 110, 170 ] 130 0.051% 99.016% ( 170, 250 ] 475 0.185% 99.201% ( 250, 380 ] 461 0.179% 99.380% ( 380, 580 ] 466 0.181% 99.562% ( 580, 870 ] 409 0.159% 99.721% ( 870, 1300 ] 207 0.081% 99.801% ( 1300, 1900 ] 111 0.043% 99.845% ( 1900, 2900 ] 162 0.063% 99.908% ( 2900, 4400 ] 154 0.060% 99.968% ( 4400, 6600 ] 54 0.021% 99.989% ( 6600, 9900 ] 15 0.006% 99.995% ( 9900, 14000 ] 7 0.003% 99.997% ( 14000, 22000 ] 12 0.005% 100.002% ( 22000, 33000 ] 2 0.001% 100.003% ( 33000, 50000 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 469608 Average: 8.2831 StdDev: 142.58 Min: 0 Median: 2.1539 Max: 31910 Percentiles: P50: 2.15 P75: 2.94 P99: 10.27 P99.9: 575.32 P99.99: 992.17 ------------------------------------------------------ [ 0, 1 ] 3145 0.670% 0.670% ( 1, 2 ] 208777 44.458% 45.127% ######### ( 2, 3 ] 148636 31.651% 76.779% ###### ( 3, 4 ] 45772 9.747% 86.525% ## ( 4, 6 ] 46870 9.981% 96.506% ## ( 6, 10 ] 11588 2.468% 98.974% ( 10, 15 ] 2306 0.491% 99.465% ( 15, 22 ] 319 0.068% 99.533% ( 22, 34 ] 68 0.014% 99.547% ( 34, 51 ] 126 0.027% 99.574% ( 51, 76 ] 34 0.007% 99.581% ( 76, 110 ] 16 0.003% 99.585% ( 110, 170 ] 91 0.019% 99.604% ( 170, 250 ] 367 0.078% 99.682% ( 250, 380 ] 581 0.124% 99.806% ( 380, 580 ] 453 0.096% 99.902% ( 580, 870 ] 368 0.078% 99.981% ( 870, 1300 ] 155 0.033% 100.014% ( 1300, 1900 ] 121 0.026% 100.039% ( 1900, 2900 ] 125 0.027% 100.066% ( 2900, 4400 ] 156 0.033% 100.099% ( 4400, 6600 ] 48 0.010% 100.109% ( 6600, 9900 ] 7 0.001% 100.111% ( 9900, 14000 ] 5 0.001% 100.112% ( 14000, 22000 ] 5 0.001% 100.113% ( 22000, 33000 ] 3 0.001% 100.114% ** Level 3 read latency histogram (micros): Count: 611185 Average: 16.9819 StdDev: 249.55 Min: 1 Median: 2.3042 Max: 44962 Percentiles: P50: 2.30 P75: 3.29 P99: 243.64 P99.9: 1164.09 P99.99: 2309.68 ------------------------------------------------------ [ 0, 1 ] 4779 0.782% 0.782% ( 1, 2 ] 242181 39.625% 40.407% ######## ( 2, 3 ] 192713 31.531% 71.938% ###### ( 3, 4 ] 65323 10.688% 82.626% ## ( 4, 6 ] 72060 11.790% 94.416% ## ( 6, 10 ] 17326 2.835% 97.251% # ( 10, 15 ] 3356 0.549% 97.800% ( 15, 22 ] 465 0.076% 97.876% ( 22, 34 ] 128 0.021% 97.897% ( 34, 51 ] 175 0.029% 97.926% ( 51, 76 ] 116 0.019% 97.944% ( 76, 110 ] 142 0.023% 97.968% ( 110, 170 ] 2152 0.352% 98.320% ( 170, 250 ] 4516 0.739% 99.059% ( 250, 380 ] 1865 0.305% 99.364% ( 380, 580 ] 1789 0.293% 99.657% ( 580, 870 ] 1165 0.191% 99.847% ( 870, 1300 ] 472 0.077% 99.924% ( 1300, 1900 ] 262 0.043% 99.967% ( 1900, 2900 ] 339 0.055% 100.023% ( 2900, 4400 ] 401 0.066% 100.088% ( 4400, 6600 ] 102 0.017% 100.105% ( 6600, 9900 ] 24 0.004% 100.109% ( 9900, 14000 ] 11 0.002% 100.111% ( 14000, 22000 ] 33 0.005% 100.116% ( 22000, 33000 ] 13 0.002% 100.118% ( 33000, 50000 ] 2 0.000% 100.119% ** Level 4 read latency histogram (micros): Count: 841844 Average: 35.7016 StdDev: 340.11 Min: 0 Median: 2.3692 Max: 49543 Percentiles: P50: 2.37 P75: 3.63 P99: 527.45 P99.9: 1729.70 P99.99: 2544.00 ------------------------------------------------------ [ 0, 1 ] 6471 0.769% 0.769% ( 1, 2 ] 322729 38.336% 39.105% ######## ( 2, 3 ] 248437 29.511% 68.616% ###### ( 3, 4 ] 85713 10.182% 78.797% ## ( 4, 6 ] 89844 10.672% 89.470% ## ( 6, 10 ] 22673 2.693% 92.163% # ( 10, 15 ] 4459 0.530% 92.692% ( 15, 22 ] 531 0.063% 92.756% ( 22, 34 ] 112 0.013% 92.769% ( 34, 51 ] 195 0.023% 92.792% ( 51, 76 ] 146 0.017% 92.809% ( 76, 110 ] 609 0.072% 92.882% ( 110, 170 ] 12315 1.463% 94.345% ( 170, 250 ] 24859 2.953% 97.297% # ( 250, 380 ] 9230 1.096% 98.394% ( 380, 580 ] 6921 0.822% 99.216% ( 580, 870 ] 3905 0.464% 99.680% ( 870, 1300 ] 1412 0.168% 99.848% ( 1300, 1900 ] 616 0.073% 99.921% ( 1900, 2900 ] 905 0.108% 100.028% ( 2900, 4400 ] 1009 0.120% 100.148% ( 4400, 6600 ] 233 0.028% 100.176% ( 6600, 9900 ] 46 0.005% 100.181% ( 9900, 14000 ] 21 0.002% 100.184% ( 14000, 22000 ] 20 0.002% 100.186% ( 22000, 33000 ] 35 0.004% 100.190% ( 33000, 50000 ] 20 0.002% 100.193% ** Level 5 read latency histogram (micros): Count: 47843 Average: 400.5282 StdDev: 861.81 Min: 91 Median: 225.9750 Max: 49758 Percentiles: P50: 225.98 P75: 359.86 P99: 3805.33 P99.9: 8047.27 P99.99: 32281.06 ------------------------------------------------------ ( 76, 110 ] 418 0.874% 0.874% ( 110, 170 ] 9600 20.066% 20.939% #### ( 170, 250 ] 19871 41.534% 62.473% ######## ( 250, 380 ] 7092 14.823% 77.297% ### ( 380, 580 ] 5204 10.877% 88.174% ## ( 580, 870 ] 2822 5.898% 94.072% # ( 870, 1300 ] 988 2.065% 96.137% ( 1300, 1900 ] 395 0.826% 96.963% ( 1900, 2900 ] 572 1.196% 98.159% ( 2900, 4400 ] 667 1.394% 99.553% ( 4400, 6600 ] 153 0.320% 99.872% ( 6600, 9900 ] 30 0.063% 99.935% ( 9900, 14000 ] 3 0.006% 99.941% ( 14000, 22000 ] 12 0.025% 99.967% ( 22000, 33000 ] 12 0.025% 99.992% ( 33000, 50000 ] 4 0.008% 100.000% ** DB Stats ** Uptime(secs): 15.8 total, 5.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 186.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.217 H:M:S, 20.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 182.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.600 H:M:S, 29.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 389.749 micros/op 10246 ops/sec 20.103 seconds 205996 operations; 9.9 MB/s (50999 of 50999 found) Microseconds per read: Count: 205996 Average: 389.7643 StdDev: 1081.64 Min: 2 Median: 238.5428 Max: 102004 Percentiles: P50: 238.54 P75: 370.40 P99: 3279.33 P99.9: 16862.68 P99.99: 39948.12 ------------------------------------------------------ ( 1, 2 ] 12 0.006% 0.006% ( 2, 3 ] 57 0.028% 0.033% ( 3, 4 ] 109 0.053% 0.086% ( 4, 6 ] 187 0.091% 0.177% ( 6, 10 ] 301 0.146% 0.323% ( 10, 15 ] 1386 0.673% 0.996% ( 15, 22 ] 2466 1.197% 2.193% ( 22, 34 ] 4268 2.072% 4.265% ( 34, 51 ] 1916 0.930% 5.195% ( 51, 76 ] 317 0.154% 5.349% ( 76, 110 ] 87 0.042% 5.391% ( 110, 170 ] 15639 7.592% 12.983% ## ( 170, 250 ] 88999 43.204% 56.187% ######### ( 250, 380 ] 41844 20.313% 76.501% #### ( 380, 580 ] 27413 13.308% 89.808% ### ( 580, 870 ] 11841 5.748% 95.556% # ( 870, 1300 ] 3985 1.935% 97.491% ( 1300, 1900 ] 1325 0.643% 98.134% ( 1900, 2900 ] 1386 0.673% 98.807% ( 2900, 4400 ] 1574 0.764% 99.571% ( 4400, 6600 ] 401 0.195% 99.766% ( 6600, 9900 ] 152 0.074% 99.839% ( 9900, 14000 ] 86 0.042% 99.881% ( 14000, 22000 ] 109 0.053% 99.934% ( 22000, 33000 ] 106 0.051% 99.985% ( 33000, 50000 ] 23 0.011% 99.997% ( 50000, 75000 ] 3 0.001% 99.998% ( 75000, 110000 ] 4 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3409433 rocksdb.bloom.filter.full.positive COUNT : 238441 rocksdb.bloom.filter.full.true.positive COUNT : 205129 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 867 rocksdb.memtable.miss COUNT : 205129 rocksdb.l0.hit COUNT : 24229 rocksdb.l1.hit COUNT : 1751 rocksdb.l2andup.hit COUNT : 179149 rocksdb.compaction.key.drop.new COUNT : 706918 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3465322 rocksdb.number.keys.read COUNT : 205996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3576212304 rocksdb.bytes.read COUNT : 205996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 493 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5757744 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14139051526 rocksdb.compact.write.bytes COUNT : 13404221464 rocksdb.flush.write.bytes COUNT : 3495499706 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 26 rocksdb.number.superversion_acquires COUNT : 664 rocksdb.number.superversion_releases COUNT : 642 rocksdb.number.superversion_cleanups COUNT : 165 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 19 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3472824320 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6404096 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 13999087405 rocksdb.non.last.level.read.count COUNT : 3353244 rocksdb.block.checksum.compute.count COUNT : 3665506 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 237.852836 P95 : 841.358996 P99 : 3278.614113 P100 : 102001.000000 COUNT : 205996 SUM : 80108967 rocksdb.db.write.micros P50 : 1.620357 P95 : 5.183935 P99 : 8.155155 P100 : 562518.000000 COUNT : 3465322 SUM : 15551527 rocksdb.compaction.times.micros P50 : 1550000.000000 P95 : 2855555.555556 P99 : 7642152.000000 P100 : 7642152.000000 COUNT : 48 SUM : 83884097 rocksdb.compaction.times.cpu_micros P50 : 1258333.333333 P95 : 1888333.333333 P99 : 5444000.000000 P100 : 5477679.000000 COUNT : 48 SUM : 60051179 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 977.500000 P95 : 5802.500000 P99 : 11991.000000 P100 : 13687.000000 COUNT : 49 SUM : 85670 rocksdb.compaction.outfile.sync.micros P50 : 1694.736842 P95 : 6370.833333 P99 : 7509.000000 P100 : 7509.000000 COUNT : 165 SUM : 393518 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 212.500000 P95 : 3100.000000 P99 : 21040.000000 P100 : 34349.000000 COUNT : 112 SUM : 98666 rocksdb.table.open.io.micros P50 : 6061.702128 P95 : 19773.134328 P99 : 24354.000000 P100 : 46504.000000 COUNT : 493 SUM : 3511000 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.361486 P95 : 9.755046 P99 : 228.519869 P100 : 49434.000000 COUNT : 3423527 SUM : 52361019 rocksdb.read.block.get.micros P50 : 207.064478 P95 : 721.795976 P99 : 2860.049413 P100 : 49762.000000 COUNT : 241468 SUM : 71816817 rocksdb.write.raw.block.micros P50 : 0.532378 P95 : 1.285312 P99 : 3.924643 P100 : 70578.000000 COUNT : 4095631 SUM : 14115386 rocksdb.numfiles.in.singlecompaction P50 : 3.106061 P95 : 3.965152 P99 : 7.480000 P100 : 9.000000 COUNT : 63 SUM : 216 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561976 P95 : 1134.119175 P99 : 2126.282051 P100 : 562332.000000 COUNT : 30975 SUM : 5760402 rocksdb.sst.read.micros P50 : 2.064316 P95 : 198.255070 P99 : 499.809578 P100 : 49758.000000 COUNT : 3353257 SUM : 110047666 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 205996 SUM : 205996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3465322 SUM : 3576212304 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 231250.000000 P95 : 649750.000000 P99 : 871303.000000 P100 : 871303.000000 COUNT : 49 SUM : 14305256 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 166 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0