[2024-12-06 10:46:57.156188] Starting SPDK v25.01-pre git sha1 5bd6ffdb5 / DPDK 24.03.0 initialization... [2024-12-06 10:46:57.156531] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1726948 ] Set seed to 1733478417148886 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 10:46:57.308064] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 10:46:57.412578] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 10:46:57.412637] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1726948' to capture a snapshot of events at runtime. [2024-12-06 10:46:57.412650] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 10:46:57.412664] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 10:46:57.412674] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1726948 for offline analysis/debug. [2024-12-06 10:46:57.413902] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 10:47:00 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/06-10:47:07 ... thread 0: (1000000,1000000) ops and (140103.2,140103.2) ops/second in (7.137594,7.137594) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 628.76 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 134.6 6.54 2.62 11 0.595 0 0 0.0 0.0 L1 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 1.2 124.9 124.2 4.67 2.87 2 2.333 591K 3416 0.0 0.0 L2 6/3 326.56 MB 1.4 0.3 0.2 0.1 0.3 0.2 0.2 1.5 138.9 138.4 2.24 1.49 3 0.746 315K 1213 0.0 0.0 L3 39/28 2.35 GB 0.5 3.1 1.9 1.2 3.0 1.8 0.1 1.5 104.0 98.5 30.73 16.60 12 2.560 2160K 7538 0.0 0.0 L4 139/8 10.20 GB 1.0 2.2 1.4 0.7 2.1 1.4 0.6 1.4 119.3 115.8 18.55 10.68 12 1.546 438K 0 0.0 0.0 L5 136/0 10.49 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 328/47 23.98 GB 0.0 6.2 4.0 2.1 6.8 4.7 2.5 7.9 100.5 110.7 62.72 34.25 40 1.568 3506K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 4.0 2.1 6.8 4.7 2.5 7.9 100.5 110.7 62.72 34.25 40 1.568 3506K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 4.0 2.1 5.9 3.8 0.0 0.0 112.2 107.9 56.17 31.63 29 1.937 3506K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 134.6 6.54 2.62 11 0.595 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.2 total, 7.1 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.78 GB write, 961.80 MB/s write, 6.15 GB read, 872.99 MB/s read, 62.7 seconds Interval compaction: 6.78 GB write, 972.41 MB/s write, 6.15 GB read, 882.62 MB/s read, 62.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 177119 Average: 22.9574 StdDev: 246.62 Min: 1 Median: 2.1717 Max: 28203 Percentiles: P50: 2.17 P75: 3.19 P99: 565.54 P99.9: 3740.74 P99.99: 6569.88 ------------------------------------------------------ [ 0, 1 ] 3873 2.187% 2.187% ( 1, 2 ] 76202 43.023% 45.210% ######### ( 2, 3 ] 49405 27.894% 73.103% ###### ( 3, 4 ] 17663 9.972% 83.076% ## ( 4, 6 ] 20042 11.316% 94.391% ## ( 6, 10 ] 5263 2.971% 97.363% # ( 10, 15 ] 1314 0.742% 98.105% ( 15, 22 ] 192 0.108% 98.213% ( 22, 34 ] 8 0.005% 98.218% ( 34, 51 ] 22 0.012% 98.230% ( 51, 76 ] 20 0.011% 98.241% ( 76, 110 ] 4 0.002% 98.244% ( 110, 170 ] 16 0.009% 98.253% ( 170, 250 ] 131 0.074% 98.327% ( 250, 380 ] 369 0.208% 98.535% ( 380, 580 ] 888 0.501% 99.036% ( 580, 870 ] 674 0.381% 99.417% ( 870, 1300 ] 362 0.204% 99.621% ( 1300, 1900 ] 169 0.095% 99.717% ( 1900, 2900 ] 187 0.106% 99.822% ( 2900, 4400 ] 246 0.139% 99.961% ( 4400, 6600 ] 52 0.029% 99.990% ( 6600, 9900 ] 12 0.007% 99.997% ( 9900, 14000 ] 1 0.001% 99.998% ( 14000, 22000 ] 5 0.003% 100.001% ( 22000, 33000 ] 3 0.002% 100.002% ** Level 1 read latency histogram (micros): Count: 99518 Average: 12.7525 StdDev: 155.19 Min: 1 Median: 2.2824 Max: 12703 Percentiles: P50: 2.28 P75: 3.27 P99: 14.53 P99.9: 2733.02 P99.99: 5137.75 ------------------------------------------------------ [ 0, 1 ] 1217 1.223% 1.223% ( 1, 2 ] 39931 40.124% 41.347% ######## ( 2, 3 ] 30490 30.638% 71.985% ###### ( 3, 4 ] 11125 11.179% 83.164% ## ( 4, 6 ] 12158 12.217% 95.381% ## ( 6, 10 ] 3025 3.040% 98.420% # ( 10, 15 ] 637 0.640% 99.060% ( 15, 22 ] 92 0.092% 99.153% ( 22, 34 ] 11 0.011% 99.164% ( 34, 51 ] 17 0.017% 99.181% ( 51, 76 ] 10 0.010% 99.191% ( 76, 110 ] 3 0.003% 99.194% ( 110, 170 ] 9 0.009% 99.203% ( 170, 250 ] 43 0.043% 99.246% ( 250, 380 ] 93 0.093% 99.340% ( 380, 580 ] 196 0.197% 99.537% ( 580, 870 ] 167 0.168% 99.705% ( 870, 1300 ] 109 0.110% 99.814% ( 1300, 1900 ] 38 0.038% 99.852% ( 1900, 2900 ] 57 0.057% 99.910% ( 2900, 4400 ] 72 0.072% 99.982% ( 4400, 6600 ] 24 0.024% 100.006% ( 6600, 9900 ] 1 0.001% 100.007% ( 9900, 14000 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 491819 Average: 16.9014 StdDev: 295.25 Min: 1 Median: 2.3299 Max: 39515 Percentiles: P50: 2.33 P75: 3.42 P99: 14.05 P99.9: 1304.39 P99.99: 2265.22 ------------------------------------------------------ [ 0, 1 ] 4958 1.008% 1.008% ( 1, 2 ] 192262 39.092% 40.100% ######## ( 2, 3 ] 147607 30.012% 70.113% ###### ( 3, 4 ] 56614 11.511% 81.624% ## ( 4, 6 ] 65246 13.266% 94.890% ### ( 6, 10 ] 16253 3.305% 98.195% # ( 10, 15 ] 4889 0.994% 99.189% ( 15, 22 ] 784 0.159% 99.348% ( 22, 34 ] 108 0.022% 99.370% ( 34, 51 ] 139 0.028% 99.398% ( 51, 76 ] 97 0.020% 99.418% ( 76, 110 ] 25 0.005% 99.423% ( 110, 170 ] 33 0.007% 99.430% ( 170, 250 ] 87 0.018% 99.448% ( 250, 380 ] 434 0.088% 99.536% ( 380, 580 ] 804 0.163% 99.699% ( 580, 870 ] 626 0.127% 99.827% ( 870, 1300 ] 359 0.073% 99.900% ( 1300, 1900 ] 298 0.061% 99.960% ( 1900, 2900 ] 402 0.082% 100.042% ( 2900, 4400 ] 459 0.093% 100.135% ( 4400, 6600 ] 139 0.028% 100.163% ( 6600, 9900 ] 38 0.008% 100.171% ( 9900, 14000 ] 15 0.003% 100.174% ( 14000, 22000 ] 34 0.007% 100.181% ( 22000, 33000 ] 16 0.003% 100.184% ( 33000, 50000 ] 4 0.001% 100.185% ** Level 3 read latency histogram (micros): Count: 773292 Average: 16.9501 StdDev: 236.22 Min: 1 Median: 2.3561 Max: 71074 Percentiles: P50: 2.36 P75: 3.37 P99: 14.45 P99.9: 1259.77 P99.99: 2104.32 ------------------------------------------------------ [ 0, 1 ] 4458 0.576% 0.576% ( 1, 2 ] 292862 37.872% 38.449% ######## ( 2, 3 ] 250841 32.438% 70.887% ###### ( 3, 4 ] 86709 11.213% 82.100% ## ( 4, 6 ] 100004 12.932% 95.032% ### ( 6, 10 ] 24927 3.223% 98.255% # ( 10, 15 ] 6473 0.837% 99.092% ( 15, 22 ] 853 0.110% 99.203% ( 22, 34 ] 102 0.013% 99.216% ( 34, 51 ] 207 0.027% 99.243% ( 51, 76 ] 154 0.020% 99.263% ( 76, 110 ] 55 0.007% 99.270% ( 110, 170 ] 77 0.010% 99.280% ( 170, 250 ] 217 0.028% 99.308% ( 250, 380 ] 828 0.107% 99.415% ( 380, 580 ] 1686 0.218% 99.633% ( 580, 870 ] 1406 0.182% 99.815% ( 870, 1300 ] 730 0.094% 99.909% ( 1300, 1900 ] 492 0.064% 99.973% ( 1900, 2900 ] 664 0.086% 100.059% ( 2900, 4400 ] 865 0.112% 100.170% ( 4400, 6600 ] 235 0.030% 100.201% ( 6600, 9900 ] 74 0.010% 100.210% ( 9900, 14000 ] 7 0.001% 100.211% ( 14000, 22000 ] 12 0.002% 100.213% ( 22000, 33000 ] 6 0.001% 100.214% ( 33000, 50000 ] 1 0.000% 100.214% ( 50000, 75000 ] 1 0.000% 100.214% ** Level 4 read latency histogram (micros): Count: 319602 Average: 46.2154 StdDev: 440.28 Min: 1 Median: 2.3656 Max: 66987 Percentiles: P50: 2.37 P75: 3.49 P99: 969.12 P99.9: 3777.63 P99.99: 4195.31 ------------------------------------------------------ [ 0, 1 ] 2239 0.701% 0.701% ( 1, 2 ] 121444 37.999% 38.699% ######## ( 2, 3 ] 98781 30.908% 69.607% ###### ( 3, 4 ] 35134 10.993% 80.600% ## ( 4, 6 ] 38718 12.114% 92.714% ## ( 6, 10 ] 9316 2.915% 95.629% # ( 10, 15 ] 2257 0.706% 96.335% ( 15, 22 ] 330 0.103% 96.438% ( 22, 34 ] 45 0.014% 96.452% ( 34, 51 ] 90 0.028% 96.481% ( 51, 76 ] 74 0.023% 96.504% ( 76, 110 ] 40 0.013% 96.516% ( 110, 170 ] 88 0.028% 96.544% ( 170, 250 ] 413 0.129% 96.673% ( 250, 380 ] 1460 0.457% 97.130% ( 380, 580 ] 3012 0.942% 98.072% ( 580, 870 ] 2664 0.834% 98.906% ( 870, 1300 ] 1310 0.410% 99.316% ( 1300, 1900 ] 533 0.167% 99.482% ( 1900, 2900 ] 731 0.229% 99.711% ( 2900, 4400 ] 1033 0.323% 100.034% ( 4400, 6600 ] 230 0.072% 100.106% ( 6600, 9900 ] 40 0.013% 100.119% ( 9900, 14000 ] 6 0.002% 100.121% ( 14000, 22000 ] 6 0.002% 100.123% ( 22000, 33000 ] 6 0.002% 100.125% ( 33000, 50000 ] 10 0.003% 100.128% ( 50000, 75000 ] 2 0.001% 100.128% ** Level 5 read latency histogram (micros): Count: 8359 Average: 1115.9066 StdDev: 1552.59 Min: 99 Median: 648.9059 Max: 48601 Percentiles: P50: 648.91 P75: 1133.98 P99: 5984.13 P99.9: 18376.00 P99.99: 45263.23 ------------------------------------------------------ ( 76, 110 ] 2 0.024% 0.024% ( 110, 170 ] 62 0.742% 0.766% ( 170, 250 ] 312 3.733% 4.498% # ( 250, 380 ] 1036 12.394% 16.892% ## ( 380, 580 ] 2293 27.432% 44.323% ##### ( 580, 870 ] 1997 23.890% 68.214% ##### ( 870, 1300 ] 924 11.054% 79.268% ## ( 1300, 1900 ] 392 4.690% 83.957% # ( 1900, 2900 ] 467 5.587% 89.544% # ( 2900, 4400 ] 668 7.991% 97.536% ## ( 4400, 6600 ] 170 2.034% 99.569% ( 6600, 9900 ] 22 0.263% 99.833% ( 9900, 14000 ] 4 0.048% 99.880% ( 14000, 22000 ] 3 0.036% 99.916% ( 22000, 33000 ] 4 0.048% 99.964% ( 33000, 50000 ] 3 0.036% 100.000% ** DB Stats ** Uptime(secs): 7.2 total, 7.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 136.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.241 H:M:S, 31.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 137.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.241 H:M:S, 31.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/06-10:47:12 ... thread 0: (1000000,2000000) ops and (203651.7,166003.5) ops/second in (4.910345,12.047939) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.53 GB 18.9 1.1 0.0 1.1 2.9 1.8 0.0 1.6 61.4 160.0 18.43 10.18 29 0.635 1149K 6165 0.0 0.0 L1 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 1.2 124.9 124.2 4.67 2.87 2 2.333 591K 3416 0.0 0.0 L2 2/0 87.22 MB 0.9 0.3 0.2 0.1 0.3 0.2 0.2 1.5 138.9 138.4 2.24 1.49 3 0.746 315K 1213 0.0 0.0 L3 27/6 1.29 GB 0.9 4.9 2.1 2.7 4.7 1.9 0.2 2.2 119.6 114.6 41.59 24.96 15 2.773 3964K 44K 0.0 0.0 L4 147/19 10.09 GB 0.9 5.2 2.2 3.0 4.7 1.7 1.1 2.1 132.0 119.0 40.08 23.88 22 1.822 1192K 0 0.0 0.0 L5 149/0 11.42 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/33 24.41 GB 0.0 12.0 5.0 7.0 13.1 6.0 4.0 7.3 114.8 125.0 107.00 63.37 71 1.507 7214K 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 5.0 7.0 13.1 6.0 4.0 7.3 114.8 125.0 107.00 63.37 71 1.507 7214K 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 5.0 7.0 11.3 4.2 0.0 0.0 128.1 120.4 95.92 57.99 46 2.085 7214K 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 164.6 11.08 5.38 25 0.443 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.1 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.06 GB write, 1102.77 MB/s write, 12.00 GB read, 1013.16 MB/s read, 107.0 seconds Interval compaction: 13.06 GB write, 1109.98 MB/s write, 12.00 GB read, 1019.79 MB/s read, 107.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 412849 Average: 22.5205 StdDev: 238.55 Min: 1 Median: 2.0173 Max: 30995 Percentiles: P50: 2.02 P75: 2.97 P99: 537.41 P99.9: 3199.15 P99.99: 4805.97 ------------------------------------------------------ [ 0, 1 ] 11959 2.897% 2.897% # ( 1, 2 ] 192590 46.649% 49.546% ######### ( 2, 3 ] 108627 26.312% 75.857% ##### ( 3, 4 ] 36874 8.932% 84.789% ## ( 4, 6 ] 39597 9.591% 94.380% ## ( 6, 10 ] 10591 2.565% 96.945% # ( 10, 15 ] 2279 0.552% 97.497% ( 15, 22 ] 317 0.077% 97.574% ( 22, 34 ] 23 0.006% 97.580% ( 34, 51 ] 40 0.010% 97.589% ( 51, 76 ] 27 0.007% 97.596% ( 76, 110 ] 19 0.005% 97.601% ( 110, 170 ] 303 0.073% 97.674% ( 170, 250 ] 1651 0.400% 98.074% ( 250, 380 ] 1992 0.483% 98.556% ( 380, 580 ] 2327 0.564% 99.120% ( 580, 870 ] 1713 0.415% 99.535% ( 870, 1300 ] 737 0.179% 99.713% ( 1300, 1900 ] 285 0.069% 99.782% ( 1900, 2900 ] 397 0.096% 99.879% ( 2900, 4400 ] 442 0.107% 99.986% ( 4400, 6600 ] 96 0.023% 100.009% ( 6600, 9900 ] 16 0.004% 100.013% ( 9900, 14000 ] 6 0.001% 100.014% ( 14000, 22000 ] 9 0.002% 100.016% ( 22000, 33000 ] 9 0.002% 100.019% ** Level 1 read latency histogram (micros): Count: 132586 Average: 12.6603 StdDev: 158.45 Min: 1 Median: 2.2055 Max: 22313 Percentiles: P50: 2.21 P75: 3.11 P99: 202.37 P99.9: 2328.37 P99.99: 4651.29 ------------------------------------------------------ [ 0, 1 ] 1922 1.450% 1.450% ( 1, 2 ] 56187 42.378% 43.827% ######## ( 2, 3 ] 39829 30.040% 73.868% ###### ( 3, 4 ] 13810 10.416% 84.283% ## ( 4, 6 ] 14602 11.013% 95.297% ## ( 6, 10 ] 3831 2.889% 98.186% # ( 10, 15 ] 778 0.587% 98.773% ( 15, 22 ] 100 0.075% 98.848% ( 22, 34 ] 14 0.011% 98.859% ( 34, 51 ] 24 0.018% 98.877% ( 51, 76 ] 11 0.008% 98.885% ( 76, 110 ] 4 0.003% 98.888% ( 110, 170 ] 49 0.037% 98.925% ( 170, 250 ] 245 0.185% 99.110% ( 250, 380 ] 311 0.235% 99.345% ( 380, 580 ] 321 0.242% 99.587% ( 580, 870 ] 227 0.171% 99.758% ( 870, 1300 ] 116 0.087% 99.845% ( 1300, 1900 ] 42 0.032% 99.877% ( 1900, 2900 ] 71 0.054% 99.931% ( 2900, 4400 ] 76 0.057% 99.988% ( 4400, 6600 ] 24 0.018% 100.006% ( 6600, 9900 ] 1 0.001% 100.007% ( 9900, 14000 ] 2 0.002% 100.008% ( 22000, 33000 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 492202 Average: 17.3528 StdDev: 296.43 Min: 1 Median: 2.3312 Max: 39515 Percentiles: P50: 2.33 P75: 3.43 P99: 14.44 P99.9: 1355.41 P99.99: 2314.10 ------------------------------------------------------ [ 0, 1 ] 4958 1.007% 1.007% ( 1, 2 ] 192262 39.062% 40.069% ######## ( 2, 3 ] 147608 29.989% 70.058% ###### ( 3, 4 ] 56616 11.503% 81.561% ## ( 4, 6 ] 65246 13.256% 94.817% ### ( 6, 10 ] 16253 3.302% 98.119% # ( 10, 15 ] 4889 0.993% 99.112% ( 15, 22 ] 784 0.159% 99.271% ( 22, 34 ] 108 0.022% 99.293% ( 34, 51 ] 139 0.028% 99.322% ( 51, 76 ] 97 0.020% 99.341% ( 76, 110 ] 25 0.005% 99.346% ( 110, 170 ] 54 0.011% 99.357% ( 170, 250 ] 169 0.034% 99.392% ( 250, 380 ] 519 0.105% 99.497% ( 380, 580 ] 899 0.183% 99.680% ( 580, 870 ] 681 0.138% 99.818% ( 870, 1300 ] 375 0.076% 99.894% ( 1300, 1900 ] 301 0.061% 99.956% ( 1900, 2900 ] 410 0.083% 100.039% ( 2900, 4400 ] 470 0.095% 100.134% ( 4400, 6600 ] 143 0.029% 100.163% ( 6600, 9900 ] 38 0.008% 100.171% ( 9900, 14000 ] 15 0.003% 100.174% ( 14000, 22000 ] 34 0.007% 100.181% ( 22000, 33000 ] 16 0.003% 100.184% ( 33000, 50000 ] 4 0.001% 100.185% ** Level 3 read latency histogram (micros): Count: 1211318 Average: 15.2242 StdDev: 215.09 Min: 1 Median: 2.2952 Max: 71074 Percentiles: P50: 2.30 P75: 3.24 P99: 18.94 P99.9: 1113.73 P99.99: 1902.24 ------------------------------------------------------ [ 0, 1 ] 8076 0.667% 0.667% ( 1, 2 ] 483855 39.945% 40.611% ######## ( 2, 3 ] 385274 31.806% 72.417% ###### ( 3, 4 ] 130136 10.743% 83.161% ## ( 4, 6 ] 145392 12.003% 95.164% ## ( 6, 10 ] 36925 3.048% 98.212% # ( 10, 15 ] 8907 0.735% 98.947% ( 15, 22 ] 1136 0.094% 99.041% ( 22, 34 ] 140 0.012% 99.053% ( 34, 51 ] 283 0.023% 99.076% ( 51, 76 ] 195 0.016% 99.092% ( 76, 110 ] 76 0.006% 99.098% ( 110, 170 ] 346 0.029% 99.127% ( 170, 250 ] 1442 0.119% 99.246% ( 250, 380 ] 2250 0.186% 99.432% ( 380, 580 ] 2857 0.236% 99.667% ( 580, 870 ] 2217 0.183% 99.850% ( 870, 1300 ] 1058 0.087% 99.938% ( 1300, 1900 ] 630 0.052% 99.990% ( 1900, 2900 ] 833 0.069% 100.059% ( 2900, 4400 ] 1027 0.085% 100.143% ( 4400, 6600 ] 268 0.022% 100.166% ( 6600, 9900 ] 86 0.007% 100.173% ( 9900, 14000 ] 12 0.001% 100.174% ( 14000, 22000 ] 22 0.002% 100.175% ( 22000, 33000 ] 10 0.001% 100.176% ( 33000, 50000 ] 2 0.000% 100.176% ( 50000, 75000 ] 1 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 995545 Average: 30.7282 StdDev: 333.98 Min: 1 Median: 2.3889 Max: 66987 Percentiles: P50: 2.39 P75: 3.55 P99: 549.57 P99.9: 1851.65 P99.99: 2468.66 ------------------------------------------------------ [ 0, 1 ] 8077 0.811% 0.811% ( 1, 2 ] 372028 37.369% 38.181% ####### ( 2, 3 ] 302589 30.394% 68.575% ###### ( 3, 4 ] 117220 11.774% 80.349% ## ( 4, 6 ] 130370 13.095% 93.445% ### ( 6, 10 ] 30916 3.105% 96.550% # ( 10, 15 ] 7952 0.799% 97.349% ( 15, 22 ] 1083 0.109% 97.458% ( 22, 34 ] 151 0.015% 97.473% ( 34, 51 ] 286 0.029% 97.502% ( 51, 76 ] 221 0.022% 97.524% ( 76, 110 ] 113 0.011% 97.535% ( 110, 170 ] 771 0.077% 97.613% ( 170, 250 ] 3447 0.346% 97.959% ( 250, 380 ] 5055 0.508% 98.467% ( 380, 580 ] 6267 0.630% 99.096% ( 580, 870 ] 4932 0.495% 99.591% ( 870, 1300 ] 2201 0.221% 99.813% ( 1300, 1900 ] 950 0.095% 99.908% ( 1900, 2900 ] 1441 0.145% 100.053% ( 2900, 4400 ] 1764 0.177% 100.230% ( 4400, 6600 ] 448 0.045% 100.275% ( 6600, 9900 ] 136 0.014% 100.289% ( 9900, 14000 ] 30 0.003% 100.292% ( 14000, 22000 ] 29 0.003% 100.295% ( 22000, 33000 ] 16 0.002% 100.296% ( 33000, 50000 ] 12 0.001% 100.297% ( 50000, 75000 ] 2 0.000% 100.298% ** Level 5 read latency histogram (micros): Count: 18107 Average: 845.5348 StdDev: 1348.72 Min: 99 Median: 487.1969 Max: 48601 Percentiles: P50: 487.20 P75: 806.55 P99: 5471.38 P99.9: 13912.26 P99.99: 43843.62 ------------------------------------------------------ ( 76, 110 ] 12 0.066% 0.066% ( 110, 170 ] 578 3.192% 3.258% # ( 170, 250 ] 2623 14.486% 17.745% ### ( 250, 380 ] 3502 19.341% 37.085% #### ( 380, 580 ] 4363 24.096% 61.181% ##### ( 580, 870 ] 3203 17.689% 78.870% #### ( 870, 1300 ] 1364 7.533% 86.403% ## ( 1300, 1900 ] 525 2.899% 89.302% # ( 1900, 2900 ] 740 4.087% 93.389% # ( 2900, 4400 ] 901 4.976% 98.365% # ( 4400, 6600 ] 236 1.303% 99.669% ( 6600, 9900 ] 37 0.204% 99.873% ( 9900, 14000 ] 5 0.028% 99.901% ( 14000, 22000 ] 7 0.039% 99.939% ( 22000, 33000 ] 6 0.033% 99.972% ( 33000, 50000 ] 5 0.028% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 162.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.873 H:M:S, 23.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 200.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.632 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/06-10:47:16 ... thread 0: (1000000,3000000) ops and (260805.2,188890.5) ops/second in (3.834280,15.882219) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.57 GB 100.3 1.8 0.0 1.8 4.7 2.8 0.0 1.6 75.4 190.5 25.04 16.12 49 0.511 1916K 9859 0.0 0.0 L1 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 1.2 124.9 124.2 4.67 2.87 2 2.333 591K 3416 0.0 0.0 L2 2/0 87.22 MB 0.9 0.3 0.2 0.1 0.3 0.2 0.2 1.5 138.9 138.4 2.24 1.49 3 0.746 315K 1213 0.0 0.0 L3 21/0 945.71 MB 0.9 4.9 2.1 2.7 4.7 1.9 0.2 2.2 119.6 114.6 41.59 24.96 15 2.773 3964K 44K 0.0 0.0 L4 145/0 9.55 GB 1.0 7.1 2.5 4.5 6.3 1.7 1.1 2.5 139.4 123.2 52.00 32.15 28 1.857 1708K 2791 0.0 0.0 L5 157/0 12.01 GB 0.1 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 343/12 25.14 GB 0.0 14.6 5.3 9.3 16.4 7.1 4.6 5.8 119.5 134.1 125.53 77.58 97 1.294 8496K 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 5.3 9.3 16.4 7.1 4.6 5.8 119.5 134.1 125.53 77.58 97 1.294 8496K 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 5.3 9.3 13.6 4.3 0.0 0.0 135.3 125.8 110.83 69.17 55 2.015 8496K 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 196.8 14.70 8.41 42 0.350 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.0 total, 15.9 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.44 GB write, 1054.47 MB/s write, 14.65 GB read, 939.69 MB/s read, 125.5 seconds Interval compaction: 16.44 GB write, 1059.70 MB/s write, 14.65 GB read, 944.35 MB/s read, 125.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 665806 Average: 23.2996 StdDev: 210.18 Min: 1 Median: 1.8191 Max: 30995 Percentiles: P50: 1.82 P75: 2.78 P99: 441.14 P99.9: 2256.10 P99.99: 3944.85 ------------------------------------------------------ [ 0, 1 ] 57964 8.706% 8.706% ## ( 1, 2 ] 335648 50.412% 59.118% ########## ( 2, 3 ] 135362 20.331% 79.449% #### ( 3, 4 ] 44455 6.677% 86.126% # ( 4, 6 ] 44532 6.688% 92.814% # ( 6, 10 ] 11751 1.765% 94.579% ( 10, 15 ] 2529 0.380% 94.959% ( 15, 22 ] 351 0.053% 95.011% ( 22, 34 ] 38 0.006% 95.017% ( 34, 51 ] 41 0.006% 95.023% ( 51, 76 ] 27 0.004% 95.027% ( 76, 110 ] 228 0.034% 95.062% ( 110, 170 ] 5842 0.877% 95.939% ( 170, 250 ] 13693 2.057% 97.996% ( 250, 380 ] 5518 0.829% 98.824% ( 380, 580 ] 3827 0.575% 99.399% ( 580, 870 ] 2076 0.312% 99.711% ( 870, 1300 ] 794 0.119% 99.830% ( 1300, 1900 ] 311 0.047% 99.877% ( 1900, 2900 ] 433 0.065% 99.942% ( 2900, 4400 ] 460 0.069% 100.011% ( 4400, 6600 ] 101 0.015% 100.026% ( 6600, 9900 ] 17 0.003% 100.029% ( 9900, 14000 ] 7 0.001% 100.030% ( 14000, 22000 ] 12 0.002% 100.032% ( 22000, 33000 ] 13 0.002% 100.034% ** Level 1 read latency histogram (micros): Count: 132763 Average: 12.9403 StdDev: 158.57 Min: 1 Median: 2.2077 Max: 22313 Percentiles: P50: 2.21 P75: 3.12 P99: 223.74 P99.9: 2325.87 P99.99: 4649.67 ------------------------------------------------------ [ 0, 1 ] 1922 1.448% 1.448% ( 1, 2 ] 56187 42.321% 43.769% ######## ( 2, 3 ] 39829 30.000% 73.769% ###### ( 3, 4 ] 13810 10.402% 84.171% ## ( 4, 6 ] 14602 10.999% 95.170% ## ( 6, 10 ] 3831 2.886% 98.055% # ( 10, 15 ] 778 0.586% 98.641% ( 15, 22 ] 100 0.075% 98.717% ( 22, 34 ] 14 0.011% 98.727% ( 34, 51 ] 24 0.018% 98.745% ( 51, 76 ] 11 0.008% 98.753% ( 76, 110 ] 5 0.004% 98.757% ( 110, 170 ] 98 0.074% 98.831% ( 170, 250 ] 334 0.252% 99.083% ( 250, 380 ] 338 0.255% 99.337% ( 380, 580 ] 330 0.249% 99.586% ( 580, 870 ] 229 0.172% 99.758% ( 870, 1300 ] 116 0.087% 99.846% ( 1300, 1900 ] 42 0.032% 99.877% ( 1900, 2900 ] 71 0.053% 99.931% ( 2900, 4400 ] 76 0.057% 99.988% ( 4400, 6600 ] 24 0.018% 100.006% ( 6600, 9900 ] 1 0.001% 100.007% ( 9900, 14000 ] 2 0.002% 100.008% ( 22000, 33000 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 492849 Average: 17.6416 StdDev: 296.39 Min: 1 Median: 2.3333 Max: 39515 Percentiles: P50: 2.33 P75: 3.44 P99: 15.79 P99.9: 1356.11 P99.99: 2315.37 ------------------------------------------------------ [ 0, 1 ] 4958 1.006% 1.006% ( 1, 2 ] 192262 39.010% 40.016% ######## ( 2, 3 ] 147608 29.950% 69.966% ###### ( 3, 4 ] 56616 11.487% 81.454% ## ( 4, 6 ] 65246 13.239% 94.692% ### ( 6, 10 ] 16253 3.298% 97.990% # ( 10, 15 ] 4889 0.992% 98.982% ( 15, 22 ] 784 0.159% 99.141% ( 22, 34 ] 108 0.022% 99.163% ( 34, 51 ] 139 0.028% 99.191% ( 51, 76 ] 97 0.020% 99.211% ( 76, 110 ] 30 0.006% 99.217% ( 110, 170 ] 204 0.041% 99.258% ( 170, 250 ] 496 0.101% 99.359% ( 250, 380 ] 624 0.127% 99.486% ( 380, 580 ] 950 0.193% 99.678% ( 580, 870 ] 688 0.140% 99.818% ( 870, 1300 ] 376 0.076% 99.894% ( 1300, 1900 ] 301 0.061% 99.955% ( 1900, 2900 ] 411 0.083% 100.039% ( 2900, 4400 ] 470 0.095% 100.134% ( 4400, 6600 ] 143 0.029% 100.163% ( 6600, 9900 ] 38 0.008% 100.171% ( 9900, 14000 ] 15 0.003% 100.174% ( 14000, 22000 ] 34 0.007% 100.181% ( 22000, 33000 ] 16 0.003% 100.184% ( 33000, 50000 ] 4 0.001% 100.185% ** Level 3 read latency histogram (micros): Count: 1271641 Average: 15.5902 StdDev: 213.00 Min: 1 Median: 2.2868 Max: 71074 Percentiles: P50: 2.29 P75: 3.24 P99: 198.40 P99.9: 1096.16 P99.99: 1897.96 ------------------------------------------------------ [ 0, 1 ] 9256 0.728% 0.728% ( 1, 2 ] 511515 40.225% 40.953% ######## ( 2, 3 ] 401170 31.547% 72.500% ###### ( 3, 4 ] 134851 10.604% 83.105% ## ( 4, 6 ] 149868 11.785% 94.890% ## ( 6, 10 ] 38352 3.016% 97.906% # ( 10, 15 ] 9195 0.723% 98.629% ( 15, 22 ] 1175 0.092% 98.721% ( 22, 34 ] 142 0.011% 98.733% ( 34, 51 ] 288 0.023% 98.755% ( 51, 76 ] 198 0.016% 98.771% ( 76, 110 ] 125 0.010% 98.781% ( 110, 170 ] 1427 0.112% 98.893% ( 170, 250 ] 3838 0.302% 99.195% ( 250, 380 ] 2943 0.231% 99.426% ( 380, 580 ] 3165 0.249% 99.675% ( 580, 870 ] 2297 0.181% 99.856% ( 870, 1300 ] 1073 0.084% 99.940% ( 1300, 1900 ] 638 0.050% 99.990% ( 1900, 2900 ] 851 0.067% 100.057% ( 2900, 4400 ] 1034 0.081% 100.138% ( 4400, 6600 ] 269 0.021% 100.160% ( 6600, 9900 ] 88 0.007% 100.166% ( 9900, 14000 ] 12 0.001% 100.167% ( 14000, 22000 ] 23 0.002% 100.169% ( 22000, 33000 ] 11 0.001% 100.170% ( 33000, 50000 ] 2 0.000% 100.170% ( 50000, 75000 ] 1 0.000% 100.170% ** Level 4 read latency histogram (micros): Count: 1217022 Average: 30.3840 StdDev: 312.82 Min: 1 Median: 2.3472 Max: 66987 Percentiles: P50: 2.35 P75: 3.53 P99: 503.18 P99.9: 1507.16 P99.99: 2203.79 ------------------------------------------------------ [ 0, 1 ] 12801 1.052% 1.052% ( 1, 2 ] 471766 38.764% 39.816% ######## ( 2, 3 ] 356973 29.332% 69.147% ###### ( 3, 4 ] 134870 11.082% 80.229% ## ( 4, 6 ] 146774 12.060% 92.290% ## ( 6, 10 ] 36010 2.959% 95.248% # ( 10, 15 ] 8997 0.739% 95.988% ( 15, 22 ] 1215 0.100% 96.087% ( 22, 34 ] 165 0.014% 96.101% ( 34, 51 ] 296 0.024% 96.125% ( 51, 76 ] 226 0.019% 96.144% ( 76, 110 ] 342 0.028% 96.172% ( 110, 170 ] 5925 0.487% 96.659% ( 170, 250 ] 15212 1.250% 97.909% ( 250, 380 ] 8472 0.696% 98.605% ( 380, 580 ] 7808 0.642% 99.247% ( 580, 870 ] 5350 0.440% 99.686% ( 870, 1300 ] 2267 0.186% 99.872% ( 1300, 1900 ] 976 0.080% 99.953% ( 1900, 2900 ] 1502 0.123% 100.076% ( 2900, 4400 ] 1789 0.147% 100.223% ( 4400, 6600 ] 453 0.037% 100.260% ( 6600, 9900 ] 137 0.011% 100.271% ( 9900, 14000 ] 34 0.003% 100.274% ( 14000, 22000 ] 33 0.003% 100.277% ( 22000, 33000 ] 18 0.001% 100.278% ( 33000, 50000 ] 14 0.001% 100.280% ( 50000, 75000 ] 2 0.000% 100.280% ** Level 5 read latency histogram (micros): Count: 34846 Average: 557.1971 StdDev: 1057.42 Min: 92 Median: 279.4886 Max: 48601 Percentiles: P50: 279.49 P75: 532.36 P99: 4331.88 P99.9: 9405.34 P99.99: 38152.36 ------------------------------------------------------ ( 76, 110 ] 181 0.519% 0.519% ( 110, 170 ] 4446 12.759% 13.278% ### ( 170, 250 ] 11452 32.865% 46.143% ####### ( 250, 380 ] 5925 17.003% 63.146% ### ( 380, 580 ] 5422 15.560% 78.706% ### ( 580, 870 ] 3491 10.018% 88.725% ## ( 870, 1300 ] 1399 4.015% 92.739% # ( 1300, 1900 ] 541 1.553% 94.292% ( 1900, 2900 ] 769 2.207% 96.499% ( 2900, 4400 ] 913 2.620% 99.119% # ( 4400, 6600 ] 239 0.686% 99.805% ( 6600, 9900 ] 39 0.112% 99.917% ( 9900, 14000 ] 7 0.020% 99.937% ( 14000, 22000 ] 9 0.026% 99.963% ( 22000, 33000 ] 8 0.023% 99.986% ( 33000, 50000 ] 5 0.014% 100.000% ** DB Stats ** Uptime(secs): 16.0 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 184.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.873 H:M:S, 18.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 466.390 micros/op 8550 ops/sec 20.232 seconds 172996 operations; 8.3 MB/s (42999 of 42999 found) Microseconds per read: Count: 172996 Average: 466.4020 StdDev: 1401.51 Min: 2 Median: 247.7345 Max: 204435 Percentiles: P50: 247.73 P75: 430.92 P99: 4092.19 P99.9: 18352.26 P99.99: 46396.27 ------------------------------------------------------ ( 1, 2 ] 3 0.002% 0.002% ( 2, 3 ] 48 0.028% 0.029% ( 3, 4 ] 75 0.043% 0.073% ( 4, 6 ] 165 0.095% 0.168% ( 6, 10 ] 294 0.170% 0.338% ( 10, 15 ] 1215 0.702% 1.040% ( 15, 22 ] 2907 1.680% 2.721% ( 22, 34 ] 3115 1.801% 4.521% ( 34, 51 ] 1422 0.822% 5.343% ( 51, 76 ] 254 0.147% 5.490% ( 76, 110 ] 72 0.042% 5.532% ( 110, 170 ] 11940 6.902% 12.434% # ( 170, 250 ] 66882 38.661% 51.095% ######## ( 250, 380 ] 35205 20.350% 71.445% #### ( 380, 580 ] 24155 13.963% 85.408% ### ( 580, 870 ] 12958 7.490% 92.898% # ( 870, 1300 ] 4989 2.884% 95.782% # ( 1300, 1900 ] 1739 1.005% 96.787% ( 1900, 2900 ] 1911 1.105% 97.892% ( 2900, 4400 ] 2412 1.394% 99.286% ( 4400, 6600 ] 676 0.391% 99.677% ( 6600, 9900 ] 223 0.129% 99.806% ( 9900, 14000 ] 95 0.055% 99.861% ( 14000, 22000 ] 125 0.072% 99.933% ( 22000, 33000 ] 79 0.046% 99.979% ( 33000, 50000 ] 25 0.014% 99.993% ( 50000, 75000 ] 8 0.005% 99.998% ( 75000, 110000 ] 2 0.001% 99.999% ( 170000, 250000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2566548 rocksdb.bloom.filter.full.positive COUNT : 197203 rocksdb.bloom.filter.full.true.positive COUNT : 172136 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 860 rocksdb.memtable.miss COUNT : 172136 rocksdb.l0.hit COUNT : 17566 rocksdb.l1.hit COUNT : 98 rocksdb.l2andup.hit COUNT : 154472 rocksdb.compaction.key.drop.new COUNT : 1088748 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3793791 rocksdb.number.keys.read COUNT : 172996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3915192312 rocksdb.bytes.read COUNT : 172996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 560 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4244426 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 17008656518 rocksdb.compact.write.bytes COUNT : 15886628294 rocksdb.flush.write.bytes COUNT : 3825333047 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 794 rocksdb.number.superversion_releases COUNT : 770 rocksdb.number.superversion_cleanups COUNT : 197 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 137 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3800456192 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6951936 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17395910352 rocksdb.non.last.level.read.count COUNT : 4176388 rocksdb.block.checksum.compute.count COUNT : 4320701 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 246.922619 P95 : 1182.485117 P99 : 4090.194940 P100 : 204433.000000 COUNT : 172996 SUM : 80523398 rocksdb.db.write.micros P50 : 1.624336 P95 : 5.167490 P99 : 7.712374 P100 : 679860.000000 COUNT : 3793791 SUM : 15079679 rocksdb.compaction.times.micros P50 : 1844736.842105 P95 : 3474000.000000 P99 : 4007150.000000 P100 : 4007150.000000 COUNT : 59 SUM : 114678951 rocksdb.compaction.times.cpu_micros P50 : 1175714.285714 P95 : 1925000.000000 P99 : 3098327.000000 P100 : 3098327.000000 COUNT : 59 SUM : 72966627 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1370.588235 P95 : 5830.000000 P99 : 10380.000000 P100 : 10380.000000 COUNT : 54 SUM : 93209 rocksdb.compaction.outfile.sync.micros P50 : 2629.166667 P95 : 8839.285714 P99 : 12428.333333 P100 : 26882.000000 COUNT : 215 SUM : 691098 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 279.250000 P95 : 2910.714286 P99 : 4000.000000 P100 : 4000.000000 COUNT : 139 SUM : 73128 rocksdb.table.open.io.micros P50 : 5301.204819 P95 : 18705.882353 P99 : 25080.000000 P100 : 195229.000000 COUNT : 560 SUM : 3857910 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.506234 P95 : 9.768038 P99 : 194.853911 P100 : 39519.000000 COUNT : 4120418 SUM : 62538170 rocksdb.read.block.get.micros P50 : 215.298834 P95 : 1003.413802 P99 : 3767.849829 P100 : 71083.000000 COUNT : 199832 SUM : 72930289 rocksdb.write.raw.block.micros P50 : 0.537204 P95 : 1.431630 P99 : 4.538083 P100 : 153421.000000 COUNT : 4780997 SUM : 18314442 rocksdb.numfiles.in.singlecompaction P50 : 3.058824 P95 : 6.700000 P99 : 10.700000 P100 : 11.000000 COUNT : 86 SUM : 301 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558428 P95 : 1103.479933 P99 : 1276.803010 P100 : 679647.000000 COUNT : 12052 SUM : 4245420 rocksdb.sst.read.micros P50 : 2.191235 P95 : 141.576574 P99 : 511.664493 P100 : 71074.000000 COUNT : 4176582 SUM : 121371471 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 172996 SUM : 172996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3793791 SUM : 3915192312 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 233529.411765 P95 : 894000.000000 P99 : 975205.000000 P100 : 975205.000000 COUNT : 54 SUM : 17127867 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 217 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0