[2024-12-04 04:59:47.482734] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-04 04:59:47.482845] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid970611 ] Set seed to 1733284787480285 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-04 04:59:47.583489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-04 04:59:47.623113] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-04 04:59:47.623156] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 970611' to capture a snapshot of events at runtime. [2024-12-04 04:59:47.623168] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid970611 for offline analysis/debug. [2024-12-04 04:59:47.623207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Dec 4 04:59:51 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/04-04:59:59 ... thread 0: (1000000,1000000) ops and (126632.6,126632.6) ops/second in (7.896859,7.896859) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/3 566.85 MB 25.2 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 115.9 7.06 2.40 9 0.785 0 0 0.0 0.0 L1 5/5 273.70 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 1.2 103.7 103.6 4.19 2.04 2 2.093 440K 328 0.0 0.0 L2 11/8 1.08 GB 1.2 0.1 0.1 0.0 0.1 0.1 0.0 1.0 137.8 137.8 0.54 0.34 1 0.545 76K 0 0.0 0.0 L3 33/11 2.90 GB 2.1 2.6 1.7 0.8 2.5 1.7 0.0 1.5 101.6 100.1 25.78 12.29 13 1.983 1286K 0 0.0 0.0 L4 204/22 12.22 GB 1.2 3.5 2.7 0.7 3.5 2.7 0.1 1.3 107.9 107.3 33.03 16.94 24 1.376 2105K 591 0.0 0.0 L5 1084/0 89.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/49 106.16 GB 0.0 6.5 4.9 1.7 7.3 5.6 0.1 9.1 94.8 105.5 70.61 34.00 49 1.441 3908K 919 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 4.9 1.7 7.3 5.6 0.1 9.1 94.8 105.5 70.61 34.00 49 1.441 3908K 919 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 4.9 1.7 6.5 4.8 0.0 0.0 105.3 104.4 63.54 31.60 40 1.589 3908K 919 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 115.9 7.06 2.40 9 0.785 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.1 total, 7.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.28 GB write, 921.32 MB/s write, 6.54 GB read, 827.32 MB/s read, 70.6 seconds Interval compaction: 7.28 GB write, 943.49 MB/s write, 6.54 GB read, 847.24 MB/s read, 70.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 126993 Average: 11.0791 StdDev: 206.17 Min: 1 Median: 1.8384 Max: 35740 Percentiles: P50: 1.84 P75: 2.92 P99: 9.92 P99.9: 1979.48 P99.99: 5658.97 ------------------------------------------------------ [ 0, 1 ] 7630 6.008% 6.008% # ( 1, 2 ] 66637 52.473% 58.481% ########## ( 2, 3 ] 22727 17.896% 76.377% #### ( 3, 4 ] 12856 10.123% 86.501% ## ( 4, 6 ] 13456 10.596% 97.097% ## ( 6, 10 ] 2469 1.944% 99.041% ( 10, 15 ] 452 0.356% 99.397% ( 15, 22 ] 42 0.033% 99.430% ( 22, 34 ] 10 0.008% 99.438% ( 34, 51 ] 1 0.001% 99.439% ( 51, 76 ] 3 0.002% 99.441% ( 76, 110 ] 2 0.002% 99.442% ( 110, 170 ] 5 0.004% 99.446% ( 170, 250 ] 17 0.013% 99.460% ( 250, 380 ] 42 0.033% 99.493% ( 380, 580 ] 89 0.070% 99.563% ( 580, 870 ] 144 0.113% 99.676% ( 870, 1300 ] 167 0.132% 99.808% ( 1300, 1900 ] 112 0.088% 99.896% ( 1900, 2900 ] 63 0.050% 99.946% ( 2900, 4400 ] 46 0.036% 99.982% ( 4400, 6600 ] 18 0.014% 99.996% ( 6600, 9900 ] 1 0.001% 99.997% ( 14000, 22000 ] 2 0.002% 99.998% ( 22000, 33000 ] 2 0.002% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 63551 Average: 7.1442 StdDev: 100.53 Min: 1 Median: 1.8354 Max: 6377 Percentiles: P50: 1.84 P75: 2.91 P99: 9.08 P99.9: 1509.98 P99.99: 4223.37 ------------------------------------------------------ [ 0, 1 ] 3284 5.168% 5.168% # ( 1, 2 ] 34104 53.664% 58.831% ########### ( 2, 3 ] 11318 17.809% 76.641% #### ( 3, 4 ] 6561 10.324% 86.965% ## ( 4, 6 ] 6838 10.760% 97.725% ## ( 6, 10 ] 1051 1.654% 99.378% ( 10, 15 ] 174 0.274% 99.652% ( 15, 22 ] 19 0.030% 99.682% ( 22, 34 ] 1 0.002% 99.684% ( 34, 51 ] 2 0.003% 99.687% ( 51, 76 ] 2 0.003% 99.690% ( 170, 250 ] 8 0.013% 99.703% ( 250, 380 ] 9 0.014% 99.717% ( 380, 580 ] 28 0.044% 99.761% ( 580, 870 ] 41 0.065% 99.825% ( 870, 1300 ] 38 0.060% 99.885% ( 1300, 1900 ] 27 0.042% 99.928% ( 1900, 2900 ] 22 0.035% 99.962% ( 2900, 4400 ] 20 0.031% 99.994% ( 4400, 6600 ] 4 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 525779 Average: 14.8540 StdDev: 218.57 Min: 1 Median: 1.8897 Max: 35141 Percentiles: P50: 1.89 P75: 2.99 P99: 13.41 P99.9: 1977.60 P99.99: 3124.40 ------------------------------------------------------ [ 0, 1 ] 25414 4.834% 4.834% # ( 1, 2 ] 266927 50.768% 55.601% ########## ( 2, 3 ] 103237 19.635% 75.237% #### ( 3, 4 ] 53962 10.263% 85.500% ## ( 4, 6 ] 54670 10.398% 95.898% ## ( 6, 10 ] 13989 2.661% 98.558% # ( 10, 15 ] 3407 0.648% 99.206% ( 15, 22 ] 483 0.092% 99.298% ( 22, 34 ] 84 0.016% 99.314% ( 34, 51 ] 29 0.006% 99.320% ( 51, 76 ] 37 0.007% 99.327% ( 76, 110 ] 22 0.004% 99.331% ( 110, 170 ] 75 0.014% 99.345% ( 170, 250 ] 146 0.028% 99.373% ( 250, 380 ] 281 0.053% 99.426% ( 380, 580 ] 522 0.099% 99.526% ( 580, 870 ] 684 0.130% 99.656% ( 870, 1300 ] 717 0.136% 99.792% ( 1300, 1900 ] 533 0.101% 99.893% ( 1900, 2900 ] 441 0.084% 99.977% ( 2900, 4400 ] 444 0.084% 100.062% ( 4400, 6600 ] 121 0.023% 100.085% ( 6600, 9900 ] 14 0.003% 100.087% ( 9900, 14000 ] 7 0.001% 100.089% ( 14000, 22000 ] 5 0.001% 100.090% ( 22000, 33000 ] 9 0.002% 100.091% ( 33000, 50000 ] 1 0.000% 100.092% ** Level 3 read latency histogram (micros): Count: 842840 Average: 12.5215 StdDev: 212.18 Min: 1 Median: 1.8963 Max: 45705 Percentiles: P50: 1.90 P75: 2.99 P99: 9.91 P99.9: 1061.08 P99.99: 1588.20 ------------------------------------------------------ [ 0, 1 ] 31992 3.796% 3.796% # ( 1, 2 ] 434469 51.548% 55.344% ########## ( 2, 3 ] 167413 19.863% 75.207% #### ( 3, 4 ] 90229 10.705% 85.912% ## ( 4, 6 ] 91284 10.831% 96.743% ## ( 6, 10 ] 19452 2.308% 99.051% ( 10, 15 ] 4322 0.513% 99.563% ( 15, 22 ] 492 0.058% 99.622% ( 22, 34 ] 49 0.006% 99.628% ( 34, 51 ] 26 0.003% 99.631% ( 51, 76 ] 71 0.008% 99.639% ( 76, 110 ] 12 0.001% 99.641% ( 110, 170 ] 63 0.007% 99.648% ( 170, 250 ] 119 0.014% 99.662% ( 250, 380 ] 261 0.031% 99.693% ( 380, 580 ] 516 0.061% 99.754% ( 580, 870 ] 842 0.100% 99.854% ( 870, 1300 ] 869 0.103% 99.957% ( 1300, 1900 ] 574 0.068% 100.026% ( 1900, 2900 ] 661 0.078% 100.104% ( 2900, 4400 ] 616 0.073% 100.177% ( 4400, 6600 ] 145 0.017% 100.194% ( 6600, 9900 ] 27 0.003% 100.197% ( 9900, 14000 ] 3 0.000% 100.198% ( 14000, 22000 ] 8 0.001% 100.199% ( 22000, 33000 ] 10 0.001% 100.200% ( 33000, 50000 ] 4 0.000% 100.200% ** Level 4 read latency histogram (micros): Count: 259056 Average: 31.1646 StdDev: 316.02 Min: 1 Median: 1.8959 Max: 49482 Percentiles: P50: 1.90 P75: 2.99 P99: 884.66 P99.9: 3311.93 P99.99: 3952.46 ------------------------------------------------------ [ 0, 1 ] 9580 3.698% 3.698% # ( 1, 2 ] 133885 51.682% 55.380% ########## ( 2, 3 ] 51373 19.831% 75.211% #### ( 3, 4 ] 27550 10.635% 85.846% ## ( 4, 6 ] 24988 9.646% 95.491% ## ( 6, 10 ] 5700 2.200% 97.692% ( 10, 15 ] 1320 0.510% 98.201% ( 15, 22 ] 144 0.056% 98.257% ( 22, 34 ] 15 0.006% 98.263% ( 34, 51 ] 16 0.006% 98.269% ( 51, 76 ] 24 0.009% 98.278% ( 76, 110 ] 14 0.005% 98.283% ( 110, 170 ] 40 0.015% 98.299% ( 170, 250 ] 154 0.059% 98.358% ( 250, 380 ] 228 0.088% 98.446% ( 380, 580 ] 547 0.211% 98.657% ( 580, 870 ] 854 0.330% 98.987% ( 870, 1300 ] 1010 0.390% 99.377% ( 1300, 1900 ] 683 0.264% 99.641% ( 1900, 2900 ] 523 0.202% 99.843% ( 2900, 4400 ] 546 0.211% 100.053% ( 4400, 6600 ] 130 0.050% 100.103% ( 6600, 9900 ] 19 0.007% 100.111% ( 14000, 22000 ] 3 0.001% 100.112% ( 22000, 33000 ] 4 0.002% 100.113% ( 33000, 50000 ] 2 0.001% 100.114% ** Level 5 read latency histogram (micros): Count: 13068 Average: 1765.8678 StdDev: 1936.91 Min: 82 Median: 1203.2500 Max: 54301 Percentiles: P50: 1203.25 P75: 2433.01 P99: 6793.11 P99.9: 27425.20 P99.99: 54301.00 ------------------------------------------------------ ( 76, 110 ] 15 0.115% 0.115% ( 110, 170 ] 45 0.344% 0.459% ( 170, 250 ] 207 1.584% 2.043% ( 250, 380 ] 615 4.706% 6.749% # ( 380, 580 ] 1404 10.744% 17.493% ## ( 580, 870 ] 2295 17.562% 35.055% #### ( 870, 1300 ] 2520 19.284% 54.339% #### ( 1300, 1900 ] 1820 13.927% 68.266% ### ( 1900, 2900 ] 1651 12.634% 80.900% ### ( 2900, 4400 ] 1723 13.185% 94.085% ### ( 4400, 6600 ] 636 4.867% 98.952% # ( 6600, 9900 ] 108 0.826% 99.778% ( 9900, 14000 ] 6 0.046% 99.824% ( 14000, 22000 ] 5 0.038% 99.862% ( 22000, 33000 ] 10 0.077% 99.939% ( 33000, 50000 ] 5 0.038% 99.977% ( 50000, 75000 ] 3 0.023% 100.000% ** DB Stats ** Uptime(secs): 8.1 total, 7.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 121.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.887 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 124.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.887 H:M:S, 49.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/04-05:00:07 ... thread 0: (1000000,2000000) ops and (128368.4,127494.6) ops/second in (7.790077,15.686936) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/12 1.23 GB 0.0 0.3 0.0 0.3 2.1 1.8 0.0 1.2 18.2 124.0 17.26 7.32 22 0.785 319K 377 0.0 0.0 L1 3/3 254.56 MB 0.0 1.0 0.6 0.4 1.0 0.6 0.0 1.5 108.5 108.4 9.42 5.07 3 3.141 1038K 1545 0.0 0.0 L2 3/1 119.51 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.3 1.0 137.8 137.8 0.54 0.34 1 0.545 76K 0 0.0 0.0 L3 27/12 1.76 GB 1.0 4.3 3.0 1.3 4.3 3.0 0.0 1.4 107.6 106.3 41.32 21.24 19 2.175 2586K 901 0.0 0.0 L4 171/8 9.64 GB 1.0 7.8 4.9 2.9 7.7 4.8 0.4 1.6 101.8 100.6 78.38 42.10 44 1.781 3580K 841 0.0 0.0 L5 1144/0 94.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1360/36 107.05 GB 0.0 13.5 8.6 4.9 15.1 10.3 5.6 8.5 94.2 105.6 146.93 76.08 89 1.651 7601K 3664 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 8.6 4.9 15.1 10.3 5.6 8.5 94.2 105.6 146.93 76.08 89 1.651 7601K 3664 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 8.6 4.9 13.4 8.5 0.0 0.0 104.7 103.6 132.16 70.27 68 1.943 7601K 3664 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 123.7 14.77 5.80 21 0.703 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.7 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.15 GB write, 976.94 MB/s write, 13.51 GB read, 871.54 MB/s read, 146.9 seconds Interval compaction: 15.15 GB write, 988.78 MB/s write, 13.51 GB read, 882.10 MB/s read, 146.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 56, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 455452 Average: 10.1698 StdDev: 222.13 Min: 1 Median: 1.7932 Max: 38652 Percentiles: P50: 1.79 P75: 2.78 P99: 9.84 P99.9: 1420.78 P99.99: 3187.08 ------------------------------------------------------ [ 0, 1 ] 30990 6.804% 6.804% # ( 1, 2 ] 248039 54.460% 61.264% ########### ( 2, 3 ] 80168 17.602% 78.866% #### ( 3, 4 ] 41554 9.124% 87.990% ## ( 4, 6 ] 42084 9.240% 97.230% ## ( 6, 10 ] 8409 1.846% 99.076% ( 10, 15 ] 1660 0.364% 99.441% ( 15, 22 ] 171 0.038% 99.478% ( 22, 34 ] 16 0.004% 99.482% ( 34, 51 ] 16 0.004% 99.485% ( 51, 76 ] 20 0.004% 99.490% ( 76, 110 ] 7 0.002% 99.491% ( 110, 170 ] 56 0.012% 99.503% ( 170, 250 ] 122 0.027% 99.530% ( 250, 380 ] 236 0.052% 99.582% ( 380, 580 ] 405 0.089% 99.671% ( 580, 870 ] 522 0.115% 99.785% ( 870, 1300 ] 470 0.103% 99.889% ( 1300, 1900 ] 266 0.058% 99.947% ( 1900, 2900 ] 172 0.038% 99.985% ( 2900, 4400 ] 133 0.029% 100.014% ( 4400, 6600 ] 36 0.008% 100.022% ( 6600, 9900 ] 7 0.002% 100.023% ( 9900, 14000 ] 3 0.001% 100.024% ( 14000, 22000 ] 14 0.003% 100.027% ( 22000, 33000 ] 11 0.002% 100.030% ( 33000, 50000 ] 3 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 252342 Average: 10.8286 StdDev: 234.21 Min: 1 Median: 1.8667 Max: 30276 Percentiles: P50: 1.87 P75: 2.92 P99: 10.00 P99.9: 1722.52 P99.99: 4221.50 ------------------------------------------------------ [ 0, 1 ] 10215 4.048% 4.048% # ( 1, 2 ] 133796 53.022% 57.070% ########### ( 2, 3 ] 48951 19.399% 76.468% #### ( 3, 4 ] 24663 9.774% 86.242% ## ( 4, 6 ] 26516 10.508% 96.750% ## ( 6, 10 ] 5681 2.251% 99.001% ( 10, 15 ] 1116 0.442% 99.444% ( 15, 22 ] 122 0.048% 99.492% ( 22, 34 ] 6 0.002% 99.494% ( 34, 51 ] 31 0.012% 99.507% ( 51, 76 ] 22 0.009% 99.515% ( 76, 110 ] 4 0.002% 99.517% ( 110, 170 ] 31 0.012% 99.529% ( 170, 250 ] 65 0.026% 99.555% ( 250, 380 ] 110 0.044% 99.599% ( 380, 580 ] 188 0.075% 99.673% ( 580, 870 ] 256 0.101% 99.775% ( 870, 1300 ] 223 0.088% 99.863% ( 1300, 1900 ] 133 0.053% 99.916% ( 1900, 2900 ] 112 0.044% 99.960% ( 2900, 4400 ] 86 0.034% 99.994% ( 4400, 6600 ] 17 0.007% 100.001% ( 6600, 9900 ] 11 0.004% 100.005% ( 9900, 14000 ] 1 0.000% 100.006% ( 14000, 22000 ] 16 0.006% 100.012% ( 22000, 33000 ] 8 0.003% 100.015% ** Level 2 read latency histogram (micros): Count: 573488 Average: 15.7970 StdDev: 278.17 Min: 1 Median: 1.8956 Max: 49496 Percentiles: P50: 1.90 P75: 2.99 P99: 13.50 P99.9: 2107.24 P99.99: 3310.55 ------------------------------------------------------ [ 0, 1 ] 26300 4.586% 4.586% # ( 1, 2 ] 290788 50.705% 55.291% ########## ( 2, 3 ] 113654 19.818% 75.109% #### ( 3, 4 ] 59081 10.302% 85.411% ## ( 4, 6 ] 60101 10.480% 95.891% ## ( 6, 10 ] 15208 2.652% 98.543% # ( 10, 15 ] 3742 0.652% 99.195% ( 15, 22 ] 515 0.090% 99.285% ( 22, 34 ] 86 0.015% 99.300% ( 34, 51 ] 36 0.006% 99.307% ( 51, 76 ] 39 0.007% 99.313% ( 76, 110 ] 24 0.004% 99.318% ( 110, 170 ] 78 0.014% 99.331% ( 170, 250 ] 156 0.027% 99.358% ( 250, 380 ] 301 0.052% 99.411% ( 380, 580 ] 579 0.101% 99.512% ( 580, 870 ] 756 0.132% 99.644% ( 870, 1300 ] 781 0.136% 99.780% ( 1300, 1900 ] 589 0.103% 99.882% ( 1900, 2900 ] 485 0.085% 99.967% ( 2900, 4400 ] 481 0.084% 100.051% ( 4400, 6600 ] 135 0.024% 100.074% ( 6600, 9900 ] 14 0.002% 100.077% ( 9900, 14000 ] 10 0.002% 100.079% ( 14000, 22000 ] 8 0.001% 100.080% ( 22000, 33000 ] 16 0.003% 100.083% ( 33000, 50000 ] 8 0.001% 100.084% ** Level 3 read latency histogram (micros): Count: 1565254 Average: 13.2540 StdDev: 313.30 Min: 1 Median: 1.8939 Max: 90989 Percentiles: P50: 1.89 P75: 2.97 P99: 9.88 P99.9: 981.72 P99.99: 1548.04 ------------------------------------------------------ [ 0, 1 ] 54626 3.490% 3.490% # ( 1, 2 ] 814399 52.030% 55.520% ########## ( 2, 3 ] 314897 20.118% 75.638% #### ( 3, 4 ] 162546 10.385% 86.022% ## ( 4, 6 ] 166459 10.635% 96.657% ## ( 6, 10 ] 37789 2.414% 99.071% ( 10, 15 ] 8122 0.519% 99.590% ( 15, 22 ] 891 0.057% 99.647% ( 22, 34 ] 82 0.005% 99.652% ( 34, 51 ] 70 0.004% 99.657% ( 51, 76 ] 143 0.009% 99.666% ( 76, 110 ] 35 0.002% 99.668% ( 110, 170 ] 126 0.008% 99.676% ( 170, 250 ] 267 0.017% 99.693% ( 250, 380 ] 535 0.034% 99.727% ( 380, 580 ] 916 0.059% 99.786% ( 580, 870 ] 1422 0.091% 99.877% ( 870, 1300 ] 1400 0.089% 99.966% ( 1300, 1900 ] 901 0.058% 100.024% ( 1900, 2900 ] 951 0.061% 100.085% ( 2900, 4400 ] 943 0.060% 100.145% ( 4400, 6600 ] 235 0.015% 100.160% ( 6600, 9900 ] 66 0.004% 100.164% ( 9900, 14000 ] 26 0.002% 100.166% ( 14000, 22000 ] 78 0.005% 100.171% ( 22000, 33000 ] 64 0.004% 100.175% ( 33000, 50000 ] 16 0.001% 100.176% ( 50000, 75000 ] 2 0.000% 100.176% ( 75000, 110000 ] 2 0.000% 100.176% ** Level 4 read latency histogram (micros): Count: 772192 Average: 28.0719 StdDev: 456.57 Min: 1 Median: 1.8846 Max: 49482 Percentiles: P50: 1.88 P75: 2.98 P99: 538.35 P99.9: 2683.12 P99.99: 3627.03 ------------------------------------------------------ [ 0, 1 ] 30288 3.922% 3.922% # ( 1, 2 ] 402212 52.087% 56.009% ########## ( 2, 3 ] 150402 19.477% 75.487% #### ( 3, 4 ] 79456 10.290% 85.776% ## ( 4, 6 ] 76217 9.870% 95.647% ## ( 6, 10 ] 18594 2.408% 98.054% ( 10, 15 ] 3886 0.503% 98.558% ( 15, 22 ] 436 0.056% 98.614% ( 22, 34 ] 38 0.005% 98.619% ( 34, 51 ] 61 0.008% 98.627% ( 51, 76 ] 67 0.009% 98.636% ( 76, 110 ] 46 0.006% 98.642% ( 110, 170 ] 158 0.020% 98.662% ( 170, 250 ] 503 0.065% 98.727% ( 250, 380 ] 810 0.105% 98.832% ( 380, 580 ] 1637 0.212% 99.044% ( 580, 870 ] 2315 0.300% 99.344% ( 870, 1300 ] 2212 0.286% 99.630% ( 1300, 1900 ] 1312 0.170% 99.800% ( 1900, 2900 ] 983 0.127% 99.928% ( 2900, 4400 ] 994 0.129% 100.056% ( 4400, 6600 ] 233 0.030% 100.087% ( 6600, 9900 ] 47 0.006% 100.093% ( 9900, 14000 ] 24 0.003% 100.096% ( 14000, 22000 ] 79 0.010% 100.106% ( 22000, 33000 ] 87 0.011% 100.117% ( 33000, 50000 ] 24 0.003% 100.120% ** Level 5 read latency histogram (micros): Count: 31196 Average: 1501.0542 StdDev: 2506.44 Min: 80 Median: 899.7364 Max: 56961 Percentiles: P50: 899.74 P75: 1711.92 P99: 7519.04 P99.9: 38101.89 P99.99: 56961.00 ------------------------------------------------------ ( 76, 110 ] 74 0.237% 0.237% ( 110, 170 ] 534 1.712% 1.949% ( 170, 250 ] 1211 3.882% 5.831% # ( 250, 380 ] 2544 8.155% 13.986% ## ( 380, 580 ] 4572 14.656% 28.641% ### ( 580, 870 ] 6259 20.063% 48.705% #### ( 870, 1300 ] 5842 18.727% 67.432% #### ( 1300, 1900 ] 3439 11.024% 78.456% ## ( 1900, 2900 ] 2752 8.822% 87.277% ## ( 2900, 4400 ] 2718 8.713% 95.990% ## ( 4400, 6600 ] 902 2.891% 98.881% # ( 6600, 9900 ] 133 0.426% 99.308% ( 9900, 14000 ] 15 0.048% 99.356% ( 14000, 22000 ] 69 0.221% 99.577% ( 22000, 33000 ] 90 0.288% 99.865% ( 33000, 50000 ] 36 0.115% 99.981% ( 50000, 75000 ] 6 0.019% 100.000% ** DB Stats ** Uptime(secs): 15.9 total, 7.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 123.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.595 H:M:S, 47.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.708 H:M:S, 47.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/04-05:00:11 ... thread 0: (1000000,3000000) ops and (245150.4,151775.3) ops/second in (4.079128,19.766064) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.66 GB 31.5 1.2 0.0 1.2 4.0 2.8 0.0 1.4 49.8 161.6 25.32 13.85 40 0.633 1279K 1517 0.0 0.0 L1 6/6 512.23 MB 0.0 1.8 1.2 0.6 1.8 1.2 0.0 1.5 123.5 123.3 14.92 9.24 4 3.731 1872K 4020 0.0 0.0 L2 1/0 47.08 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.6 1.0 137.8 137.8 0.54 0.34 1 0.545 76K 0 0.0 0.0 L3 19/3 1.23 GB 1.0 5.7 3.4 2.3 5.6 3.3 0.0 1.7 118.3 117.0 49.00 27.34 24 2.042 3954K 7631 0.0 0.0 L4 176/10 9.84 GB 0.9 8.8 5.4 3.4 8.7 5.3 0.8 1.6 107.0 105.6 84.27 46.77 49 1.720 3894K 1267 0.0 0.0 L5 1152/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1368/29 108.01 GB 0.0 17.6 10.0 7.5 20.2 12.6 7.0 7.3 103.3 118.6 174.06 97.54 118 1.475 11M 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.6 10.0 7.5 20.2 12.6 7.0 7.3 103.3 118.6 174.06 97.54 118 1.475 11M 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.6 10.0 7.5 17.4 9.8 0.0 0.0 115.9 114.7 155.20 88.94 82 1.893 11M 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 150.3 18.85 8.59 36 0.524 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.0 total, 19.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.15 GB write, 1034.10 MB/s write, 17.56 GB read, 901.21 MB/s read, 174.1 seconds Interval compaction: 20.15 GB write, 1044.04 MB/s write, 17.56 GB read, 909.88 MB/s read, 174.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 748174 Average: 8.3472 StdDev: 177.09 Min: 1 Median: 1.7665 Max: 38652 Percentiles: P50: 1.77 P75: 2.69 P99: 9.65 P99.9: 1108.84 P99.99: 2393.76 ------------------------------------------------------ [ 0, 1 ] 54196 7.244% 7.244% # ( 1, 2 ] 417315 55.778% 63.022% ########### ( 2, 3 ] 129764 17.344% 80.366% ### ( 3, 4 ] 64903 8.675% 89.041% ## ( 4, 6 ] 63425 8.477% 97.518% ## ( 6, 10 ] 12158 1.625% 99.143% ( 10, 15 ] 2341 0.313% 99.456% ( 15, 22 ] 229 0.031% 99.486% ( 22, 34 ] 20 0.003% 99.489% ( 34, 51 ] 27 0.004% 99.493% ( 51, 76 ] 25 0.003% 99.496% ( 76, 110 ] 36 0.005% 99.501% ( 110, 170 ] 229 0.031% 99.531% ( 170, 250 ] 383 0.051% 99.583% ( 250, 380 ] 524 0.070% 99.653% ( 380, 580 ] 750 0.100% 99.753% ( 580, 870 ] 777 0.104% 99.857% ( 870, 1300 ] 583 0.078% 99.935% ( 1300, 1900 ] 310 0.041% 99.976% ( 1900, 2900 ] 211 0.028% 100.004% ( 2900, 4400 ] 145 0.019% 100.024% ( 4400, 6600 ] 42 0.006% 100.029% ( 6600, 9900 ] 7 0.001% 100.030% ( 9900, 14000 ] 3 0.000% 100.031% ( 14000, 22000 ] 14 0.002% 100.032% ( 22000, 33000 ] 11 0.001% 100.034% ( 33000, 50000 ] 3 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 386913 Average: 8.7590 StdDev: 192.87 Min: 1 Median: 1.8406 Max: 30276 Percentiles: P50: 1.84 P75: 2.85 P99: 9.75 P99.9: 1205.28 P99.99: 3255.99 ------------------------------------------------------ [ 0, 1 ] 16242 4.198% 4.198% # ( 1, 2 ] 210829 54.490% 58.688% ########### ( 2, 3 ] 74091 19.149% 77.837% #### ( 3, 4 ] 36547 9.446% 87.283% ## ( 4, 6 ] 37963 9.812% 97.095% ## ( 6, 10 ] 7871 2.034% 99.129% ( 10, 15 ] 1500 0.388% 99.517% ( 15, 22 ] 155 0.040% 99.557% ( 22, 34 ] 10 0.003% 99.559% ( 34, 51 ] 38 0.010% 99.569% ( 51, 76 ] 28 0.007% 99.576% ( 76, 110 ] 9 0.002% 99.579% ( 110, 170 ] 81 0.021% 99.600% ( 170, 250 ] 129 0.033% 99.633% ( 250, 380 ] 193 0.050% 99.683% ( 380, 580 ] 284 0.073% 99.756% ( 580, 870 ] 344 0.089% 99.845% ( 870, 1300 ] 272 0.070% 99.915% ( 1300, 1900 ] 144 0.037% 99.953% ( 1900, 2900 ] 122 0.032% 99.984% ( 2900, 4400 ] 94 0.024% 100.009% ( 4400, 6600 ] 17 0.004% 100.013% ( 6600, 9900 ] 11 0.003% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ( 14000, 22000 ] 17 0.004% 100.020% ( 22000, 33000 ] 8 0.002% 100.022% ** Level 2 read latency histogram (micros): Count: 580730 Average: 15.9459 StdDev: 277.46 Min: 1 Median: 1.8973 Max: 49496 Percentiles: P50: 1.90 P75: 3.00 P99: 13.74 P99.9: 2121.64 P99.99: 3328.79 ------------------------------------------------------ [ 0, 1 ] 26401 4.546% 4.546% # ( 1, 2 ] 294166 50.655% 55.201% ########## ( 2, 3 ] 115273 19.850% 75.050% #### ( 3, 4 ] 59834 10.303% 85.354% ## ( 4, 6 ] 60994 10.503% 95.857% ## ( 6, 10 ] 15420 2.655% 98.512% # ( 10, 15 ] 3790 0.653% 99.164% ( 15, 22 ] 521 0.090% 99.254% ( 22, 34 ] 90 0.015% 99.270% ( 34, 51 ] 38 0.007% 99.276% ( 51, 76 ] 41 0.007% 99.283% ( 76, 110 ] 27 0.005% 99.288% ( 110, 170 ] 99 0.017% 99.305% ( 170, 250 ] 188 0.032% 99.337% ( 250, 380 ] 328 0.056% 99.394% ( 380, 580 ] 617 0.106% 99.500% ( 580, 870 ] 800 0.138% 99.638% ( 870, 1300 ] 809 0.139% 99.777% ( 1300, 1900 ] 604 0.104% 99.881% ( 1900, 2900 ] 493 0.085% 99.966% ( 2900, 4400 ] 486 0.084% 100.050% ( 4400, 6600 ] 137 0.024% 100.073% ( 6600, 9900 ] 15 0.003% 100.076% ( 9900, 14000 ] 10 0.002% 100.078% ( 14000, 22000 ] 8 0.001% 100.079% ( 22000, 33000 ] 16 0.003% 100.082% ( 33000, 50000 ] 8 0.001% 100.083% ** Level 3 read latency histogram (micros): Count: 1925174 Average: 11.8832 StdDev: 284.29 Min: 1 Median: 1.8800 Max: 90989 Percentiles: P50: 1.88 P75: 2.93 P99: 9.86 P99.9: 893.69 P99.99: 1472.17 ------------------------------------------------------ [ 0, 1 ] 67579 3.510% 3.510% # ( 1, 2 ] 1017023 52.828% 56.338% ########### ( 2, 3 ] 385056 20.001% 76.339% #### ( 3, 4 ] 194537 10.105% 86.444% ## ( 4, 6 ] 198174 10.294% 96.738% ## ( 6, 10 ] 45166 2.346% 99.084% ( 10, 15 ] 9620 0.500% 99.583% ( 15, 22 ] 1018 0.053% 99.636% ( 22, 34 ] 99 0.005% 99.641% ( 34, 51 ] 118 0.006% 99.648% ( 51, 76 ] 177 0.009% 99.657% ( 76, 110 ] 66 0.003% 99.660% ( 110, 170 ] 275 0.014% 99.675% ( 170, 250 ] 526 0.027% 99.702% ( 250, 380 ] 802 0.042% 99.744% ( 380, 580 ] 1229 0.064% 99.807% ( 580, 870 ] 1700 0.088% 99.896% ( 870, 1300 ] 1540 0.080% 99.976% ( 1300, 1900 ] 967 0.050% 100.026% ( 1900, 2900 ] 1019 0.053% 100.079% ( 2900, 4400 ] 988 0.051% 100.130% ( 4400, 6600 ] 242 0.013% 100.143% ( 6600, 9900 ] 66 0.003% 100.146% ( 9900, 14000 ] 26 0.001% 100.147% ( 14000, 22000 ] 79 0.004% 100.152% ( 22000, 33000 ] 64 0.003% 100.155% ( 33000, 50000 ] 16 0.001% 100.156% ( 50000, 75000 ] 2 0.000% 100.156% ( 75000, 110000 ] 2 0.000% 100.156% ** Level 4 read latency histogram (micros): Count: 1027106 Average: 24.4513 StdDev: 400.55 Min: 1 Median: 1.8668 Max: 49482 Percentiles: P50: 1.87 P75: 2.93 P99: 461.50 P99.9: 2435.65 P99.99: 3471.24 ------------------------------------------------------ [ 0, 1 ] 41660 4.056% 4.056% # ( 1, 2 ] 544396 53.003% 57.059% ########### ( 2, 3 ] 197223 19.202% 76.261% #### ( 3, 4 ] 101337 9.866% 86.127% ## ( 4, 6 ] 97299 9.473% 95.600% ## ( 6, 10 ] 24290 2.365% 97.965% ( 10, 15 ] 5054 0.492% 98.457% ( 15, 22 ] 547 0.053% 98.510% ( 22, 34 ] 50 0.005% 98.515% ( 34, 51 ] 98 0.010% 98.525% ( 51, 76 ] 90 0.009% 98.534% ( 76, 110 ] 132 0.013% 98.546% ( 110, 170 ] 657 0.064% 98.610% ( 170, 250 ] 1253 0.122% 98.732% ( 250, 380 ] 1710 0.166% 98.899% ( 380, 580 ] 2552 0.248% 99.147% ( 580, 870 ] 3128 0.305% 99.452% ( 870, 1300 ] 2582 0.251% 99.703% ( 1300, 1900 ] 1430 0.139% 99.842% ( 1900, 2900 ] 1105 0.108% 99.950% ( 2900, 4400 ] 1080 0.105% 100.055% ( 4400, 6600 ] 241 0.023% 100.079% ( 6600, 9900 ] 47 0.005% 100.083% ( 9900, 14000 ] 24 0.002% 100.086% ( 14000, 22000 ] 81 0.008% 100.093% ( 22000, 33000 ] 87 0.008% 100.102% ( 33000, 50000 ] 24 0.002% 100.104% ** Level 5 read latency histogram (micros): Count: 51627 Average: 1139.6824 StdDev: 2040.57 Min: 79 Median: 669.6005 Max: 56961 Percentiles: P50: 669.60 P75: 1226.74 P99: 6229.21 P99.9: 31823.37 P99.99: 53488.75 ------------------------------------------------------ ( 76, 110 ] 474 0.918% 0.918% ( 110, 170 ] 2748 5.323% 6.241% # ( 170, 250 ] 4399 8.521% 14.762% ## ( 250, 380 ] 6352 12.304% 27.065% ## ( 380, 580 ] 8867 17.175% 44.240% ### ( 580, 870 ] 9624 18.641% 62.882% #### ( 870, 1300 ] 7541 14.607% 77.489% ### ( 1300, 1900 ] 3995 7.738% 85.227% ## ( 1900, 2900 ] 3244 6.284% 91.510% # ( 2900, 4400 ] 3081 5.968% 97.478% # ( 4400, 6600 ] 945 1.830% 99.309% ( 6600, 9900 ] 139 0.269% 99.578% ( 9900, 14000 ] 17 0.033% 99.611% ( 14000, 22000 ] 69 0.134% 99.744% ( 22000, 33000 ] 90 0.174% 99.919% ( 33000, 50000 ] 36 0.070% 99.988% ( 50000, 75000 ] 6 0.012% 100.000% ** DB Stats ** Uptime(secs): 20.0 total, 4.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 147.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.853 H:M:S, 39.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 241.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.258 H:M:S, 6.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/04-05:00:15 ... thread 0: (1000000,4000000) ops and (280363.0,171432.0) ops/second in (3.566805,23.332869) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.64 GB 132.2 2.2 0.0 2.2 6.0 3.7 0.0 1.6 69.6 187.5 32.57 20.52 60 0.543 2302K 2511 0.0 0.0 L1 6/6 512.23 MB 0.0 1.8 1.2 0.6 1.8 1.2 0.0 1.5 123.5 123.3 14.92 9.24 4 3.731 1872K 4020 0.0 0.0 L2 1/0 47.08 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.6 1.0 137.8 137.8 0.54 0.34 1 0.545 76K 0 0.0 0.0 L3 16/0 982.65 MB 1.0 5.7 3.4 2.3 5.6 3.3 0.0 1.7 118.3 117.0 49.00 27.34 24 2.042 3954K 7631 0.0 0.0 L4 180/0 9.76 GB 1.0 10.0 5.6 4.4 9.8 5.5 0.8 1.7 113.6 111.6 90.12 51.94 52 1.733 4497K 3744 0.0 0.0 L5 1156/0 95.02 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/16 108.93 GB 0.0 19.7 10.3 9.4 23.3 13.8 7.3 6.2 108.0 127.2 187.16 109.38 141 1.327 12M 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.7 10.3 9.4 23.3 13.8 7.3 6.2 108.0 127.2 187.16 109.38 141 1.327 12M 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.7 10.3 9.4 19.5 10.1 0.0 0.0 122.5 121.0 165.00 97.94 89 1.854 12M 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 173.4 22.16 11.44 52 0.426 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.5 total, 23.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.25 GB write, 1012.24 MB/s write, 19.74 GB read, 859.44 MB/s read, 187.2 seconds Interval compaction: 23.25 GB write, 1020.49 MB/s write, 19.74 GB read, 866.44 MB/s read, 187.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1026468 Average: 10.1652 StdDev: 155.42 Min: 0 Median: 1.6829 Max: 38652 Percentiles: P50: 1.68 P75: 2.49 P99: 180.55 P99.9: 902.65 P99.99: 1793.69 ------------------------------------------------------ [ 0, 1 ] 122357 11.920% 11.920% ## ( 1, 2 ] 572389 55.763% 67.683% ########### ( 2, 3 ] 152835 14.889% 82.573% ### ( 3, 4 ] 73533 7.164% 89.736% # ( 4, 6 ] 69193 6.741% 96.477% # ( 6, 10 ] 13226 1.288% 97.766% ( 10, 15 ] 2525 0.246% 98.012% ( 15, 22 ] 266 0.026% 98.038% ( 22, 34 ] 24 0.002% 98.040% ( 34, 51 ] 30 0.003% 98.043% ( 51, 76 ] 31 0.003% 98.046% ( 76, 110 ] 1761 0.172% 98.217% ( 110, 170 ] 7489 0.730% 98.947% ( 170, 250 ] 4126 0.402% 99.349% ( 250, 380 ] 2205 0.215% 99.564% ( 380, 580 ] 2114 0.206% 99.770% ( 580, 870 ] 1284 0.125% 99.895% ( 870, 1300 ] 705 0.069% 99.963% ( 1300, 1900 ] 331 0.032% 99.996% ( 1900, 2900 ] 227 0.022% 100.018% ( 2900, 4400 ] 153 0.015% 100.033% ( 4400, 6600 ] 42 0.004% 100.037% ( 6600, 9900 ] 7 0.001% 100.038% ( 9900, 14000 ] 3 0.000% 100.038% ( 14000, 22000 ] 14 0.001% 100.039% ( 22000, 33000 ] 11 0.001% 100.040% ( 33000, 50000 ] 3 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 404009 Average: 8.8573 StdDev: 189.02 Min: 1 Median: 1.8587 Max: 30276 Percentiles: P50: 1.86 P75: 2.90 P99: 10.74 P99.9: 1182.43 P99.99: 3228.71 ------------------------------------------------------ [ 0, 1 ] 16527 4.091% 4.091% # ( 1, 2 ] 216009 53.466% 57.557% ########### ( 2, 3 ] 78187 19.353% 76.910% #### ( 3, 4 ] 39148 9.690% 86.600% ## ( 4, 6 ] 41060 10.163% 96.763% ## ( 6, 10 ] 8786 2.175% 98.938% ( 10, 15 ] 1717 0.425% 99.363% ( 15, 22 ] 254 0.063% 99.426% ( 22, 34 ] 24 0.006% 99.431% ( 34, 51 ] 39 0.010% 99.441% ( 51, 76 ] 28 0.007% 99.448% ( 76, 110 ] 90 0.022% 99.470% ( 110, 170 ] 344 0.085% 99.555% ( 170, 250 ] 253 0.063% 99.618% ( 250, 380 ] 246 0.061% 99.679% ( 380, 580 ] 327 0.081% 99.760% ( 580, 870 ] 365 0.090% 99.850% ( 870, 1300 ] 278 0.069% 99.919% ( 1300, 1900 ] 145 0.036% 99.955% ( 1900, 2900 ] 122 0.030% 99.985% ( 2900, 4400 ] 94 0.023% 100.008% ( 4400, 6600 ] 17 0.004% 100.013% ( 6600, 9900 ] 11 0.003% 100.015% ( 9900, 14000 ] 1 0.000% 100.016% ( 14000, 22000 ] 17 0.004% 100.020% ( 22000, 33000 ] 8 0.002% 100.022% ** Level 2 read latency histogram (micros): Count: 580896 Average: 16.0024 StdDev: 277.45 Min: 1 Median: 1.8976 Max: 49496 Percentiles: P50: 1.90 P75: 3.00 P99: 13.96 P99.9: 2121.31 P99.99: 3328.74 ------------------------------------------------------ [ 0, 1 ] 26401 4.545% 4.545% # ( 1, 2 ] 294166 50.640% 55.185% ########## ( 2, 3 ] 115273 19.844% 75.029% #### ( 3, 4 ] 59834 10.300% 85.329% ## ( 4, 6 ] 60994 10.500% 95.829% ## ( 6, 10 ] 15420 2.655% 98.484% # ( 10, 15 ] 3790 0.652% 99.136% ( 15, 22 ] 521 0.090% 99.226% ( 22, 34 ] 90 0.015% 99.241% ( 34, 51 ] 38 0.007% 99.248% ( 51, 76 ] 41 0.007% 99.255% ( 76, 110 ] 56 0.010% 99.265% ( 110, 170 ] 163 0.028% 99.293% ( 170, 250 ] 224 0.039% 99.331% ( 250, 380 ] 344 0.059% 99.390% ( 380, 580 ] 634 0.109% 99.500% ( 580, 870 ] 803 0.138% 99.638% ( 870, 1300 ] 809 0.139% 99.777% ( 1300, 1900 ] 605 0.104% 99.881% ( 1900, 2900 ] 493 0.085% 99.966% ( 2900, 4400 ] 486 0.084% 100.050% ( 4400, 6600 ] 137 0.024% 100.073% ( 6600, 9900 ] 15 0.003% 100.076% ( 9900, 14000 ] 10 0.002% 100.078% ( 14000, 22000 ] 8 0.001% 100.079% ( 22000, 33000 ] 16 0.003% 100.082% ( 33000, 50000 ] 8 0.001% 100.083% ** Level 3 read latency histogram (micros): Count: 1988111 Average: 11.6874 StdDev: 279.82 Min: 1 Median: 1.8741 Max: 90989 Percentiles: P50: 1.87 P75: 2.92 P99: 9.90 P99.9: 874.97 P99.99: 1460.65 ------------------------------------------------------ [ 0, 1 ] 71568 3.600% 3.600% # ( 1, 2 ] 1055414 53.086% 56.686% ########### ( 2, 3 ] 395621 19.899% 76.585% #### ( 3, 4 ] 198587 9.989% 86.574% ## ( 4, 6 ] 201812 10.151% 96.725% ## ( 6, 10 ] 46366 2.332% 99.057% ( 10, 15 ] 9815 0.494% 99.551% ( 15, 22 ] 1040 0.052% 99.603% ( 22, 34 ] 101 0.005% 99.608% ( 34, 51 ] 118 0.006% 99.614% ( 51, 76 ] 177 0.009% 99.623% ( 76, 110 ] 165 0.008% 99.631% ( 110, 170 ] 681 0.034% 99.666% ( 170, 250 ] 711 0.036% 99.701% ( 250, 380 ] 895 0.045% 99.746% ( 380, 580 ] 1309 0.066% 99.812% ( 580, 870 ] 1725 0.087% 99.899% ( 870, 1300 ] 1548 0.078% 99.977% ( 1300, 1900 ] 968 0.049% 100.026% ( 1900, 2900 ] 1020 0.051% 100.077% ( 2900, 4400 ] 988 0.050% 100.127% ( 4400, 6600 ] 242 0.012% 100.139% ( 6600, 9900 ] 66 0.003% 100.142% ( 9900, 14000 ] 26 0.001% 100.143% ( 14000, 22000 ] 79 0.004% 100.147% ( 22000, 33000 ] 64 0.003% 100.151% ( 33000, 50000 ] 16 0.001% 100.151% ( 50000, 75000 ] 2 0.000% 100.152% ( 75000, 110000 ] 2 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 1067076 Average: 25.0973 StdDev: 393.61 Min: 1 Median: 1.8676 Max: 49482 Percentiles: P50: 1.87 P75: 2.95 P99: 477.60 P99.9: 2399.48 P99.99: 3460.48 ------------------------------------------------------ [ 0, 1 ] 44212 4.143% 4.143% # ( 1, 2 ] 563980 52.853% 56.996% ########### ( 2, 3 ] 202561 18.983% 75.979% #### ( 3, 4 ] 103728 9.721% 85.700% ## ( 4, 6 ] 99504 9.325% 95.025% ## ( 6, 10 ] 24988 2.342% 97.366% ( 10, 15 ] 5140 0.482% 97.848% ( 15, 22 ] 551 0.052% 97.900% ( 22, 34 ] 51 0.005% 97.904% ( 34, 51 ] 98 0.009% 97.914% ( 51, 76 ] 92 0.009% 97.922% ( 76, 110 ] 1010 0.095% 98.017% ( 110, 170 ] 3797 0.356% 98.373% ( 170, 250 ] 2713 0.254% 98.627% ( 250, 380 ] 2446 0.229% 98.856% ( 380, 580 ] 3144 0.295% 99.151% ( 580, 870 ] 3359 0.315% 99.466% ( 870, 1300 ] 2638 0.247% 99.713% ( 1300, 1900 ] 1442 0.135% 99.848% ( 1900, 2900 ] 1111 0.104% 99.952% ( 2900, 4400 ] 1082 0.101% 100.054% ( 4400, 6600 ] 241 0.023% 100.076% ( 6600, 9900 ] 47 0.004% 100.081% ( 9900, 14000 ] 24 0.002% 100.083% ( 14000, 22000 ] 81 0.008% 100.090% ( 22000, 33000 ] 87 0.008% 100.098% ( 33000, 50000 ] 24 0.002% 100.101% ** Level 5 read latency histogram (micros): Count: 92396 Average: 733.8862 StdDev: 1596.85 Min: 74 Median: 335.2289 Max: 56961 Percentiles: P50: 335.23 P75: 776.68 P99: 5275.44 P99.9: 26596.04 P99.99: 47525.74 ------------------------------------------------------ ( 51, 76 ] 2 0.002% 0.002% ( 76, 110 ] 5395 5.839% 5.841% # ( 110, 170 ] 21068 22.802% 28.643% ##### ( 170, 250 ] 12975 14.043% 42.686% ### ( 250, 380 ] 10308 11.156% 53.842% ## ( 380, 580 ] 12120 13.117% 66.960% ### ( 580, 870 ] 10954 11.855% 78.815% ## ( 870, 1300 ] 7849 8.495% 87.310% ## ( 1300, 1900 ] 4049 4.382% 91.692% # ( 1900, 2900 ] 3279 3.549% 95.241% # ( 2900, 4400 ] 3097 3.352% 98.593% # ( 4400, 6600 ] 945 1.023% 99.616% ( 6600, 9900 ] 139 0.150% 99.766% ( 9900, 14000 ] 17 0.018% 99.785% ( 14000, 22000 ] 69 0.075% 99.859% ( 22000, 33000 ] 90 0.097% 99.957% ( 33000, 50000 ] 36 0.039% 99.996% ( 50000, 75000 ] 6 0.006% 100.002% ** DB Stats ** Uptime(secs): 23.5 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 167.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.853 H:M:S, 33.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/04-05:00:20 ... thread 0: (1000000,5000000) ops and (196212.0,175874.3) ops/second in (5.096528,28.429397) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.63 GB 100.7 3.4 0.0 3.4 8.2 4.7 0.0 1.7 86.8 206.1 40.64 28.06 81 0.502 3582K 3742 0.0 0.0 L1 6/6 512.23 MB 0.0 1.8 1.2 0.6 1.8 1.2 0.0 1.5 123.5 123.3 14.92 9.24 4 3.731 1872K 4020 0.0 0.0 L2 1/0 47.08 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.6 1.0 137.8 137.8 0.54 0.34 1 0.545 76K 0 0.0 0.0 L3 16/0 982.65 MB 1.0 5.7 3.4 2.3 5.6 3.3 0.0 1.7 118.3 117.0 49.00 27.34 24 2.042 3954K 7631 0.0 0.0 L4 180/0 9.76 GB 1.0 10.0 5.6 4.4 9.8 5.5 0.8 1.7 113.6 111.6 90.12 51.94 52 1.733 4497K 3744 0.0 0.0 L5 1156/0 95.02 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1378/19 109.91 GB 0.0 21.0 10.3 10.7 25.5 14.8 7.3 5.4 110.0 133.6 195.23 116.91 162 1.205 13M 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.0 10.3 10.7 25.5 14.8 7.3 5.4 110.0 133.6 195.23 116.91 162 1.205 13M 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.0 10.3 10.7 20.7 10.1 0.0 0.0 126.5 125.0 169.84 102.70 94 1.807 13M 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 191.0 25.39 14.22 68 0.373 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.6 total, 28.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.47 GB write, 911.19 MB/s write, 20.97 GB read, 750.42 MB/s read, 195.2 seconds Interval compaction: 25.47 GB write, 917.28 MB/s write, 20.97 GB read, 755.44 MB/s read, 195.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 58, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1365469 Average: 12.0090 StdDev: 138.81 Min: 0 Median: 1.6191 Max: 38652 Percentiles: P50: 1.62 P75: 2.32 P99: 223.42 P99.9: 802.80 P99.99: 1434.34 ------------------------------------------------------ [ 0, 1 ] 218849 16.027% 16.027% ### ( 1, 2 ] 749255 54.872% 70.899% ########### ( 2, 3 ] 174495 12.779% 83.678% ### ( 3, 4 ] 81869 5.996% 89.674% # ( 4, 6 ] 74611 5.464% 95.138% # ( 6, 10 ] 14347 1.051% 96.189% ( 10, 15 ] 2847 0.208% 96.397% ( 15, 22 ] 315 0.023% 96.420% ( 22, 34 ] 29 0.002% 96.422% ( 34, 51 ] 34 0.002% 96.425% ( 51, 76 ] 35 0.003% 96.427% ( 76, 110 ] 6096 0.446% 96.874% ( 110, 170 ] 22502 1.648% 98.522% ( 170, 250 ] 9781 0.716% 99.238% ( 250, 380 ] 4108 0.301% 99.539% ( 380, 580 ] 3627 0.266% 99.805% ( 580, 870 ] 1698 0.124% 99.929% ( 870, 1300 ] 760 0.056% 99.985% ( 1300, 1900 ] 337 0.025% 100.009% ( 1900, 2900 ] 244 0.018% 100.027% ( 2900, 4400 ] 169 0.012% 100.039% ( 4400, 6600 ] 42 0.003% 100.043% ( 6600, 9900 ] 7 0.001% 100.043% ( 9900, 14000 ] 3 0.000% 100.043% ( 14000, 22000 ] 14 0.001% 100.044% ( 22000, 33000 ] 11 0.001% 100.045% ( 33000, 50000 ] 3 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 427886 Average: 8.9578 StdDev: 183.98 Min: 1 Median: 1.8868 Max: 30276 Percentiles: P50: 1.89 P75: 2.96 P99: 13.35 P99.9: 1151.74 P99.99: 3190.61 ------------------------------------------------------ [ 0, 1 ] 16900 3.950% 3.950% # ( 1, 2 ] 222197 51.929% 55.879% ########## ( 2, 3 ] 85026 19.871% 75.750% #### ( 3, 4 ] 42588 9.953% 85.703% ## ( 4, 6 ] 45713 10.683% 96.386% ## ( 6, 10 ] 9850 2.302% 98.688% ( 10, 15 ] 1991 0.465% 99.154% ( 15, 22 ] 386 0.090% 99.244% ( 22, 34 ] 40 0.009% 99.253% ( 34, 51 ] 40 0.009% 99.263% ( 51, 76 ] 28 0.007% 99.269% ( 76, 110 ] 231 0.054% 99.323% ( 110, 170 ] 823 0.192% 99.516% ( 170, 250 ] 410 0.096% 99.611% ( 250, 380 ] 299 0.070% 99.681% ( 380, 580 ] 369 0.086% 99.767% ( 580, 870 ] 383 0.090% 99.857% ( 870, 1300 ] 281 0.066% 99.923% ( 1300, 1900 ] 148 0.035% 99.957% ( 1900, 2900 ] 122 0.029% 99.986% ( 2900, 4400 ] 94 0.022% 100.008% ( 4400, 6600 ] 17 0.004% 100.012% ( 6600, 9900 ] 11 0.003% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ( 14000, 22000 ] 17 0.004% 100.018% ( 22000, 33000 ] 8 0.002% 100.020% ** Level 2 read latency histogram (micros): Count: 581204 Average: 16.0865 StdDev: 277.41 Min: 1 Median: 1.8981 Max: 49496 Percentiles: P50: 1.90 P75: 3.00 P99: 14.36 P99.9: 2120.68 P99.99: 3328.64 ------------------------------------------------------ [ 0, 1 ] 26401 4.542% 4.542% # ( 1, 2 ] 294166 50.613% 55.156% ########## ( 2, 3 ] 115273 19.833% 74.989% #### ( 3, 4 ] 59834 10.295% 85.284% ## ( 4, 6 ] 60994 10.494% 95.778% ## ( 6, 10 ] 15420 2.653% 98.432% # ( 10, 15 ] 3790 0.652% 99.084% ( 15, 22 ] 521 0.090% 99.173% ( 22, 34 ] 90 0.015% 99.189% ( 34, 51 ] 38 0.007% 99.195% ( 51, 76 ] 41 0.007% 99.202% ( 76, 110 ] 115 0.020% 99.222% ( 110, 170 ] 322 0.055% 99.278% ( 170, 250 ] 277 0.048% 99.325% ( 250, 380 ] 364 0.063% 99.388% ( 380, 580 ] 646 0.111% 99.499% ( 580, 870 ] 806 0.139% 99.638% ( 870, 1300 ] 811 0.140% 99.777% ( 1300, 1900 ] 605 0.104% 99.881% ( 1900, 2900 ] 493 0.085% 99.966% ( 2900, 4400 ] 486 0.084% 100.050% ( 4400, 6600 ] 137 0.024% 100.073% ( 6600, 9900 ] 15 0.003% 100.076% ( 9900, 14000 ] 10 0.002% 100.078% ( 14000, 22000 ] 8 0.001% 100.079% ( 22000, 33000 ] 16 0.003% 100.082% ( 33000, 50000 ] 8 0.001% 100.083% ** Level 3 read latency histogram (micros): Count: 1989944 Average: 11.8394 StdDev: 279.76 Min: 1 Median: 1.8749 Max: 90989 Percentiles: P50: 1.87 P75: 2.92 P99: 10.34 P99.9: 875.56 P99.99: 1460.54 ------------------------------------------------------ [ 0, 1 ] 71568 3.596% 3.596% # ( 1, 2 ] 1055414 53.037% 56.634% ########### ( 2, 3 ] 395622 19.881% 76.515% #### ( 3, 4 ] 198587 9.980% 86.494% ## ( 4, 6 ] 201813 10.142% 96.636% ## ( 6, 10 ] 46367 2.330% 98.966% ( 10, 15 ] 9815 0.493% 99.459% ( 15, 22 ] 1040 0.052% 99.512% ( 22, 34 ] 101 0.005% 99.517% ( 34, 51 ] 118 0.006% 99.523% ( 51, 76 ] 177 0.009% 99.532% ( 76, 110 ] 457 0.023% 99.555% ( 110, 170 ] 1664 0.084% 99.638% ( 170, 250 ] 1039 0.052% 99.690% ( 250, 380 ] 1017 0.051% 99.741% ( 380, 580 ] 1386 0.070% 99.811% ( 580, 870 ] 1749 0.088% 99.899% ( 870, 1300 ] 1552 0.078% 99.977% ( 1300, 1900 ] 968 0.049% 100.026% ( 1900, 2900 ] 1020 0.051% 100.077% ( 2900, 4400 ] 988 0.050% 100.127% ( 4400, 6600 ] 242 0.012% 100.139% ( 6600, 9900 ] 66 0.003% 100.142% ( 9900, 14000 ] 26 0.001% 100.143% ( 14000, 22000 ] 79 0.004% 100.147% ( 22000, 33000 ] 64 0.003% 100.151% ( 33000, 50000 ] 16 0.001% 100.151% ( 50000, 75000 ] 2 0.000% 100.151% ( 75000, 110000 ] 2 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 1080135 Average: 26.8461 StdDev: 391.77 Min: 1 Median: 1.8791 Max: 49482 Percentiles: P50: 1.88 P75: 3.00 P99: 497.53 P99.9: 2390.02 P99.99: 3458.67 ------------------------------------------------------ [ 0, 1 ] 44213 4.093% 4.093% # ( 1, 2 ] 564051 52.220% 56.314% ########## ( 2, 3 ] 202836 18.779% 75.092% #### ( 3, 4 ] 103881 9.617% 84.710% ## ( 4, 6 ] 99705 9.231% 93.941% ## ( 6, 10 ] 25012 2.316% 96.256% ( 10, 15 ] 5148 0.477% 96.733% ( 15, 22 ] 552 0.051% 96.784% ( 22, 34 ] 51 0.005% 96.789% ( 34, 51 ] 98 0.009% 96.798% ( 51, 76 ] 93 0.009% 96.806% ( 76, 110 ] 3046 0.282% 97.088% ( 110, 170 ] 10321 0.956% 98.044% ( 170, 250 ] 4914 0.455% 98.499% ( 250, 380 ] 3223 0.298% 98.797% ( 380, 580 ] 3726 0.345% 99.142% ( 580, 870 ] 3532 0.327% 99.469% ( 870, 1300 ] 2663 0.247% 99.716% ( 1300, 1900 ] 1443 0.134% 99.849% ( 1900, 2900 ] 1116 0.103% 99.953% ( 2900, 4400 ] 1082 0.100% 100.053% ( 4400, 6600 ] 241 0.022% 100.075% ( 6600, 9900 ] 47 0.004% 100.080% ( 9900, 14000 ] 24 0.002% 100.082% ( 14000, 22000 ] 81 0.007% 100.089% ( 22000, 33000 ] 87 0.008% 100.097% ( 33000, 50000 ] 24 0.002% 100.100% ** Level 5 read latency histogram (micros): Count: 161679 Average: 496.0974 StdDev: 1240.69 Min: 73 Median: 188.9305 Max: 56961 Percentiles: P50: 188.93 P75: 465.56 P99: 4244.88 P99.9: 17863.30 P99.99: 42365.16 ------------------------------------------------------ ( 51, 76 ] 8 0.005% 0.005% ( 76, 110 ] 16996 10.512% 10.517% ## ( 110, 170 ] 57822 35.763% 46.281% ####### ( 170, 250 ] 25413 15.718% 61.999% ### ( 250, 380 ] 14446 8.935% 70.934% ## ( 380, 580 ] 15367 9.505% 80.438% ## ( 580, 870 ] 11876 7.345% 87.784% # ( 870, 1300 ] 7969 4.929% 92.713% # ( 1300, 1900 ] 4072 2.519% 95.231% # ( 1900, 2900 ] 3312 2.049% 97.280% ( 2900, 4400 ] 3102 1.919% 99.198% ( 4400, 6600 ] 945 0.584% 99.783% ( 6600, 9900 ] 139 0.086% 99.869% ( 9900, 14000 ] 17 0.011% 99.879% ( 14000, 22000 ] 69 0.043% 99.922% ( 22000, 33000 ] 90 0.056% 99.978% ( 33000, 50000 ] 36 0.022% 100.000% ( 50000, 75000 ] 6 0.004% 100.004% ** DB Stats ** Uptime(secs): 28.6 total, 5.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 171.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.276 H:M:S, 32.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.423 H:M:S, 27.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 278.578 micros/op 14349 ops/sec 60.142 seconds 862996 operations; 13.9 MB/s (214999 of 214999 found) Microseconds per read: Count: 862996 Average: 278.5804 StdDev: 975.02 Min: 2 Median: 171.9876 Max: 266030 Percentiles: P50: 171.99 P75: 238.40 P99: 1881.45 P99.9: 13941.94 P99.99: 36295.15 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 27 0.003% 0.004% ( 3, 4 ] 52 0.006% 0.010% ( 4, 6 ] 80 0.009% 0.019% ( 6, 10 ] 401 0.046% 0.066% ( 10, 15 ] 3576 0.414% 0.480% ( 15, 22 ] 3972 0.460% 0.940% ( 22, 34 ] 6910 0.801% 1.741% ( 34, 51 ] 1890 0.219% 1.960% ( 51, 76 ] 264 0.031% 1.991% ( 76, 110 ] 22289 2.583% 4.573% # ( 110, 170 ] 385574 44.679% 49.252% ######### ( 170, 250 ] 259891 30.115% 79.367% ###### ( 250, 380 ] 89889 10.416% 89.783% ## ( 380, 580 ] 42516 4.927% 94.709% # ( 580, 870 ] 21585 2.501% 97.210% # ( 870, 1300 ] 10870 1.260% 98.470% ( 1300, 1900 ] 4720 0.547% 99.017% ( 1900, 2900 ] 3260 0.378% 99.395% ( 2900, 4400 ] 2828 0.328% 99.722% ( 4400, 6600 ] 770 0.089% 99.812% ( 6600, 9900 ] 276 0.032% 99.844% ( 9900, 14000 ] 494 0.057% 99.901% ( 14000, 22000 ] 531 0.062% 99.962% ( 22000, 33000 ] 223 0.026% 99.988% ( 33000, 50000 ] 81 0.009% 99.998% ( 50000, 75000 ] 15 0.002% 99.999% ( 75000, 110000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13510436 rocksdb.bloom.filter.full.positive COUNT : 994770 rocksdb.bloom.filter.full.true.positive COUNT : 862588 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 408 rocksdb.memtable.miss COUNT : 862588 rocksdb.l0.hit COUNT : 30076 rocksdb.l1.hit COUNT : 8496 rocksdb.l2andup.hit COUNT : 824016 rocksdb.compaction.key.drop.new COUNT : 289836 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5933503 rocksdb.number.keys.read COUNT : 862996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6123375096 rocksdb.bytes.read COUNT : 862996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1742 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36312995 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27663562983 rocksdb.compact.write.bytes COUNT : 27359500951 rocksdb.flush.write.bytes COUNT : 6077224860 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 1195 rocksdb.number.superversion_releases COUNT : 1163 rocksdb.number.superversion_cleanups COUNT : 299 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 364 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6028325888 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2451456 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31315134187 rocksdb.non.last.level.read.count COUNT : 7424160 rocksdb.block.checksum.compute.count COUNT : 7703915 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 170.233627 P95 : 612.295301 P99 : 1881.024204 P100 : 266028.000000 COUNT : 862996 SUM : 239678701 rocksdb.db.write.micros P50 : 1.589357 P95 : 4.860669 P99 : 9.982900 P100 : 1427741.000000 COUNT : 5933503 SUM : 51980232 rocksdb.compaction.times.micros P50 : 1513157.894737 P95 : 4300000.000000 P99 : 9800000.000000 P100 : 26043980.000000 COUNT : 100 SUM : 205773974 rocksdb.compaction.times.cpu_micros P50 : 964615.384615 P95 : 2900000.000000 P99 : 6500000.000000 P100 : 10676419.000000 COUNT : 100 SUM : 123028086 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 826.891892 P95 : 135500.000000 P99 : 412300.000000 P100 : 528780.000000 COUNT : 83 SUM : 1725221 rocksdb.compaction.outfile.sync.micros P50 : 21478.260870 P95 : 270041.666667 P99 : 476900.000000 P100 : 562726.000000 COUNT : 343 SUM : 21054368 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 250.000000 P95 : 3600.000000 P99 : 5808.000000 P100 : 31009.000000 COUNT : 208 SUM : 203284 rocksdb.table.open.io.micros P50 : 8510.869565 P95 : 20058.149780 P99 : 29637.142857 P100 : 241347.000000 COUNT : 1742 SUM : 15932087 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.835779 P95 : 9.860261 P99 : 166.799479 P100 : 49501.000000 COUNT : 6698181 SUM : 99998755 rocksdb.read.block.get.micros P50 : 141.445296 P95 : 518.862317 P99 : 1792.440728 P100 : 94944.000000 COUNT : 1003985 SUM : 209081252 rocksdb.write.raw.block.micros P50 : 0.529173 P95 : 1.147149 P99 : 3.417595 P100 : 95852.000000 COUNT : 8098605 SUM : 27485978 rocksdb.numfiles.in.singlecompaction P50 : 3.122222 P95 : 6.520000 P99 : 13.650000 P100 : 24.000000 COUNT : 127 SUM : 480 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565327 P95 : 1142.502964 P99 : 2098.043812 P100 : 1427573.000000 COUNT : 210669 SUM : 36335131 rocksdb.sst.read.micros P50 : 1.920244 P95 : 160.580803 P99 : 508.487611 P100 : 90989.000000 COUNT : 7424192 SUM : 290580838 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 862996 SUM : 862996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5933503 SUM : 6123375096 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 231481.481481 P95 : 1053800.000000 P99 : 1609500.000000 P100 : 1677170.000000 COUNT : 83 SUM : 28462392 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 366 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0