[2024-07-12 17:22:55.350142] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-12 17:22:55.350462] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid195998 ] Set seed to 1720797775342965 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 17:22:55.499640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 17:22:55.528953] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 17:22:55.529000] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 195998' to capture a snapshot of events at runtime. [2024-07-12 17:22:55.529015] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid195998 for offline analysis/debug. [2024-07-12 17:22:55.529047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 17:22:56 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/07/12-17:23:03 ... thread 0: (1000000,1000000) ops and (158047.1,158047.1) ops/second in (6.327228,6.327228) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/3 962.14 MB 12.6 0.8 0.0 0.8 1.6 0.8 0.0 1.9 86.4 177.7 8.96 4.41 12 0.747 786K 1277 0.0 0.0 L2 4/2 515.13 MB 2.6 0.5 0.4 0.1 0.5 0.4 0.0 1.1 127.1 126.4 3.86 2.18 1 3.863 441K 0 0.0 0.0 L3 63/11 4.73 GB 3.8 5.2 3.4 1.8 5.1 3.3 0.5 1.5 126.3 125.3 41.97 22.04 21 1.999 2314K 4323 0.0 0.0 L4 193/14 10.31 GB 1.0 0.9 0.6 0.2 0.9 0.6 0.1 1.4 153.7 151.9 5.86 3.18 9 0.651 730K 0 0.0 0.0 L5 1184/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1448/30 106.91 GB 0.0 7.3 4.4 2.9 8.0 5.2 0.6 10.0 123.1 135.7 60.65 31.81 43 1.411 4272K 5600 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 4.4 2.9 8.0 5.2 0.6 10.0 123.1 135.7 60.65 31.81 43 1.411 4272K 5600 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 4.4 2.9 7.2 4.4 0.0 0.0 135.2 134.2 55.23 29.88 33 1.674 4272K 5600 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 151.0 5.42 1.93 10 0.542 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.5 total, 6.3 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.04 GB write, 1260.26 MB/s write, 7.29 GB read, 1143.66 MB/s read, 60.7 seconds Interval compaction: 8.04 GB write, 1300.22 MB/s write, 7.29 GB read, 1179.92 MB/s read, 60.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 212469 Average: 8.7641 StdDev: 155.90 Min: 0 Median: 1.3657 Max: 16823 Percentiles: P50: 1.37 P75: 1.92 P99: 5.78 P99.9: 2123.27 P99.99: 5973.80 ------------------------------------------------------ [ 0, 1 ] 71302 33.559% 33.559% ####### ( 1, 2 ] 95535 44.964% 78.523% ######### ( 2, 3 ] 26077 12.273% 90.796% ## ( 3, 4 ] 13229 6.226% 97.023% # ( 4, 6 ] 4712 2.218% 99.240% ( 6, 10 ] 772 0.363% 99.604% ( 10, 15 ] 26 0.012% 99.616% ( 15, 22 ] 4 0.002% 99.618% ( 22, 34 ] 3 0.001% 99.619% ( 34, 51 ] 10 0.005% 99.624% ( 51, 76 ] 7 0.003% 99.627% ( 76, 110 ] 3 0.001% 99.629% ( 110, 170 ] 5 0.002% 99.631% ( 170, 250 ] 8 0.004% 99.635% ( 250, 380 ] 28 0.013% 99.648% ( 380, 580 ] 64 0.030% 99.678% ( 580, 870 ] 162 0.076% 99.754% ( 870, 1300 ] 186 0.088% 99.842% ( 1300, 1900 ] 105 0.049% 99.891% ( 1900, 2900 ] 83 0.039% 99.930% ( 2900, 4400 ] 101 0.048% 99.978% ( 4400, 6600 ] 36 0.017% 99.995% ( 6600, 9900 ] 13 0.006% 100.001% ( 9900, 14000 ] 2 0.001% 100.002% ( 14000, 22000 ] 3 0.001% 100.003% ** Level 1 read latency histogram (micros): Count: 110361 Average: 13.9440 StdDev: 260.05 Min: 1 Median: 1.6884 Max: 23120 Percentiles: P50: 1.69 P75: 2.59 P99: 9.57 P99.9: 3254.92 P99.99: 13975.33 ------------------------------------------------------ [ 0, 1 ] 17385 15.753% 15.753% ### ( 1, 2 ] 54903 49.749% 65.501% ########## ( 2, 3 ] 17678 16.018% 81.520% ### ( 3, 4 ] 10480 9.496% 91.016% ## ( 4, 6 ] 7003 6.346% 97.361% # ( 6, 10 ] 2028 1.838% 99.199% ( 10, 15 ] 201 0.182% 99.381% ( 15, 22 ] 53 0.048% 99.429% ( 22, 34 ] 27 0.024% 99.454% ( 34, 51 ] 14 0.013% 99.466% ( 51, 76 ] 11 0.010% 99.476% ( 76, 110 ] 8 0.007% 99.484% ( 110, 170 ] 10 0.009% 99.493% ( 170, 250 ] 10 0.009% 99.502% ( 250, 380 ] 30 0.027% 99.529% ( 380, 580 ] 64 0.058% 99.587% ( 580, 870 ] 81 0.073% 99.660% ( 870, 1300 ] 73 0.066% 99.726% ( 1300, 1900 ] 71 0.064% 99.791% ( 1900, 2900 ] 101 0.092% 99.882% ( 2900, 4400 ] 83 0.075% 99.957% ( 4400, 6600 ] 25 0.023% 99.980% ( 6600, 9900 ] 5 0.005% 99.985% ( 9900, 14000 ] 6 0.005% 99.990% ( 14000, 22000 ] 9 0.008% 99.998% ( 22000, 33000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 793261 Average: 13.0694 StdDev: 247.83 Min: 0 Median: 1.6073 Max: 35882 Percentiles: P50: 1.61 P75: 2.42 P99: 9.06 P99.9: 2708.10 P99.99: 4267.44 ------------------------------------------------------ [ 0, 1 ] 167191 21.076% 21.076% #### ( 1, 2 ] 377831 47.630% 68.707% ########## ( 2, 3 ] 118499 14.938% 83.645% ### ( 3, 4 ] 70244 8.855% 92.500% ## ( 4, 6 ] 42483 5.355% 97.855% # ( 6, 10 ] 11865 1.496% 99.351% ( 10, 15 ] 1157 0.146% 99.497% ( 15, 22 ] 278 0.035% 99.532% ( 22, 34 ] 135 0.017% 99.549% ( 34, 51 ] 66 0.008% 99.557% ( 51, 76 ] 53 0.007% 99.564% ( 76, 110 ] 37 0.005% 99.569% ( 110, 170 ] 59 0.007% 99.576% ( 170, 250 ] 67 0.008% 99.584% ( 250, 380 ] 163 0.021% 99.605% ( 380, 580 ] 356 0.045% 99.650% ( 580, 870 ] 506 0.064% 99.714% ( 870, 1300 ] 549 0.069% 99.783% ( 1300, 1900 ] 456 0.057% 99.840% ( 1900, 2900 ] 585 0.074% 99.914% ( 2900, 4400 ] 660 0.083% 99.997% ( 4400, 6600 ] 215 0.027% 100.024% ( 6600, 9900 ] 71 0.009% 100.033% ( 9900, 14000 ] 22 0.003% 100.036% ( 14000, 22000 ] 23 0.003% 100.039% ( 22000, 33000 ] 17 0.002% 100.041% ( 33000, 50000 ] 4 0.001% 100.042% ** Level 3 read latency histogram (micros): Count: 716142 Average: 10.6085 StdDev: 200.83 Min: 0 Median: 1.4850 Max: 39500 Percentiles: P50: 1.48 P75: 2.09 P99: 7.06 P99.9: 2538.95 P99.99: 4256.09 ------------------------------------------------------ [ 0, 1 ] 198165 27.671% 27.671% ###### ( 1, 2 ] 329738 46.044% 73.715% ######### ( 2, 3 ] 100456 14.027% 87.742% ### ( 3, 4 ] 55505 7.751% 95.493% ## ( 4, 6 ] 23769 3.319% 98.812% # ( 6, 10 ] 5087 0.710% 99.522% ( 10, 15 ] 468 0.065% 99.588% ( 15, 22 ] 104 0.015% 99.602% ( 22, 34 ] 59 0.008% 99.610% ( 34, 51 ] 67 0.009% 99.620% ( 51, 76 ] 43 0.006% 99.626% ( 76, 110 ] 24 0.003% 99.629% ( 110, 170 ] 40 0.006% 99.635% ( 170, 250 ] 59 0.008% 99.643% ( 250, 380 ] 86 0.012% 99.655% ( 380, 580 ] 225 0.031% 99.686% ( 580, 870 ] 406 0.057% 99.743% ( 870, 1300 ] 495 0.069% 99.812% ( 1300, 1900 ] 351 0.049% 99.861% ( 1900, 2900 ] 438 0.061% 99.922% ( 2900, 4400 ] 538 0.075% 99.997% ( 4400, 6600 ] 153 0.021% 100.019% ( 6600, 9900 ] 37 0.005% 100.024% ( 9900, 14000 ] 8 0.001% 100.025% ( 14000, 22000 ] 10 0.001% 100.026% ( 22000, 33000 ] 8 0.001% 100.028% ( 33000, 50000 ] 1 0.000% 100.028% ** Level 4 read latency histogram (micros): Count: 98062 Average: 49.1209 StdDev: 539.37 Min: 0 Median: 1.4065 Max: 59645 Percentiles: P50: 1.41 P75: 1.99 P99: 1387.55 P99.9: 5194.89 P99.99: 9779.07 ------------------------------------------------------ [ 0, 1 ] 32085 32.719% 32.719% ####### ( 1, 2 ] 41695 42.519% 75.238% ######### ( 2, 3 ] 13044 13.302% 88.540% ### ( 3, 4 ] 5831 5.946% 94.486% # ( 4, 6 ] 2138 2.180% 96.666% ( 6, 10 ] 507 0.517% 97.183% ( 10, 15 ] 39 0.040% 97.223% ( 15, 22 ] 7 0.007% 97.230% ( 22, 34 ] 1 0.001% 97.231% ( 34, 51 ] 8 0.008% 97.240% ( 51, 76 ] 8 0.008% 97.248% ( 76, 110 ] 8 0.008% 97.256% ( 110, 170 ] 37 0.038% 97.294% ( 170, 250 ] 68 0.069% 97.363% ( 250, 380 ] 178 0.182% 97.544% ( 380, 580 ] 329 0.336% 97.880% ( 580, 870 ] 579 0.590% 98.470% ( 870, 1300 ] 476 0.485% 98.956% ( 1300, 1900 ] 311 0.317% 99.273% ( 1900, 2900 ] 279 0.285% 99.557% ( 2900, 4400 ] 300 0.306% 99.863% ( 4400, 6600 ] 105 0.107% 99.970% ( 6600, 9900 ] 22 0.022% 99.993% ( 14000, 22000 ] 5 0.005% 99.998% ( 22000, 33000 ] 9 0.009% 100.007% ( 33000, 50000 ] 3 0.003% 100.010% ( 50000, 75000 ] 2 0.002% 100.012% ** Level 5 read latency histogram (micros): Count: 9760 Average: 1779.5353 StdDev: 2808.31 Min: 103 Median: 1110.5200 Max: 65210 Percentiles: P50: 1110.52 P75: 2269.54 P99: 7929.71 P99.9: 48005.33 P99.99: 65210.00 ------------------------------------------------------ ( 76, 110 ] 2 0.020% 0.020% ( 110, 170 ] 63 0.645% 0.666% ( 170, 250 ] 193 1.977% 2.643% ( 250, 380 ] 534 5.471% 8.115% # ( 380, 580 ] 1175 12.039% 20.154% ## ( 580, 870 ] 1848 18.934% 39.088% #### ( 870, 1300 ] 1904 19.508% 58.596% #### ( 1300, 1900 ] 1220 12.500% 71.096% ## ( 1900, 2900 ] 1031 10.564% 81.660% ## ( 2900, 4400 ] 1221 12.510% 94.170% ### ( 4400, 6600 ] 444 4.549% 98.719% # ( 6600, 9900 ] 68 0.697% 99.416% ( 9900, 14000 ] 7 0.072% 99.488% ( 14000, 22000 ] 10 0.102% 99.590% ( 22000, 33000 ] 17 0.174% 99.764% ( 33000, 50000 ] 15 0.154% 99.918% ( 50000, 75000 ] 8 0.082% 100.000% ** DB Stats ** Uptime(secs): 6.5 total, 6.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 150.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.949 H:M:S, 29.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.949 H:M:S, 30.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-17:23:09 ... thread 0: (1000000,2000000) ops and (172673.9,165037.0) ops/second in (5.791263,12.118491) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 1.11 GB 18.9 1.4 0.0 1.4 3.2 1.8 0.0 1.8 81.9 183.7 17.92 8.49 26 0.689 1489K 2181 0.0 0.0 L1 3/3 263.17 MB 0.0 0.8 0.8 0.0 0.8 0.8 0.0 1.0 193.9 193.4 4.31 2.77 1 4.312 849K 1950 0.0 0.0 L2 3/1 386.32 MB 2.6 0.5 0.4 0.1 0.5 0.4 0.6 1.1 127.1 126.4 3.86 2.18 1 3.863 441K 0 0.0 0.0 L3 27/12 1.81 GB 1.0 6.3 3.9 2.4 6.2 3.9 0.6 1.6 130.9 129.9 49.11 25.85 26 1.889 3184K 5340 0.0 0.0 L4 213/25 11.85 GB 1.1 7.3 4.2 3.2 7.2 4.0 0.2 1.7 163.6 160.1 45.93 24.96 52 0.883 4569K 0 0.0 0.0 L5 1208/0 92.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1461/46 107.74 GB 0.0 16.3 9.3 7.0 17.9 10.9 3.2 10.0 138.2 151.5 121.13 64.25 106 1.143 10M 9471 0.0 0.0 Int 0/0 0.00 KB 0.0 16.3 9.3 7.0 17.9 10.9 3.2 10.0 138.2 151.5 121.13 64.25 106 1.143 10M 9471 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.3 9.3 7.0 16.1 9.1 0.0 0.0 152.5 150.5 109.74 60.23 84 1.306 10M 9471 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 160.4 11.39 4.02 22 0.518 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.92 GB write, 1489.05 MB/s write, 16.35 GB read, 1358.47 MB/s read, 121.1 seconds Interval compaction: 17.92 GB write, 1513.71 MB/s write, 16.35 GB read, 1380.96 MB/s read, 121.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 53, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 619563 Average: 9.0212 StdDev: 147.42 Min: 0 Median: 1.3752 Max: 16823 Percentiles: P50: 1.38 P75: 1.93 P99: 5.94 P99.9: 1837.40 P99.99: 4150.20 ------------------------------------------------------ [ 0, 1 ] 205386 33.150% 33.150% ####### ( 1, 2 ] 278255 44.911% 78.062% ######### ( 2, 3 ] 77217 12.463% 90.525% ## ( 3, 4 ] 38649 6.238% 96.763% # ( 4, 6 ] 14313 2.310% 99.073% ( 6, 10 ] 2894 0.467% 99.540% ( 10, 15 ] 158 0.026% 99.566% ( 15, 22 ] 15 0.002% 99.568% ( 22, 34 ] 21 0.003% 99.571% ( 34, 51 ] 65 0.010% 99.582% ( 51, 76 ] 26 0.004% 99.586% ( 76, 110 ] 10 0.002% 99.588% ( 110, 170 ] 14 0.002% 99.590% ( 170, 250 ] 23 0.004% 99.594% ( 250, 380 ] 125 0.020% 99.614% ( 380, 580 ] 375 0.061% 99.674% ( 580, 870 ] 646 0.104% 99.779% ( 870, 1300 ] 532 0.086% 99.865% ( 1300, 1900 ] 245 0.040% 99.904% ( 1900, 2900 ] 262 0.042% 99.946% ( 2900, 4400 ] 324 0.052% 99.999% ( 4400, 6600 ] 118 0.019% 100.018% ( 6600, 9900 ] 25 0.004% 100.022% ( 9900, 14000 ] 4 0.001% 100.022% ( 14000, 22000 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 189774 Average: 12.5180 StdDev: 230.24 Min: 0 Median: 1.5745 Max: 23120 Percentiles: P50: 1.57 P75: 2.32 P99: 9.09 P99.9: 3051.44 P99.99: 9254.92 ------------------------------------------------------ [ 0, 1 ] 42865 22.587% 22.587% ##### ( 1, 2 ] 90547 47.713% 70.300% ########## ( 2, 3 ] 27977 14.742% 85.043% ### ( 3, 4 ] 15518 8.177% 93.220% ## ( 4, 6 ] 9058 4.773% 97.993% # ( 6, 10 ] 2476 1.305% 99.298% ( 10, 15 ] 236 0.124% 99.422% ( 15, 22 ] 57 0.030% 99.452% ( 22, 34 ] 32 0.017% 99.469% ( 34, 51 ] 35 0.018% 99.487% ( 51, 76 ] 18 0.009% 99.497% ( 76, 110 ] 8 0.004% 99.501% ( 110, 170 ] 13 0.007% 99.508% ( 170, 250 ] 12 0.006% 99.514% ( 250, 380 ] 45 0.024% 99.538% ( 380, 580 ] 109 0.057% 99.595% ( 580, 870 ] 170 0.090% 99.685% ( 870, 1300 ] 132 0.070% 99.754% ( 1300, 1900 ] 125 0.066% 99.820% ( 1900, 2900 ] 138 0.073% 99.893% ( 2900, 4400 ] 131 0.069% 99.962% ( 4400, 6600 ] 49 0.026% 99.988% ( 6600, 9900 ] 5 0.003% 99.991% ( 9900, 14000 ] 7 0.004% 99.994% ( 14000, 22000 ] 11 0.006% 100.000% ( 22000, 33000 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 950078 Average: 12.5977 StdDev: 235.08 Min: 0 Median: 1.5772 Max: 35882 Percentiles: P50: 1.58 P75: 2.34 P99: 8.94 P99.9: 2746.83 P99.99: 4347.86 ------------------------------------------------------ [ 0, 1 ] 216349 22.772% 22.772% ##### ( 1, 2 ] 448162 47.171% 69.943% ######### ( 2, 3 ] 139279 14.660% 84.603% ### ( 3, 4 ] 80547 8.478% 93.080% ## ( 4, 6 ] 46772 4.923% 98.003% # ( 6, 10 ] 12881 1.356% 99.359% ( 10, 15 ] 1255 0.132% 99.491% ( 15, 22 ] 288 0.030% 99.522% ( 22, 34 ] 151 0.016% 99.538% ( 34, 51 ] 128 0.013% 99.551% ( 51, 76 ] 70 0.007% 99.558% ( 76, 110 ] 40 0.004% 99.563% ( 110, 170 ] 62 0.007% 99.569% ( 170, 250 ] 70 0.007% 99.576% ( 250, 380 ] 198 0.021% 99.597% ( 380, 580 ] 464 0.049% 99.646% ( 580, 870 ] 666 0.070% 99.716% ( 870, 1300 ] 660 0.069% 99.786% ( 1300, 1900 ] 505 0.053% 99.839% ( 1900, 2900 ] 686 0.072% 99.911% ( 2900, 4400 ] 777 0.082% 99.993% ( 4400, 6600 ] 254 0.027% 100.020% ( 6600, 9900 ] 77 0.008% 100.028% ( 9900, 14000 ] 22 0.002% 100.030% ( 14000, 22000 ] 23 0.002% 100.032% ( 22000, 33000 ] 17 0.002% 100.034% ( 33000, 50000 ] 4 0.000% 100.035% ** Level 3 read latency histogram (micros): Count: 1598018 Average: 10.0662 StdDev: 181.22 Min: 0 Median: 1.4470 Max: 44123 Percentiles: P50: 1.45 P75: 2.00 P99: 6.87 P99.9: 2397.21 P99.99: 4218.12 ------------------------------------------------------ [ 0, 1 ] 473838 29.652% 29.652% ###### ( 1, 2 ] 727480 45.524% 75.175% ######### ( 2, 3 ] 216434 13.544% 88.719% ### ( 3, 4 ] 114879 7.189% 95.908% # ( 4, 6 ] 47204 2.954% 98.862% # ( 6, 10 ] 10160 0.636% 99.498% ( 10, 15 ] 971 0.061% 99.559% ( 15, 22 ] 177 0.011% 99.570% ( 22, 34 ] 140 0.009% 99.579% ( 34, 51 ] 244 0.015% 99.594% ( 51, 76 ] 97 0.006% 99.600% ( 76, 110 ] 45 0.003% 99.603% ( 110, 170 ] 57 0.004% 99.606% ( 170, 250 ] 103 0.006% 99.613% ( 250, 380 ] 281 0.018% 99.630% ( 380, 580 ] 815 0.051% 99.681% ( 580, 870 ] 1261 0.079% 99.760% ( 870, 1300 ] 1104 0.069% 99.829% ( 1300, 1900 ] 681 0.043% 99.872% ( 1900, 2900 ] 903 0.057% 99.928% ( 2900, 4400 ] 1120 0.070% 99.998% ( 4400, 6600 ] 324 0.020% 100.019% ( 6600, 9900 ] 80 0.005% 100.024% ( 9900, 14000 ] 12 0.001% 100.025% ( 14000, 22000 ] 11 0.001% 100.025% ( 22000, 33000 ] 11 0.001% 100.026% ( 33000, 50000 ] 2 0.000% 100.026% ** Level 4 read latency histogram (micros): Count: 963324 Average: 17.9056 StdDev: 259.44 Min: 0 Median: 1.4105 Max: 59645 Percentiles: P50: 1.41 P75: 1.97 P99: 345.57 P99.9: 3304.66 P99.99: 5126.89 ------------------------------------------------------ [ 0, 1 ] 306087 31.774% 31.774% ###### ( 1, 2 ] 427749 44.403% 76.177% ######### ( 2, 3 ] 126595 13.141% 89.319% ### ( 3, 4 ] 60931 6.325% 95.644% # ( 4, 6 ] 24714 2.565% 98.210% # ( 6, 10 ] 5959 0.619% 98.828% ( 10, 15 ] 447 0.046% 98.875% ( 15, 22 ] 52 0.005% 98.880% ( 22, 34 ] 80 0.008% 98.888% ( 34, 51 ] 223 0.023% 98.911% ( 51, 76 ] 70 0.007% 98.919% ( 76, 110 ] 45 0.005% 98.923% ( 110, 170 ] 131 0.014% 98.937% ( 170, 250 ] 150 0.016% 98.952% ( 250, 380 ] 624 0.065% 99.017% ( 380, 580 ] 1735 0.180% 99.197% ( 580, 870 ] 2778 0.288% 99.486% ( 870, 1300 ] 1907 0.198% 99.684% ( 1300, 1900 ] 871 0.090% 99.774% ( 1900, 2900 ] 935 0.097% 99.871% ( 2900, 4400 ] 1033 0.107% 99.978% ( 4400, 6600 ] 341 0.035% 100.014% ( 6600, 9900 ] 49 0.005% 100.019% ( 9900, 14000 ] 6 0.001% 100.020% ( 14000, 22000 ] 7 0.001% 100.020% ( 22000, 33000 ] 14 0.001% 100.022% ( 33000, 50000 ] 5 0.001% 100.022% ( 50000, 75000 ] 3 0.000% 100.023% ** Level 5 read latency histogram (micros): Count: 23457 Average: 1500.5853 StdDev: 2143.54 Min: 103 Median: 897.3663 Max: 65210 Percentiles: P50: 897.37 P75: 1766.47 P99: 6482.19 P99.9: 35401.72 P99.99: 65210.00 ------------------------------------------------------ ( 76, 110 ] 2 0.009% 0.009% ( 110, 170 ] 68 0.290% 0.298% ( 170, 250 ] 339 1.445% 1.744% ( 250, 380 ] 1457 6.211% 7.955% # ( 380, 580 ] 3817 16.272% 24.227% ### ( 580, 870 ] 5760 24.556% 48.783% ##### ( 870, 1300 ] 4486 19.124% 67.907% #### ( 1300, 1900 ] 2140 9.123% 77.030% ## ( 1900, 2900 ] 1909 8.138% 85.169% ## ( 2900, 4400 ] 2386 10.172% 95.340% ## ( 4400, 6600 ] 907 3.867% 99.207% # ( 6600, 9900 ] 121 0.516% 99.723% ( 9900, 14000 ] 10 0.043% 99.766% ( 14000, 22000 ] 11 0.047% 99.812% ( 22000, 33000 ] 18 0.077% 99.889% ( 33000, 50000 ] 18 0.077% 99.966% ( 50000, 75000 ] 9 0.038% 100.004% ** DB Stats ** Uptime(secs): 12.3 total, 5.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 159.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.213 H:M:S, 34.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.264 H:M:S, 39.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-17:23:12 ... thread 0: (1000000,3000000) ops and (274871.4,190396.9) ops/second in (3.638065,15.756556) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.09 GB 94.4 2.3 0.0 2.3 5.1 2.8 0.0 1.8 97.4 214.9 24.11 13.18 44 0.548 2385K 3229 0.0 0.0 L1 3/3 263.17 MB 0.0 0.8 0.8 0.0 0.8 0.8 0.0 1.0 193.9 193.4 4.31 2.77 1 4.312 849K 1950 0.0 0.0 L2 0/0 0.00 KB 0.0 0.5 0.4 0.1 0.5 0.4 0.6 1.1 127.1 126.4 3.86 2.18 1 3.863 441K 0 0.0 0.0 L3 17/0 989.66 MB 1.0 7.2 4.3 2.9 7.2 4.3 0.6 1.7 138.0 137.0 53.62 29.08 29 1.849 3777K 5347 0.0 0.0 L4 186/0 9.64 GB 1.0 10.1 5.1 5.0 9.8 4.8 0.5 1.9 169.0 164.8 60.96 34.16 66 0.924 5779K 3084 0.0 0.0 L5 1252/0 95.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1471/12 108.63 GB 0.0 20.9 10.6 10.2 23.3 13.1 6.9 8.4 145.6 162.7 146.86 81.37 141 1.042 13M 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.9 10.6 10.2 23.3 13.1 6.9 8.4 145.6 162.7 146.86 81.37 141 1.042 13M 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.9 10.6 10.2 20.6 10.3 0.0 0.0 162.0 159.6 131.95 75.14 104 1.269 13M 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 190.1 14.91 6.23 37 0.403 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.0 total, 15.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.33 GB write, 1497.16 MB/s write, 20.88 GB read, 1339.54 MB/s read, 146.9 seconds Interval compaction: 23.33 GB write, 1516.23 MB/s write, 20.88 GB read, 1356.60 MB/s read, 146.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1052027 Average: 7.3521 StdDev: 119.61 Min: 0 Median: 1.3050 Max: 16823 Percentiles: P50: 1.31 P75: 1.87 P99: 5.97 P99.9: 1032.11 P99.99: 2729.55 ------------------------------------------------------ [ 0, 1 ] 384475 36.546% 36.546% ####### ( 1, 2 ] 464061 44.111% 80.657% ######### ( 2, 3 ] 116572 11.081% 91.738% ## ( 3, 4 ] 55299 5.256% 96.994% # ( 4, 6 ] 21434 2.037% 99.032% ( 6, 10 ] 4491 0.427% 99.459% ( 10, 15 ] 453 0.043% 99.502% ( 15, 22 ] 86 0.008% 99.510% ( 22, 34 ] 66 0.006% 99.516% ( 34, 51 ] 110 0.010% 99.527% ( 51, 76 ] 31 0.003% 99.530% ( 76, 110 ] 26 0.002% 99.532% ( 110, 170 ] 222 0.021% 99.553% ( 170, 250 ] 463 0.044% 99.597% ( 250, 380 ] 1087 0.103% 99.700% ( 380, 580 ] 942 0.090% 99.790% ( 580, 870 ] 929 0.088% 99.878% ( 870, 1300 ] 610 0.058% 99.936% ( 1300, 1900 ] 303 0.029% 99.965% ( 1900, 2900 ] 318 0.030% 99.995% ( 2900, 4400 ] 361 0.034% 100.030% ( 4400, 6600 ] 126 0.012% 100.042% ( 6600, 9900 ] 25 0.002% 100.044% ( 9900, 14000 ] 4 0.000% 100.044% ( 14000, 22000 ] 3 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 277315 Average: 10.6214 StdDev: 197.43 Min: 0 Median: 1.5081 Max: 23120 Percentiles: P50: 1.51 P75: 2.14 P99: 8.69 P99.9: 2603.38 P99.99: 6347.81 ------------------------------------------------------ [ 0, 1 ] 72583 26.173% 26.173% ##### ( 1, 2 ] 130038 46.892% 73.065% ######### ( 2, 3 ] 38263 13.798% 86.863% ### ( 3, 4 ] 20417 7.362% 94.225% # ( 4, 6 ] 11222 4.047% 98.272% # ( 6, 10 ] 2997 1.081% 99.353% ( 10, 15 ] 258 0.093% 99.446% ( 15, 22 ] 62 0.022% 99.468% ( 22, 34 ] 34 0.012% 99.480% ( 34, 51 ] 37 0.013% 99.494% ( 51, 76 ] 21 0.008% 99.501% ( 76, 110 ] 9 0.003% 99.505% ( 110, 170 ] 33 0.012% 99.516% ( 170, 250 ] 44 0.016% 99.532% ( 250, 380 ] 132 0.048% 99.580% ( 380, 580 ] 189 0.068% 99.648% ( 580, 870 ] 249 0.090% 99.738% ( 870, 1300 ] 177 0.064% 99.802% ( 1300, 1900 ] 151 0.054% 99.856% ( 1900, 2900 ] 173 0.062% 99.919% ( 2900, 4400 ] 154 0.056% 99.974% ( 4400, 6600 ] 50 0.018% 99.992% ( 6600, 9900 ] 6 0.002% 99.994% ( 9900, 14000 ] 7 0.003% 99.997% ( 14000, 22000 ] 11 0.004% 100.001% ( 22000, 33000 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 982791 Average: 12.3719 StdDev: 231.71 Min: 0 Median: 1.5686 Max: 35882 Percentiles: P50: 1.57 P75: 2.33 P99: 8.89 P99.9: 2716.01 P99.99: 4342.22 ------------------------------------------------------ [ 0, 1 ] 228894 23.290% 23.290% ##### ( 1, 2 ] 461647 46.973% 70.263% ######### ( 2, 3 ] 143127 14.563% 84.827% ### ( 3, 4 ] 82303 8.374% 93.201% ## ( 4, 6 ] 47519 4.835% 98.036% # ( 6, 10 ] 13097 1.333% 99.369% ( 10, 15 ] 1269 0.129% 99.498% ( 15, 22 ] 288 0.029% 99.527% ( 22, 34 ] 152 0.015% 99.543% ( 34, 51 ] 135 0.014% 99.556% ( 51, 76 ] 71 0.007% 99.564% ( 76, 110 ] 40 0.004% 99.568% ( 110, 170 ] 62 0.006% 99.574% ( 170, 250 ] 72 0.007% 99.581% ( 250, 380 ] 205 0.021% 99.602% ( 380, 580 ] 479 0.049% 99.651% ( 580, 870 ] 689 0.070% 99.721% ( 870, 1300 ] 666 0.068% 99.789% ( 1300, 1900 ] 522 0.053% 99.842% ( 1900, 2900 ] 700 0.071% 99.913% ( 2900, 4400 ] 786 0.080% 99.993% ( 4400, 6600 ] 254 0.026% 100.019% ( 6600, 9900 ] 77 0.008% 100.027% ( 9900, 14000 ] 22 0.002% 100.029% ( 14000, 22000 ] 23 0.002% 100.031% ( 22000, 33000 ] 17 0.002% 100.033% ( 33000, 50000 ] 4 0.000% 100.033% ** Level 3 read latency histogram (micros): Count: 1884383 Average: 9.3269 StdDev: 169.82 Min: 0 Median: 1.4354 Max: 44123 Percentiles: P50: 1.44 P75: 1.98 P99: 6.60 P99.9: 2167.10 P99.99: 4158.82 ------------------------------------------------------ [ 0, 1 ] 568780 30.184% 30.184% ###### ( 1, 2 ] 857680 45.515% 75.699% ######### ( 2, 3 ] 252037 13.375% 89.074% ### ( 3, 4 ] 131803 6.994% 96.069% # ( 4, 6 ] 53524 2.840% 98.909% # ( 6, 10 ] 11406 0.605% 99.514% ( 10, 15 ] 1077 0.057% 99.571% ( 15, 22 ] 197 0.010% 99.582% ( 22, 34 ] 155 0.008% 99.590% ( 34, 51 ] 280 0.015% 99.605% ( 51, 76 ] 114 0.006% 99.611% ( 76, 110 ] 52 0.003% 99.614% ( 110, 170 ] 85 0.005% 99.618% ( 170, 250 ] 179 0.009% 99.628% ( 250, 380 ] 462 0.025% 99.652% ( 380, 580 ] 1039 0.055% 99.707% ( 580, 870 ] 1464 0.078% 99.785% ( 870, 1300 ] 1161 0.062% 99.847% ( 1300, 1900 ] 744 0.039% 99.886% ( 1900, 2900 ] 972 0.052% 99.938% ( 2900, 4400 ] 1172 0.062% 100.000% ( 4400, 6600 ] 337 0.018% 100.018% ( 6600, 9900 ] 81 0.004% 100.022% ( 9900, 14000 ] 12 0.001% 100.023% ( 14000, 22000 ] 11 0.001% 100.023% ( 22000, 33000 ] 11 0.001% 100.024% ( 33000, 50000 ] 2 0.000% 100.024% ** Level 4 read latency histogram (micros): Count: 1299071 Average: 16.1954 StdDev: 232.79 Min: 0 Median: 1.4022 Max: 59645 Percentiles: P50: 1.40 P75: 1.97 P99: 293.84 P99.9: 2941.86 P99.99: 4530.31 ------------------------------------------------------ [ 0, 1 ] 418868 32.244% 32.244% ###### ( 1, 2 ] 573508 44.148% 76.391% ######### ( 2, 3 ] 168293 12.955% 89.346% ### ( 3, 4 ] 81221 6.252% 95.598% # ( 4, 6 ] 32979 2.539% 98.137% # ( 6, 10 ] 8220 0.633% 98.770% ( 10, 15 ] 594 0.046% 98.815% ( 15, 22 ] 78 0.006% 98.821% ( 22, 34 ] 110 0.008% 98.830% ( 34, 51 ] 277 0.021% 98.851% ( 51, 76 ] 80 0.006% 98.857% ( 76, 110 ] 66 0.005% 98.862% ( 110, 170 ] 415 0.032% 98.894% ( 170, 250 ] 738 0.057% 98.951% ( 250, 380 ] 1878 0.145% 99.096% ( 380, 580 ] 2765 0.213% 99.309% ( 580, 870 ] 3365 0.259% 99.568% ( 870, 1300 ] 2142 0.165% 99.733% ( 1300, 1900 ] 1014 0.078% 99.811% ( 1900, 2900 ] 1128 0.087% 99.897% ( 2900, 4400 ] 1180 0.091% 99.988% ( 4400, 6600 ] 373 0.029% 100.017% ( 6600, 9900 ] 56 0.004% 100.021% ( 9900, 14000 ] 6 0.000% 100.022% ( 14000, 22000 ] 7 0.001% 100.022% ( 22000, 33000 ] 14 0.001% 100.023% ( 33000, 50000 ] 5 0.000% 100.024% ( 50000, 75000 ] 3 0.000% 100.024% ** Level 5 read latency histogram (micros): Count: 42791 Average: 1063.4701 StdDev: 1711.07 Min: 85 Median: 604.2518 Max: 65210 Percentiles: P50: 604.25 P75: 1131.60 P99: 6069.87 P99.9: 22738.83 P99.99: 60335.83 ------------------------------------------------------ ( 76, 110 ] 144 0.337% 0.337% ( 110, 170 ] 1400 3.272% 3.608% # ( 170, 250 ] 3197 7.471% 11.079% # ( 250, 380 ] 7605 17.772% 28.852% #### ( 380, 580 ] 8362 19.541% 48.393% #### ( 580, 870 ] 8233 19.240% 67.633% #### ( 870, 1300 ] 5183 12.112% 79.746% ## ( 1300, 1900 ] 2455 5.737% 85.483% # ( 1900, 2900 ] 2329 5.443% 90.926% # ( 2900, 4400 ] 2713 6.340% 97.266% # ( 4400, 6600 ] 979 2.288% 99.554% ( 6600, 9900 ] 127 0.297% 99.850% ( 9900, 14000 ] 10 0.023% 99.874% ( 14000, 22000 ] 11 0.026% 99.900% ( 22000, 33000 ] 18 0.042% 99.942% ( 33000, 50000 ] 18 0.042% 99.984% ( 50000, 75000 ] 9 0.021% 100.005% ** DB Stats ** Uptime(secs): 16.0 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 185.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.612 H:M:S, 28.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.399 H:M:S, 11.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-17:23:15 ... thread 0: (1000000,4000000) ops and (323550.0,212232.4) ops/second in (3.090712,18.847268) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.15 GB 12.6 3.0 0.0 3.0 6.8 3.7 0.0 1.8 106.2 237.5 29.24 17.75 63 0.464 3153K 3952 0.0 0.0 L1 8/8 792.41 MB 0.0 2.0 1.7 0.3 2.0 1.7 0.0 1.1 208.4 207.6 9.80 6.98 2 4.902 2074K 7722 0.0 0.0 L2 1/0 46.97 MB 0.5 0.5 0.4 0.1 0.5 0.4 1.0 1.1 127.1 126.4 3.86 2.18 1 3.863 441K 0 0.0 0.0 L3 16/0 948.36 MB 0.9 7.7 4.5 3.1 7.6 4.5 0.7 1.7 142.1 141.1 55.29 30.64 31 1.784 4243K 7218 0.0 0.0 L4 188/0 9.76 GB 1.0 11.1 5.5 5.6 10.8 5.2 0.5 2.0 173.5 169.3 65.33 37.72 72 0.907 6586K 7432 0.0 0.0 L5 1256/0 95.93 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1484/21 109.58 GB 0.0 24.3 12.2 12.1 27.7 15.6 7.6 7.4 151.9 173.2 163.53 95.27 169 0.968 16M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 12.2 12.1 27.7 15.6 7.6 7.4 151.9 173.2 163.53 95.27 169 0.968 16M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 12.2 12.1 23.9 11.8 0.0 0.0 170.5 168.1 145.66 86.60 116 1.256 16M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 215.1 17.87 8.67 53 0.337 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 18.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.66 GB write, 1486.99 MB/s write, 24.25 GB read, 1303.56 MB/s read, 163.5 seconds Interval compaction: 27.66 GB write, 1502.82 MB/s write, 24.25 GB read, 1317.43 MB/s read, 163.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1351520 Average: 6.6941 StdDev: 107.53 Min: 0 Median: 1.2604 Max: 16823 Percentiles: P50: 1.26 P75: 1.83 P99: 5.98 P99.9: 837.43 P99.99: 2297.68 ------------------------------------------------------ [ 0, 1 ] 521496 38.586% 38.586% ######## ( 1, 2 ] 592397 43.832% 82.418% ######### ( 2, 3 ] 137793 10.195% 92.613% ## ( 3, 4 ] 62094 4.594% 97.208% # ( 4, 6 ] 24409 1.806% 99.014% ( 6, 10 ] 5365 0.397% 99.411% ( 10, 15 ] 723 0.053% 99.464% ( 15, 22 ] 125 0.009% 99.473% ( 22, 34 ] 102 0.008% 99.481% ( 34, 51 ] 113 0.008% 99.489% ( 51, 76 ] 33 0.002% 99.492% ( 76, 110 ] 43 0.003% 99.495% ( 110, 170 ] 386 0.029% 99.523% ( 170, 250 ] 784 0.058% 99.581% ( 250, 380 ] 1919 0.142% 99.723% ( 380, 580 ] 1419 0.105% 99.828% ( 580, 870 ] 1091 0.081% 99.909% ( 870, 1300 ] 649 0.048% 99.957% ( 1300, 1900 ] 316 0.023% 99.981% ( 1900, 2900 ] 324 0.024% 100.005% ( 2900, 4400 ] 370 0.027% 100.032% ( 4400, 6600 ] 127 0.009% 100.041% ( 6600, 9900 ] 26 0.002% 100.043% ( 9900, 14000 ] 4 0.000% 100.044% ( 14000, 22000 ] 3 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 365437 Average: 9.0383 StdDev: 172.75 Min: 0 Median: 1.4546 Max: 23120 Percentiles: P50: 1.45 P75: 1.99 P99: 8.69 P99.9: 2055.72 P99.99: 5520.08 ------------------------------------------------------ [ 0, 1 ] 105110 28.763% 28.763% ###### ( 1, 2 ] 170704 46.712% 75.475% ######### ( 2, 3 ] 46418 12.702% 88.177% ### ( 3, 4 ] 23989 6.564% 94.742% # ( 4, 6 ] 13133 3.594% 98.335% # ( 6, 10 ] 3614 0.989% 99.324% ( 10, 15 ] 361 0.099% 99.423% ( 15, 22 ] 85 0.023% 99.446% ( 22, 34 ] 51 0.014% 99.460% ( 34, 51 ] 37 0.010% 99.470% ( 51, 76 ] 21 0.006% 99.476% ( 76, 110 ] 17 0.005% 99.481% ( 110, 170 ] 84 0.023% 99.504% ( 170, 250 ] 147 0.040% 99.544% ( 250, 380 ] 359 0.098% 99.642% ( 380, 580 ] 299 0.082% 99.724% ( 580, 870 ] 282 0.077% 99.801% ( 870, 1300 ] 180 0.049% 99.851% ( 1300, 1900 ] 153 0.042% 99.892% ( 1900, 2900 ] 177 0.048% 99.941% ( 2900, 4400 ] 154 0.042% 99.983% ( 4400, 6600 ] 50 0.014% 99.997% ( 6600, 9900 ] 6 0.002% 99.998% ( 9900, 14000 ] 7 0.002% 100.000% ( 14000, 22000 ] 11 0.003% 100.003% ( 22000, 33000 ] 2 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 982791 Average: 12.3719 StdDev: 231.71 Min: 0 Median: 1.5686 Max: 35882 Percentiles: P50: 1.57 P75: 2.33 P99: 8.89 P99.9: 2716.01 P99.99: 4342.22 ------------------------------------------------------ [ 0, 1 ] 228894 23.290% 23.290% ##### ( 1, 2 ] 461647 46.973% 70.263% ######### ( 2, 3 ] 143127 14.563% 84.827% ### ( 3, 4 ] 82303 8.374% 93.201% ## ( 4, 6 ] 47519 4.835% 98.036% # ( 6, 10 ] 13097 1.333% 99.369% ( 10, 15 ] 1269 0.129% 99.498% ( 15, 22 ] 288 0.029% 99.527% ( 22, 34 ] 152 0.015% 99.543% ( 34, 51 ] 135 0.014% 99.556% ( 51, 76 ] 71 0.007% 99.564% ( 76, 110 ] 40 0.004% 99.568% ( 110, 170 ] 62 0.006% 99.574% ( 170, 250 ] 72 0.007% 99.581% ( 250, 380 ] 205 0.021% 99.602% ( 380, 580 ] 479 0.049% 99.651% ( 580, 870 ] 689 0.070% 99.721% ( 870, 1300 ] 666 0.068% 99.789% ( 1300, 1900 ] 522 0.053% 99.842% ( 1900, 2900 ] 700 0.071% 99.913% ( 2900, 4400 ] 786 0.080% 99.993% ( 4400, 6600 ] 254 0.026% 100.019% ( 6600, 9900 ] 77 0.008% 100.027% ( 9900, 14000 ] 22 0.002% 100.029% ( 14000, 22000 ] 23 0.002% 100.031% ( 22000, 33000 ] 17 0.002% 100.033% ( 33000, 50000 ] 4 0.000% 100.033% ** Level 3 read latency histogram (micros): Count: 2025921 Average: 8.9761 StdDev: 164.20 Min: 0 Median: 1.4251 Max: 44123 Percentiles: P50: 1.43 P75: 1.97 P99: 6.64 P99.9: 2019.23 P99.99: 4121.42 ------------------------------------------------------ [ 0, 1 ] 620656 30.636% 30.636% ###### ( 1, 2 ] 922771 45.548% 76.184% ######### ( 2, 3 ] 266306 13.145% 89.329% ### ( 3, 4 ] 137674 6.796% 96.125% # ( 4, 6 ] 56318 2.780% 98.904% # ( 6, 10 ] 12123 0.598% 99.503% ( 10, 15 ] 1131 0.056% 99.559% ( 15, 22 ] 207 0.010% 99.569% ( 22, 34 ] 162 0.008% 99.577% ( 34, 51 ] 301 0.015% 99.592% ( 51, 76 ] 118 0.006% 99.598% ( 76, 110 ] 57 0.003% 99.600% ( 110, 170 ] 160 0.008% 99.608% ( 170, 250 ] 357 0.018% 99.626% ( 250, 380 ] 768 0.038% 99.664% ( 380, 580 ] 1206 0.060% 99.723% ( 580, 870 ] 1539 0.076% 99.799% ( 870, 1300 ] 1173 0.058% 99.857% ( 1300, 1900 ] 751 0.037% 99.894% ( 1900, 2900 ] 982 0.048% 99.943% ( 2900, 4400 ] 1177 0.058% 100.001% ( 4400, 6600 ] 338 0.017% 100.017% ( 6600, 9900 ] 81 0.004% 100.021% ( 9900, 14000 ] 12 0.001% 100.022% ( 14000, 22000 ] 11 0.001% 100.023% ( 22000, 33000 ] 11 0.001% 100.023% ( 33000, 50000 ] 2 0.000% 100.023% ** Level 4 read latency histogram (micros): Count: 1465040 Average: 15.8786 StdDev: 221.91 Min: 0 Median: 1.3976 Max: 59645 Percentiles: P50: 1.40 P75: 1.96 P99: 335.88 P99.9: 2756.12 P99.99: 4344.23 ------------------------------------------------------ [ 0, 1 ] 474783 32.408% 32.408% ###### ( 1, 2 ] 648264 44.249% 76.656% ######### ( 2, 3 ] 186247 12.713% 89.369% ### ( 3, 4 ] 88826 6.063% 95.432% # ( 4, 6 ] 36598 2.498% 97.930% ( 6, 10 ] 9406 0.642% 98.572% ( 10, 15 ] 700 0.048% 98.620% ( 15, 22 ] 92 0.006% 98.626% ( 22, 34 ] 120 0.008% 98.635% ( 34, 51 ] 292 0.020% 98.655% ( 51, 76 ] 85 0.006% 98.660% ( 76, 110 ] 104 0.007% 98.667% ( 110, 170 ] 778 0.053% 98.721% ( 170, 250 ] 1585 0.108% 98.829% ( 250, 380 ] 3799 0.259% 99.088% ( 380, 580 ] 3883 0.265% 99.353% ( 580, 870 ] 3779 0.258% 99.611% ( 870, 1300 ] 2207 0.151% 99.762% ( 1300, 1900 ] 1039 0.071% 99.833% ( 1900, 2900 ] 1154 0.079% 99.911% ( 2900, 4400 ] 1197 0.082% 99.993% ( 4400, 6600 ] 376 0.026% 100.019% ( 6600, 9900 ] 57 0.004% 100.023% ( 9900, 14000 ] 6 0.000% 100.023% ( 14000, 22000 ] 9 0.001% 100.024% ( 22000, 33000 ] 14 0.001% 100.025% ( 33000, 50000 ] 5 0.000% 100.025% ( 50000, 75000 ] 3 0.000% 100.025% ** Level 5 read latency histogram (micros): Count: 65638 Average: 821.1675 StdDev: 1432.76 Min: 85 Median: 451.7123 Max: 65210 Percentiles: P50: 451.71 P75: 808.64 P99: 5573.67 P99.9: 10023.68 P99.99: 49467.52 ------------------------------------------------------ ( 76, 110 ] 326 0.497% 0.497% ( 110, 170 ] 3275 4.989% 5.486% # ( 170, 250 ] 7204 10.975% 16.462% ## ( 250, 380 ] 17158 26.140% 42.602% ##### ( 380, 580 ] 13543 20.633% 63.235% #### ( 580, 870 ] 9795 14.923% 78.157% ### ( 870, 1300 ] 5482 8.352% 86.509% ## ( 1300, 1900 ] 2516 3.833% 90.342% # ( 1900, 2900 ] 2393 3.646% 93.988% # ( 2900, 4400 ] 2762 4.208% 98.196% # ( 4400, 6600 ] 989 1.507% 99.703% ( 6600, 9900 ] 129 0.197% 99.899% ( 9900, 14000 ] 12 0.018% 99.918% ( 14000, 22000 ] 12 0.018% 99.936% ( 22000, 33000 ] 18 0.027% 99.963% ( 33000, 50000 ] 18 0.027% 99.991% ( 50000, 75000 ] 9 0.014% 100.005% ** DB Stats ** Uptime(secs): 19.1 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 206.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.612 H:M:S, 24.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-17:23:19 ... thread 0: (1000000,5000000) ops and (255768.0,219712.0) ops/second in (3.909794,22.757062) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.13 GB 113.3 4.0 0.0 4.0 8.7 4.7 0.0 1.8 117.5 256.0 35.00 23.13 83 0.422 4176K 4902 0.0 0.0 L1 8/8 792.41 MB 0.0 2.0 1.7 0.3 2.0 1.7 0.0 1.1 208.4 207.6 9.80 6.98 2 4.902 2074K 7722 0.0 0.0 L2 1/0 46.97 MB 0.5 0.5 0.4 0.1 0.5 0.4 1.0 1.1 127.1 126.4 3.86 2.18 1 3.863 441K 0 0.0 0.0 L3 16/0 948.36 MB 0.9 7.7 4.5 3.1 7.6 4.5 0.7 1.7 142.1 141.1 55.29 30.64 31 1.784 4243K 7218 0.0 0.0 L4 188/0 9.76 GB 1.0 11.1 5.5 5.6 10.8 5.2 0.5 2.0 173.5 169.3 65.33 37.72 72 0.907 6586K 7432 0.0 0.0 L5 1256/0 95.93 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1488/21 110.57 GB 0.0 25.2 12.2 13.1 29.6 16.6 7.6 6.3 152.6 179.2 169.29 100.65 189 0.896 17M 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 12.2 13.1 29.6 16.6 7.6 6.3 152.6 179.2 169.29 100.65 189 0.896 17M 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 12.2 13.1 24.9 11.8 0.0 0.0 173.9 171.6 148.57 89.43 120 1.238 17M 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 234.1 20.72 11.23 69 0.300 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.0 total, 22.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.63 GB write, 1321.53 MB/s write, 25.24 GB read, 1125.48 MB/s read, 169.3 seconds Interval compaction: 29.63 GB write, 1333.19 MB/s write, 25.24 GB read, 1135.40 MB/s read, 169.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1722068 Average: 7.2076 StdDev: 97.77 Min: 0 Median: 1.2050 Max: 16823 Percentiles: P50: 1.21 P75: 1.79 P99: 32.23 P99.9: 703.62 P99.99: 1685.73 ------------------------------------------------------ [ 0, 1 ] 709769 41.216% 41.216% ######## ( 1, 2 ] 737728 42.840% 84.056% ######### ( 2, 3 ] 153459 8.911% 92.967% ## ( 3, 4 ] 67437 3.916% 96.883% # ( 4, 6 ] 27443 1.594% 98.477% ( 6, 10 ] 6569 0.381% 98.858% ( 10, 15 ] 2055 0.119% 98.978% ( 15, 22 ] 262 0.015% 98.993% ( 22, 34 ] 147 0.009% 99.001% ( 34, 51 ] 117 0.007% 99.008% ( 51, 76 ] 33 0.002% 99.010% ( 76, 110 ] 294 0.017% 99.027% ( 110, 170 ] 2375 0.138% 99.165% ( 170, 250 ] 2982 0.173% 99.338% ( 250, 380 ] 6743 0.392% 99.730% ( 380, 580 ] 2419 0.140% 99.870% ( 580, 870 ] 1208 0.070% 99.940% ( 870, 1300 ] 653 0.038% 99.978% ( 1300, 1900 ] 317 0.018% 99.997% ( 1900, 2900 ] 325 0.019% 100.016% ( 2900, 4400 ] 370 0.021% 100.037% ( 4400, 6600 ] 127 0.007% 100.044% ( 6600, 9900 ] 26 0.002% 100.046% ( 9900, 14000 ] 4 0.000% 100.046% ( 14000, 22000 ] 3 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 384262 Average: 9.3351 StdDev: 168.95 Min: 0 Median: 1.4645 Max: 23120 Percentiles: P50: 1.46 P75: 2.05 P99: 13.23 P99.9: 1949.37 P99.99: 5437.25 ------------------------------------------------------ [ 0, 1 ] 110750 28.821% 28.821% ###### ( 1, 2 ] 175192 45.592% 74.413% ######### ( 2, 3 ] 47436 12.345% 86.758% ## ( 3, 4 ] 26126 6.799% 93.557% # ( 4, 6 ] 15445 4.019% 97.576% # ( 6, 10 ] 4355 1.133% 98.710% ( 10, 15 ] 1726 0.449% 99.159% ( 15, 22 ] 249 0.065% 99.224% ( 22, 34 ] 131 0.034% 99.258% ( 34, 51 ] 66 0.017% 99.275% ( 51, 76 ] 30 0.008% 99.283% ( 76, 110 ] 48 0.012% 99.295% ( 110, 170 ] 278 0.072% 99.368% ( 170, 250 ] 318 0.083% 99.450% ( 250, 380 ] 718 0.187% 99.637% ( 380, 580 ] 376 0.098% 99.735% ( 580, 870 ] 290 0.075% 99.811% ( 870, 1300 ] 182 0.047% 99.858% ( 1300, 1900 ] 153 0.040% 99.898% ( 1900, 2900 ] 177 0.046% 99.944% ( 2900, 4400 ] 154 0.040% 99.984% ( 4400, 6600 ] 50 0.013% 99.997% ( 6600, 9900 ] 6 0.002% 99.998% ( 9900, 14000 ] 7 0.002% 100.000% ( 14000, 22000 ] 11 0.003% 100.003% ( 22000, 33000 ] 2 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 982791 Average: 12.3719 StdDev: 231.71 Min: 0 Median: 1.5686 Max: 35882 Percentiles: P50: 1.57 P75: 2.33 P99: 8.89 P99.9: 2716.01 P99.99: 4342.22 ------------------------------------------------------ [ 0, 1 ] 228894 23.290% 23.290% ##### ( 1, 2 ] 461647 46.973% 70.263% ######### ( 2, 3 ] 143127 14.563% 84.827% ### ( 3, 4 ] 82303 8.374% 93.201% ## ( 4, 6 ] 47519 4.835% 98.036% # ( 6, 10 ] 13097 1.333% 99.369% ( 10, 15 ] 1269 0.129% 99.498% ( 15, 22 ] 288 0.029% 99.527% ( 22, 34 ] 152 0.015% 99.543% ( 34, 51 ] 135 0.014% 99.556% ( 51, 76 ] 71 0.007% 99.564% ( 76, 110 ] 40 0.004% 99.568% ( 110, 170 ] 62 0.006% 99.574% ( 170, 250 ] 72 0.007% 99.581% ( 250, 380 ] 205 0.021% 99.602% ( 380, 580 ] 479 0.049% 99.651% ( 580, 870 ] 689 0.070% 99.721% ( 870, 1300 ] 666 0.068% 99.789% ( 1300, 1900 ] 522 0.053% 99.842% ( 1900, 2900 ] 700 0.071% 99.913% ( 2900, 4400 ] 786 0.080% 99.993% ( 4400, 6600 ] 254 0.026% 100.019% ( 6600, 9900 ] 77 0.008% 100.027% ( 9900, 14000 ] 22 0.002% 100.029% ( 14000, 22000 ] 23 0.002% 100.031% ( 22000, 33000 ] 17 0.002% 100.033% ( 33000, 50000 ] 4 0.000% 100.033% ** Level 3 read latency histogram (micros): Count: 2026660 Average: 9.0474 StdDev: 164.23 Min: 0 Median: 1.4255 Max: 44123 Percentiles: P50: 1.43 P75: 1.97 P99: 6.85 P99.9: 2018.47 P99.99: 4121.33 ------------------------------------------------------ [ 0, 1 ] 620657 30.625% 30.625% ###### ( 1, 2 ] 922790 45.533% 76.157% ######### ( 2, 3 ] 266316 13.141% 89.298% ### ( 3, 4 ] 137709 6.795% 96.093% # ( 4, 6 ] 56353 2.781% 98.873% # ( 6, 10 ] 12143 0.599% 99.472% ( 10, 15 ] 1183 0.058% 99.531% ( 15, 22 ] 207 0.010% 99.541% ( 22, 34 ] 163 0.008% 99.549% ( 34, 51 ] 301 0.015% 99.564% ( 51, 76 ] 118 0.006% 99.570% ( 76, 110 ] 69 0.003% 99.573% ( 110, 170 ] 276 0.014% 99.587% ( 170, 250 ] 482 0.024% 99.611% ( 250, 380 ] 1016 0.050% 99.661% ( 380, 580 ] 1264 0.062% 99.723% ( 580, 870 ] 1547 0.076% 99.799% ( 870, 1300 ] 1173 0.058% 99.857% ( 1300, 1900 ] 751 0.037% 99.894% ( 1900, 2900 ] 982 0.048% 99.943% ( 2900, 4400 ] 1177 0.058% 100.001% ( 4400, 6600 ] 338 0.017% 100.018% ( 6600, 9900 ] 81 0.004% 100.022% ( 9900, 14000 ] 12 0.001% 100.022% ( 14000, 22000 ] 11 0.001% 100.023% ( 22000, 33000 ] 11 0.001% 100.023% ( 33000, 50000 ] 2 0.000% 100.023% ** Level 4 read latency histogram (micros): Count: 1471407 Average: 16.8862 StdDev: 222.12 Min: 0 Median: 1.4025 Max: 59645 Percentiles: P50: 1.40 P75: 1.97 P99: 366.16 P99.9: 2751.47 P99.99: 4343.48 ------------------------------------------------------ [ 0, 1 ] 474786 32.267% 32.267% ###### ( 1, 2 ] 648316 44.061% 76.328% ######### ( 2, 3 ] 186307 12.662% 88.990% ### ( 3, 4 ] 88906 6.042% 95.033% # ( 4, 6 ] 36698 2.494% 97.527% ( 6, 10 ] 9458 0.643% 98.169% ( 10, 15 ] 808 0.055% 98.224% ( 15, 22 ] 96 0.007% 98.231% ( 22, 34 ] 122 0.008% 98.239% ( 34, 51 ] 292 0.020% 98.259% ( 51, 76 ] 85 0.006% 98.265% ( 76, 110 ] 244 0.017% 98.281% ( 110, 170 ] 1916 0.130% 98.412% ( 170, 250 ] 2859 0.194% 98.606% ( 250, 380 ] 6491 0.441% 99.047% ( 380, 580 ] 4477 0.304% 99.351% ( 580, 870 ] 3845 0.261% 99.613% ( 870, 1300 ] 2208 0.150% 99.763% ( 1300, 1900 ] 1039 0.071% 99.833% ( 1900, 2900 ] 1154 0.078% 99.912% ( 2900, 4400 ] 1198 0.081% 99.993% ( 4400, 6600 ] 376 0.026% 100.019% ( 6600, 9900 ] 57 0.004% 100.022% ( 9900, 14000 ] 6 0.000% 100.023% ( 14000, 22000 ] 9 0.001% 100.024% ( 22000, 33000 ] 14 0.001% 100.024% ( 33000, 50000 ] 5 0.000% 100.025% ( 50000, 75000 ] 3 0.000% 100.025% ** Level 5 read latency histogram (micros): Count: 100559 Average: 628.8069 StdDev: 1189.02 Min: 84 Median: 345.7367 Max: 65210 Percentiles: P50: 345.74 P75: 573.46 P99: 4781.30 P99.9: 8836.86 P99.99: 39558.32 ------------------------------------------------------ ( 76, 110 ] 1187 1.180% 1.180% ( 110, 170 ] 10051 9.995% 11.176% ## ( 170, 250 ] 15044 14.960% 26.136% ### ( 250, 380 ] 32586 32.405% 58.541% ###### ( 380, 580 ] 17111 17.016% 75.557% ### ( 580, 870 ] 10233 10.176% 85.733% ## ( 870, 1300 ] 5490 5.459% 91.192% # ( 1300, 1900 ] 2519 2.505% 93.697% # ( 1900, 2900 ] 2398 2.385% 96.082% ( 2900, 4400 ] 2763 2.748% 98.830% # ( 4400, 6600 ] 989 0.984% 99.813% ( 6600, 9900 ] 129 0.128% 99.941% ( 9900, 14000 ] 12 0.012% 99.953% ( 14000, 22000 ] 12 0.012% 99.965% ( 22000, 33000 ] 18 0.018% 99.983% ( 33000, 50000 ] 18 0.018% 100.001% ( 50000, 75000 ] 9 0.009% 100.010% ** DB Stats ** Uptime(secs): 23.0 total, 3.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 214.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.612 H:M:S, 20.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 251.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-17:23:40 ... thread 0: (1000000,6000000) ops and (48232.2,137962.5) ops/second in (20.733018,43.490080) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 4.11 GB 238.1 6.8 0.0 6.8 12.5 5.7 0.0 2.2 144.5 266.1 48.06 35.70 105 0.458 7053K 16K 0.0 0.0 L1 8/8 792.41 MB 0.0 2.0 1.7 0.3 2.0 1.7 0.0 1.1 208.4 207.6 9.80 6.98 2 4.902 2074K 7722 0.0 0.0 L2 1/0 46.97 MB 0.5 0.5 0.4 0.1 0.5 0.4 1.0 1.1 127.1 126.4 3.86 2.18 1 3.863 441K 0 0.0 0.0 L3 16/0 948.36 MB 0.9 7.7 4.5 3.1 7.6 4.5 0.7 1.7 142.1 141.1 55.29 30.64 31 1.784 4243K 7218 0.0 0.0 L4 188/0 9.76 GB 1.0 11.1 5.5 5.6 10.8 5.2 0.5 2.0 173.5 169.3 65.33 37.72 72 0.907 6586K 7432 0.0 0.0 L5 1256/0 95.93 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1483/17 111.54 GB 0.0 28.0 12.2 15.8 33.4 17.5 7.6 5.8 157.3 187.4 182.35 113.22 211 0.864 20M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.0 12.2 15.8 33.4 17.5 7.6 5.8 157.3 187.4 182.35 113.22 211 0.864 20M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.0 12.2 15.8 27.6 11.8 0.0 0.0 181.0 178.7 158.43 99.10 126 1.257 20M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 245.0 23.91 14.12 85 0.281 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.7 total, 43.5 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.37 GB write, 782.09 MB/s write, 28.00 GB read, 656.27 MB/s read, 182.3 seconds Interval compaction: 33.37 GB write, 785.69 MB/s write, 28.00 GB read, 659.29 MB/s read, 182.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 58, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2514313 Average: 14.3180 StdDev: 93.19 Min: 0 Median: 1.2943 Max: 16823 Percentiles: P50: 1.29 P75: 1.84 P99: 329.91 P99.9: 558.27 P99.99: 1047.81 ------------------------------------------------------ [ 0, 1 ] 915756 36.422% 36.422% ####### ( 1, 2 ] 1160134 46.141% 82.563% ######### ( 2, 3 ] 187642 7.463% 90.026% # ( 3, 4 ] 82818 3.294% 93.320% # ( 4, 6 ] 35801 1.424% 94.744% ( 6, 10 ] 8834 0.351% 95.095% ( 10, 15 ] 8046 0.320% 95.415% ( 15, 22 ] 524 0.021% 95.436% ( 22, 34 ] 256 0.010% 95.446% ( 34, 51 ] 130 0.005% 95.451% ( 51, 76 ] 33 0.001% 95.452% ( 76, 110 ] 4758 0.189% 95.642% ( 110, 170 ] 32806 1.305% 96.946% ( 170, 250 ] 22399 0.891% 97.837% ( 250, 380 ] 47561 1.892% 99.729% ( 380, 580 ] 4826 0.192% 99.921% ( 580, 870 ] 1464 0.058% 99.979% ( 870, 1300 ] 664 0.026% 100.006% ( 1300, 1900 ] 322 0.013% 100.018% ( 1900, 2900 ] 325 0.013% 100.031% ( 2900, 4400 ] 370 0.015% 100.046% ( 4400, 6600 ] 128 0.005% 100.051% ( 6600, 9900 ] 26 0.001% 100.052% ( 9900, 14000 ] 4 0.000% 100.052% ( 14000, 22000 ] 3 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 441197 Average: 11.4178 StdDev: 159.64 Min: 0 Median: 1.5882 Max: 23120 Percentiles: P50: 1.59 P75: 2.70 P99: 240.56 P99.9: 1707.07 P99.99: 5098.73 ------------------------------------------------------ [ 0, 1 ] 114738 26.006% 26.006% ##### ( 1, 2 ] 179972 40.792% 66.798% ######## ( 2, 3 ] 51921 11.768% 78.566% ## ( 3, 4 ] 38364 8.695% 87.261% ## ( 4, 6 ] 26485 6.003% 93.264% # ( 6, 10 ] 7714 1.748% 95.013% ( 10, 15 ] 12518 2.837% 97.850% # ( 15, 22 ] 949 0.215% 98.065% ( 22, 34 ] 427 0.097% 98.162% ( 34, 51 ] 296 0.067% 98.229% ( 51, 76 ] 48 0.011% 98.240% ( 76, 110 ] 299 0.068% 98.308% ( 110, 170 ] 1873 0.425% 98.732% ( 170, 250 ] 1339 0.303% 99.036% ( 250, 380 ] 2714 0.615% 99.651% ( 380, 580 ] 509 0.115% 99.766% ( 580, 870 ] 304 0.069% 99.835% ( 870, 1300 ] 182 0.041% 99.876% ( 1300, 1900 ] 153 0.035% 99.911% ( 1900, 2900 ] 178 0.040% 99.951% ( 2900, 4400 ] 154 0.035% 99.986% ( 4400, 6600 ] 50 0.011% 99.998% ( 6600, 9900 ] 6 0.001% 99.999% ( 9900, 14000 ] 7 0.002% 100.001% ( 14000, 22000 ] 11 0.002% 100.003% ( 22000, 33000 ] 2 0.000% 100.004% ** Level 2 read latency histogram (micros): Count: 982791 Average: 12.3719 StdDev: 231.71 Min: 0 Median: 1.5686 Max: 35882 Percentiles: P50: 1.57 P75: 2.33 P99: 8.89 P99.9: 2716.01 P99.99: 4342.22 ------------------------------------------------------ [ 0, 1 ] 228894 23.290% 23.290% ##### ( 1, 2 ] 461647 46.973% 70.263% ######### ( 2, 3 ] 143127 14.563% 84.827% ### ( 3, 4 ] 82303 8.374% 93.201% ## ( 4, 6 ] 47519 4.835% 98.036% # ( 6, 10 ] 13097 1.333% 99.369% ( 10, 15 ] 1269 0.129% 99.498% ( 15, 22 ] 288 0.029% 99.527% ( 22, 34 ] 152 0.015% 99.543% ( 34, 51 ] 135 0.014% 99.556% ( 51, 76 ] 71 0.007% 99.564% ( 76, 110 ] 40 0.004% 99.568% ( 110, 170 ] 62 0.006% 99.574% ( 170, 250 ] 72 0.007% 99.581% ( 250, 380 ] 205 0.021% 99.602% ( 380, 580 ] 479 0.049% 99.651% ( 580, 870 ] 689 0.070% 99.721% ( 870, 1300 ] 666 0.068% 99.789% ( 1300, 1900 ] 522 0.053% 99.842% ( 1900, 2900 ] 700 0.071% 99.913% ( 2900, 4400 ] 786 0.080% 99.993% ( 4400, 6600 ] 254 0.026% 100.019% ( 6600, 9900 ] 77 0.008% 100.027% ( 9900, 14000 ] 22 0.002% 100.029% ( 14000, 22000 ] 23 0.002% 100.031% ( 22000, 33000 ] 17 0.002% 100.033% ( 33000, 50000 ] 4 0.000% 100.033% ** Level 3 read latency histogram (micros): Count: 2031170 Average: 9.5249 StdDev: 164.41 Min: 0 Median: 1.4280 Max: 44123 Percentiles: P50: 1.43 P75: 1.98 P99: 8.32 P99.9: 2013.88 P99.99: 4120.75 ------------------------------------------------------ [ 0, 1 ] 620657 30.557% 30.557% ###### ( 1, 2 ] 922790 45.431% 75.988% ######### ( 2, 3 ] 266316 13.111% 89.100% ### ( 3, 4 ] 137709 6.780% 95.879% # ( 4, 6 ] 56353 2.774% 98.654% # ( 6, 10 ] 12143 0.598% 99.252% ( 10, 15 ] 1183 0.058% 99.310% ( 15, 22 ] 207 0.010% 99.320% ( 22, 34 ] 163 0.008% 99.328% ( 34, 51 ] 301 0.015% 99.343% ( 51, 76 ] 118 0.006% 99.349% ( 76, 110 ] 304 0.015% 99.364% ( 110, 170 ] 1715 0.084% 99.448% ( 170, 250 ] 1383 0.068% 99.516% ( 250, 380 ] 2821 0.139% 99.655% ( 380, 580 ] 1385 0.068% 99.723% ( 580, 870 ] 1555 0.077% 99.800% ( 870, 1300 ] 1173 0.058% 99.858% ( 1300, 1900 ] 751 0.037% 99.894% ( 1900, 2900 ] 982 0.048% 99.943% ( 2900, 4400 ] 1177 0.058% 100.001% ( 4400, 6600 ] 338 0.017% 100.017% ( 6600, 9900 ] 81 0.004% 100.021% ( 9900, 14000 ] 12 0.001% 100.022% ( 14000, 22000 ] 11 0.001% 100.023% ( 22000, 33000 ] 11 0.001% 100.023% ( 33000, 50000 ] 2 0.000% 100.023% ** Level 4 read latency histogram (micros): Count: 1509854 Average: 22.1090 StdDev: 222.08 Min: 0 Median: 1.4321 Max: 59645 Percentiles: P50: 1.43 P75: 2.05 P99: 379.59 P99.9: 2718.15 P99.99: 4338.67 ------------------------------------------------------ [ 0, 1 ] 474789 31.446% 31.446% ###### ( 1, 2 ] 648344 42.941% 74.387% ######### ( 2, 3 ] 186330 12.341% 86.728% ## ( 3, 4 ] 88985 5.894% 92.621% # ( 4, 6 ] 36814 2.438% 95.060% ( 6, 10 ] 9507 0.630% 95.689% ( 10, 15 ] 957 0.063% 95.753% ( 15, 22 ] 104 0.007% 95.760% ( 22, 34 ] 128 0.008% 95.768% ( 34, 51 ] 292 0.019% 95.787% ( 51, 76 ] 85 0.006% 95.793% ( 76, 110 ] 2113 0.140% 95.933% ( 110, 170 ] 14138 0.936% 96.869% ( 170, 250 ] 10519 0.697% 97.566% ( 250, 380 ] 21719 1.438% 99.005% ( 380, 580 ] 5391 0.357% 99.362% ( 580, 870 ] 3932 0.260% 99.622% ( 870, 1300 ] 2212 0.147% 99.769% ( 1300, 1900 ] 1041 0.069% 99.837% ( 1900, 2900 ] 1154 0.076% 99.914% ( 2900, 4400 ] 1198 0.079% 99.993% ( 4400, 6600 ] 376 0.025% 100.018% ( 6600, 9900 ] 57 0.004% 100.022% ( 9900, 14000 ] 6 0.000% 100.022% ( 14000, 22000 ] 9 0.001% 100.023% ( 22000, 33000 ] 14 0.001% 100.024% ( 33000, 50000 ] 5 0.000% 100.024% ( 50000, 75000 ] 3 0.000% 100.024% ** Level 5 read latency histogram (micros): Count: 307660 Average: 357.6858 StdDev: 709.06 Min: 83 Median: 261.5696 Max: 65210 Percentiles: P50: 261.57 P75: 347.14 P99: 3342.12 P99.9: 6224.82 P99.99: 9368.77 ------------------------------------------------------ ( 76, 110 ] 11113 3.612% 3.612% # ( 110, 170 ] 75450 24.524% 28.136% ##### ( 170, 250 ] 56868 18.484% 46.620% #### ( 250, 380 ] 116852 37.981% 84.601% ######## ( 380, 580 ] 22243 7.230% 91.831% # ( 580, 870 ] 10808 3.513% 95.344% # ( 870, 1300 ] 5509 1.791% 97.134% ( 1300, 1900 ] 2526 0.821% 97.955% ( 1900, 2900 ] 2401 0.780% 98.736% ( 2900, 4400 ] 2763 0.898% 99.634% ( 4400, 6600 ] 989 0.321% 99.955% ( 6600, 9900 ] 129 0.042% 99.997% ( 9900, 14000 ] 12 0.004% 100.001% ( 14000, 22000 ] 12 0.004% 100.005% ( 22000, 33000 ] 18 0.006% 100.011% ( 33000, 50000 ] 18 0.006% 100.017% ( 50000, 75000 ] 9 0.003% 100.020% ** DB Stats ** Uptime(secs): 43.7 total, 20.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 135.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.220 H:M:S, 46.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 47.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:15.608 H:M:S, 75.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 409.313 micros/op 9752 ops/sec 60.289 seconds 587996 operations; 9.4 MB/s (146999 of 146999 found) Microseconds per read: Count: 587996 Average: 409.3182 StdDev: 1099.18 Min: 2 Median: 311.0317 Max: 203188 Percentiles: P50: 311.03 P75: 466.05 P99: 2467.56 P99.9: 14784.77 P99.99: 32732.08 ------------------------------------------------------ ( 1, 2 ] 3 0.001% 0.001% ( 2, 3 ] 16 0.003% 0.003% ( 3, 4 ] 11 0.002% 0.005% ( 4, 6 ] 30 0.005% 0.010% ( 6, 10 ] 437 0.074% 0.085% ( 10, 15 ] 500 0.085% 0.170% ( 15, 22 ] 1060 0.180% 0.350% ( 22, 34 ] 3075 0.523% 0.873% ( 34, 51 ] 1248 0.212% 1.085% ( 51, 76 ] 2503 0.426% 1.511% ( 76, 110 ] 3466 0.589% 2.100% ( 110, 170 ] 56498 9.609% 11.709% ## ( 170, 250 ] 154166 26.219% 37.928% ##### ( 250, 380 ] 151201 25.715% 63.642% ##### ( 380, 580 ] 155222 26.398% 90.041% ##### ( 580, 870 ] 38841 6.606% 96.646% # ( 870, 1300 ] 10024 1.705% 98.351% ( 1300, 1900 ] 2563 0.436% 98.787% ( 1900, 2900 ] 2206 0.375% 99.162% ( 2900, 4400 ] 2394 0.407% 99.569% ( 4400, 6600 ] 1089 0.185% 99.755% ( 6600, 9900 ] 478 0.081% 99.836% ( 9900, 14000 ] 336 0.057% 99.893% ( 14000, 22000 ] 418 0.071% 99.964% ( 22000, 33000 ] 156 0.027% 99.991% ( 33000, 50000 ] 29 0.005% 99.996% ( 50000, 75000 ] 12 0.002% 99.998% ( 75000, 110000 ] 7 0.001% 99.999% ( 110000, 170000 ] 5 0.001% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 9690803 rocksdb.bloom.filter.full.positive COUNT : 682349 rocksdb.bloom.filter.full.true.positive COUNT : 587704 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 292 rocksdb.memtable.miss COUNT : 587704 rocksdb.l0.hit COUNT : 21892 rocksdb.l1.hit COUNT : 4261 rocksdb.l2andup.hit COUNT : 561551 rocksdb.compaction.key.drop.new COUNT : 383040 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6061538 rocksdb.number.keys.read COUNT : 587996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6255507216 rocksdb.bytes.read COUNT : 587996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1882 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35707650 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31715759886 rocksdb.compact.write.bytes COUNT : 31322304152 rocksdb.flush.write.bytes COUNT : 6209571165 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 1354 rocksdb.number.superversion_releases COUNT : 1329 rocksdb.number.superversion_cleanups COUNT : 340 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 337 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6159353856 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2257920 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34261061066 rocksdb.non.last.level.read.count COUNT : 8136495 rocksdb.block.checksum.compute.count COUNT : 8373509 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 306.441905 P95 : 796.067226 P99 : 2465.927273 P100 : 203185.000000 COUNT : 587996 SUM : 239229950 rocksdb.db.write.micros P50 : 1.510967 P95 : 4.548610 P99 : 13.987202 P100 : 661087.000000 COUNT : 6061538 SUM : 52144230 rocksdb.compaction.times.micros P50 : 1014545.454545 P95 : 2870000.000000 P99 : 5491581.000000 P100 : 5491581.000000 COUNT : 126 SUM : 158433016 rocksdb.compaction.times.cpu_micros P50 : 621176.470588 P95 : 1865000.000000 P99 : 3936000.000000 P100 : 5377485.000000 COUNT : 126 SUM : 99103847 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 856.190476 P95 : 6435.000000 P99 : 10474.000000 P100 : 10803.000000 COUNT : 86 SUM : 152140 rocksdb.compaction.outfile.sync.micros P50 : 3596.428571 P95 : 30682.142857 P99 : 68416.666667 P100 : 96529.000000 COUNT : 379 SUM : 2748796 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 390.000000 P95 : 3100.000000 P99 : 4340.000000 P100 : 4782.000000 COUNT : 248 SUM : 192415 rocksdb.table.open.io.micros P50 : 5800.546448 P95 : 19311.392405 P99 : 40412.000000 P100 : 165232.000000 COUNT : 1882 SUM : 14387794 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.706367 P95 : 7.059272 P99 : 266.159557 P100 : 50740.000000 COUNT : 7681504 SUM : 103046741 rocksdb.read.block.get.micros P50 : 242.486477 P95 : 552.726037 P99 : 1993.191020 P100 : 65284.000000 COUNT : 690280 SUM : 199430403 rocksdb.write.raw.block.micros P50 : 0.521131 P95 : 0.990148 P99 : 4.148163 P100 : 69448.000000 COUNT : 9090852 SUM : 23200854 rocksdb.numfiles.in.singlecompaction P50 : 2.562500 P95 : 4.814286 P99 : 9.160000 P100 : 17.000000 COUNT : 163 SUM : 515 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.635205 P95 : 1203.641842 P99 : 2450.543011 P100 : 660911.000000 COUNT : 168798 SUM : 35754955 rocksdb.sst.read.micros P50 : 1.505182 P95 : 246.537851 P99 : 406.591890 P100 : 65210.000000 COUNT : 8136792 SUM : 282059869 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 587996 SUM : 587996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6061538 SUM : 6255507216 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220000.000000 P95 : 748833.333333 P99 : 953503.000000 P100 : 953503.000000 COUNT : 86 SUM : 24143613 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 402 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0