[2024-07-24 11:38:12.102008] Starting SPDK v24.09-pre git sha1 8711e7e9b / DPDK 23.11.0 initialization... [2024-07-24 11:38:12.102299] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3289142 ] Set seed to 1721813892095593 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 11:38:12.214782] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 11:38:12.256537] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 11:38:12.256589] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3289142' to capture a snapshot of events at runtime. [2024-07-24 11:38:12.256599] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-24 11:38:12.256613] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-24 11:38:12.256622] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3289142 for offline analysis/debug. [2024-07-24 11:38:12.256712] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 11:38:16 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/24-11:38:19 ... thread 0: (1000000,1000000) ops and (331672.2,331672.2) ops/second in (3.015025,3.015025) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.95 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 349.0 2.53 2.27 12 0.211 0 0 0.0 0.0 L1 3/0 249.18 MB 24.9 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.2 245.9 1.02 0.99 1 1.024 255K 260 0.0 0.0 L2 3/2 191.41 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 12/0 993.24 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 102.8 306.1 4.33 4.00 15 0.289 452K 364 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.2 1.5 102.8 306.1 4.33 4.00 15 0.289 452K 364 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 246.4 246.2 1.81 1.73 3 0.603 452K 364 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 349.0 2.53 2.27 12 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 409.34 MB/s write, 0.43 GB read, 137.40 MB/s read, 4.3 seconds Interval compaction: 1.30 GB write, 439.88 MB/s write, 0.43 GB read, 147.66 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 156840 Average: 1.9918 StdDev: 14.60 Min: 0 Median: 1.3349 Max: 3411 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.49 P99.99: 18.43 ------------------------------------------------------ [ 0, 1 ] 47049 29.998% 29.998% ###### ( 1, 2 ] 93674 59.726% 89.724% ############ ( 2, 3 ] 9498 6.056% 95.780% # ( 3, 4 ] 3518 2.243% 98.023% ( 4, 6 ] 2464 1.571% 99.594% ( 6, 10 ] 553 0.353% 99.946% ( 10, 15 ] 61 0.039% 99.985% ( 15, 22 ] 19 0.012% 99.997% ( 22, 34 ] 2 0.001% 99.999% ( 34, 51 ] 2 0.001% 100.000% ( 110, 170 ] 8 0.005% 100.005% ( 170, 250 ] 4 0.003% 100.008% ( 250, 380 ] 5 0.003% 100.011% ( 380, 580 ] 1 0.001% 100.011% ( 870, 1300 ] 1 0.001% 100.012% ( 1300, 1900 ] 2 0.001% 100.013% ( 1900, 2900 ] 1 0.001% 100.014% ( 2900, 4400 ] 2 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 667 Average: 6.2669 StdDev: 48.62 Min: 1 Median: 1.7191 Max: 995 Percentiles: P50: 1.72 P75: 2.43 P99: 17.31 P99.9: 995.00 P99.99: 995.00 ------------------------------------------------------ [ 0, 1 ] 66 9.895% 9.895% ## ( 1, 2 ] 372 55.772% 65.667% ########### ( 2, 3 ] 145 21.739% 87.406% #### ( 3, 4 ] 40 5.997% 93.403% # ( 4, 6 ] 24 3.598% 97.001% # ( 6, 10 ] 11 1.649% 98.651% ( 10, 15 ] 2 0.300% 98.951% ( 15, 22 ] 1 0.150% 99.100% ( 110, 170 ] 1 0.150% 99.250% ( 170, 250 ] 2 0.300% 99.550% ( 250, 380 ] 1 0.150% 99.700% ( 580, 870 ] 1 0.150% 99.850% ( 870, 1300 ] 1 0.150% 100.000% ** Level 2 read latency histogram (micros): Count: 42035 Average: 2.4121 StdDev: 17.84 Min: 0 Median: 1.5452 Max: 2842 Percentiles: P50: 1.55 P75: 1.92 P99: 5.92 P99.9: 10.62 P99.99: 695.49 ------------------------------------------------------ [ 0, 1 ] 5590 13.298% 13.298% ### ( 1, 2 ] 28296 67.315% 80.614% ############# ( 2, 3 ] 4458 10.605% 91.219% ## ( 3, 4 ] 1962 4.668% 95.887% # ( 4, 6 ] 1364 3.245% 99.132% # ( 6, 10 ] 320 0.761% 99.893% ( 10, 15 ] 32 0.076% 99.969% ( 15, 22 ] 3 0.007% 99.976% ( 22, 34 ] 2 0.005% 99.981% ( 51, 76 ] 1 0.002% 99.983% ( 76, 110 ] 1 0.002% 99.986% ( 170, 250 ] 1 0.002% 99.988% ( 380, 580 ] 1 0.002% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 1 0.002% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 1769.7818 StdDev: 1380.95 Min: 164 Median: 1400.0000 Max: 6548 Percentiles: P50: 1400.00 P75: 2681.25 P99: 5995.00 P99.9: 6539.50 P99.99: 6548.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 2 3.636% 7.273% # ( 380, 580 ] 9 16.364% 23.636% ### ( 580, 870 ] 6 10.909% 34.545% ## ( 870, 1300 ] 7 12.727% 47.273% ### ( 1300, 1900 ] 9 16.364% 63.636% ### ( 1900, 2900 ] 8 14.545% 78.182% ### ( 2900, 4400 ] 10 18.182% 96.364% #### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1718.8000 StdDev: 1507.52 Min: 414 Median: 977.5000 Max: 5118 Percentiles: P50: 977.50 P75: 1900.00 P99: 5118.00 P99.9: 5118.00 P99.99: 5118.00 ------------------------------------------------------ ( 380, 580 ] 3 15.000% 15.000% ### ( 580, 870 ] 6 30.000% 45.000% ###### ( 870, 1300 ] 4 20.000% 65.000% #### ( 1300, 1900 ] 2 10.000% 75.000% ## ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 2 10.000% 90.000% ## ( 4400, 6600 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 303.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.414 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-11:38:22 ... thread 0: (1000000,2000000) ops and (349934.8,340558.9) ops/second in (2.857675,5.872700) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.35 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 99.1 319.9 8.27 7.64 29 0.285 831K 866 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.2 245.9 1.02 0.99 1 1.024 255K 260 0.0 0.0 L2 2/1 82.07 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 17/8 868.63 MB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 226.8 226.8 0.82 0.76 1 0.824 189K 0 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 139.2 139.2 1.21 0.83 1 1.208 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/19 97.92 GB 0.0 1.6 0.7 0.9 3.4 2.5 1.4 1.9 133.8 284.6 12.11 10.97 34 0.356 1644K 1230 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.7 0.9 3.4 2.5 1.3 1.9 133.8 284.6 12.11 10.97 34 0.356 1644K 1230 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.7 0.9 1.6 0.7 0.0 0.0 234.9 234.7 6.90 6.32 8 0.862 1644K 1230 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.6 5.21 4.64 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.36 GB write, 564.83 MB/s write, 1.58 GB read, 265.52 MB/s read, 12.1 seconds Interval compaction: 3.36 GB write, 586.47 MB/s write, 1.58 GB read, 275.70 MB/s read, 12.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 391144 Average: 2.2264 StdDev: 15.41 Min: 0 Median: 1.4850 Max: 4227 Percentiles: P50: 1.49 P75: 1.88 P99: 5.68 P99.9: 9.76 P99.99: 15.90 ------------------------------------------------------ [ 0, 1 ] 76035 19.439% 19.439% #### ( 1, 2 ] 246461 63.010% 82.449% ############# ( 2, 3 ] 41825 10.693% 93.142% ## ( 3, 4 ] 13794 3.527% 96.669% # ( 4, 6 ] 10863 2.777% 99.446% # ( 6, 10 ] 1889 0.483% 99.929% ( 10, 15 ] 233 0.060% 99.989% ( 15, 22 ] 38 0.010% 99.998% ( 22, 34 ] 4 0.001% 99.999% ( 34, 51 ] 3 0.001% 100.000% ( 51, 76 ] 1 0.000% 100.001% ( 110, 170 ] 13 0.003% 100.004% ( 170, 250 ] 10 0.003% 100.006% ( 250, 380 ] 10 0.003% 100.009% ( 380, 580 ] 3 0.001% 100.010% ( 580, 870 ] 7 0.002% 100.012% ( 870, 1300 ] 3 0.001% 100.012% ( 1300, 1900 ] 6 0.002% 100.014% ( 1900, 2900 ] 1 0.000% 100.014% ( 2900, 4400 ] 5 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 667 Average: 6.2669 StdDev: 48.62 Min: 1 Median: 1.7191 Max: 995 Percentiles: P50: 1.72 P75: 2.43 P99: 17.31 P99.9: 995.00 P99.99: 995.00 ------------------------------------------------------ [ 0, 1 ] 66 9.895% 9.895% ## ( 1, 2 ] 372 55.772% 65.667% ########### ( 2, 3 ] 145 21.739% 87.406% #### ( 3, 4 ] 40 5.997% 93.403% # ( 4, 6 ] 24 3.598% 97.001% # ( 6, 10 ] 11 1.649% 98.651% ( 10, 15 ] 2 0.300% 98.951% ( 15, 22 ] 1 0.150% 99.100% ( 110, 170 ] 1 0.150% 99.250% ( 170, 250 ] 2 0.300% 99.550% ( 250, 380 ] 1 0.150% 99.700% ( 580, 870 ] 1 0.150% 99.850% ( 870, 1300 ] 1 0.150% 100.000% ** Level 2 read latency histogram (micros): Count: 50878 Average: 2.6946 StdDev: 18.81 Min: 0 Median: 1.5673 Max: 2842 Percentiles: P50: 1.57 P75: 1.95 P99: 6.52 P99.9: 142.63 P99.99: 764.85 ------------------------------------------------------ [ 0, 1 ] 6423 12.624% 12.624% ### ( 1, 2 ] 33521 65.885% 78.509% ############# ( 2, 3 ] 6175 12.137% 90.646% ## ( 3, 4 ] 2488 4.890% 95.536% # ( 4, 6 ] 1705 3.351% 98.888% # ( 6, 10 ] 444 0.873% 99.760% ( 10, 15 ] 43 0.085% 99.845% ( 15, 22 ] 3 0.006% 99.851% ( 22, 34 ] 2 0.004% 99.855% ( 34, 51 ] 1 0.002% 99.857% ( 51, 76 ] 1 0.002% 99.858% ( 76, 110 ] 1 0.002% 99.860% ( 110, 170 ] 37 0.073% 99.933% ( 170, 250 ] 12 0.024% 99.957% ( 250, 380 ] 8 0.016% 99.972% ( 380, 580 ] 7 0.014% 99.986% ( 580, 870 ] 3 0.006% 99.992% ( 870, 1300 ] 2 0.004% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 186654 Average: 3.6576 StdDev: 41.96 Min: 0 Median: 1.7049 Max: 6548 Percentiles: P50: 1.70 P75: 2.37 P99: 8.96 P99.9: 198.23 P99.99: 583.59 ------------------------------------------------------ [ 0, 1 ] 14393 7.711% 7.711% ## ( 1, 2 ] 111984 59.995% 67.707% ############ ( 2, 3 ] 36833 19.733% 87.440% #### ( 3, 4 ] 10037 5.377% 92.817% # ( 4, 6 ] 9161 4.908% 97.725% # ( 6, 10 ] 3214 1.722% 99.447% ( 10, 15 ] 405 0.217% 99.664% ( 15, 22 ] 103 0.055% 99.719% ( 22, 34 ] 27 0.014% 99.734% ( 34, 51 ] 5 0.003% 99.736% ( 51, 76 ] 3 0.002% 99.738% ( 76, 110 ] 67 0.036% 99.774% ( 110, 170 ] 205 0.110% 99.884% ( 170, 250 ] 86 0.046% 99.930% ( 250, 380 ] 63 0.034% 99.964% ( 380, 580 ] 49 0.026% 99.990% ( 580, 870 ] 27 0.014% 100.004% ( 870, 1300 ] 13 0.007% 100.011% ( 1300, 1900 ] 11 0.006% 100.017% ( 1900, 2900 ] 8 0.004% 100.021% ( 2900, 4400 ] 11 0.006% 100.027% ( 4400, 6600 ] 2 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 305 Average: 116.4230 StdDev: 574.26 Min: 0 Median: 1.3050 Max: 5118 Percentiles: P50: 1.30 P75: 3.55 P99: 3612.50 P99.9: 5118.00 P99.99: 5118.00 ------------------------------------------------------ [ 0, 1 ] 122 40.000% 40.000% ######## ( 1, 2 ] 100 32.787% 72.787% ####### ( 2, 3 ] 4 1.311% 74.098% ( 3, 4 ] 5 1.639% 75.738% ( 4, 6 ] 10 3.279% 79.016% # ( 6, 10 ] 43 14.098% 93.115% ### ( 380, 580 ] 4 1.311% 94.426% ( 580, 870 ] 6 1.967% 96.393% ( 870, 1300 ] 4 1.311% 97.705% ( 1300, 1900 ] 2 0.656% 98.361% ( 1900, 2900 ] 1 0.328% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 863.0500 StdDev: 1290.08 Min: 79 Median: 250.0000 Max: 4786 Percentiles: P50: 250.00 P75: 870.00 P99: 4786.00 P99.9: 4786.00 P99.99: 4786.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.620 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.206 H:M:S, 7.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/24-11:38:25 ... thread 0: (1000000,3000000) ops and (330488.2,337134.4) ops/second in (3.025827,8.898527) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.27 GB 94.4 1.6 0.0 1.6 4.3 2.7 0.0 1.6 117.4 316.0 13.95 12.99 45 0.310 1663K 1717 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.2 245.9 1.02 0.99 1 1.024 255K 260 0.0 0.0 L2 1/0 77.63 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 15/0 870.08 MB 0.9 0.8 0.2 0.7 0.8 0.2 0.3 4.5 224.7 223.9 3.87 3.61 2 1.935 883K 3030 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 139.2 139.2 1.21 0.83 1 1.208 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/10 98.84 GB 0.0 3.0 0.7 2.3 5.7 3.4 1.4 2.1 149.8 282.6 20.84 19.17 51 0.409 3169K 5111 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 0.7 2.3 5.7 3.4 1.3 2.1 149.8 282.6 20.84 19.17 51 0.409 3169K 5111 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 0.7 2.3 3.0 0.7 0.0 0.0 240.7 240.3 12.97 12.15 12 1.081 3169K 5111 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 352.3 7.87 7.02 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.75 GB write, 645.24 MB/s write, 3.05 GB read, 342.05 MB/s read, 20.8 seconds Interval compaction: 5.75 GB write, 661.55 MB/s write, 3.05 GB read, 350.70 MB/s read, 20.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 803769 Average: 2.2282 StdDev: 11.39 Min: 0 Median: 1.5241 Max: 4227 Percentiles: P50: 1.52 P75: 1.91 P99: 5.60 P99.9: 9.47 P99.99: 13.16 ------------------------------------------------------ [ 0, 1 ] 126333 15.718% 15.718% ### ( 1, 2 ] 525715 65.406% 81.124% ############# ( 2, 3 ] 97944 12.186% 93.309% ## ( 3, 4 ] 28571 3.555% 96.864% # ( 4, 6 ] 21518 2.677% 99.541% # ( 6, 10 ] 3323 0.413% 99.955% ( 10, 15 ] 453 0.056% 100.011% ( 15, 22 ] 53 0.007% 100.018% ( 22, 34 ] 7 0.001% 100.018% ( 34, 51 ] 7 0.001% 100.019% ( 51, 76 ] 3 0.000% 100.020% ( 110, 170 ] 20 0.002% 100.022% ( 170, 250 ] 15 0.002% 100.024% ( 250, 380 ] 14 0.002% 100.026% ( 380, 580 ] 9 0.001% 100.027% ( 580, 870 ] 13 0.002% 100.028% ( 870, 1300 ] 6 0.001% 100.029% ( 1300, 1900 ] 7 0.001% 100.030% ( 1900, 2900 ] 1 0.000% 100.030% ( 2900, 4400 ] 5 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 667 Average: 6.2669 StdDev: 48.62 Min: 1 Median: 1.7191 Max: 995 Percentiles: P50: 1.72 P75: 2.43 P99: 17.31 P99.9: 995.00 P99.99: 995.00 ------------------------------------------------------ [ 0, 1 ] 66 9.895% 9.895% ## ( 1, 2 ] 372 55.772% 65.667% ########### ( 2, 3 ] 145 21.739% 87.406% #### ( 3, 4 ] 40 5.997% 93.403% # ( 4, 6 ] 24 3.598% 97.001% # ( 6, 10 ] 11 1.649% 98.651% ( 10, 15 ] 2 0.300% 98.951% ( 15, 22 ] 1 0.150% 99.100% ( 110, 170 ] 1 0.150% 99.250% ( 170, 250 ] 2 0.300% 99.550% ( 250, 380 ] 1 0.150% 99.700% ( 580, 870 ] 1 0.150% 99.850% ( 870, 1300 ] 1 0.150% 100.000% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186684 Average: 3.7015 StdDev: 42.47 Min: 0 Median: 1.7049 Max: 6548 Percentiles: P50: 1.70 P75: 2.37 P99: 8.98 P99.9: 207.99 P99.99: 637.27 ------------------------------------------------------ [ 0, 1 ] 14402 7.715% 7.715% ## ( 1, 2 ] 111992 59.990% 67.705% ############ ( 2, 3 ] 36834 19.731% 87.435% #### ( 3, 4 ] 10037 5.376% 92.812% # ( 4, 6 ] 9161 4.907% 97.719% # ( 6, 10 ] 3214 1.722% 99.441% ( 10, 15 ] 405 0.217% 99.658% ( 15, 22 ] 103 0.055% 99.713% ( 22, 34 ] 27 0.014% 99.727% ( 34, 51 ] 5 0.003% 99.730% ( 51, 76 ] 3 0.002% 99.732% ( 76, 110 ] 67 0.036% 99.768% ( 110, 170 ] 206 0.110% 99.878% ( 170, 250 ] 87 0.047% 99.924% ( 250, 380 ] 66 0.035% 99.960% ( 380, 580 ] 51 0.027% 99.987% ( 580, 870 ] 27 0.014% 100.002% ( 870, 1300 ] 17 0.009% 100.011% ( 1300, 1900 ] 12 0.006% 100.017% ( 1900, 2900 ] 8 0.004% 100.021% ( 2900, 4400 ] 11 0.006% 100.027% ( 4400, 6600 ] 2 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 305 Average: 116.4230 StdDev: 574.26 Min: 0 Median: 1.3050 Max: 5118 Percentiles: P50: 1.30 P75: 3.55 P99: 3612.50 P99.9: 5118.00 P99.99: 5118.00 ------------------------------------------------------ [ 0, 1 ] 122 40.000% 40.000% ######## ( 1, 2 ] 100 32.787% 72.787% ####### ( 2, 3 ] 4 1.311% 74.098% ( 3, 4 ] 5 1.639% 75.738% ( 4, 6 ] 10 3.279% 79.016% # ( 6, 10 ] 43 14.098% 93.115% ### ( 380, 580 ] 4 1.311% 94.426% ( 580, 870 ] 6 1.967% 96.393% ( 870, 1300 ] 4 1.311% 97.705% ( 1300, 1900 ] 2 0.656% 98.361% ( 1900, 2900 ] 1 0.328% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 863.0500 StdDev: 1290.08 Min: 79 Median: 250.0000 Max: 4786 Percentiles: P50: 250.00 P75: 870.00 P99: 4786.00 P99.9: 4786.00 P99.99: 4786.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.020 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-11:38:28 ... thread 0: (1000000,4000000) ops and (335807.6,336801.7) ops/second in (2.977896,11.876423) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.21 GB 6.3 2.5 0.0 2.5 6.1 3.7 0.0 1.7 126.0 314.9 19.99 18.67 62 0.322 2558K 2752 0.0 0.0 L1 10/10 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 236.3 235.4 5.59 5.43 2 2.797 1342K 4986 0.0 0.0 L2 1/0 77.63 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 15/0 870.08 MB 0.9 0.8 0.2 0.7 0.8 0.2 0.3 4.5 224.7 223.9 3.87 3.61 2 1.935 883K 3030 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 139.2 139.2 1.21 0.83 1 1.208 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/23 99.82 GB 0.0 5.0 1.8 3.2 8.6 5.4 1.4 2.3 161.3 281.1 31.45 29.30 69 0.456 5151K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.8 3.2 8.6 5.4 1.3 2.3 161.3 281.1 31.45 29.30 69 0.456 5151K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.8 3.2 4.9 1.8 0.0 0.0 243.8 243.2 20.81 19.81 16 1.301 5151K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.3 10.64 9.49 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.63 GB write, 730.54 MB/s write, 4.95 GB read, 419.16 MB/s read, 31.5 seconds Interval compaction: 8.63 GB write, 744.38 MB/s write, 4.95 GB read, 427.10 MB/s read, 31.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1075050 Average: 2.1930 StdDev: 10.85 Min: 0 Median: 1.5016 Max: 4227 Percentiles: P50: 1.50 P75: 1.88 P99: 5.55 P99.9: 9.52 P99.99: 13.51 ------------------------------------------------------ [ 0, 1 ] 185554 17.260% 17.260% ### ( 1, 2 ] 701701 65.271% 82.532% ############# ( 2, 3 ] 121445 11.297% 93.828% ## ( 3, 4 ] 35829 3.333% 97.161% # ( 4, 6 ] 25581 2.380% 99.540% ( 6, 10 ] 4400 0.409% 99.950% ( 10, 15 ] 619 0.058% 100.007% ( 15, 22 ] 74 0.007% 100.014% ( 22, 34 ] 8 0.001% 100.015% ( 34, 51 ] 7 0.001% 100.016% ( 51, 76 ] 5 0.000% 100.016% ( 76, 110 ] 18 0.002% 100.018% ( 110, 170 ] 31 0.003% 100.021% ( 170, 250 ] 23 0.002% 100.023% ( 250, 380 ] 26 0.002% 100.025% ( 380, 580 ] 12 0.001% 100.026% ( 580, 870 ] 19 0.002% 100.028% ( 870, 1300 ] 7 0.001% 100.029% ( 1300, 1900 ] 11 0.001% 100.030% ( 1900, 2900 ] 2 0.000% 100.030% ( 2900, 4400 ] 5 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 18386 Average: 3.3984 StdDev: 28.65 Min: 0 Median: 1.3924 Max: 1578 Percentiles: P50: 1.39 P75: 1.79 P99: 8.74 P99.9: 420.35 P99.99: 1348.42 ------------------------------------------------------ [ 0, 1 ] 4662 25.356% 25.356% ##### ( 1, 2 ] 11547 62.803% 88.159% ############# ( 2, 3 ] 1145 6.228% 94.387% # ( 3, 4 ] 406 2.208% 96.595% ( 4, 6 ] 277 1.507% 98.102% ( 6, 10 ] 241 1.311% 99.413% ( 10, 15 ] 15 0.082% 99.494% ( 15, 22 ] 5 0.027% 99.521% ( 110, 170 ] 53 0.288% 99.810% ( 170, 250 ] 7 0.038% 99.848% ( 250, 380 ] 8 0.044% 99.891% ( 380, 580 ] 8 0.044% 99.935% ( 580, 870 ] 6 0.033% 99.967% ( 870, 1300 ] 4 0.022% 99.989% ( 1300, 1900 ] 2 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186684 Average: 3.7015 StdDev: 42.47 Min: 0 Median: 1.7049 Max: 6548 Percentiles: P50: 1.70 P75: 2.37 P99: 8.98 P99.9: 207.99 P99.99: 637.27 ------------------------------------------------------ [ 0, 1 ] 14402 7.715% 7.715% ## ( 1, 2 ] 111992 59.990% 67.705% ############ ( 2, 3 ] 36834 19.731% 87.435% #### ( 3, 4 ] 10037 5.376% 92.812% # ( 4, 6 ] 9161 4.907% 97.719% # ( 6, 10 ] 3214 1.722% 99.441% ( 10, 15 ] 405 0.217% 99.658% ( 15, 22 ] 103 0.055% 99.713% ( 22, 34 ] 27 0.014% 99.727% ( 34, 51 ] 5 0.003% 99.730% ( 51, 76 ] 3 0.002% 99.732% ( 76, 110 ] 67 0.036% 99.768% ( 110, 170 ] 206 0.110% 99.878% ( 170, 250 ] 87 0.047% 99.924% ( 250, 380 ] 66 0.035% 99.960% ( 380, 580 ] 51 0.027% 99.987% ( 580, 870 ] 27 0.014% 100.002% ( 870, 1300 ] 17 0.009% 100.011% ( 1300, 1900 ] 12 0.006% 100.017% ( 1900, 2900 ] 8 0.004% 100.021% ( 2900, 4400 ] 11 0.006% 100.027% ( 4400, 6600 ] 2 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 305 Average: 116.4230 StdDev: 574.26 Min: 0 Median: 1.3050 Max: 5118 Percentiles: P50: 1.30 P75: 3.55 P99: 3612.50 P99.9: 5118.00 P99.99: 5118.00 ------------------------------------------------------ [ 0, 1 ] 122 40.000% 40.000% ######## ( 1, 2 ] 100 32.787% 72.787% ####### ( 2, 3 ] 4 1.311% 74.098% ( 3, 4 ] 5 1.639% 75.738% ( 4, 6 ] 10 3.279% 79.016% # ( 6, 10 ] 43 14.098% 93.115% ### ( 380, 580 ] 4 1.311% 94.426% ( 580, 870 ] 6 1.967% 96.393% ( 870, 1300 ] 4 1.311% 97.705% ( 1300, 1900 ] 2 0.656% 98.361% ( 1900, 2900 ] 1 0.328% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 863.0500 StdDev: 1290.08 Min: 79 Median: 250.0000 Max: 4786 Percentiles: P50: 250.00 P75: 870.00 P99: 4786.00 P99.9: 4786.00 P99.99: 4786.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.409 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-11:38:31 ... thread 0: (1000000,5000000) ops and (328078.1,335020.1) ops/second in (3.048055,14.924478) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.20 GB 100.7 3.3 0.0 3.3 7.9 4.7 0.0 1.7 129.1 314.1 25.86 24.19 79 0.327 3390K 3655 0.0 0.0 L1 10/10 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 236.3 235.4 5.59 5.43 2 2.797 1342K 4986 0.0 0.0 L2 1/0 77.63 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 15/0 870.08 MB 0.9 0.8 0.2 0.7 0.8 0.2 0.3 4.5 224.7 223.9 3.87 3.61 2 1.935 883K 3030 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 139.2 139.2 1.21 0.83 1 1.208 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/23 100.80 GB 0.0 5.8 1.8 4.0 10.4 6.4 1.4 2.2 157.9 285.9 37.32 34.81 86 0.434 5983K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 1.8 4.0 10.4 6.4 1.3 2.2 157.9 285.9 37.32 34.81 86 0.434 5983K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 1.8 4.0 5.7 1.8 0.0 0.0 247.0 246.5 23.86 22.79 19 1.256 5983K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.7 13.46 12.01 67 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 14.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.42 GB write, 704.09 MB/s write, 5.75 GB read, 388.89 MB/s read, 37.3 seconds Interval compaction: 10.42 GB write, 714.71 MB/s write, 5.75 GB read, 394.75 MB/s read, 37.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1419772 Average: 2.2052 StdDev: 10.57 Min: 0 Median: 1.5086 Max: 4227 Percentiles: P50: 1.51 P75: 1.89 P99: 5.53 P99.9: 9.50 P99.99: 13.76 ------------------------------------------------------ [ 0, 1 ] 233719 16.462% 16.462% ### ( 1, 2 ] 936176 65.938% 82.400% ############# ( 2, 3 ] 163386 11.508% 93.908% ## ( 3, 4 ] 47166 3.322% 97.230% # ( 4, 6 ] 32855 2.314% 99.544% ( 6, 10 ] 5772 0.407% 99.951% ( 10, 15 ] 743 0.052% 100.003% ( 15, 22 ] 97 0.007% 100.010% ( 22, 34 ] 13 0.001% 100.011% ( 34, 51 ] 7 0.000% 100.011% ( 51, 76 ] 7 0.000% 100.012% ( 76, 110 ] 37 0.003% 100.015% ( 110, 170 ] 60 0.004% 100.019% ( 170, 250 ] 42 0.003% 100.022% ( 250, 380 ] 39 0.003% 100.024% ( 380, 580 ] 18 0.001% 100.026% ( 580, 870 ] 30 0.002% 100.028% ( 870, 1300 ] 12 0.001% 100.029% ( 1300, 1900 ] 11 0.001% 100.029% ( 1900, 2900 ] 3 0.000% 100.030% ( 2900, 4400 ] 6 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 80340 Average: 2.8904 StdDev: 19.93 Min: 0 Median: 1.5429 Max: 3030 Percentiles: P50: 1.54 P75: 1.92 P99: 8.28 P99.9: 177.60 P99.99: 868.59 ------------------------------------------------------ [ 0, 1 ] 10980 13.667% 13.667% ### ( 1, 2 ] 53766 66.923% 80.590% ############# ( 2, 3 ] 9906 12.330% 92.920% ## ( 3, 4 ] 2405 2.994% 95.914% # ( 4, 6 ] 1784 2.221% 98.134% ( 6, 10 ] 1218 1.516% 99.650% ( 10, 15 ] 54 0.067% 99.717% ( 15, 22 ] 10 0.012% 99.730% ( 22, 34 ] 1 0.001% 99.731% ( 76, 110 ] 20 0.025% 99.756% ( 110, 170 ] 113 0.141% 99.897% ( 170, 250 ] 28 0.035% 99.932% ( 250, 380 ] 16 0.020% 99.951% ( 380, 580 ] 24 0.030% 99.981% ( 580, 870 ] 7 0.009% 99.990% ( 870, 1300 ] 5 0.006% 99.996% ( 1300, 1900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186684 Average: 3.7015 StdDev: 42.47 Min: 0 Median: 1.7049 Max: 6548 Percentiles: P50: 1.70 P75: 2.37 P99: 8.98 P99.9: 207.99 P99.99: 637.27 ------------------------------------------------------ [ 0, 1 ] 14402 7.715% 7.715% ## ( 1, 2 ] 111992 59.990% 67.705% ############ ( 2, 3 ] 36834 19.731% 87.435% #### ( 3, 4 ] 10037 5.376% 92.812% # ( 4, 6 ] 9161 4.907% 97.719% # ( 6, 10 ] 3214 1.722% 99.441% ( 10, 15 ] 405 0.217% 99.658% ( 15, 22 ] 103 0.055% 99.713% ( 22, 34 ] 27 0.014% 99.727% ( 34, 51 ] 5 0.003% 99.730% ( 51, 76 ] 3 0.002% 99.732% ( 76, 110 ] 67 0.036% 99.768% ( 110, 170 ] 206 0.110% 99.878% ( 170, 250 ] 87 0.047% 99.924% ( 250, 380 ] 66 0.035% 99.960% ( 380, 580 ] 51 0.027% 99.987% ( 580, 870 ] 27 0.014% 100.002% ( 870, 1300 ] 17 0.009% 100.011% ( 1300, 1900 ] 12 0.006% 100.017% ( 1900, 2900 ] 8 0.004% 100.021% ( 2900, 4400 ] 11 0.006% 100.027% ( 4400, 6600 ] 2 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 305 Average: 116.4230 StdDev: 574.26 Min: 0 Median: 1.3050 Max: 5118 Percentiles: P50: 1.30 P75: 3.55 P99: 3612.50 P99.9: 5118.00 P99.99: 5118.00 ------------------------------------------------------ [ 0, 1 ] 122 40.000% 40.000% ######## ( 1, 2 ] 100 32.787% 72.787% ####### ( 2, 3 ] 4 1.311% 74.098% ( 3, 4 ] 5 1.639% 75.738% ( 4, 6 ] 10 3.279% 79.016% # ( 6, 10 ] 43 14.098% 93.115% ### ( 380, 580 ] 4 1.311% 94.426% ( 580, 870 ] 6 1.967% 96.393% ( 870, 1300 ] 4 1.311% 97.705% ( 1300, 1900 ] 2 0.656% 98.361% ( 1900, 2900 ] 1 0.328% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 863.0500 StdDev: 1290.08 Min: 79 Median: 250.0000 Max: 4786 Percentiles: P50: 250.00 P75: 870.00 P99: 4786.00 P99.9: 4786.00 P99.99: 4786.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.2 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 324.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.839 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-11:38:40 ... thread 0: (1000000,6000000) ops and (105642.8,245999.1) ops/second in (9.465858,24.390336) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 2.33 GB 0.0 5.4 0.0 5.4 11.1 5.7 0.0 1.9 150.0 308.4 36.94 34.80 101 0.366 5628K 7573 0.0 0.0 L1 16/16 1.90 GB 0.0 4.2 3.2 1.0 4.2 3.2 0.2 1.3 229.5 227.3 18.90 18.20 3 6.299 4405K 42K 0.0 0.0 L2 9/5 1.08 GB 5.2 0.2 0.1 0.1 0.2 0.1 1.3 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 15/8 870.08 MB 0.7 0.8 0.2 0.7 0.8 0.2 0.3 4.5 224.7 223.9 3.87 3.61 2 1.935 883K 3030 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 139.2 139.2 1.21 0.83 1 1.208 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/37 101.81 GB 0.0 10.9 3.7 7.2 16.5 9.3 2.4 2.9 180.1 274.2 61.71 58.19 109 0.566 11M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.9 3.7 7.2 16.5 9.3 2.3 2.9 180.1 274.2 61.71 58.19 109 0.566 11M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.9 3.7 7.2 10.8 3.6 0.0 0.0 245.9 244.7 45.20 43.47 26 1.738 11M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.9 16.51 14.72 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.6 total, 24.4 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.52 GB write, 687.21 MB/s write, 10.85 GB read, 451.41 MB/s read, 61.7 seconds Interval compaction: 16.52 GB write, 693.55 MB/s write, 10.85 GB read, 455.57 MB/s read, 61.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 17, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2284768 Average: 2.2496 StdDev: 11.07 Min: 0 Median: 1.4937 Max: 4227 Percentiles: P50: 1.49 P75: 1.87 P99: 5.59 P99.9: 10.15 P99.99: 126.07 ------------------------------------------------------ [ 0, 1 ] 393451 17.221% 17.221% ### ( 1, 2 ] 1517063 66.399% 83.620% ############# ( 2, 3 ] 241744 10.581% 94.200% ## ( 3, 4 ] 71501 3.129% 97.330% # ( 4, 6 ] 48139 2.107% 99.437% ( 6, 10 ] 10548 0.462% 99.898% ( 10, 15 ] 1251 0.055% 99.953% ( 15, 22 ] 317 0.014% 99.967% ( 22, 34 ] 22 0.001% 99.968% ( 34, 51 ] 7 0.000% 99.968% ( 51, 76 ] 12 0.001% 99.969% ( 76, 110 ] 356 0.016% 99.984% ( 110, 170 ] 480 0.021% 100.005% ( 170, 250 ] 182 0.008% 100.013% ( 250, 380 ] 124 0.005% 100.019% ( 380, 580 ] 82 0.004% 100.022% ( 580, 870 ] 67 0.003% 100.025% ( 870, 1300 ] 24 0.001% 100.026% ( 1300, 1900 ] 15 0.001% 100.027% ( 1900, 2900 ] 5 0.000% 100.027% ( 2900, 4400 ] 9 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 271413 Average: 2.8520 StdDev: 19.65 Min: 0 Median: 1.4946 Max: 3294 Percentiles: P50: 1.49 P75: 1.87 P99: 7.96 P99.9: 201.82 P99.99: 868.76 ------------------------------------------------------ [ 0, 1 ] 47182 17.384% 17.384% ### ( 1, 2 ] 178998 65.950% 83.334% ############# ( 2, 3 ] 27739 10.220% 93.554% ## ( 3, 4 ] 7444 2.743% 96.297% # ( 4, 6 ] 5787 2.132% 98.429% ( 6, 10 ] 3161 1.165% 99.594% ( 10, 15 ] 192 0.071% 99.665% ( 15, 22 ] 52 0.019% 99.684% ( 22, 34 ] 5 0.002% 99.686% ( 34, 51 ] 1 0.000% 99.686% ( 51, 76 ] 7 0.003% 99.689% ( 76, 110 ] 280 0.103% 99.792% ( 110, 170 ] 255 0.094% 99.886% ( 170, 250 ] 97 0.036% 99.922% ( 250, 380 ] 78 0.029% 99.950% ( 380, 580 ] 75 0.028% 99.978% ( 580, 870 ] 33 0.012% 99.990% ( 870, 1300 ] 21 0.008% 99.998% ( 1300, 1900 ] 4 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186685 Average: 3.7046 StdDev: 42.49 Min: 0 Median: 1.7049 Max: 6548 Percentiles: P50: 1.70 P75: 2.37 P99: 8.98 P99.9: 208.91 P99.99: 645.58 ------------------------------------------------------ [ 0, 1 ] 14402 7.715% 7.715% ## ( 1, 2 ] 111992 59.990% 67.704% ############ ( 2, 3 ] 36834 19.731% 87.435% #### ( 3, 4 ] 10037 5.376% 92.811% # ( 4, 6 ] 9161 4.907% 97.719% # ( 6, 10 ] 3214 1.722% 99.440% ( 10, 15 ] 405 0.217% 99.657% ( 15, 22 ] 103 0.055% 99.712% ( 22, 34 ] 27 0.014% 99.727% ( 34, 51 ] 5 0.003% 99.729% ( 51, 76 ] 3 0.002% 99.731% ( 76, 110 ] 67 0.036% 99.767% ( 110, 170 ] 206 0.110% 99.877% ( 170, 250 ] 87 0.047% 99.924% ( 250, 380 ] 66 0.035% 99.959% ( 380, 580 ] 51 0.027% 99.987% ( 580, 870 ] 28 0.015% 100.002% ( 870, 1300 ] 17 0.009% 100.011% ( 1300, 1900 ] 12 0.006% 100.017% ( 1900, 2900 ] 8 0.004% 100.021% ( 2900, 4400 ] 11 0.006% 100.027% ( 4400, 6600 ] 2 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 305 Average: 116.4230 StdDev: 574.26 Min: 0 Median: 1.3050 Max: 5118 Percentiles: P50: 1.30 P75: 3.55 P99: 3612.50 P99.9: 5118.00 P99.99: 5118.00 ------------------------------------------------------ [ 0, 1 ] 122 40.000% 40.000% ######## ( 1, 2 ] 100 32.787% 72.787% ####### ( 2, 3 ] 4 1.311% 74.098% ( 3, 4 ] 5 1.639% 75.738% ( 4, 6 ] 10 3.279% 79.016% # ( 6, 10 ] 43 14.098% 93.115% ### ( 380, 580 ] 4 1.311% 94.426% ( 580, 870 ] 6 1.967% 96.393% ( 870, 1300 ] 4 1.311% 97.705% ( 1300, 1900 ] 2 0.656% 98.361% ( 1900, 2900 ] 1 0.328% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 863.0500 StdDev: 1290.08 Min: 79 Median: 250.0000 Max: 4786 Percentiles: P50: 250.00 P75: 870.00 P99: 4786.00 P99.9: 4786.00 P99.99: 4786.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 24.6 total, 9.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 239.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.590 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.751 H:M:S, 71.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 0 2024/07/24-11:38:47 ... thread 0: (1000000,7000000) ops and (160797.9,228688.5) ops/second in (6.218988,30.609324) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 3.19 GB 62.9 5.9 0.0 5.9 12.5 6.6 0.0 1.9 145.2 306.8 41.65 38.99 116 0.359 6139K 8080 0.0 0.0 L1 16/16 1.90 GB 0.0 4.2 3.2 1.0 4.2 3.2 0.2 1.3 229.5 227.3 18.90 18.20 3 6.299 4405K 42K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.3 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 24/0 974.73 MB 1.0 2.1 1.3 0.9 2.1 1.3 0.3 1.7 220.1 219.5 9.92 9.15 5 1.984 2217K 5738 0.0 0.0 L4 173/0 9.69 GB 1.0 0.6 0.6 0.0 0.6 0.6 0.8 1.0 128.3 128.1 5.02 3.05 10 0.502 650K 794 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/28 102.66 GB 0.0 13.1 5.2 7.9 19.6 11.7 4.0 3.0 175.8 263.4 76.27 70.13 136 0.561 13M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 5.2 7.9 19.6 11.7 3.9 3.0 175.8 263.4 76.27 70.13 136 0.561 13M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 5.2 7.9 13.0 5.1 0.0 0.0 235.1 234.1 57.02 53.15 40 1.426 13M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 350.2 19.25 16.98 96 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.8 total, 30.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.62 GB write, 651.46 MB/s write, 13.09 GB read, 434.75 MB/s read, 76.3 seconds Interval compaction: 19.62 GB write, 656.25 MB/s write, 13.09 GB read, 437.94 MB/s read, 76.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 18, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2685051 Average: 2.3474 StdDev: 14.68 Min: 0 Median: 1.5054 Max: 4255 Percentiles: P50: 1.51 P75: 1.88 P99: 5.71 P99.9: 12.29 P99.99: 162.71 ------------------------------------------------------ [ 0, 1 ] 439069 16.352% 16.352% ### ( 1, 2 ] 1787740 66.581% 82.934% ############# ( 2, 3 ] 290391 10.815% 93.749% ## ( 3, 4 ] 88687 3.303% 97.052% # ( 4, 6 ] 61083 2.275% 99.327% ( 6, 10 ] 14659 0.546% 99.873% ( 10, 15 ] 1610 0.060% 99.933% ( 15, 22 ] 413 0.015% 99.948% ( 22, 34 ] 33 0.001% 99.949% ( 34, 51 ] 10 0.000% 99.949% ( 51, 76 ] 14 0.001% 99.950% ( 76, 110 ] 457 0.017% 99.967% ( 110, 170 ] 704 0.026% 99.993% ( 170, 250 ] 301 0.011% 100.004% ( 250, 380 ] 197 0.007% 100.012% ( 380, 580 ] 173 0.006% 100.018% ( 580, 870 ] 113 0.004% 100.022% ( 870, 1300 ] 43 0.002% 100.024% ( 1300, 1900 ] 20 0.001% 100.025% ( 1900, 2900 ] 17 0.001% 100.025% ( 2900, 4400 ] 19 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 659028 Average: 2.8102 StdDev: 31.71 Min: 0 Median: 1.5443 Max: 20200 Percentiles: P50: 1.54 P75: 1.92 P99: 8.15 P99.9: 149.26 P99.99: 519.84 ------------------------------------------------------ [ 0, 1 ] 88821 13.478% 13.478% ### ( 1, 2 ] 442195 67.098% 80.576% ############# ( 2, 3 ] 75919 11.520% 92.095% ## ( 3, 4 ] 22995 3.489% 95.585% # ( 4, 6 ] 17609 2.672% 98.257% # ( 6, 10 ] 9117 1.383% 99.640% ( 10, 15 ] 668 0.101% 99.741% ( 15, 22 ] 159 0.024% 99.766% ( 22, 34 ] 16 0.002% 99.768% ( 34, 51 ] 3 0.000% 99.768% ( 51, 76 ] 29 0.004% 99.773% ( 76, 110 ] 499 0.076% 99.849% ( 110, 170 ] 518 0.079% 99.927% ( 170, 250 ] 185 0.028% 99.955% ( 250, 380 ] 141 0.021% 99.977% ( 380, 580 ] 126 0.019% 99.996% ( 580, 870 ] 62 0.009% 100.005% ( 870, 1300 ] 27 0.004% 100.009% ( 1300, 1900 ] 7 0.001% 100.010% ( 1900, 2900 ] 1 0.000% 100.010% ( 2900, 4400 ] 4 0.001% 100.011% ( 6600, 9900 ] 1 0.000% 100.011% ( 14000, 22000 ] 1 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 319623 Average: 4.1006 StdDev: 50.45 Min: 0 Median: 1.8044 Max: 8020 Percentiles: P50: 1.80 P75: 2.65 P99: 8.67 P99.9: 130.53 P99.99: 188.40 ------------------------------------------------------ [ 0, 1 ] 16971 5.310% 5.310% # ( 1, 2 ] 177573 55.557% 60.867% ########### ( 2, 3 ] 68988 21.584% 82.451% #### ( 3, 4 ] 24628 7.705% 90.156% ## ( 4, 6 ] 24835 7.770% 97.926% ## ( 6, 10 ] 5133 1.606% 99.532% ( 10, 15 ] 702 0.220% 99.752% ( 15, 22 ] 144 0.045% 99.797% ( 22, 34 ] 29 0.009% 99.806% ( 34, 51 ] 6 0.002% 99.808% ( 51, 76 ] 4 0.001% 99.809% ( 76, 110 ] 160 0.050% 99.859% ( 110, 170 ] 381 0.119% 99.978% ( 170, 250 ] 161 0.050% 100.029% ( 250, 380 ] 149 0.047% 100.075% ( 380, 580 ] 97 0.030% 100.106% ( 580, 870 ] 51 0.016% 100.122% ( 870, 1300 ] 28 0.009% 100.130% ( 1300, 1900 ] 18 0.006% 100.136% ( 1900, 2900 ] 10 0.003% 100.139% ( 2900, 4400 ] 33 0.010% 100.150% ( 4400, 6600 ] 2 0.001% 100.150% ( 6600, 9900 ] 1 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 6971 Average: 54.4203 StdDev: 274.66 Min: 0 Median: 2.0100 Max: 7256 Percentiles: P50: 2.01 P75: 3.41 P99: 947.28 P99.9: 4188.82 P99.99: 7256.00 ------------------------------------------------------ [ 0, 1 ] 271 3.888% 3.888% # ( 1, 2 ] 3200 45.904% 49.792% ######### ( 2, 3 ] 1448 20.772% 70.564% #### ( 3, 4 ] 761 10.917% 81.480% ## ( 4, 6 ] 471 6.757% 88.237% # ( 6, 10 ] 182 2.611% 90.848% # ( 10, 15 ] 16 0.230% 91.077% ( 15, 22 ] 4 0.057% 91.135% ( 76, 110 ] 25 0.359% 91.493% ( 110, 170 ] 77 1.105% 92.598% ( 170, 250 ] 80 1.148% 93.746% ( 250, 380 ] 101 1.449% 95.194% ( 380, 580 ] 152 2.180% 97.375% ( 580, 870 ] 107 1.535% 98.910% ( 870, 1300 ] 35 0.502% 99.412% ( 1300, 1900 ] 12 0.172% 99.584% ( 1900, 2900 ] 10 0.143% 99.727% ( 2900, 4400 ] 14 0.201% 99.928% ( 4400, 6600 ] 3 0.043% 99.971% ( 6600, 9900 ] 1 0.014% 99.986% ** Level 5 read latency histogram (micros): Count: 80 Average: 764.6375 StdDev: 1078.31 Min: 79 Median: 190.0000 Max: 4786 Percentiles: P50: 190.00 P75: 833.75 P99: 4786.00 P99.9: 4786.00 P99.99: 4786.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 25 31.250% 48.750% ###### ( 170, 250 ] 4 5.000% 53.750% # ( 250, 380 ] 4 5.000% 58.750% # ( 380, 580 ] 6 7.500% 66.250% ## ( 580, 870 ] 8 10.000% 76.250% ## ( 870, 1300 ] 3 3.750% 80.000% # ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 4 5.000% 90.000% # ( 2900, 4400 ] 7 8.750% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 30.8 total, 6.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 223.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.027 H:M:S, 39.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 158.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.438 H:M:S, 55.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-11:39:05 ... thread 0: (1000000,8000000) ops and (54597.5,163515.0) ops/second in (18.315860,48.925184) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/2 1.83 GB 6.3 8.5 0.0 8.5 16.0 7.5 0.0 2.1 152.3 287.7 57.07 52.04 135 0.423 8825K 19K 0.0 0.0 L1 0/0 0.00 KB 0.0 8.5 5.5 2.9 8.4 5.4 0.2 1.5 221.9 219.0 39.09 36.33 4 9.773 8367K 42K 0.0 0.0 L2 21/18 2.55 GB 3.5 0.2 0.1 0.1 0.2 0.1 5.5 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 33/13 2.22 GB 1.3 4.8 2.9 1.9 4.8 2.9 0.3 1.7 165.6 164.6 29.86 21.81 17 1.756 5021K 27K 0.0 0.0 L4 173/6 9.71 GB 1.0 1.0 0.9 0.0 1.0 0.9 0.8 1.0 132.0 131.8 7.48 4.64 14 0.534 993K 1106 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/39 103.54 GB 0.0 22.9 9.5 13.5 30.3 16.9 8.4 4.0 174.9 231.4 134.28 115.55 172 0.781 23M 91K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.9 9.5 13.5 30.3 16.9 8.3 4.0 174.9 231.4 134.28 115.55 172 0.781 23M 91K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.9 9.5 13.5 22.8 9.3 0.0 0.0 210.1 208.6 111.82 95.94 62 1.804 23M 91K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 345.0 22.46 19.62 110 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.2 total, 48.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.35 GB write, 632.23 MB/s write, 22.94 GB read, 477.91 MB/s read, 134.3 seconds Interval compaction: 30.35 GB write, 635.14 MB/s write, 22.94 GB read, 480.11 MB/s read, 134.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 20, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3758891 Average: 3.0434 StdDev: 28.32 Min: 0 Median: 1.5210 Max: 8397 Percentiles: P50: 1.52 P75: 1.90 P99: 7.35 P99.9: 160.59 P99.99: 413.70 ------------------------------------------------------ [ 0, 1 ] 602909 16.040% 16.040% ### ( 1, 2 ] 2450263 65.186% 81.225% ############# ( 2, 3 ] 419996 11.173% 92.399% ## ( 3, 4 ] 134921 3.589% 95.988% # ( 4, 6 ] 103895 2.764% 98.752% # ( 6, 10 ] 27549 0.733% 99.485% ( 10, 15 ] 3049 0.081% 99.566% ( 15, 22 ] 636 0.017% 99.583% ( 22, 34 ] 44 0.001% 99.584% ( 34, 51 ] 17 0.000% 99.585% ( 51, 76 ] 82 0.002% 99.587% ( 76, 110 ] 6406 0.170% 99.757% ( 110, 170 ] 6363 0.169% 99.927% ( 170, 250 ] 1336 0.036% 99.962% ( 250, 380 ] 932 0.025% 99.987% ( 380, 580 ] 695 0.018% 100.005% ( 580, 870 ] 319 0.008% 100.014% ( 870, 1300 ] 123 0.003% 100.017% ( 1300, 1900 ] 53 0.001% 100.019% ( 1900, 2900 ] 65 0.002% 100.020% ( 2900, 4400 ] 61 0.002% 100.022% ( 4400, 6600 ] 23 0.001% 100.023% ( 6600, 9900 ] 6 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1806419 Average: 5.6697 StdDev: 86.99 Min: 0 Median: 1.6951 Max: 20200 Percentiles: P50: 1.70 P75: 2.46 P99: 9.17 P99.9: 304.97 P99.99: 742.64 ------------------------------------------------------ [ 0, 1 ] 184156 10.195% 10.195% ## ( 1, 2 ] 1034424 57.264% 67.458% ########### ( 2, 3 ] 296744 16.427% 83.886% ### ( 3, 4 ] 121001 6.698% 90.584% # ( 4, 6 ] 123875 6.857% 97.441% # ( 6, 10 ] 35517 1.966% 99.408% ( 10, 15 ] 4211 0.233% 99.641% ( 15, 22 ] 624 0.035% 99.675% ( 22, 34 ] 41 0.002% 99.677% ( 34, 51 ] 26 0.001% 99.679% ( 51, 76 ] 79 0.004% 99.683% ( 76, 110 ] 1666 0.092% 99.776% ( 110, 170 ] 1529 0.085% 99.860% ( 170, 250 ] 489 0.027% 99.887% ( 250, 380 ] 550 0.030% 99.918% ( 380, 580 ] 821 0.045% 99.963% ( 580, 870 ] 869 0.048% 100.011% ( 870, 1300 ] 639 0.035% 100.047% ( 1300, 1900 ] 323 0.018% 100.064% ( 1900, 2900 ] 306 0.017% 100.081% ( 2900, 4400 ] 389 0.022% 100.103% ( 4400, 6600 ] 87 0.005% 100.108% ( 6600, 9900 ] 30 0.002% 100.109% ( 9900, 14000 ] 2 0.000% 100.110% ( 14000, 22000 ] 1 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 776068 Average: 7.0306 StdDev: 95.80 Min: 0 Median: 1.9485 Max: 9937 Percentiles: P50: 1.95 P75: 2.97 P99: 9.40 P99.9: 387.38 P99.99: 689.84 ------------------------------------------------------ [ 0, 1 ] 21455 2.765% 2.765% # ( 1, 2 ] 386466 49.798% 52.563% ########## ( 2, 3 ] 179178 23.088% 75.650% ##### ( 3, 4 ] 80408 10.361% 86.011% ## ( 4, 6 ] 86239 11.112% 97.124% ## ( 6, 10 ] 17143 2.209% 99.333% ( 10, 15 ] 2525 0.325% 99.658% ( 15, 22 ] 364 0.047% 99.705% ( 22, 34 ] 50 0.006% 99.711% ( 34, 51 ] 13 0.002% 99.713% ( 51, 76 ] 20 0.003% 99.716% ( 76, 110 ] 179 0.023% 99.739% ( 110, 170 ] 449 0.058% 99.797% ( 170, 250 ] 316 0.041% 99.837% ( 250, 380 ] 468 0.060% 99.898% ( 380, 580 ] 540 0.070% 99.967% ( 580, 870 ] 471 0.061% 100.028% ( 870, 1300 ] 411 0.053% 100.081% ( 1300, 1900 ] 214 0.028% 100.108% ( 1900, 2900 ] 172 0.022% 100.131% ( 2900, 4400 ] 222 0.029% 100.159% ( 4400, 6600 ] 49 0.006% 100.165% ( 6600, 9900 ] 7 0.001% 100.166% ( 9900, 14000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 16165 Average: 62.0789 StdDev: 375.48 Min: 0 Median: 2.1014 Max: 20000 Percentiles: P50: 2.10 P75: 3.42 P99: 1316.53 P99.9: 4845.50 P99.99: 17068.00 ------------------------------------------------------ [ 0, 1 ] 381 2.357% 2.357% ( 1, 2 ] 7331 45.351% 47.708% ######### ( 2, 3 ] 3654 22.604% 70.312% ##### ( 3, 4 ] 1816 11.234% 81.547% ## ( 4, 6 ] 1416 8.760% 90.306% ## ( 6, 10 ] 423 2.617% 92.923% # ( 10, 15 ] 42 0.260% 93.183% ( 15, 22 ] 7 0.043% 93.226% ( 34, 51 ] 1 0.006% 93.232% ( 51, 76 ] 2 0.012% 93.245% ( 76, 110 ] 28 0.173% 93.418% ( 110, 170 ] 91 0.563% 93.981% ( 170, 250 ] 98 0.606% 94.587% ( 250, 380 ] 152 0.940% 95.527% ( 380, 580 ] 229 1.417% 96.944% ( 580, 870 ] 207 1.281% 98.225% ( 870, 1300 ] 125 0.773% 98.998% ( 1300, 1900 ] 49 0.303% 99.301% ( 1900, 2900 ] 39 0.241% 99.542% ( 2900, 4400 ] 56 0.346% 99.889% ( 4400, 6600 ] 14 0.087% 99.975% ( 6600, 9900 ] 3 0.019% 99.994% ( 14000, 22000 ] 1 0.006% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1015.2500 StdDev: 1285.87 Min: 79 Median: 351.1111 Max: 5091 Percentiles: P50: 351.11 P75: 1540.00 P99: 5091.00 P99.9: 5091.00 P99.99: 5091.00 ------------------------------------------------------ ( 76, 110 ] 14 14.000% 14.000% ### ( 110, 170 ] 25 25.000% 39.000% ##### ( 170, 250 ] 4 4.000% 43.000% # ( 250, 380 ] 9 9.000% 52.000% ## ( 380, 580 ] 7 7.000% 59.000% # ( 580, 870 ] 8 8.000% 67.000% ## ( 870, 1300 ] 6 6.000% 73.000% # ( 1300, 1900 ] 5 5.000% 78.000% # ( 1900, 2900 ] 8 8.000% 86.000% ## ( 2900, 4400 ] 12 12.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 49.2 total, 18.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 160.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.002 H:M:S, 54.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 53.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.975 H:M:S, 81.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/24-11:39:11 ... thread 0: (1000000,9000000) ops and (154126.4,162415.7) ops/second in (6.488183,55.413367) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 2.82 GB 69.2 9.2 0.0 9.2 17.7 8.5 0.0 2.1 140.4 271.0 66.86 57.57 148 0.452 9528K 20K 0.0 0.0 L1 0/0 0.00 KB 0.0 8.5 5.5 2.9 8.4 5.4 0.2 1.5 221.9 219.0 39.09 36.33 4 9.773 8367K 42K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.5 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 15/1 1.07 GB 1.0 7.9 5.3 2.6 7.9 5.3 0.4 1.5 149.2 148.5 54.37 36.60 24 2.265 7324K 34K 0.0 0.0 L4 169/3 9.76 GB 1.0 4.8 4.5 0.3 4.8 4.5 1.0 1.1 119.4 119.1 41.43 23.09 56 0.740 4918K 6635 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/10 104.51 GB 0.0 30.6 15.5 15.1 39.0 23.8 12.3 4.6 154.6 196.9 202.53 154.32 234 0.866 30M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.6 15.5 15.1 39.0 23.8 12.2 4.6 154.6 196.9 202.53 154.32 234 0.866 30M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.6 15.5 15.1 30.4 15.3 0.0 0.0 180.1 179.0 173.91 131.99 113 1.539 30M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 305.9 28.62 22.34 121 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.6 total, 55.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.95 GB write, 716.84 MB/s write, 30.58 GB read, 562.79 MB/s read, 202.5 seconds Interval compaction: 38.95 GB write, 719.75 MB/s write, 30.58 GB read, 565.07 MB/s read, 202.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 70, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 70, interval: 118 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4172144 Average: 3.4599 StdDev: 46.29 Min: 0 Median: 1.5569 Max: 13609 Percentiles: P50: 1.56 P75: 1.95 P99: 7.98 P99.9: 163.31 P99.99: 564.08 ------------------------------------------------------ [ 0, 1 ] 612496 14.681% 14.681% ### ( 1, 2 ] 2645992 63.420% 78.101% ############# ( 2, 3 ] 526523 12.620% 90.721% ### ( 3, 4 ] 173012 4.147% 94.868% # ( 4, 6 ] 153094 3.669% 98.537% # ( 6, 10 ] 39089 0.937% 99.474% ( 10, 15 ] 4694 0.113% 99.587% ( 15, 22 ] 833 0.020% 99.607% ( 22, 34 ] 57 0.001% 99.608% ( 34, 51 ] 26 0.001% 99.609% ( 51, 76 ] 84 0.002% 99.611% ( 76, 110 ] 6409 0.154% 99.764% ( 110, 170 ] 6373 0.153% 99.917% ( 170, 250 ] 1363 0.033% 99.950% ( 250, 380 ] 974 0.023% 99.973% ( 380, 580 ] 769 0.018% 99.991% ( 580, 870 ] 446 0.011% 100.002% ( 870, 1300 ] 263 0.006% 100.008% ( 1300, 1900 ] 149 0.004% 100.012% ( 1900, 2900 ] 216 0.005% 100.017% ( 2900, 4400 ] 207 0.005% 100.022% ( 4400, 6600 ] 77 0.002% 100.024% ( 6600, 9900 ] 17 0.000% 100.024% ( 9900, 14000 ] 4 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 2136763 Average: 6.5882 StdDev: 104.21 Min: 0 Median: 1.7450 Max: 20200 Percentiles: P50: 1.75 P75: 2.60 P99: 9.35 P99.9: 455.45 P99.99: 995.63 ------------------------------------------------------ [ 0, 1 ] 186756 8.740% 8.740% ## ( 1, 2 ] 1183372 55.382% 64.122% ########### ( 2, 3 ] 385021 18.019% 82.141% #### ( 3, 4 ] 157916 7.390% 89.531% # ( 4, 6 ] 164223 7.686% 97.217% ## ( 6, 10 ] 45557 2.132% 99.349% ( 10, 15 ] 5955 0.279% 99.627% ( 15, 22 ] 873 0.041% 99.668% ( 22, 34 ] 60 0.003% 99.671% ( 34, 51 ] 41 0.002% 99.673% ( 51, 76 ] 90 0.004% 99.677% ( 76, 110 ] 1673 0.078% 99.755% ( 110, 170 ] 1548 0.072% 99.828% ( 170, 250 ] 530 0.025% 99.853% ( 250, 380 ] 634 0.030% 99.882% ( 380, 580 ] 1000 0.047% 99.929% ( 580, 870 ] 1059 0.050% 99.979% ( 870, 1300 ] 826 0.039% 100.017% ( 1300, 1900 ] 444 0.021% 100.038% ( 1900, 2900 ] 517 0.024% 100.062% ( 2900, 4400 ] 675 0.032% 100.094% ( 4400, 6600 ] 176 0.008% 100.102% ( 6600, 9900 ] 47 0.002% 100.104% ( 9900, 14000 ] 8 0.000% 100.105% ( 14000, 22000 ] 1 0.000% 100.105% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1779866 Average: 8.6905 StdDev: 128.08 Min: 0 Median: 2.0102 Max: 15773 Percentiles: P50: 2.01 P75: 3.06 P99: 9.41 P99.9: 412.57 P99.99: 754.00 ------------------------------------------------------ [ 0, 1 ] 29011 1.630% 1.630% ( 1, 2 ] 856460 48.119% 49.749% ########## ( 2, 3 ] 438537 24.639% 74.388% ##### ( 3, 4 ] 193518 10.873% 85.261% ## ( 4, 6 ] 208891 11.736% 96.997% ## ( 6, 10 ] 41793 2.348% 99.345% ( 10, 15 ] 6768 0.380% 99.725% ( 15, 22 ] 879 0.049% 99.775% ( 22, 34 ] 101 0.006% 99.780% ( 34, 51 ] 38 0.002% 99.783% ( 51, 76 ] 27 0.002% 99.784% ( 76, 110 ] 199 0.011% 99.795% ( 110, 170 ] 490 0.028% 99.823% ( 170, 250 ] 431 0.024% 99.847% ( 250, 380 ] 765 0.043% 99.890% ( 380, 580 ] 1100 0.062% 99.952% ( 580, 870 ] 1135 0.064% 100.016% ( 870, 1300 ] 982 0.055% 100.071% ( 1300, 1900 ] 624 0.035% 100.106% ( 1900, 2900 ] 685 0.038% 100.144% ( 2900, 4400 ] 852 0.048% 100.192% ( 4400, 6600 ] 227 0.013% 100.205% ( 6600, 9900 ] 52 0.003% 100.208% ( 9900, 14000 ] 11 0.001% 100.208% ( 14000, 22000 ] 1 0.000% 100.208% ** Level 4 read latency histogram (micros): Count: 99150 Average: 59.6480 StdDev: 383.90 Min: 0 Median: 2.0546 Max: 20000 Percentiles: P50: 2.05 P75: 3.29 P99: 1764.72 P99.9: 5148.92 P99.99: 8184.79 ------------------------------------------------------ [ 0, 1 ] 1873 1.889% 1.889% ( 1, 2 ] 46448 46.846% 48.735% ######### ( 2, 3 ] 22949 23.146% 71.881% ##### ( 3, 4 ] 10821 10.914% 82.795% ## ( 4, 6 ] 9623 9.705% 92.500% ## ( 6, 10 ] 2625 2.648% 95.148% # ( 10, 15 ] 369 0.372% 95.520% ( 15, 22 ] 41 0.041% 95.561% ( 22, 34 ] 6 0.006% 95.567% ( 34, 51 ] 5 0.005% 95.572% ( 51, 76 ] 2 0.002% 95.574% ( 76, 110 ] 70 0.071% 95.645% ( 110, 170 ] 148 0.149% 95.794% ( 170, 250 ] 255 0.257% 96.051% ( 250, 380 ] 391 0.394% 96.446% ( 380, 580 ] 674 0.680% 97.126% ( 580, 870 ] 867 0.874% 98.000% ( 870, 1300 ] 661 0.667% 98.667% ( 1300, 1900 ] 428 0.432% 99.098% ( 1900, 2900 ] 350 0.353% 99.451% ( 2900, 4400 ] 405 0.408% 99.860% ( 4400, 6600 ] 120 0.121% 99.981% ( 6600, 9900 ] 21 0.021% 100.002% ( 9900, 14000 ] 3 0.003% 100.005% ( 14000, 22000 ] 1 0.001% 100.006% ** Level 5 read latency histogram (micros): Count: 320 Average: 1419.0875 StdDev: 1440.83 Min: 79 Median: 765.2778 Max: 7486 Percentiles: P50: 765.28 P75: 2452.63 P99: 6062.22 P99.9: 7486.00 P99.99: 7486.00 ------------------------------------------------------ ( 76, 110 ] 20 6.250% 6.250% # ( 110, 170 ] 38 11.875% 18.125% ## ( 170, 250 ] 12 3.750% 21.875% # ( 250, 380 ] 30 9.375% 31.250% ## ( 380, 580 ] 37 11.562% 42.812% ## ( 580, 870 ] 36 11.250% 54.062% ## ( 870, 1300 ] 28 8.750% 62.812% ## ( 1300, 1900 ] 18 5.625% 68.438% # ( 1900, 2900 ] 38 11.875% 80.312% ## ( 2900, 4400 ] 53 16.562% 96.875% ### ( 4400, 6600 ] 9 2.812% 99.688% # ( 6600, 9900 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 55.6 total, 6.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 159.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.506 H:M:S, 54.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 151.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.504 H:M:S, 54.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/24-11:39:14 ... thread 0: (1000000,10000000) ops and (330712.1,171124.0) ops/second in (3.023778,58.437145) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.97 GB 169.9 10.0 0.0 10.0 19.5 9.5 0.0 2.1 140.7 273.4 72.95 63.25 164 0.445 10M 21K 0.0 0.0 L1 30/0 1.46 GB 149.7 10.2 7.3 2.9 10.1 7.2 0.2 1.4 207.7 205.4 50.50 44.51 5 10.099 10M 46K 0.0 0.0 L2 1/0 77.87 MB 0.8 0.2 0.1 0.1 0.2 0.1 5.8 1.5 246.6 246.5 0.78 0.74 2 0.392 196K 104 0.0 0.0 L3 16/2 1.12 GB 0.9 7.9 5.3 2.6 7.9 5.3 0.6 1.5 149.2 148.5 54.37 36.60 24 2.265 7324K 34K 0.0 0.0 L4 167/6 9.63 GB 1.0 5.0 4.6 0.4 5.0 4.6 1.0 1.1 120.7 120.4 42.52 23.90 57 0.746 5102K 6635 0.0 0.0 L5 1108/0 91.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1332/12 105.42 GB 0.0 33.4 17.4 16.0 42.7 26.6 13.2 4.5 154.6 197.6 221.12 169.00 252 0.877 33M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 33.4 17.4 16.0 42.7 26.6 13.1 4.5 154.6 197.6 221.12 169.00 252 0.877 33M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 33.4 17.4 16.0 33.2 17.2 0.0 0.0 180.2 179.2 189.76 144.27 118 1.608 33M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 309.4 31.36 24.73 134 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.7 total, 58.4 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 42.68 GB write, 744.98 MB/s write, 33.39 GB read, 582.88 MB/s read, 221.1 seconds Interval compaction: 42.68 GB write, 747.85 MB/s write, 33.39 GB read, 585.13 MB/s read, 221.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 73, interval: 121 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4556952 Average: 3.3730 StdDev: 44.38 Min: 0 Median: 1.5629 Max: 13609 Percentiles: P50: 1.56 P75: 1.96 P99: 7.80 P99.9: 158.30 P99.99: 506.23 ------------------------------------------------------ [ 0, 1 ] 649556 14.254% 14.254% ### ( 1, 2 ] 2893600 63.499% 77.753% ############# ( 2, 3 ] 594300 13.042% 90.794% ### ( 3, 4 ] 188080 4.127% 94.922% # ( 4, 6 ] 166642 3.657% 98.579% # ( 6, 10 ] 42718 0.937% 99.516% ( 10, 15 ] 4898 0.107% 99.623% ( 15, 22 ] 849 0.019% 99.642% ( 22, 34 ] 61 0.001% 99.643% ( 34, 51 ] 29 0.001% 99.644% ( 51, 76 ] 88 0.002% 99.646% ( 76, 110 ] 6426 0.141% 99.787% ( 110, 170 ] 6396 0.140% 99.927% ( 170, 250 ] 1378 0.030% 99.958% ( 250, 380 ] 984 0.022% 99.979% ( 380, 580 ] 780 0.017% 99.996% ( 580, 870 ] 459 0.010% 100.006% ( 870, 1300 ] 267 0.006% 100.012% ( 1300, 1900 ] 150 0.003% 100.016% ( 1900, 2900 ] 218 0.005% 100.020% ( 2900, 4400 ] 208 0.005% 100.025% ( 4400, 6600 ] 77 0.002% 100.027% ( 6600, 9900 ] 17 0.000% 100.027% ( 9900, 14000 ] 4 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 2136934 Average: 6.6058 StdDev: 104.26 Min: 0 Median: 1.7451 Max: 20200 Percentiles: P50: 1.75 P75: 2.60 P99: 9.35 P99.9: 461.12 P99.99: 999.00 ------------------------------------------------------ [ 0, 1 ] 186757 8.739% 8.739% ## ( 1, 2 ] 1183388 55.378% 64.117% ########### ( 2, 3 ] 385053 18.019% 82.136% #### ( 3, 4 ] 157928 7.390% 89.527% # ( 4, 6 ] 164227 7.685% 97.212% ## ( 6, 10 ] 45558 2.132% 99.344% ( 10, 15 ] 5955 0.279% 99.622% ( 15, 22 ] 873 0.041% 99.663% ( 22, 34 ] 60 0.003% 99.666% ( 34, 51 ] 41 0.002% 99.668% ( 51, 76 ] 95 0.004% 99.672% ( 76, 110 ] 1688 0.079% 99.751% ( 110, 170 ] 1564 0.073% 99.825% ( 170, 250 ] 540 0.025% 99.850% ( 250, 380 ] 660 0.031% 99.881% ( 380, 580 ] 1011 0.047% 99.928% ( 580, 870 ] 1073 0.050% 99.978% ( 870, 1300 ] 831 0.039% 100.017% ( 1300, 1900 ] 447 0.021% 100.038% ( 1900, 2900 ] 517 0.024% 100.062% ( 2900, 4400 ] 675 0.032% 100.094% ( 4400, 6600 ] 176 0.008% 100.102% ( 6600, 9900 ] 47 0.002% 100.104% ( 9900, 14000 ] 8 0.000% 100.105% ( 14000, 22000 ] 1 0.000% 100.105% ** Level 2 read latency histogram (micros): Count: 77369 Average: 2.5969 StdDev: 15.27 Min: 0 Median: 1.5910 Max: 2842 Percentiles: P50: 1.59 P75: 1.97 P99: 7.26 P99.9: 20.63 P99.99: 558.95 ------------------------------------------------------ [ 0, 1 ] 8137 10.517% 10.517% ## ( 1, 2 ] 51684 66.802% 77.319% ############# ( 2, 3 ] 9889 12.782% 90.101% ### ( 3, 4 ] 3949 5.104% 95.205% # ( 4, 6 ] 2650 3.425% 98.630% # ( 6, 10 ] 912 1.179% 99.809% ( 10, 15 ] 65 0.084% 99.893% ( 15, 22 ] 7 0.009% 99.902% ( 22, 34 ] 2 0.003% 99.904% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 1 0.001% 99.908% ( 110, 170 ] 37 0.048% 99.956% ( 170, 250 ] 12 0.016% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 7 0.009% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1803222 Average: 8.6333 StdDev: 127.30 Min: 0 Median: 2.0014 Max: 15773 Percentiles: P50: 2.00 P75: 3.04 P99: 9.41 P99.9: 414.91 P99.99: 756.48 ------------------------------------------------------ [ 0, 1 ] 29676 1.646% 1.646% ( 1, 2 ] 871298 48.319% 49.965% ########## ( 2, 3 ] 443448 24.592% 74.557% ##### ( 3, 4 ] 194728 10.799% 85.356% ## ( 4, 6 ] 210064 11.649% 97.005% ## ( 6, 10 ] 42231 2.342% 99.347% ( 10, 15 ] 6784 0.376% 99.723% ( 15, 22 ] 879 0.049% 99.772% ( 22, 34 ] 101 0.006% 99.777% ( 34, 51 ] 38 0.002% 99.780% ( 51, 76 ] 27 0.001% 99.781% ( 76, 110 ] 200 0.011% 99.792% ( 110, 170 ] 517 0.029% 99.821% ( 170, 250 ] 448 0.025% 99.846% ( 250, 380 ] 786 0.044% 99.889% ( 380, 580 ] 1116 0.062% 99.951% ( 580, 870 ] 1153 0.064% 100.015% ( 870, 1300 ] 986 0.055% 100.070% ( 1300, 1900 ] 625 0.035% 100.104% ( 1900, 2900 ] 685 0.038% 100.142% ( 2900, 4400 ] 852 0.047% 100.190% ( 4400, 6600 ] 227 0.013% 100.202% ( 6600, 9900 ] 52 0.003% 100.205% ( 9900, 14000 ] 11 0.001% 100.206% ( 14000, 22000 ] 1 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 101157 Average: 58.9801 StdDev: 380.53 Min: 0 Median: 2.0334 Max: 20000 Percentiles: P50: 2.03 P75: 3.26 P99: 1738.74 P99.9: 5112.12 P99.99: 8153.25 ------------------------------------------------------ [ 0, 1 ] 2029 2.006% 2.006% ( 1, 2 ] 47776 47.230% 49.235% ######### ( 2, 3 ] 23188 22.923% 72.158% ##### ( 3, 4 ] 10894 10.769% 82.928% ## ( 4, 6 ] 9683 9.572% 92.500% ## ( 6, 10 ] 2650 2.620% 95.119% # ( 10, 15 ] 369 0.365% 95.484% ( 15, 22 ] 42 0.042% 95.526% ( 22, 34 ] 6 0.006% 95.532% ( 34, 51 ] 5 0.005% 95.537% ( 51, 76 ] 2 0.002% 95.539% ( 76, 110 ] 76 0.075% 95.614% ( 110, 170 ] 182 0.180% 95.794% ( 170, 250 ] 274 0.271% 96.065% ( 250, 380 ] 411 0.406% 96.471% ( 380, 580 ] 695 0.687% 97.158% ( 580, 870 ] 883 0.873% 98.031% ( 870, 1300 ] 666 0.658% 98.689% ( 1300, 1900 ] 430 0.425% 99.114% ( 1900, 2900 ] 350 0.346% 99.460% ( 2900, 4400 ] 406 0.401% 99.862% ( 4400, 6600 ] 120 0.119% 99.980% ( 6600, 9900 ] 21 0.021% 100.001% ( 9900, 14000 ] 3 0.003% 100.004% ( 14000, 22000 ] 1 0.001% 100.005% ** Level 5 read latency histogram (micros): Count: 340 Average: 1372.3265 StdDev: 1422.83 Min: 79 Median: 725.0000 Max: 7486 Percentiles: P50: 725.00 P75: 2347.37 P99: 6013.33 P99.9: 7486.00 P99.99: 7486.00 ------------------------------------------------------ ( 76, 110 ] 23 6.765% 6.765% # ( 110, 170 ] 41 12.059% 18.824% ## ( 170, 250 ] 16 4.706% 23.529% # ( 250, 380 ] 32 9.412% 32.941% ## ( 380, 580 ] 40 11.765% 44.706% ## ( 580, 870 ] 36 10.588% 55.294% ## ( 870, 1300 ] 30 8.824% 64.118% ## ( 1300, 1900 ] 20 5.882% 70.000% # ( 1900, 2900 ] 38 11.176% 81.176% ## ( 2900, 4400 ] 54 15.882% 97.059% ### ( 4400, 6600 ] 9 2.647% 99.706% # ( 6600, 9900 ] 1 0.294% 100.000% ** DB Stats ** Uptime(secs): 58.7 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 167.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.915 H:M:S, 52.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.708 micros/op 175193 ops/sec 60.002 seconds 10511999 operations; 169.8 MB/s Microseconds per write: Count: 10511999 Average: 5.7080 StdDev: 497.70 Min: 1 Median: 1.7503 Max: 784056 Percentiles: P50: 1.75 P75: 2.73 P99: 8.41 P99.9: 1110.40 P99.99: 2698.28 ------------------------------------------------------ [ 0, 1 ] 1301693 12.383% 12.383% ## ( 1, 2 ] 5270450 50.137% 62.520% ########## ( 2, 3 ] 1795104 17.077% 79.597% ### ( 3, 4 ] 1450508 13.799% 93.396% ### ( 4, 6 ] 529873 5.041% 98.436% # ( 6, 10 ] 98170 0.934% 99.370% ( 10, 15 ] 27474 0.261% 99.632% ( 15, 22 ] 7163 0.068% 99.700% ( 22, 34 ] 1761 0.017% 99.716% ( 34, 51 ] 226 0.002% 99.719% ( 51, 76 ] 33 0.000% 99.719% ( 76, 110 ] 7301 0.069% 99.788% ( 110, 170 ] 2944 0.028% 99.816% ( 170, 250 ] 280 0.003% 99.819% ( 250, 380 ] 102 0.001% 99.820% ( 380, 580 ] 21 0.000% 99.820% ( 580, 870 ] 26 0.000% 99.820% ( 870, 1300 ] 14950 0.142% 99.963% ( 1300, 1900 ] 78 0.001% 99.963% ( 1900, 2900 ] 3496 0.033% 99.997% ( 2900, 4400 ] 234 0.002% 99.999% ( 4400, 6600 ] 67 0.001% 100.000% ( 6600, 9900 ] 15 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 194653 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10511999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10848382968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 676 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31131647 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36816820016 rocksdb.compact.write.bytes COUNT : 36611724597 rocksdb.flush.write.bytes COUNT : 10701184103 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 80 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 412 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10615011328 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4217856 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36926995756 rocksdb.non.last.level.read.count COUNT : 8918120 rocksdb.block.checksum.compute.count COUNT : 8916848 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.400102 P95 : 3.838296 P99 : 6.618614 P100 : 784053.000000 COUNT : 10511999 SUM : 55056711 rocksdb.compaction.times.micros P50 : 974651.162791 P95 : 5345000.000000 P99 : 13559000.000000 P100 : 20193911.000000 COUNT : 121 SUM : 193039774 rocksdb.compaction.times.cpu_micros P50 : 715000.000000 P95 : 4265000.000000 P99 : 13118000.000000 P100 : 18128428.000000 COUNT : 121 SUM : 147278562 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.808824 P95 : 8167.500000 P99 : 127700.000000 P100 : 164534.000000 COUNT : 141 SUM : 571005 rocksdb.compaction.outfile.sync.micros P50 : 1242.819149 P95 : 67386.363636 P99 : 140360.000000 P100 : 616215.000000 COUNT : 447 SUM : 5827118 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 125.600000 P95 : 2913.636364 P99 : 5148.000000 P100 : 13638.000000 COUNT : 298 SUM : 147562 rocksdb.table.open.io.micros P50 : 1591.891892 P95 : 8635.000000 P99 : 14320.000000 P100 : 27516.000000 COUNT : 676 SUM : 1636996 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.741857 P95 : 8.317086 P99 : 12.279804 P100 : 20205.000000 COUNT : 8915017 SUM : 71020576 rocksdb.read.block.get.micros P50 : 500.000000 P95 : 3844.318182 P99 : 5924.387097 P100 : 7543.000000 COUNT : 1352 SUM : 1304181 rocksdb.write.raw.block.micros P50 : 0.514986 P95 : 0.978474 P99 : 2.799870 P100 : 35352.000000 COUNT : 11465078 SUM : 24733818 rocksdb.numfiles.in.singlecompaction P50 : 3.026667 P95 : 5.300000 P99 : 17.240000 P100 : 24.000000 COUNT : 168 SUM : 570 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556993 P95 : 1144.496991 P99 : 2451.679699 P100 : 783855.000000 COUNT : 184005 SUM : 31146006 rocksdb.sst.read.micros P50 : 1.684398 P95 : 5.122739 P99 : 9.179517 P100 : 20200.000000 COUNT : 8918544 SUM : 52533879 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10511999 SUM : 10848382968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214301.075269 P95 : 505083.333333 P99 : 830275.000000 P100 : 942536.000000 COUNT : 141 SUM : 32815974 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 420 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0