[2024-12-15 12:01:33.034837] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 22.11.4 initialization... [2024-12-15 12:01:33.035109] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid181843 ] Set seed to 1734260493028152 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 12:01:33.154476] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 12:01:33.177737] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 12:01:33.177785] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 181843' to capture a snapshot of events at runtime. [2024-12-15 12:01:33.177796] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 12:01:33.177807] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 12:01:33.177815] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid181843 for offline analysis/debug. [2024-12-15 12:01:33.178381] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 12:01:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-12:01:40 ... thread 0: (1000000,1000000) ops and (326674.0,326674.0) ops/second in (3.061156,3.061156) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 566.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 342.8 2.57 2.33 12 0.214 0 0 0.0 0.0 L1 1/0 1.94 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 244.2 244.0 1.03 1.00 1 1.032 255K 211 0.0 0.0 L2 3/2 298.55 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 16/9 755.47 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 191.4 191.4 0.33 0.27 1 0.327 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/17 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 96.0 294.7 4.44 4.07 15 0.296 432K 235 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 96.0 294.7 4.44 4.07 15 0.296 432K 235 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 228.4 228.3 1.86 1.74 3 0.621 432K 235 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 342.8 2.57 2.33 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 397.08 MB/s write, 0.42 GB read, 129.32 MB/s read, 4.4 seconds Interval compaction: 1.28 GB write, 426.89 MB/s write, 0.42 GB read, 139.02 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 126587 Average: 1.9277 StdDev: 15.19 Min: 0 Median: 1.2556 Max: 2822 Percentiles: P50: 1.26 P75: 1.70 P99: 4.71 P99.9: 9.88 P99.99: 300.73 ------------------------------------------------------ [ 0, 1 ] 44912 35.479% 35.479% ####### ( 1, 2 ] 71926 56.819% 92.299% ########### ( 2, 3 ] 5697 4.500% 96.799% # ( 3, 4 ] 2361 1.865% 98.664% ( 4, 6 ] 1198 0.946% 99.611% ( 6, 10 ] 379 0.299% 99.910% ( 10, 15 ] 67 0.053% 99.963% ( 15, 22 ] 19 0.015% 99.978% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 2 0.002% 99.981% ( 51, 76 ] 2 0.002% 99.983% ( 110, 170 ] 7 0.006% 99.988% ( 170, 250 ] 1 0.001% 99.989% ( 250, 380 ] 6 0.005% 99.994% ( 380, 580 ] 1 0.001% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 4 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 22312 Average: 3.1920 StdDev: 31.58 Min: 1 Median: 1.4795 Max: 3104 Percentiles: P50: 1.48 P75: 1.91 P99: 8.43 P99.9: 311.62 P99.99: 1275.15 ------------------------------------------------------ [ 0, 1 ] 5007 22.441% 22.441% #### ( 1, 2 ] 12824 57.476% 79.917% ########### ( 2, 3 ] 2590 11.608% 91.525% ## ( 3, 4 ] 819 3.671% 95.195% # ( 4, 6 ] 702 3.146% 98.342% # ( 6, 10 ] 242 1.085% 99.426% ( 10, 15 ] 36 0.161% 99.588% ( 15, 22 ] 4 0.018% 99.606% ( 22, 34 ] 1 0.004% 99.610% ( 34, 51 ] 30 0.134% 99.745% ( 51, 76 ] 13 0.058% 99.803% ( 76, 110 ] 4 0.018% 99.821% ( 110, 170 ] 1 0.004% 99.825% ( 170, 250 ] 11 0.049% 99.875% ( 250, 380 ] 12 0.054% 99.928% ( 380, 580 ] 5 0.022% 99.951% ( 580, 870 ] 5 0.022% 99.973% ( 870, 1300 ] 4 0.018% 99.991% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 15897 Average: 1.8233 StdDev: 3.13 Min: 0 Median: 1.2484 Max: 297 Percentiles: P50: 1.25 P75: 1.71 P99: 4.10 P99.9: 9.93 P99.99: 202.82 ------------------------------------------------------ [ 0, 1 ] 5821 36.617% 36.617% ####### ( 1, 2 ] 8566 53.884% 90.501% ########### ( 2, 3 ] 1055 6.636% 97.138% # ( 3, 4 ] 291 1.831% 98.968% ( 4, 6 ] 98 0.616% 99.585% ( 6, 10 ] 51 0.321% 99.906% ( 10, 15 ] 10 0.063% 99.969% ( 15, 22 ] 2 0.013% 99.981% ( 110, 170 ] 1 0.006% 99.987% ( 170, 250 ] 1 0.006% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 21447 Average: 6.3841 StdDev: 72.97 Min: 1 Median: 1.6740 Max: 3579 Percentiles: P50: 1.67 P75: 2.30 P99: 12.77 P99.9: 1175.56 P99.99: 2756.91 ------------------------------------------------------ [ 0, 1 ] 2038 9.502% 9.502% ## ( 1, 2 ] 12887 60.088% 69.590% ############ ( 2, 3 ] 3837 17.891% 87.481% #### ( 3, 4 ] 1203 5.609% 93.090% # ( 4, 6 ] 821 3.828% 96.918% # ( 6, 10 ] 406 1.893% 98.811% ( 10, 15 ] 75 0.350% 99.161% ( 15, 22 ] 9 0.042% 99.203% ( 22, 34 ] 2 0.009% 99.212% ( 34, 51 ] 1 0.005% 99.217% ( 51, 76 ] 7 0.033% 99.249% ( 76, 110 ] 3 0.014% 99.263% ( 110, 170 ] 63 0.294% 99.557% ( 170, 250 ] 29 0.135% 99.692% ( 250, 380 ] 15 0.070% 99.762% ( 380, 580 ] 19 0.089% 99.851% ( 580, 870 ] 8 0.037% 99.888% ( 870, 1300 ] 5 0.023% 99.911% ( 1300, 1900 ] 11 0.051% 99.963% ( 1900, 2900 ] 8 0.037% 100.000% ( 2900, 4400 ] 3 0.014% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 1502.0857 StdDev: 1194.45 Min: 132 Median: 1146.4286 Max: 4650 Percentiles: P50: 1146.43 P75: 1983.33 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 7 20.000% 28.571% #### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 7 20.000% 57.143% #### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 3 8.571% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 298.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.425 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.425 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-12:01:43 ... thread 0: (1000000,2000000) ops and (320240.6,323425.3) ops/second in (3.122652,6.183808) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.54 GB 0.0 0.9 0.0 0.9 2.8 1.8 0.0 1.5 103.3 309.7 9.15 8.49 29 0.315 959K 1203 0.0 0.0 L1 1/1 1.94 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 244.2 244.0 1.03 1.00 1 1.032 255K 211 0.0 0.0 L2 1/1 121.05 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 77/34 932.49 MB 0.8 1.0 0.2 0.7 1.0 0.2 0.0 4.1 208.7 208.6 4.74 4.08 3 1.580 1004K 525 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/47 97.98 GB 0.0 2.2 0.5 1.8 4.1 2.3 0.4 2.2 148.9 271.3 15.43 14.05 34 0.454 2333K 1963 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 0.5 1.8 4.1 2.3 0.4 2.2 148.9 271.3 15.43 14.05 34 0.454 2333K 1963 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 0.5 1.8 2.2 0.5 0.0 0.0 231.1 230.9 9.94 9.15 8 1.243 2333K 1963 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 344.6 5.48 4.89 26 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.4 total, 6.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.09 GB write, 652.40 MB/s write, 2.24 GB read, 358.12 MB/s read, 15.4 seconds Interval compaction: 4.09 GB write, 676.65 MB/s write, 2.24 GB read, 371.43 MB/s read, 15.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378833 Average: 2.2284 StdDev: 14.49 Min: 0 Median: 1.4886 Max: 4353 Percentiles: P50: 1.49 P75: 1.88 P99: 5.63 P99.9: 9.91 P99.99: 17.68 ------------------------------------------------------ [ 0, 1 ] 71593 18.898% 18.898% #### ( 1, 2 ] 241139 63.653% 82.551% ############# ( 2, 3 ] 40636 10.727% 93.278% ## ( 3, 4 ] 14391 3.799% 97.077% # ( 4, 6 ] 8917 2.354% 99.431% ( 6, 10 ] 1819 0.480% 99.911% ( 10, 15 ] 282 0.074% 99.985% ( 15, 22 ] 50 0.013% 99.998% ( 22, 34 ] 2 0.001% 99.999% ( 34, 51 ] 4 0.001% 100.000% ( 51, 76 ] 6 0.002% 100.002% ( 110, 170 ] 8 0.002% 100.004% ( 170, 250 ] 12 0.003% 100.007% ( 250, 380 ] 12 0.003% 100.010% ( 380, 580 ] 3 0.001% 100.011% ( 580, 870 ] 5 0.001% 100.012% ( 870, 1300 ] 6 0.002% 100.014% ( 1300, 1900 ] 4 0.001% 100.015% ( 1900, 2900 ] 7 0.002% 100.017% ( 2900, 4400 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 62046 Average: 2.6587 StdDev: 18.96 Min: 1 Median: 1.5874 Max: 3104 Percentiles: P50: 1.59 P75: 1.99 P99: 6.27 P99.9: 48.14 P99.99: 858.13 ------------------------------------------------------ [ 0, 1 ] 8238 13.277% 13.277% ### ( 1, 2 ] 38791 62.520% 75.797% ############# ( 2, 3 ] 9246 14.902% 90.699% ### ( 3, 4 ] 2913 4.695% 95.394% # ( 4, 6 ] 2206 3.555% 98.949% # ( 6, 10 ] 473 0.762% 99.712% ( 10, 15 ] 83 0.134% 99.845% ( 15, 22 ] 8 0.013% 99.858% ( 22, 34 ] 1 0.002% 99.860% ( 34, 51 ] 30 0.048% 99.908% ( 51, 76 ] 13 0.021% 99.929% ( 76, 110 ] 4 0.006% 99.936% ( 110, 170 ] 1 0.002% 99.937% ( 170, 250 ] 11 0.018% 99.955% ( 250, 380 ] 12 0.019% 99.974% ( 380, 580 ] 5 0.008% 99.982% ( 580, 870 ] 5 0.008% 99.990% ( 870, 1300 ] 4 0.006% 99.997% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195986 Average: 3.3512 StdDev: 28.45 Min: 1 Median: 1.6398 Max: 3579 Percentiles: P50: 1.64 P75: 2.18 P99: 9.06 P99.9: 223.56 P99.99: 796.40 ------------------------------------------------------ [ 0, 1 ] 21414 10.926% 10.926% ## ( 1, 2 ] 119687 61.069% 71.995% ############ ( 2, 3 ] 32962 16.819% 88.814% ### ( 3, 4 ] 10508 5.362% 94.176% # ( 4, 6 ] 6748 3.443% 97.619% # ( 6, 10 ] 3534 1.803% 99.422% ( 10, 15 ] 390 0.199% 99.621% ( 15, 22 ] 90 0.046% 99.667% ( 22, 34 ] 56 0.029% 99.695% ( 34, 51 ] 11 0.006% 99.701% ( 51, 76 ] 15 0.008% 99.709% ( 76, 110 ] 130 0.066% 99.775% ( 110, 170 ] 164 0.084% 99.859% ( 170, 250 ] 121 0.062% 99.920% ( 250, 380 ] 65 0.033% 99.954% ( 380, 580 ] 52 0.027% 99.980% ( 580, 870 ] 26 0.013% 99.993% ( 870, 1300 ] 12 0.006% 99.999% ( 1300, 1900 ] 14 0.007% 100.007% ( 1900, 2900 ] 8 0.004% 100.011% ( 2900, 4400 ] 3 0.002% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 1502.0857 StdDev: 1194.45 Min: 132 Median: 1146.4286 Max: 4650 Percentiles: P50: 1146.43 P75: 1983.33 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 7 20.000% 28.571% #### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 7 20.000% 57.143% #### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 3 8.571% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.4 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 306.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.839 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-12:01:46 ... thread 0: (1000000,3000000) ops and (343050.6,329712.7) ops/second in (2.915022,9.098830) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.46 GB 94.4 1.7 0.0 1.7 4.5 2.8 0.0 1.6 117.5 306.3 15.01 14.00 46 0.326 1791K 2049 0.0 0.0 L1 1/1 1.94 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 244.2 244.0 1.03 1.00 1 1.032 255K 211 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 39/0 994.35 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.5 210.4 5.74 5.03 4 1.436 1199K 525 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1228/12 98.90 GB 0.0 3.3 0.6 2.7 6.0 3.4 0.5 2.2 149.7 276.8 22.29 20.51 52 0.429 3359K 2809 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 0.6 2.7 6.0 3.4 0.4 2.2 149.7 276.8 22.29 20.51 52 0.429 3359K 2809 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 0.6 2.7 3.3 0.6 0.0 0.0 236.1 235.9 14.13 13.23 12 1.178 3359K 2809 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 347.5 8.16 7.27 40 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.02 GB write, 661.09 MB/s write, 3.26 GB read, 357.58 MB/s read, 22.3 seconds Interval compaction: 6.02 GB write, 677.79 MB/s write, 3.26 GB read, 366.62 MB/s read, 22.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 785064 Average: 2.2415 StdDev: 11.19 Min: 0 Median: 1.5252 Max: 4353 Percentiles: P50: 1.53 P75: 1.90 P99: 5.60 P99.9: 9.79 P99.99: 13.93 ------------------------------------------------------ [ 0, 1 ] 118769 15.129% 15.129% ### ( 1, 2 ] 521211 66.391% 81.519% ############# ( 2, 3 ] 91743 11.686% 93.206% ## ( 3, 4 ] 31192 3.973% 97.179% # ( 4, 6 ] 17883 2.278% 99.457% ( 6, 10 ] 3676 0.468% 99.925% ( 10, 15 ] 654 0.083% 100.008% ( 15, 22 ] 76 0.010% 100.018% ( 22, 34 ] 5 0.001% 100.018% ( 34, 51 ] 4 0.001% 100.019% ( 51, 76 ] 16 0.002% 100.021% ( 76, 110 ] 7 0.001% 100.022% ( 110, 170 ] 19 0.002% 100.024% ( 170, 250 ] 20 0.003% 100.027% ( 250, 380 ] 20 0.003% 100.029% ( 380, 580 ] 9 0.001% 100.031% ( 580, 870 ] 12 0.002% 100.032% ( 870, 1300 ] 10 0.001% 100.033% ( 1300, 1900 ] 5 0.001% 100.034% ( 1900, 2900 ] 8 0.001% 100.035% ( 2900, 4400 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 75707 Average: 2.6078 StdDev: 17.17 Min: 1 Median: 1.5998 Max: 3104 Percentiles: P50: 1.60 P75: 1.99 P99: 5.99 P99.9: 40.74 P99.99: 778.90 ------------------------------------------------------ [ 0, 1 ] 9025 11.921% 11.921% ## ( 1, 2 ] 48061 63.483% 75.404% ############# ( 2, 3 ] 11548 15.254% 90.657% ### ( 3, 4 ] 3659 4.833% 95.491% # ( 4, 6 ] 2675 3.533% 99.024% # ( 6, 10 ] 540 0.713% 99.737% ( 10, 15 ] 101 0.133% 99.871% ( 15, 22 ] 8 0.011% 99.881% ( 22, 34 ] 2 0.003% 99.884% ( 34, 51 ] 31 0.041% 99.925% ( 51, 76 ] 13 0.017% 99.942% ( 76, 110 ] 4 0.005% 99.947% ( 110, 170 ] 1 0.001% 99.948% ( 170, 250 ] 11 0.015% 99.963% ( 250, 380 ] 12 0.016% 99.979% ( 380, 580 ] 5 0.007% 99.985% ( 580, 870 ] 5 0.007% 99.992% ( 870, 1300 ] 4 0.005% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215797 Average: 3.2642 StdDev: 27.20 Min: 0 Median: 1.6371 Max: 3579 Percentiles: P50: 1.64 P75: 2.15 P99: 8.91 P99.9: 212.76 P99.99: 777.85 ------------------------------------------------------ [ 0, 1 ] 22825 10.577% 10.577% ## ( 1, 2 ] 133538 61.881% 72.458% ############ ( 2, 3 ] 35819 16.598% 89.057% ### ( 3, 4 ] 11536 5.346% 94.403% # ( 4, 6 ] 7284 3.375% 97.778% # ( 6, 10 ] 3624 1.679% 99.457% ( 10, 15 ] 420 0.195% 99.652% ( 15, 22 ] 92 0.043% 99.695% ( 22, 34 ] 56 0.026% 99.721% ( 34, 51 ] 11 0.005% 99.726% ( 51, 76 ] 16 0.007% 99.733% ( 76, 110 ] 130 0.060% 99.793% ( 110, 170 ] 165 0.076% 99.870% ( 170, 250 ] 122 0.057% 99.926% ( 250, 380 ] 67 0.031% 99.957% ( 380, 580 ] 52 0.024% 99.981% ( 580, 870 ] 27 0.013% 99.994% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.006% 100.006% ( 1900, 2900 ] 8 0.004% 100.010% ( 2900, 4400 ] 3 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 35 Average: 1502.0857 StdDev: 1194.45 Min: 132 Median: 1146.4286 Max: 4650 Percentiles: P50: 1146.43 P75: 1983.33 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 7 20.000% 28.571% #### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 7 20.000% 57.143% #### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 3 8.571% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 316.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.059 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.220 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:01:49 ... thread 0: (1000000,4000000) ops and (326390.6,328875.9) ops/second in (3.063814,12.162644) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.21 GB 201.4 2.6 0.0 2.6 6.3 3.7 0.0 1.7 124.7 305.7 21.21 19.83 63 0.337 2686K 3045 0.0 0.0 L1 11/0 1.22 GB 125.4 1.5 1.4 0.1 1.5 1.4 0.1 1.0 228.4 227.3 6.62 6.42 2 3.312 1535K 6783 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 39/0 994.35 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.5 210.4 5.74 5.03 4 1.436 1199K 525 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/4 99.88 GB 0.0 5.4 1.8 3.5 9.1 5.6 0.5 2.4 160.7 273.2 34.09 31.75 70 0.487 5534K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.8 3.5 9.1 5.6 0.4 2.4 160.7 273.2 34.09 31.75 70 0.487 5534K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.8 3.5 5.3 1.8 0.0 0.0 237.2 236.8 23.10 21.97 16 1.443 5534K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 349.6 10.99 9.79 54 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.09 GB write, 751.23 MB/s write, 5.35 GB read, 442.06 MB/s read, 34.1 seconds Interval compaction: 9.09 GB write, 765.43 MB/s write, 5.35 GB read, 450.41 MB/s read, 34.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 14, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1133117 Average: 2.2499 StdDev: 11.95 Min: 0 Median: 1.5114 Max: 4353 Percentiles: P50: 1.51 P75: 1.89 P99: 5.59 P99.9: 9.93 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 181549 16.022% 16.022% ### ( 1, 2 ] 752830 66.439% 82.461% ############# ( 2, 3 ] 126616 11.174% 93.635% ## ( 3, 4 ] 42023 3.709% 97.344% # ( 4, 6 ] 23585 2.081% 99.425% ( 6, 10 ] 5483 0.484% 99.909% ( 10, 15 ] 939 0.083% 99.992% ( 15, 22 ] 103 0.009% 100.001% ( 22, 34 ] 11 0.001% 100.002% ( 34, 51 ] 7 0.001% 100.003% ( 51, 76 ] 17 0.002% 100.004% ( 76, 110 ] 65 0.006% 100.010% ( 110, 170 ] 98 0.009% 100.018% ( 170, 250 ] 59 0.005% 100.024% ( 250, 380 ] 45 0.004% 100.028% ( 380, 580 ] 29 0.003% 100.030% ( 580, 870 ] 24 0.002% 100.032% ( 870, 1300 ] 13 0.001% 100.033% ( 1300, 1900 ] 6 0.001% 100.034% ( 1900, 2900 ] 12 0.001% 100.035% ( 2900, 4400 ] 2 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 76254 Average: 2.9448 StdDev: 23.22 Min: 0 Median: 1.6007 Max: 3104 Percentiles: P50: 1.60 P75: 2.00 P99: 6.49 P99.9: 161.77 P99.99: 1138.73 ------------------------------------------------------ [ 0, 1 ] 9092 11.923% 11.923% ## ( 1, 2 ] 48333 63.384% 75.308% ############# ( 2, 3 ] 11650 15.278% 90.585% ### ( 3, 4 ] 3668 4.810% 95.396% # ( 4, 6 ] 2682 3.517% 98.913% # ( 6, 10 ] 545 0.715% 99.628% ( 10, 15 ] 101 0.132% 99.760% ( 15, 22 ] 8 0.010% 99.771% ( 22, 34 ] 3 0.004% 99.774% ( 34, 51 ] 31 0.041% 99.815% ( 51, 76 ] 13 0.017% 99.832% ( 76, 110 ] 25 0.033% 99.865% ( 110, 170 ] 31 0.041% 99.906% ( 170, 250 ] 15 0.020% 99.925% ( 250, 380 ] 20 0.026% 99.951% ( 380, 580 ] 16 0.021% 99.972% ( 580, 870 ] 9 0.012% 99.984% ( 870, 1300 ] 7 0.009% 99.993% ( 1300, 1900 ] 3 0.004% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215797 Average: 3.2642 StdDev: 27.20 Min: 0 Median: 1.6371 Max: 3579 Percentiles: P50: 1.64 P75: 2.15 P99: 8.91 P99.9: 212.76 P99.99: 777.85 ------------------------------------------------------ [ 0, 1 ] 22825 10.577% 10.577% ## ( 1, 2 ] 133538 61.881% 72.458% ############ ( 2, 3 ] 35819 16.598% 89.057% ### ( 3, 4 ] 11536 5.346% 94.403% # ( 4, 6 ] 7284 3.375% 97.778% # ( 6, 10 ] 3624 1.679% 99.457% ( 10, 15 ] 420 0.195% 99.652% ( 15, 22 ] 92 0.043% 99.695% ( 22, 34 ] 56 0.026% 99.721% ( 34, 51 ] 11 0.005% 99.726% ( 51, 76 ] 16 0.007% 99.733% ( 76, 110 ] 130 0.060% 99.793% ( 110, 170 ] 165 0.076% 99.870% ( 170, 250 ] 122 0.057% 99.926% ( 250, 380 ] 67 0.031% 99.957% ( 380, 580 ] 52 0.024% 99.981% ( 580, 870 ] 27 0.013% 99.994% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.006% 100.006% ( 1900, 2900 ] 8 0.004% 100.010% ( 2900, 4400 ] 3 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 35 Average: 1502.0857 StdDev: 1194.45 Min: 132 Median: 1146.4286 Max: 4650 Percentiles: P50: 1146.43 P75: 1983.33 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 7 20.000% 28.571% #### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 7 20.000% 57.143% #### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 3 8.571% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 317.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.446 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-12:01:52 ... thread 0: (1000000,5000000) ops and (308554.5,324600.2) ops/second in (3.240919,15.403563) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.13 GB 62.9 3.3 0.0 3.3 8.0 4.7 0.0 1.7 127.2 306.1 26.74 25.03 79 0.338 3454K 3751 0.0 0.0 L1 11/11 1.22 GB 0.0 1.5 1.4 0.1 1.5 1.4 0.1 1.0 228.4 227.3 6.62 6.42 2 3.312 1535K 6783 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 39/0 994.35 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.5 210.4 5.74 5.03 4 1.436 1199K 525 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/26 100.80 GB 0.0 6.1 1.8 4.3 10.8 6.5 0.5 2.3 157.4 278.0 39.61 36.96 86 0.461 6302K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 1.8 4.3 10.8 6.5 0.4 2.3 157.4 278.0 39.61 36.96 86 0.461 6302K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 1.8 4.3 6.1 1.8 0.0 0.0 240.1 239.7 25.97 24.78 19 1.367 6302K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.8 13.65 12.17 67 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.75 GB write, 704.25 MB/s write, 6.09 GB read, 398.78 MB/s read, 39.6 seconds Interval compaction: 10.75 GB write, 714.76 MB/s write, 6.09 GB read, 404.73 MB/s read, 39.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 17, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1400573 Average: 2.2443 StdDev: 12.12 Min: 0 Median: 1.5018 Max: 4353 Percentiles: P50: 1.50 P75: 1.88 P99: 5.55 P99.9: 10.04 P99.99: 21.12 ------------------------------------------------------ [ 0, 1 ] 231545 16.532% 16.532% ### ( 1, 2 ] 934215 66.702% 83.235% ############# ( 2, 3 ] 150580 10.751% 93.986% ## ( 3, 4 ] 49540 3.537% 97.523% # ( 4, 6 ] 26721 1.908% 99.431% ( 6, 10 ] 6563 0.469% 99.899% ( 10, 15 ] 1166 0.083% 99.983% ( 15, 22 ] 120 0.009% 99.991% ( 22, 34 ] 17 0.001% 99.992% ( 34, 51 ] 9 0.001% 99.993% ( 51, 76 ] 18 0.001% 99.994% ( 76, 110 ] 91 0.006% 100.001% ( 110, 170 ] 164 0.012% 100.013% ( 170, 250 ] 85 0.006% 100.019% ( 250, 380 ] 67 0.005% 100.023% ( 380, 580 ] 46 0.003% 100.027% ( 580, 870 ] 31 0.002% 100.029% ( 870, 1300 ] 14 0.001% 100.030% ( 1300, 1900 ] 9 0.001% 100.031% ( 1900, 2900 ] 15 0.001% 100.032% ( 2900, 4400 ] 3 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 140579 Average: 2.7233 StdDev: 19.59 Min: 0 Median: 1.5354 Max: 3104 Percentiles: P50: 1.54 P75: 1.92 P99: 7.46 P99.9: 140.70 P99.99: 868.47 ------------------------------------------------------ [ 0, 1 ] 21359 15.194% 15.194% ### ( 1, 2 ] 91390 65.010% 80.203% ############# ( 2, 3 ] 17077 12.148% 92.351% ## ( 3, 4 ] 5287 3.761% 96.112% # ( 4, 6 ] 3554 2.528% 98.640% # ( 6, 10 ] 1385 0.985% 99.625% ( 10, 15 ] 205 0.146% 99.771% ( 15, 22 ] 18 0.013% 99.784% ( 22, 34 ] 4 0.003% 99.787% ( 34, 51 ] 31 0.022% 99.809% ( 51, 76 ] 14 0.010% 99.819% ( 76, 110 ] 75 0.053% 99.872% ( 110, 170 ] 79 0.056% 99.928% ( 170, 250 ] 23 0.016% 99.945% ( 250, 380 ] 31 0.022% 99.967% ( 380, 580 ] 23 0.016% 99.983% ( 580, 870 ] 11 0.008% 99.991% ( 870, 1300 ] 8 0.006% 99.996% ( 1300, 1900 ] 3 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215797 Average: 3.2642 StdDev: 27.20 Min: 0 Median: 1.6371 Max: 3579 Percentiles: P50: 1.64 P75: 2.15 P99: 8.91 P99.9: 212.76 P99.99: 777.85 ------------------------------------------------------ [ 0, 1 ] 22825 10.577% 10.577% ## ( 1, 2 ] 133538 61.881% 72.458% ############ ( 2, 3 ] 35819 16.598% 89.057% ### ( 3, 4 ] 11536 5.346% 94.403% # ( 4, 6 ] 7284 3.375% 97.778% # ( 6, 10 ] 3624 1.679% 99.457% ( 10, 15 ] 420 0.195% 99.652% ( 15, 22 ] 92 0.043% 99.695% ( 22, 34 ] 56 0.026% 99.721% ( 34, 51 ] 11 0.005% 99.726% ( 51, 76 ] 16 0.007% 99.733% ( 76, 110 ] 130 0.060% 99.793% ( 110, 170 ] 165 0.076% 99.870% ( 170, 250 ] 122 0.057% 99.926% ( 250, 380 ] 67 0.031% 99.957% ( 380, 580 ] 52 0.024% 99.981% ( 580, 870 ] 27 0.013% 99.994% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.006% 100.006% ( 1900, 2900 ] 8 0.004% 100.010% ( 2900, 4400 ] 3 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 35 Average: 1502.0857 StdDev: 1194.45 Min: 132 Median: 1146.4286 Max: 4650 Percentiles: P50: 1146.43 P75: 1983.33 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 7 20.000% 28.571% #### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 7 20.000% 57.143% #### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 3 8.571% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.002 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 303.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.556 H:M:S, 17.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:02:04 ... thread 0: (1000000,6000000) ops and (83902.5,219601.9) ops/second in (11.918603,27.322166) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 4.11 GB 169.0 5.8 0.0 5.8 11.4 5.6 0.0 2.0 147.6 291.8 40.10 37.37 100 0.401 6011K 13K 0.0 0.0 L1 11/11 1.22 GB 0.0 1.5 1.4 0.1 1.5 1.4 0.1 1.0 228.4 227.3 6.62 6.42 2 3.312 1535K 6783 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 39/0 994.35 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.5 210.4 5.74 5.03 4 1.436 1199K 525 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/26 101.78 GB 0.0 8.5 1.8 6.7 14.2 7.5 0.5 2.5 165.2 274.2 52.97 49.30 107 0.495 8859K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.5 1.8 6.7 14.2 7.5 0.4 2.5 165.2 274.2 52.97 49.30 107 0.495 8859K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.5 1.8 6.7 8.5 1.8 0.0 0.0 240.5 239.9 36.40 34.50 24 1.517 8859K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.7 16.57 14.80 83 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.6 total, 27.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.19 GB write, 527.25 MB/s write, 8.55 GB read, 317.69 MB/s read, 53.0 seconds Interval compaction: 14.19 GB write, 531.68 MB/s write, 8.55 GB read, 320.36 MB/s read, 53.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 17, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2449051 Average: 2.8924 StdDev: 17.87 Min: 0 Median: 1.4993 Max: 4458 Percentiles: P50: 1.50 P75: 1.88 P99: 6.92 P99.9: 160.88 P99.99: 346.50 ------------------------------------------------------ [ 0, 1 ] 411447 16.800% 16.800% ### ( 1, 2 ] 1628351 66.489% 83.289% ############# ( 2, 3 ] 250655 10.235% 93.524% ## ( 3, 4 ] 85038 3.472% 96.996% # ( 4, 6 ] 45553 1.860% 98.856% ( 6, 10 ] 15250 0.623% 99.479% ( 10, 15 ] 2255 0.092% 99.571% ( 15, 22 ] 275 0.011% 99.582% ( 22, 34 ] 26 0.001% 99.583% ( 34, 51 ] 15 0.001% 99.584% ( 51, 76 ] 63 0.003% 99.587% ( 76, 110 ] 3763 0.154% 99.740% ( 110, 170 ] 4614 0.188% 99.929% ( 170, 250 ] 1008 0.041% 99.970% ( 250, 380 ] 667 0.027% 99.997% ( 380, 580 ] 487 0.020% 100.017% ( 580, 870 ] 204 0.008% 100.025% ( 870, 1300 ] 43 0.002% 100.027% ( 1300, 1900 ] 14 0.001% 100.028% ( 1900, 2900 ] 27 0.001% 100.029% ( 2900, 4400 ] 7 0.000% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 356901 Average: 2.9122 StdDev: 17.93 Min: 0 Median: 1.5217 Max: 3104 Percentiles: P50: 1.52 P75: 1.90 P99: 8.50 P99.9: 164.81 P99.99: 714.54 ------------------------------------------------------ [ 0, 1 ] 55736 15.617% 15.617% ### ( 1, 2 ] 235213 65.904% 81.521% ############# ( 2, 3 ] 38146 10.688% 92.209% ## ( 3, 4 ] 12991 3.640% 95.849% # ( 4, 6 ] 8680 2.432% 98.281% ( 6, 10 ] 4110 1.152% 99.433% ( 10, 15 ] 455 0.127% 99.560% ( 15, 22 ] 52 0.015% 99.575% ( 22, 34 ] 5 0.001% 99.576% ( 34, 51 ] 33 0.009% 99.585% ( 51, 76 ] 42 0.012% 99.597% ( 76, 110 ] 596 0.167% 99.764% ( 110, 170 ] 531 0.149% 99.913% ( 170, 250 ] 115 0.032% 99.945% ( 250, 380 ] 83 0.023% 99.968% ( 380, 580 ] 62 0.017% 99.986% ( 580, 870 ] 33 0.009% 99.995% ( 870, 1300 ] 10 0.003% 99.998% ( 1300, 1900 ] 3 0.001% 99.999% ( 1900, 2900 ] 3 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215797 Average: 3.2642 StdDev: 27.20 Min: 0 Median: 1.6371 Max: 3579 Percentiles: P50: 1.64 P75: 2.15 P99: 8.91 P99.9: 212.76 P99.99: 777.85 ------------------------------------------------------ [ 0, 1 ] 22825 10.577% 10.577% ## ( 1, 2 ] 133538 61.881% 72.458% ############ ( 2, 3 ] 35819 16.598% 89.057% ### ( 3, 4 ] 11536 5.346% 94.403% # ( 4, 6 ] 7284 3.375% 97.778% # ( 6, 10 ] 3624 1.679% 99.457% ( 10, 15 ] 420 0.195% 99.652% ( 15, 22 ] 92 0.043% 99.695% ( 22, 34 ] 56 0.026% 99.721% ( 34, 51 ] 11 0.005% 99.726% ( 51, 76 ] 16 0.007% 99.733% ( 76, 110 ] 130 0.060% 99.793% ( 110, 170 ] 165 0.076% 99.870% ( 170, 250 ] 122 0.057% 99.926% ( 250, 380 ] 67 0.031% 99.957% ( 380, 580 ] 52 0.024% 99.981% ( 580, 870 ] 27 0.013% 99.994% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.006% 100.006% ( 1900, 2900 ] 8 0.004% 100.010% ( 2900, 4400 ] 3 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 35 Average: 1502.0857 StdDev: 1194.45 Min: 132 Median: 1146.4286 Max: 4650 Percentiles: P50: 1146.43 P75: 1983.33 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 7 20.000% 28.571% #### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 7 20.000% 57.143% #### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 3 8.571% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 27.6 total, 11.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 214.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.804 H:M:S, 39.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 82.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.802 H:M:S, 73.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:02:08 ... thread 0: (1000000,7000000) ops and (243065.7,222672.7) ops/second in (4.114114,31.436280) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.88 GB 25.2 6.6 0.0 6.6 13.2 6.6 0.0 2.0 144.5 290.1 46.63 43.20 117 0.399 6843K 14K 0.0 0.0 L1 23/23 1.96 GB 0.0 4.9 3.6 1.3 4.9 3.6 0.1 1.3 213.2 210.6 23.61 21.86 3 7.869 5110K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.7 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 16/0 971.84 MB 1.0 1.9 1.0 0.9 1.9 1.0 0.8 1.9 160.6 160.4 12.00 8.60 16 0.750 1904K 1772 0.0 0.0 L4 179/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 136.9 136.9 0.94 0.68 1 0.943 126K 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/31 102.71 GB 0.0 13.6 4.8 8.8 20.2 11.4 5.3 3.0 166.6 246.9 83.68 74.80 138 0.606 14M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.6 4.8 8.8 20.2 11.4 5.3 3.0 166.6 246.9 83.68 74.80 138 0.606 14M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.6 4.8 8.8 13.5 4.7 0.0 0.0 218.1 216.9 63.90 57.35 41 1.559 14M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 344.0 19.78 17.45 97 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.7 total, 31.4 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.18 GB write, 652.57 MB/s write, 13.61 GB read, 440.16 MB/s read, 83.7 seconds Interval compaction: 20.18 GB write, 657.35 MB/s write, 13.61 GB read, 443.38 MB/s read, 83.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 19, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2727121 Average: 2.8467 StdDev: 17.58 Min: 0 Median: 1.5011 Max: 4458 Percentiles: P50: 1.50 P75: 1.88 P99: 6.87 P99.9: 158.72 P99.99: 350.30 ------------------------------------------------------ [ 0, 1 ] 456973 16.757% 16.757% ### ( 1, 2 ] 1809347 66.346% 83.103% ############# ( 2, 3 ] 280393 10.282% 93.385% ## ( 3, 4 ] 95499 3.502% 96.886% # ( 4, 6 ] 53789 1.972% 98.859% ( 6, 10 ] 17797 0.653% 99.511% ( 10, 15 ] 2633 0.097% 99.608% ( 15, 22 ] 317 0.012% 99.620% ( 22, 34 ] 35 0.001% 99.621% ( 34, 51 ] 16 0.001% 99.622% ( 51, 76 ] 64 0.002% 99.624% ( 76, 110 ] 3765 0.138% 99.762% ( 110, 170 ] 4640 0.170% 99.932% ( 170, 250 ] 1043 0.038% 99.970% ( 250, 380 ] 699 0.026% 99.996% ( 380, 580 ] 514 0.019% 100.015% ( 580, 870 ] 232 0.009% 100.023% ( 870, 1300 ] 52 0.002% 100.025% ( 1300, 1900 ] 16 0.001% 100.026% ( 1900, 2900 ] 28 0.001% 100.027% ( 2900, 4400 ] 8 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 561079 Average: 4.8142 StdDev: 67.36 Min: 0 Median: 1.6404 Max: 7891 Percentiles: P50: 1.64 P75: 2.23 P99: 9.46 P99.9: 242.59 P99.99: 522.24 ------------------------------------------------------ [ 0, 1 ] 64736 11.538% 11.538% ## ( 1, 2 ] 336995 60.062% 71.600% ############ ( 2, 3 ] 82125 14.637% 86.237% ### ( 3, 4 ] 33951 6.051% 92.288% # ( 4, 6 ] 28939 5.158% 97.445% # ( 6, 10 ] 10069 1.795% 99.240% ( 10, 15 ] 1748 0.312% 99.552% ( 15, 22 ] 238 0.042% 99.594% ( 22, 34 ] 22 0.004% 99.598% ( 34, 51 ] 39 0.007% 99.605% ( 51, 76 ] 67 0.012% 99.617% ( 76, 110 ] 649 0.116% 99.732% ( 110, 170 ] 704 0.125% 99.858% ( 170, 250 ] 260 0.046% 99.904% ( 250, 380 ] 291 0.052% 99.956% ( 380, 580 ] 267 0.048% 100.004% ( 580, 870 ] 184 0.033% 100.037% ( 870, 1300 ] 100 0.018% 100.054% ( 1300, 1900 ] 50 0.009% 100.063% ( 1900, 2900 ] 67 0.012% 100.075% ( 2900, 4400 ] 84 0.015% 100.090% ( 4400, 6600 ] 24 0.004% 100.094% ( 6600, 9900 ] 1 0.000% 100.095% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 263581 Average: 5.4627 StdDev: 67.53 Min: 0 Median: 1.6608 Max: 7174 Percentiles: P50: 1.66 P75: 2.25 P99: 9.76 P99.9: 725.66 P99.99: 2270.84 ------------------------------------------------------ [ 0, 1 ] 25786 9.783% 9.783% ## ( 1, 2 ] 160412 60.859% 70.642% ############ ( 2, 3 ] 45660 17.323% 87.965% ### ( 3, 4 ] 14792 5.612% 93.577% # ( 4, 6 ] 9837 3.732% 97.309% # ( 6, 10 ] 4745 1.800% 99.109% ( 10, 15 ] 634 0.241% 99.349% ( 15, 22 ] 125 0.047% 99.397% ( 22, 34 ] 58 0.022% 99.419% ( 34, 51 ] 12 0.005% 99.423% ( 51, 76 ] 17 0.006% 99.430% ( 76, 110 ] 179 0.068% 99.498% ( 110, 170 ] 294 0.112% 99.609% ( 170, 250 ] 225 0.085% 99.695% ( 250, 380 ] 219 0.083% 99.778% ( 380, 580 ] 230 0.087% 99.865% ( 580, 870 ] 184 0.070% 99.935% ( 870, 1300 ] 91 0.035% 99.969% ( 1300, 1900 ] 45 0.017% 99.986% ( 1900, 2900 ] 26 0.010% 99.996% ( 2900, 4400 ] 29 0.011% 100.007% ( 4400, 6600 ] 10 0.004% 100.011% ( 6600, 9900 ] 1 0.000% 100.011% ** Level 4 read latency histogram (micros): Count: 170 Average: 315.8118 StdDev: 812.03 Min: 0 Median: 1.8269 Max: 4650 Percentiles: P50: 1.83 P75: 18.06 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ [ 0, 1 ] 42 24.706% 24.706% ##### ( 1, 2 ] 52 30.588% 55.294% ###### ( 2, 3 ] 5 2.941% 58.235% # ( 3, 4 ] 6 3.529% 61.765% # ( 4, 6 ] 2 1.176% 62.941% ( 6, 10 ] 4 2.353% 65.294% ( 10, 15 ] 13 7.647% 72.941% ## ( 15, 22 ] 8 4.706% 77.647% # ( 34, 51 ] 1 0.588% 78.235% ( 110, 170 ] 1 0.588% 78.824% ( 170, 250 ] 1 0.588% 79.412% ( 250, 380 ] 3 1.765% 81.176% ( 380, 580 ] 7 4.118% 85.294% # ( 580, 870 ] 3 1.765% 87.059% ( 870, 1300 ] 7 4.118% 91.176% # ( 1300, 1900 ] 6 3.529% 94.706% # ( 1900, 2900 ] 3 1.765% 96.471% ( 2900, 4400 ] 4 2.353% 98.824% ( 4400, 6600 ] 2 1.176% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 785.8250 StdDev: 946.67 Min: 79 Median: 234.0000 Max: 3282 Percentiles: P50: 234.00 P75: 1300.00 P99: 3282.00 P99.9: 3282.00 P99.99: 3282.00 ------------------------------------------------------ ( 76, 110 ] 20 25.000% 25.000% ##### ( 110, 170 ] 12 15.000% 40.000% ### ( 170, 250 ] 10 12.500% 52.500% ### ( 250, 380 ] 3 3.750% 56.250% # ( 380, 580 ] 4 5.000% 61.250% # ( 580, 870 ] 7 8.750% 70.000% ## ( 870, 1300 ] 4 5.000% 75.000% # ( 1300, 1900 ] 8 10.000% 85.000% ## ( 1900, 2900 ] 7 8.750% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 31.7 total, 4.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 217.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.199 H:M:S, 38.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 239.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.395 H:M:S, 33.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-12:02:12 ... thread 0: (1000000,8000000) ops and (322972.2,231665.7) ops/second in (3.096242,34.532522) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.80 GB 94.4 7.1 0.0 7.1 14.7 7.6 0.0 1.9 141.7 291.6 51.57 47.83 132 0.391 7418K 15K 0.0 0.0 L1 23/23 1.96 GB 0.0 4.9 3.6 1.3 4.9 3.6 0.1 1.3 213.2 210.6 23.61 21.86 3 7.869 5110K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.7 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 16/0 971.84 MB 1.0 1.9 1.0 0.9 1.9 1.0 0.8 1.9 160.6 160.4 12.00 8.60 16 0.750 1904K 1772 0.0 0.0 L4 179/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 136.9 136.9 0.94 0.68 1 0.943 126K 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/35 103.63 GB 0.0 14.2 4.8 9.4 21.7 12.3 5.3 2.9 163.7 250.2 88.63 79.44 153 0.579 14M 76K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 4.8 9.4 21.7 12.3 5.3 2.9 163.7 250.2 88.63 79.44 153 0.579 14M 76K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 4.8 9.4 14.1 4.7 0.0 0.0 219.5 218.4 66.07 59.49 43 1.537 14M 76K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.6 22.55 19.95 110 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.8 total, 34.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.66 GB write, 637.92 MB/s write, 14.17 GB read, 417.27 MB/s read, 88.6 seconds Interval compaction: 21.66 GB write, 642.17 MB/s write, 14.17 GB read, 420.05 MB/s read, 88.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 23, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3112772 Average: 2.7770 StdDev: 16.68 Min: 0 Median: 1.5075 Max: 4458 Percentiles: P50: 1.51 P75: 1.88 P99: 6.64 P99.9: 152.78 P99.99: 323.55 ------------------------------------------------------ [ 0, 1 ] 504601 16.211% 16.211% ### ( 1, 2 ] 2072445 66.579% 82.789% ############# ( 2, 3 ] 330846 10.629% 93.418% ## ( 3, 4 ] 108976 3.501% 96.919% # ( 4, 6 ] 61459 1.974% 98.893% ( 6, 10 ] 20764 0.667% 99.560% ( 10, 15 ] 2948 0.095% 99.655% ( 15, 22 ] 352 0.011% 99.667% ( 22, 34 ] 40 0.001% 99.668% ( 34, 51 ] 17 0.001% 99.668% ( 51, 76 ] 69 0.002% 99.671% ( 76, 110 ] 3815 0.123% 99.793% ( 110, 170 ] 4667 0.150% 99.943% ( 170, 250 ] 1060 0.034% 99.977% ( 250, 380 ] 710 0.023% 100.000% ( 380, 580 ] 525 0.017% 100.017% ( 580, 870 ] 237 0.008% 100.024% ( 870, 1300 ] 59 0.002% 100.026% ( 1300, 1900 ] 17 0.001% 100.027% ( 1900, 2900 ] 29 0.001% 100.028% ( 2900, 4400 ] 8 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 561079 Average: 4.8142 StdDev: 67.36 Min: 0 Median: 1.6404 Max: 7891 Percentiles: P50: 1.64 P75: 2.23 P99: 9.46 P99.9: 242.59 P99.99: 522.24 ------------------------------------------------------ [ 0, 1 ] 64736 11.538% 11.538% ## ( 1, 2 ] 336995 60.062% 71.600% ############ ( 2, 3 ] 82125 14.637% 86.237% ### ( 3, 4 ] 33951 6.051% 92.288% # ( 4, 6 ] 28939 5.158% 97.445% # ( 6, 10 ] 10069 1.795% 99.240% ( 10, 15 ] 1748 0.312% 99.552% ( 15, 22 ] 238 0.042% 99.594% ( 22, 34 ] 22 0.004% 99.598% ( 34, 51 ] 39 0.007% 99.605% ( 51, 76 ] 67 0.012% 99.617% ( 76, 110 ] 649 0.116% 99.732% ( 110, 170 ] 704 0.125% 99.858% ( 170, 250 ] 260 0.046% 99.904% ( 250, 380 ] 291 0.052% 99.956% ( 380, 580 ] 267 0.048% 100.004% ( 580, 870 ] 184 0.033% 100.037% ( 870, 1300 ] 100 0.018% 100.054% ( 1300, 1900 ] 50 0.009% 100.063% ( 1900, 2900 ] 67 0.012% 100.075% ( 2900, 4400 ] 84 0.015% 100.090% ( 4400, 6600 ] 24 0.004% 100.094% ( 6600, 9900 ] 1 0.000% 100.095% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 263581 Average: 5.4627 StdDev: 67.53 Min: 0 Median: 1.6608 Max: 7174 Percentiles: P50: 1.66 P75: 2.25 P99: 9.76 P99.9: 725.66 P99.99: 2270.84 ------------------------------------------------------ [ 0, 1 ] 25786 9.783% 9.783% ## ( 1, 2 ] 160412 60.859% 70.642% ############ ( 2, 3 ] 45660 17.323% 87.965% ### ( 3, 4 ] 14792 5.612% 93.577% # ( 4, 6 ] 9837 3.732% 97.309% # ( 6, 10 ] 4745 1.800% 99.109% ( 10, 15 ] 634 0.241% 99.349% ( 15, 22 ] 125 0.047% 99.397% ( 22, 34 ] 58 0.022% 99.419% ( 34, 51 ] 12 0.005% 99.423% ( 51, 76 ] 17 0.006% 99.430% ( 76, 110 ] 179 0.068% 99.498% ( 110, 170 ] 294 0.112% 99.609% ( 170, 250 ] 225 0.085% 99.695% ( 250, 380 ] 219 0.083% 99.778% ( 380, 580 ] 230 0.087% 99.865% ( 580, 870 ] 184 0.070% 99.935% ( 870, 1300 ] 91 0.035% 99.969% ( 1300, 1900 ] 45 0.017% 99.986% ( 1900, 2900 ] 26 0.010% 99.996% ( 2900, 4400 ] 29 0.011% 100.007% ( 4400, 6600 ] 10 0.004% 100.011% ( 6600, 9900 ] 1 0.000% 100.011% ** Level 4 read latency histogram (micros): Count: 170 Average: 315.8118 StdDev: 812.03 Min: 0 Median: 1.8269 Max: 4650 Percentiles: P50: 1.83 P75: 18.06 P99: 4650.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ [ 0, 1 ] 42 24.706% 24.706% ##### ( 1, 2 ] 52 30.588% 55.294% ###### ( 2, 3 ] 5 2.941% 58.235% # ( 3, 4 ] 6 3.529% 61.765% # ( 4, 6 ] 2 1.176% 62.941% ( 6, 10 ] 4 2.353% 65.294% ( 10, 15 ] 13 7.647% 72.941% ## ( 15, 22 ] 8 4.706% 77.647% # ( 34, 51 ] 1 0.588% 78.235% ( 110, 170 ] 1 0.588% 78.824% ( 170, 250 ] 1 0.588% 79.412% ( 250, 380 ] 3 1.765% 81.176% ( 380, 580 ] 7 4.118% 85.294% # ( 580, 870 ] 3 1.765% 87.059% ( 870, 1300 ] 7 4.118% 91.176% # ( 1300, 1900 ] 6 3.529% 94.706% # ( 1900, 2900 ] 3 1.765% 96.471% ( 2900, 4400 ] 4 2.353% 98.824% ( 4400, 6600 ] 2 1.176% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 785.8250 StdDev: 946.67 Min: 79 Median: 234.0000 Max: 3282 Percentiles: P50: 234.00 P75: 1300.00 P99: 3282.00 P99.9: 3282.00 P99.99: 3282.00 ------------------------------------------------------ ( 76, 110 ] 20 25.000% 25.000% ##### ( 110, 170 ] 12 15.000% 40.000% ### ( 170, 250 ] 10 12.500% 52.500% ### ( 250, 380 ] 3 3.750% 56.250% # ( 380, 580 ] 4 5.000% 61.250% # ( 580, 870 ] 7 8.750% 70.000% ## ( 870, 1300 ] 4 5.000% 75.000% # ( 1300, 1900 ] 8 10.000% 85.000% ## ( 1900, 2900 ] 7 8.750% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 34.8 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 226.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.620 H:M:S, 36.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.422 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:02:36 ... thread 0: (1000000,9000000) ops and (40892.2,152575.9) ops/second in (24.454517,58.987039) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.09 GB 6.3 8.7 0.0 8.7 17.1 8.5 0.0 2.0 143.6 283.8 61.86 56.15 148 0.418 9016K 19K 0.0 0.0 L1 13/13 1.20 GB 0.0 9.5 6.3 3.2 9.4 6.1 0.1 1.5 211.6 208.6 46.00 42.08 4 11.500 7849K 59K 0.0 0.0 L2 1/0 99.10 MB 1.0 0.1 0.1 0.0 0.1 0.1 5.0 1.8 220.1 220.1 0.51 0.47 1 0.506 113K 24 0.0 0.0 L3 14/0 948.98 MB 0.9 3.0 1.5 1.5 3.0 1.5 3.5 2.0 145.4 144.4 21.47 14.24 23 0.933 3117K 20K 0.0 0.0 L4 171/0 9.64 GB 1.0 3.9 3.3 0.6 3.9 3.3 1.4 1.2 124.5 124.1 32.08 18.93 33 0.972 4051K 11K 0.0 0.0 L5 1100/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/25 104.44 GB 0.0 25.2 11.2 14.1 33.5 19.5 14.7 4.0 159.6 212.1 161.91 131.87 209 0.775 24M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 11.2 14.1 33.5 19.5 14.6 4.0 159.6 212.1 161.91 131.87 209 0.775 24M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 11.2 14.1 25.0 11.0 0.0 0.0 191.5 190.1 134.94 109.40 86 1.569 24M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 322.3 26.97 22.47 123 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.2 total, 59.0 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.54 GB write, 579.93 MB/s write, 25.24 GB read, 436.37 MB/s read, 161.9 seconds Interval compaction: 33.54 GB write, 582.19 MB/s write, 25.24 GB read, 438.07 MB/s read, 161.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 38, pending-compaction-bytes-stops: 0, total-delays: 55, total-stops: 46, interval: 101 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4234718 Average: 3.1176 StdDev: 29.16 Min: 0 Median: 1.5131 Max: 7437 Percentiles: P50: 1.51 P75: 1.89 P99: 7.70 P99.9: 164.50 P99.99: 435.31 ------------------------------------------------------ [ 0, 1 ] 681422 16.091% 16.091% ### ( 1, 2 ] 2798389 66.082% 82.173% ############# ( 2, 3 ] 451341 10.658% 92.831% ## ( 3, 4 ] 153392 3.622% 96.454% # ( 4, 6 ] 94818 2.239% 98.693% ( 6, 10 ] 30587 0.722% 99.415% ( 10, 15 ] 4769 0.113% 99.528% ( 15, 22 ] 563 0.013% 99.541% ( 22, 34 ] 56 0.001% 99.542% ( 34, 51 ] 23 0.001% 99.543% ( 51, 76 ] 145 0.003% 99.546% ( 76, 110 ] 7756 0.183% 99.729% ( 110, 170 ] 7954 0.188% 99.917% ( 170, 250 ] 1665 0.039% 99.957% ( 250, 380 ] 1156 0.027% 99.984% ( 380, 580 ] 942 0.022% 100.006% ( 580, 870 ] 417 0.010% 100.016% ( 870, 1300 ] 116 0.003% 100.019% ( 1300, 1900 ] 63 0.001% 100.020% ( 1900, 2900 ] 86 0.002% 100.022% ( 2900, 4400 ] 95 0.002% 100.024% ( 4400, 6600 ] 16 0.000% 100.025% ( 6600, 9900 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1887655 Average: 6.3624 StdDev: 98.08 Min: 0 Median: 1.6900 Max: 10085 Percentiles: P50: 1.69 P75: 2.49 P99: 9.65 P99.9: 169.96 P99.99: 493.55 ------------------------------------------------------ [ 0, 1 ] 228653 12.113% 12.113% ## ( 1, 2 ] 1036467 54.908% 67.021% ########### ( 2, 3 ] 305306 16.174% 83.195% ### ( 3, 4 ] 139690 7.400% 90.595% # ( 4, 6 ] 125628 6.655% 97.250% # ( 6, 10 ] 36239 1.920% 99.170% ( 10, 15 ] 7085 0.375% 99.545% ( 15, 22 ] 939 0.050% 99.595% ( 22, 34 ] 81 0.004% 99.599% ( 34, 51 ] 52 0.003% 99.602% ( 51, 76 ] 213 0.011% 99.613% ( 76, 110 ] 3009 0.159% 99.773% ( 110, 170 ] 2407 0.128% 99.900% ( 170, 250 ] 572 0.030% 99.930% ( 250, 380 ] 700 0.037% 99.967% ( 380, 580 ] 749 0.040% 100.007% ( 580, 870 ] 796 0.042% 100.049% ( 870, 1300 ] 582 0.031% 100.080% ( 1300, 1900 ] 368 0.019% 100.100% ( 1900, 2900 ] 470 0.025% 100.125% ( 2900, 4400 ] 550 0.029% 100.154% ( 4400, 6600 ] 163 0.009% 100.162% ( 6600, 9900 ] 32 0.002% 100.164% ( 9900, 14000 ] 1 0.000% 100.164% ** Level 2 read latency histogram (micros): Count: 28264 Average: 1.9352 StdDev: 2.41 Min: 0 Median: 1.3750 Max: 297 Percentiles: P50: 1.38 P75: 1.80 P99: 4.57 P99.9: 9.61 P99.99: 120.42 ------------------------------------------------------ [ 0, 1 ] 7822 27.675% 27.675% ###### ( 1, 2 ] 16825 59.528% 87.203% ############ ( 2, 3 ] 2606 9.220% 96.423% ## ( 3, 4 ] 654 2.314% 98.737% ( 4, 6 ] 262 0.927% 99.664% ( 6, 10 ] 74 0.262% 99.926% ( 10, 15 ] 16 0.057% 99.982% ( 15, 22 ] 2 0.007% 99.989% ( 110, 170 ] 1 0.004% 99.993% ( 170, 250 ] 1 0.004% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 617210 Average: 6.9771 StdDev: 94.44 Min: 0 Median: 1.8251 Max: 11713 Percentiles: P50: 1.83 P75: 2.74 P99: 9.61 P99.9: 777.45 P99.99: 1481.18 ------------------------------------------------------ [ 0, 1 ] 30184 4.890% 4.890% # ( 1, 2 ] 337459 54.675% 59.565% ########### ( 2, 3 ] 129440 20.972% 80.537% #### ( 3, 4 ] 56614 9.173% 89.710% ## ( 4, 6 ] 47557 7.705% 97.415% ## ( 6, 10 ] 10830 1.755% 99.169% ( 10, 15 ] 2055 0.333% 99.502% ( 15, 22 ] 288 0.047% 99.549% ( 22, 34 ] 69 0.011% 99.560% ( 34, 51 ] 19 0.003% 99.563% ( 51, 76 ] 26 0.004% 99.568% ( 76, 110 ] 184 0.030% 99.597% ( 110, 170 ] 324 0.052% 99.650% ( 170, 250 ] 297 0.048% 99.698% ( 250, 380 ] 392 0.064% 99.762% ( 380, 580 ] 513 0.083% 99.845% ( 580, 870 ] 502 0.081% 99.926% ( 870, 1300 ] 337 0.055% 99.981% ( 1300, 1900 ] 193 0.031% 100.012% ( 1900, 2900 ] 132 0.021% 100.033% ( 2900, 4400 ] 145 0.023% 100.057% ( 4400, 6600 ] 50 0.008% 100.065% ( 6600, 9900 ] 2 0.000% 100.065% ( 9900, 14000 ] 2 0.000% 100.065% ** Level 4 read latency histogram (micros): Count: 108331 Average: 18.9487 StdDev: 186.29 Min: 0 Median: 1.9422 Max: 8102 Percentiles: P50: 1.94 P75: 2.94 P99: 445.30 P99.9: 2804.79 P99.99: 3909.54 ------------------------------------------------------ [ 0, 1 ] 1783 1.646% 1.646% ( 1, 2 ] 55595 51.320% 52.965% ########## ( 2, 3 ] 25283 23.339% 76.304% ##### ( 3, 4 ] 12344 11.395% 87.699% ## ( 4, 6 ] 9436 8.710% 96.409% ## ( 6, 10 ] 1899 1.753% 98.162% ( 10, 15 ] 447 0.413% 98.575% ( 15, 22 ] 56 0.052% 98.626% ( 22, 34 ] 14 0.013% 98.639% ( 34, 51 ] 4 0.004% 98.643% ( 51, 76 ] 2 0.002% 98.645% ( 76, 110 ] 13 0.012% 98.657% ( 110, 170 ] 44 0.041% 98.698% ( 170, 250 ] 102 0.094% 98.792% ( 250, 380 ] 147 0.136% 98.927% ( 380, 580 ] 241 0.222% 99.150% ( 580, 870 ] 321 0.296% 99.446% ( 870, 1300 ] 253 0.234% 99.680% ( 1300, 1900 ] 150 0.138% 99.818% ( 1900, 2900 ] 98 0.090% 99.909% ( 2900, 4400 ] 131 0.121% 100.030% ( 4400, 6600 ] 23 0.021% 100.051% ( 6600, 9900 ] 2 0.002% 100.053% ** Level 5 read latency histogram (micros): Count: 280 Average: 1586.9393 StdDev: 1686.88 Min: 79 Median: 923.7500 Max: 12301 Percentiles: P50: 923.75 P75: 2577.42 P99: 6930.00 P99.9: 12301.00 P99.99: 12301.00 ------------------------------------------------------ ( 76, 110 ] 21 7.500% 7.500% ## ( 110, 170 ] 24 8.571% 16.071% ## ( 170, 250 ] 20 7.143% 23.214% # ( 250, 380 ] 16 5.714% 28.929% # ( 380, 580 ] 29 10.357% 39.286% ## ( 580, 870 ] 27 9.643% 48.929% ## ( 870, 1300 ] 24 8.571% 57.500% ## ( 1300, 1900 ] 28 10.000% 67.500% ## ( 1900, 2900 ] 31 11.071% 78.571% ## ( 2900, 4400 ] 42 15.000% 93.571% ### ( 4400, 6600 ] 15 5.357% 98.929% # ( 6600, 9900 ] 2 0.714% 99.643% ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 59.2 total, 24.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 149.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:33.330 H:M:S, 56.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 40.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.710 H:M:S, 84.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.455 micros/op 154927 ops/sec 60.002 seconds 9295999 operations; 150.1 MB/s Microseconds per write: Count: 9295999 Average: 6.4546 StdDev: 401.44 Min: 1 Median: 1.7723 Max: 696662 Percentiles: P50: 1.77 P75: 2.83 P99: 10.21 P99.9: 1207.15 P99.99: 2760.15 ------------------------------------------------------ [ 0, 1 ] 1045633 11.248% 11.248% ## ( 1, 2 ] 4664203 50.174% 61.423% ########## ( 2, 3 ] 1528587 16.443% 77.866% ### ( 3, 4 ] 1295273 13.934% 91.800% ### ( 4, 6 ] 524787 5.645% 97.445% # ( 6, 10 ] 142401 1.532% 98.977% ( 10, 15 ] 50480 0.543% 99.520% ( 15, 22 ] 11044 0.119% 99.639% ( 22, 34 ] 2067 0.022% 99.661% ( 34, 51 ] 243 0.003% 99.664% ( 51, 76 ] 31 0.000% 99.664% ( 76, 110 ] 6289 0.068% 99.731% ( 110, 170 ] 2631 0.028% 99.760% ( 170, 250 ] 289 0.003% 99.763% ( 250, 380 ] 225 0.002% 99.765% ( 380, 580 ] 29 0.000% 99.766% ( 580, 870 ] 25 0.000% 99.766% ( 870, 1300 ] 15899 0.171% 99.937% ( 1300, 1900 ] 83 0.001% 99.938% ( 1900, 2900 ] 5639 0.061% 99.998% ( 2900, 4400 ] 80 0.001% 99.999% ( 4400, 6600 ] 22 0.000% 100.000% ( 6600, 9900 ] 16 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 197608 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9295999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9593470968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 565 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33528848 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29002936725 rocksdb.compact.write.bytes COUNT : 28800972334 rocksdb.flush.write.bytes COUNT : 9446220424 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 246 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9370054656 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3639296 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29097890084 rocksdb.non.last.level.read.count COUNT : 7027182 rocksdb.block.checksum.compute.count COUNT : 7026119 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.428925 P95 : 3.989802 P99 : 8.886601 P100 : 696660.000000 COUNT : 9295999 SUM : 55440842 rocksdb.compaction.times.micros P50 : 1035151.515152 P95 : 4020000.000000 P99 : 22391139.000000 P100 : 22391139.000000 COUNT : 88 SUM : 137438624 rocksdb.compaction.times.cpu_micros P50 : 777142.857143 P95 : 3740000.000000 P99 : 18480000.000000 P100 : 20222041.000000 COUNT : 88 SUM : 111799458 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 683.851351 P95 : 1495.000000 P99 : 47705.000000 P100 : 165078.000000 COUNT : 127 SUM : 372970 rocksdb.compaction.outfile.sync.micros P50 : 1040.963855 P95 : 89777.777778 P99 : 225466.666667 P100 : 253373.000000 COUNT : 384 SUM : 5916891 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.904110 P95 : 2308.333333 P99 : 5107.000000 P100 : 5107.000000 COUNT : 251 SUM : 102639 rocksdb.table.open.io.micros P50 : 1404.166667 P95 : 8691.964286 P99 : 16977.777778 P100 : 21453.000000 COUNT : 565 SUM : 1321168 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.657161 P95 : 7.764354 P99 : 12.608756 P100 : 11723.000000 COUNT : 7024794 SUM : 47060453 rocksdb.read.block.get.micros P50 : 439.130435 P95 : 3742.307692 P99 : 6149.523810 P100 : 12457.000000 COUNT : 1130 SUM : 1026213 rocksdb.write.raw.block.micros P50 : 0.516316 P95 : 0.981000 P99 : 3.371778 P100 : 11701.000000 COUNT : 9276818 SUM : 18918796 rocksdb.numfiles.in.singlecompaction P50 : 3.007463 P95 : 5.175000 P99 : 27.640000 P100 : 35.000000 COUNT : 153 SUM : 572 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560873 P95 : 1185.114442 P99 : 2564.004971 P100 : 696479.000000 COUNT : 201166 SUM : 33551214 rocksdb.sst.read.micros P50 : 1.586945 P95 : 4.466650 P99 : 9.132934 P100 : 12301.000000 COUNT : 7027797 SUM : 32501962 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9295999 SUM : 9593470968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213440.860215 P95 : 369031.250000 P99 : 675850.000000 P100 : 853402.000000 COUNT : 127 SUM : 27877065 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 352 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0