[2024-11-18 09:19:34.165809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-18 09:19:34.166076] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid950365 ] Set seed to 1731917974159106 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 09:19:34.279869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 09:19:34.319337] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 09:19:34.319395] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 950365' to capture a snapshot of events at runtime. [2024-11-18 09:19:34.319407] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid950365 for offline analysis/debug. [2024-11-18 09:19:34.319431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 09:19:38 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-09:19:41 ... thread 0: (1000000,1000000) ops and (358582.3,358582.3) ops/second in (2.788760,2.788760) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 504.00 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 355.5 2.30 2.06 12 0.192 0 0 0.0 0.0 L1 1/0 1.91 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 237.9 237.7 1.06 1.03 1 1.059 255K 212 0.0 0.0 L2 3/2 299.00 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 16/9 755.44 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 214.5 214.5 0.29 0.25 1 0.291 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/17 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 102.5 299.4 4.16 3.81 15 0.277 432K 244 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 102.5 299.4 4.16 3.81 15 0.277 432K 244 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 229.8 229.7 1.85 1.75 3 0.618 432K 244 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 355.5 2.30 2.06 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 415.54 MB/s write, 0.42 GB read, 142.26 MB/s read, 4.2 seconds Interval compaction: 1.22 GB write, 446.16 MB/s write, 0.42 GB read, 152.74 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 113222 Average: 1.8995 StdDev: 18.64 Min: 1 Median: 1.1750 Max: 3052 Percentiles: P50: 1.18 P75: 1.65 P99: 4.74 P99.9: 9.95 P99.99: 167.85 ------------------------------------------------------ [ 0, 1 ] 46157 40.767% 40.767% ######## ( 1, 2 ] 59730 52.755% 93.522% ########### ( 2, 3 ] 4032 3.561% 97.083% # ( 3, 4 ] 1797 1.587% 98.670% ( 4, 6 ] 1016 0.897% 99.567% ( 6, 10 ] 382 0.337% 99.905% ( 10, 15 ] 56 0.049% 99.954% ( 15, 22 ] 20 0.018% 99.972% ( 22, 34 ] 6 0.005% 99.977% ( 34, 51 ] 4 0.004% 99.981% ( 51, 76 ] 2 0.002% 99.982% ( 110, 170 ] 9 0.008% 99.990% ( 170, 250 ] 2 0.002% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 1 0.001% 99.995% ( 580, 870 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ( 1900, 2900 ] 2 0.002% 100.002% ( 2900, 4400 ] 2 0.002% 100.004% ** Level 1 read latency histogram (micros): Count: 16298 Average: 2.9775 StdDev: 37.71 Min: 1 Median: 1.3377 Max: 4092 Percentiles: P50: 1.34 P75: 1.82 P99: 9.53 P99.9: 131.06 P99.99: 1522.12 ------------------------------------------------------ [ 0, 1 ] 5285 32.427% 32.427% ###### ( 1, 2 ] 8482 52.043% 84.470% ########## ( 2, 3 ] 1243 7.627% 92.097% ## ( 3, 4 ] 502 3.080% 95.177% # ( 4, 6 ] 405 2.485% 97.662% ( 6, 10 ] 247 1.516% 99.178% ( 10, 15 ] 47 0.288% 99.466% ( 15, 22 ] 10 0.061% 99.528% ( 22, 34 ] 2 0.012% 99.540% ( 34, 51 ] 32 0.196% 99.736% ( 51, 76 ] 17 0.104% 99.840% ( 76, 110 ] 9 0.055% 99.896% ( 110, 170 ] 2 0.012% 99.908% ( 170, 250 ] 2 0.012% 99.920% ( 250, 380 ] 4 0.025% 99.945% ( 380, 580 ] 3 0.018% 99.963% ( 580, 870 ] 2 0.012% 99.975% ( 870, 1300 ] 2 0.012% 99.988% ( 1300, 1900 ] 1 0.006% 99.994% ( 2900, 4400 ] 1 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 15883 Average: 1.7747 StdDev: 7.62 Min: 1 Median: 1.1854 Max: 899 Percentiles: P50: 1.19 P75: 1.64 P99: 3.53 P99.9: 9.16 P99.99: 226.47 ------------------------------------------------------ [ 0, 1 ] 6319 39.785% 39.785% ######## ( 1, 2 ] 8753 55.109% 94.894% ########### ( 2, 3 ] 571 3.595% 98.489% # ( 3, 4 ] 153 0.963% 99.452% ( 4, 6 ] 49 0.309% 99.761% ( 6, 10 ] 28 0.176% 99.937% ( 10, 15 ] 2 0.013% 99.950% ( 15, 22 ] 4 0.025% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 8434 Average: 11.8418 StdDev: 147.92 Min: 1 Median: 1.5908 Max: 5061 Percentiles: P50: 1.59 P75: 2.19 P99: 136.95 P99.9: 2661.00 P99.99: 4219.27 ------------------------------------------------------ [ 0, 1 ] 1482 17.572% 17.572% #### ( 1, 2 ] 4629 54.885% 72.457% ########### ( 2, 3 ] 1117 13.244% 85.701% ### ( 3, 4 ] 491 5.822% 91.522% # ( 4, 6 ] 386 4.577% 96.099% # ( 6, 10 ] 168 1.992% 98.091% ( 10, 15 ] 43 0.510% 98.601% ( 15, 22 ] 9 0.107% 98.708% ( 22, 34 ] 3 0.036% 98.743% ( 34, 51 ] 1 0.012% 98.755% ( 110, 170 ] 46 0.545% 99.300% ( 170, 250 ] 12 0.142% 99.443% ( 250, 380 ] 9 0.107% 99.549% ( 380, 580 ] 10 0.119% 99.668% ( 580, 870 ] 7 0.083% 99.751% ( 870, 1300 ] 5 0.059% 99.810% ( 1300, 1900 ] 3 0.036% 99.846% ( 1900, 2900 ] 6 0.071% 99.917% ( 2900, 4400 ] 7 0.083% 100.000% ( 4400, 6600 ] 2 0.024% 100.024% ** Level 4 read latency histogram (micros): Count: 35 Average: 1782.6286 StdDev: 1435.38 Min: 217 Median: 1138.7500 Max: 4933 Percentiles: P50: 1138.75 P75: 2608.33 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 7 20.000% 25.714% #### ( 580, 870 ] 6 17.143% 42.857% ### ( 870, 1300 ] 4 11.429% 54.286% ## ( 1300, 1900 ] 3 8.571% 62.857% ## ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 4 11.429% 91.429% ## ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.208 H:M:S, 7.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.208 H:M:S, 7.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-09:19:44 ... thread 0: (1000000,2000000) ops and (327357.2,342259.1) ops/second in (3.054767,5.843527) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.48 GB 6.3 0.9 0.0 0.9 2.7 1.8 0.0 1.5 107.8 316.1 8.76 8.14 29 0.302 959K 1228 0.0 0.0 L1 1/1 1.91 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 237.9 237.7 1.06 1.03 1 1.059 255K 212 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 41/0 995.07 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 209.6 209.5 5.45 4.73 4 1.362 1134K 545 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1225/11 97.92 GB 0.0 2.4 0.6 1.8 4.2 2.4 0.5 2.3 155.3 271.0 15.77 14.37 35 0.451 2463K 2017 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 0.6 1.8 4.2 2.4 0.4 2.3 155.3 271.0 15.77 14.37 35 0.451 2463K 2017 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 0.6 1.8 2.4 0.6 0.0 0.0 231.0 230.8 10.61 9.76 9 1.179 2463K 2017 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.7 5.17 4.61 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.17 GB write, 706.52 MB/s write, 2.39 GB read, 404.93 MB/s read, 15.8 seconds Interval compaction: 4.17 GB write, 731.38 MB/s write, 2.39 GB read, 419.18 MB/s read, 15.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 388852 Average: 2.1855 StdDev: 12.69 Min: 1 Median: 1.4490 Max: 3052 Percentiles: P50: 1.45 P75: 1.86 P99: 5.74 P99.9: 9.94 P99.99: 18.09 ------------------------------------------------------ [ 0, 1 ] 88646 22.797% 22.797% ##### ( 1, 2 ] 235580 60.583% 83.380% ############ ( 2, 3 ] 33799 8.692% 92.072% ## ( 3, 4 ] 17193 4.421% 96.494% # ( 4, 6 ] 11176 2.874% 99.368% # ( 6, 10 ] 2100 0.540% 99.908% ( 10, 15 ] 302 0.078% 99.986% ( 15, 22 ] 41 0.011% 99.996% ( 22, 34 ] 8 0.002% 99.998% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 4 0.001% 100.001% ( 110, 170 ] 13 0.003% 100.004% ( 170, 250 ] 10 0.003% 100.006% ( 250, 380 ] 10 0.003% 100.009% ( 380, 580 ] 1 0.000% 100.009% ( 580, 870 ] 8 0.002% 100.011% ( 870, 1300 ] 9 0.002% 100.014% ( 1300, 1900 ] 2 0.001% 100.014% ( 1900, 2900 ] 2 0.001% 100.015% ( 2900, 4400 ] 3 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 75818 Average: 2.5874 StdDev: 17.52 Min: 1 Median: 1.6094 Max: 4092 Percentiles: P50: 1.61 P75: 2.12 P99: 7.36 P99.9: 34.10 P99.99: 474.55 ------------------------------------------------------ [ 0, 1 ] 10249 13.518% 13.518% ### ( 1, 2 ] 45390 59.867% 73.385% ############ ( 2, 3 ] 10432 13.759% 87.144% ### ( 3, 4 ] 4618 6.091% 93.235% # ( 4, 6 ] 4099 5.406% 98.641% # ( 6, 10 ] 801 1.056% 99.698% ( 10, 15 ] 136 0.179% 99.877% ( 15, 22 ] 15 0.020% 99.897% ( 22, 34 ] 2 0.003% 99.900% ( 34, 51 ] 32 0.042% 99.942% ( 51, 76 ] 18 0.024% 99.966% ( 76, 110 ] 9 0.012% 99.978% ( 110, 170 ] 2 0.003% 99.980% ( 170, 250 ] 2 0.003% 99.983% ( 250, 380 ] 4 0.005% 99.988% ( 380, 580 ] 3 0.004% 99.992% ( 580, 870 ] 2 0.003% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 198456 Average: 3.4439 StdDev: 35.84 Min: 0 Median: 1.5853 Max: 5061 Percentiles: P50: 1.59 P75: 2.08 P99: 9.28 P99.9: 218.27 P99.99: 685.17 ------------------------------------------------------ [ 0, 1 ] 32181 16.216% 16.216% ### ( 1, 2 ] 114547 57.719% 73.935% ############ ( 2, 3 ] 26830 13.519% 87.454% ### ( 3, 4 ] 11629 5.860% 93.314% # ( 4, 6 ] 8251 4.158% 97.471% # ( 6, 10 ] 3698 1.863% 99.335% ( 10, 15 ] 514 0.259% 99.594% ( 15, 22 ] 116 0.058% 99.652% ( 22, 34 ] 58 0.029% 99.682% ( 34, 51 ] 15 0.008% 99.689% ( 51, 76 ] 4 0.002% 99.691% ( 76, 110 ] 103 0.052% 99.743% ( 110, 170 ] 250 0.126% 99.869% ( 170, 250 ] 102 0.051% 99.920% ( 250, 380 ] 65 0.033% 99.953% ( 380, 580 ] 63 0.032% 99.985% ( 580, 870 ] 28 0.014% 99.999% ( 870, 1300 ] 16 0.008% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ( 1900, 2900 ] 6 0.003% 100.013% ( 2900, 4400 ] 9 0.005% 100.017% ( 4400, 6600 ] 2 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1782.6286 StdDev: 1435.38 Min: 217 Median: 1138.7500 Max: 4933 Percentiles: P50: 1138.75 P75: 2608.33 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 7 20.000% 25.714% #### ( 580, 870 ] 6 17.143% 42.857% ### ( 870, 1300 ] 4 11.429% 54.286% ## ( 1300, 1900 ] 3 8.571% 62.857% ## ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 4 11.429% 91.429% ## ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.585 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.377 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-09:19:47 ... thread 0: (1000000,3000000) ops and (324434.0,336103.6) ops/second in (3.082291,8.925818) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.46 GB 100.7 1.7 0.0 1.7 4.5 2.8 0.0 1.6 120.4 313.7 14.65 13.66 46 0.319 1791K 2052 0.0 0.0 L1 1/1 1.91 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 237.9 237.7 1.06 1.03 1 1.059 255K 212 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 41/0 995.07 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 209.6 209.5 5.45 4.73 4 1.362 1134K 545 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1230/11 98.90 GB 0.0 3.2 0.6 2.6 6.0 3.4 0.5 2.2 150.9 281.6 21.66 19.89 52 0.417 3294K 2841 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.6 2.6 6.0 3.4 0.4 2.2 150.9 281.6 21.66 19.89 52 0.417 3294K 2841 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.6 2.6 3.2 0.6 0.0 0.0 239.3 239.1 13.66 12.76 12 1.138 3294K 2841 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.3 8.00 7.13 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.96 GB write, 668.00 MB/s write, 3.19 GB read, 357.94 MB/s read, 21.7 seconds Interval compaction: 5.96 GB write, 683.39 MB/s write, 3.19 GB read, 366.18 MB/s read, 21.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 808395 Average: 2.1405 StdDev: 11.07 Min: 1 Median: 1.4539 Max: 3909 Percentiles: P50: 1.45 P75: 1.84 P99: 5.58 P99.9: 9.66 P99.99: 13.72 ------------------------------------------------------ [ 0, 1 ] 168545 20.849% 20.849% #### ( 1, 2 ] 519169 64.222% 85.072% ############# ( 2, 3 ] 66484 8.224% 93.296% ## ( 3, 4 ] 31874 3.943% 97.239% # ( 4, 6 ] 18081 2.237% 99.475% ( 6, 10 ] 3754 0.464% 99.940% ( 10, 15 ] 547 0.068% 100.007% ( 15, 22 ] 67 0.008% 100.016% ( 22, 34 ] 13 0.002% 100.017% ( 34, 51 ] 9 0.001% 100.018% ( 51, 76 ] 5 0.001% 100.019% ( 76, 110 ] 13 0.002% 100.021% ( 110, 170 ] 22 0.003% 100.023% ( 170, 250 ] 19 0.002% 100.026% ( 250, 380 ] 23 0.003% 100.028% ( 380, 580 ] 3 0.000% 100.029% ( 580, 870 ] 12 0.001% 100.030% ( 870, 1300 ] 14 0.002% 100.032% ( 1300, 1900 ] 3 0.000% 100.032% ( 1900, 2900 ] 2 0.000% 100.033% ( 2900, 4400 ] 5 0.001% 100.033% ** Level 1 read latency histogram (micros): Count: 75818 Average: 2.5874 StdDev: 17.52 Min: 1 Median: 1.6094 Max: 4092 Percentiles: P50: 1.61 P75: 2.12 P99: 7.36 P99.9: 34.10 P99.99: 474.55 ------------------------------------------------------ [ 0, 1 ] 10249 13.518% 13.518% ### ( 1, 2 ] 45390 59.867% 73.385% ############ ( 2, 3 ] 10432 13.759% 87.144% ### ( 3, 4 ] 4618 6.091% 93.235% # ( 4, 6 ] 4099 5.406% 98.641% # ( 6, 10 ] 801 1.056% 99.698% ( 10, 15 ] 136 0.179% 99.877% ( 15, 22 ] 15 0.020% 99.897% ( 22, 34 ] 2 0.003% 99.900% ( 34, 51 ] 32 0.042% 99.942% ( 51, 76 ] 18 0.024% 99.966% ( 76, 110 ] 9 0.012% 99.978% ( 110, 170 ] 2 0.003% 99.980% ( 170, 250 ] 2 0.003% 99.983% ( 250, 380 ] 4 0.005% 99.988% ( 380, 580 ] 3 0.004% 99.992% ( 580, 870 ] 2 0.003% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 198456 Average: 3.4439 StdDev: 35.84 Min: 0 Median: 1.5853 Max: 5061 Percentiles: P50: 1.59 P75: 2.08 P99: 9.28 P99.9: 218.27 P99.99: 685.17 ------------------------------------------------------ [ 0, 1 ] 32181 16.216% 16.216% ### ( 1, 2 ] 114547 57.719% 73.935% ############ ( 2, 3 ] 26830 13.519% 87.454% ### ( 3, 4 ] 11629 5.860% 93.314% # ( 4, 6 ] 8251 4.158% 97.471% # ( 6, 10 ] 3698 1.863% 99.335% ( 10, 15 ] 514 0.259% 99.594% ( 15, 22 ] 116 0.058% 99.652% ( 22, 34 ] 58 0.029% 99.682% ( 34, 51 ] 15 0.008% 99.689% ( 51, 76 ] 4 0.002% 99.691% ( 76, 110 ] 103 0.052% 99.743% ( 110, 170 ] 250 0.126% 99.869% ( 170, 250 ] 102 0.051% 99.920% ( 250, 380 ] 65 0.033% 99.953% ( 380, 580 ] 63 0.032% 99.985% ( 580, 870 ] 28 0.014% 99.999% ( 870, 1300 ] 16 0.008% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ( 1900, 2900 ] 6 0.003% 100.013% ( 2900, 4400 ] 9 0.005% 100.017% ( 4400, 6600 ] 2 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1782.6286 StdDev: 1435.38 Min: 217 Median: 1138.7500 Max: 4933 Percentiles: P50: 1138.75 P75: 2608.33 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 7 20.000% 25.714% #### ( 580, 870 ] 6 17.143% 42.857% ### ( 870, 1300 ] 4 11.429% 54.286% ## ( 1300, 1900 ] 3 8.571% 62.857% ## ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 4 11.429% 91.429% ## ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.031 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.445 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-09:19:50 ... thread 0: (1000000,4000000) ops and (331665.6,334983.0) ops/second in (3.015085,11.940903) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.27 GB 18.9 2.8 0.0 2.8 6.6 3.7 0.0 1.8 133.5 310.3 21.71 20.35 64 0.339 2942K 3292 0.0 0.0 L1 10/10 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 235.4 234.4 6.16 5.96 2 3.079 1471K 6015 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 41/0 995.07 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 209.6 209.5 5.45 4.73 4 1.362 1134K 545 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1235/20 99.88 GB 0.0 5.5 1.8 3.7 9.2 5.5 0.5 2.5 165.6 278.9 33.82 31.52 71 0.476 5662K 9884 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.8 3.7 9.2 5.5 0.4 2.5 165.6 278.9 33.82 31.52 71 0.476 5662K 9884 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.8 3.7 5.5 1.8 0.0 0.0 243.4 242.9 23.01 21.87 17 1.354 5662K 9884 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.6 10.81 9.65 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.21 GB write, 776.51 MB/s write, 5.47 GB read, 461.03 MB/s read, 33.8 seconds Interval compaction: 9.21 GB write, 789.88 MB/s write, 5.47 GB read, 468.97 MB/s read, 33.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1126854 Average: 2.1401 StdDev: 11.00 Min: 0 Median: 1.4413 Max: 3909 Percentiles: P50: 1.44 P75: 1.83 P99: 5.55 P99.9: 9.78 P99.99: 14.65 ------------------------------------------------------ [ 0, 1 ] 244551 21.702% 21.702% #### ( 1, 2 ] 722569 64.123% 85.825% ############# ( 2, 3 ] 88769 7.878% 93.702% ## ( 3, 4 ] 41813 3.711% 97.413% # ( 4, 6 ] 23050 2.046% 99.458% ( 6, 10 ] 5269 0.468% 99.926% ( 10, 15 ] 775 0.069% 99.995% ( 15, 22 ] 112 0.010% 100.005% ( 22, 34 ] 16 0.001% 100.006% ( 34, 51 ] 11 0.001% 100.007% ( 51, 76 ] 9 0.001% 100.008% ( 76, 110 ] 55 0.005% 100.013% ( 110, 170 ] 95 0.008% 100.021% ( 170, 250 ] 39 0.003% 100.025% ( 250, 380 ] 41 0.004% 100.028% ( 380, 580 ] 18 0.002% 100.030% ( 580, 870 ] 22 0.002% 100.032% ( 870, 1300 ] 22 0.002% 100.034% ( 1300, 1900 ] 4 0.000% 100.034% ( 1900, 2900 ] 2 0.000% 100.034% ( 2900, 4400 ] 6 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 81125 Average: 3.0184 StdDev: 25.67 Min: 1 Median: 1.5916 Max: 4092 Percentiles: P50: 1.59 P75: 2.05 P99: 8.07 P99.9: 150.19 P99.99: 1148.60 ------------------------------------------------------ [ 0, 1 ] 11965 14.749% 14.749% ### ( 1, 2 ] 48338 59.585% 74.333% ############ ( 2, 3 ] 10667 13.149% 87.482% ### ( 3, 4 ] 4751 5.856% 93.339% # ( 4, 6 ] 4137 5.100% 98.438% # ( 6, 10 ] 880 1.085% 99.523% ( 10, 15 ] 145 0.179% 99.702% ( 15, 22 ] 17 0.021% 99.723% ( 22, 34 ] 2 0.002% 99.725% ( 34, 51 ] 32 0.039% 99.765% ( 51, 76 ] 18 0.022% 99.787% ( 76, 110 ] 47 0.058% 99.845% ( 110, 170 ] 67 0.083% 99.927% ( 170, 250 ] 11 0.014% 99.941% ( 250, 380 ] 16 0.020% 99.961% ( 380, 580 ] 15 0.018% 99.979% ( 580, 870 ] 5 0.006% 99.985% ( 870, 1300 ] 6 0.007% 99.993% ( 1300, 1900 ] 3 0.004% 99.996% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 198456 Average: 3.4439 StdDev: 35.84 Min: 0 Median: 1.5853 Max: 5061 Percentiles: P50: 1.59 P75: 2.08 P99: 9.28 P99.9: 218.27 P99.99: 685.17 ------------------------------------------------------ [ 0, 1 ] 32181 16.216% 16.216% ### ( 1, 2 ] 114547 57.719% 73.935% ############ ( 2, 3 ] 26830 13.519% 87.454% ### ( 3, 4 ] 11629 5.860% 93.314% # ( 4, 6 ] 8251 4.158% 97.471% # ( 6, 10 ] 3698 1.863% 99.335% ( 10, 15 ] 514 0.259% 99.594% ( 15, 22 ] 116 0.058% 99.652% ( 22, 34 ] 58 0.029% 99.682% ( 34, 51 ] 15 0.008% 99.689% ( 51, 76 ] 4 0.002% 99.691% ( 76, 110 ] 103 0.052% 99.743% ( 110, 170 ] 250 0.126% 99.869% ( 170, 250 ] 102 0.051% 99.920% ( 250, 380 ] 65 0.033% 99.953% ( 380, 580 ] 63 0.032% 99.985% ( 580, 870 ] 28 0.014% 99.999% ( 870, 1300 ] 16 0.008% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ( 1900, 2900 ] 6 0.003% 100.013% ( 2900, 4400 ] 9 0.005% 100.017% ( 4400, 6600 ] 2 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1782.6286 StdDev: 1435.38 Min: 217 Median: 1138.7500 Max: 4933 Percentiles: P50: 1138.75 P75: 2608.33 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 7 20.000% 25.714% #### ( 580, 870 ] 6 17.143% 42.857% ### ( 870, 1300 ] 4 11.429% 54.286% ## ( 1300, 1900 ] 3 8.571% 62.857% ## ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 4 11.429% 91.429% ## ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.420 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-09:19:53 ... thread 0: (1000000,5000000) ops and (302379.5,327911.7) ops/second in (3.307103,15.248006) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.26 GB 94.4 3.6 0.0 3.6 8.4 4.7 0.0 1.8 135.0 310.9 27.54 25.82 82 0.336 3773K 4176 0.0 0.0 L1 10/10 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 235.4 234.4 6.16 5.96 2 3.079 1471K 6015 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 41/0 995.07 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 209.6 209.5 5.45 4.73 4 1.362 1134K 545 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/24 100.86 GB 0.0 6.3 1.8 4.5 11.0 6.5 0.5 2.3 161.9 283.9 39.65 36.99 89 0.446 6493K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 1.8 4.5 11.0 6.5 0.4 2.3 161.9 283.9 39.65 36.99 89 0.446 6493K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 1.8 4.5 6.3 1.8 0.0 0.0 246.8 246.4 26.01 24.82 20 1.301 6493K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.6 13.64 12.16 69 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.00 GB write, 728.51 MB/s write, 6.27 GB read, 415.37 MB/s read, 39.7 seconds Interval compaction: 11.00 GB write, 738.33 MB/s write, 6.27 GB read, 420.97 MB/s read, 39.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 19, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1460017 Average: 2.1413 StdDev: 10.80 Min: 0 Median: 1.4421 Max: 3909 Percentiles: P50: 1.44 P75: 1.83 P99: 5.51 P99.9: 9.79 P99.99: 14.88 ------------------------------------------------------ [ 0, 1 ] 311886 21.362% 21.362% #### ( 1, 2 ] 945729 64.775% 86.137% ############# ( 2, 3 ] 113817 7.796% 93.933% ## ( 3, 4 ] 52715 3.611% 97.543% # ( 4, 6 ] 28168 1.929% 99.472% ( 6, 10 ] 6592 0.452% 99.924% ( 10, 15 ] 990 0.068% 99.992% ( 15, 22 ] 130 0.009% 100.001% ( 22, 34 ] 18 0.001% 100.002% ( 34, 51 ] 14 0.001% 100.003% ( 51, 76 ] 15 0.001% 100.004% ( 76, 110 ] 72 0.005% 100.009% ( 110, 170 ] 155 0.011% 100.019% ( 170, 250 ] 67 0.005% 100.024% ( 250, 380 ] 58 0.004% 100.028% ( 380, 580 ] 26 0.002% 100.030% ( 580, 870 ] 29 0.002% 100.032% ( 870, 1300 ] 26 0.002% 100.034% ( 1300, 1900 ] 6 0.000% 100.034% ( 1900, 2900 ] 3 0.000% 100.034% ( 2900, 4400 ] 7 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 149276 Average: 2.7390 StdDev: 19.87 Min: 1 Median: 1.5276 Max: 4092 Percentiles: P50: 1.53 P75: 1.93 P99: 8.17 P99.9: 133.95 P99.99: 728.50 ------------------------------------------------------ [ 0, 1 ] 25239 16.908% 16.908% ### ( 1, 2 ] 93625 62.719% 79.627% ############# ( 2, 3 ] 15882 10.639% 90.266% ## ( 3, 4 ] 6786 4.546% 94.812% # ( 4, 6 ] 5184 3.473% 98.285% # ( 6, 10 ] 1964 1.316% 99.601% ( 10, 15 ] 219 0.147% 99.747% ( 15, 22 ] 21 0.014% 99.762% ( 22, 34 ] 5 0.003% 99.765% ( 34, 51 ] 32 0.021% 99.786% ( 51, 76 ] 21 0.014% 99.800% ( 76, 110 ] 110 0.074% 99.874% ( 110, 170 ] 97 0.065% 99.939% ( 170, 250 ] 22 0.015% 99.954% ( 250, 380 ] 23 0.015% 99.969% ( 380, 580 ] 28 0.019% 99.988% ( 580, 870 ] 6 0.004% 99.992% ( 870, 1300 ] 6 0.004% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 198456 Average: 3.4439 StdDev: 35.84 Min: 0 Median: 1.5853 Max: 5061 Percentiles: P50: 1.59 P75: 2.08 P99: 9.28 P99.9: 218.27 P99.99: 685.17 ------------------------------------------------------ [ 0, 1 ] 32181 16.216% 16.216% ### ( 1, 2 ] 114547 57.719% 73.935% ############ ( 2, 3 ] 26830 13.519% 87.454% ### ( 3, 4 ] 11629 5.860% 93.314% # ( 4, 6 ] 8251 4.158% 97.471% # ( 6, 10 ] 3698 1.863% 99.335% ( 10, 15 ] 514 0.259% 99.594% ( 15, 22 ] 116 0.058% 99.652% ( 22, 34 ] 58 0.029% 99.682% ( 34, 51 ] 15 0.008% 99.689% ( 51, 76 ] 4 0.002% 99.691% ( 76, 110 ] 103 0.052% 99.743% ( 110, 170 ] 250 0.126% 99.869% ( 170, 250 ] 102 0.051% 99.920% ( 250, 380 ] 65 0.033% 99.953% ( 380, 580 ] 63 0.032% 99.985% ( 580, 870 ] 28 0.014% 99.999% ( 870, 1300 ] 16 0.008% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ( 1900, 2900 ] 6 0.003% 100.013% ( 2900, 4400 ] 9 0.005% 100.017% ( 4400, 6600 ] 2 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1782.6286 StdDev: 1435.38 Min: 217 Median: 1138.7500 Max: 4933 Percentiles: P50: 1138.75 P75: 2608.33 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 7 20.000% 25.714% #### ( 580, 870 ] 6 17.143% 42.857% ### ( 870, 1300 ] 4 11.429% 54.286% ## ( 1300, 1900 ] 3 8.571% 62.857% ## ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 4 11.429% 91.429% ## ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 15.5 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 318.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.073 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.652 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-09:20:02 ... thread 0: (1000000,6000000) ops and (112124.5,248275.9) ops/second in (8.918658,24.166664) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.24 GB 219.8 5.7 0.0 5.7 11.4 5.7 0.0 2.0 151.5 304.3 38.26 35.94 103 0.371 5883K 9833 0.0 0.0 L1 10/10 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 235.4 234.4 6.16 5.96 2 3.079 1471K 6015 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 41/0 995.07 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 209.6 209.5 5.45 4.73 4 1.362 1134K 545 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/20 101.84 GB 0.0 8.3 1.8 6.5 14.0 7.5 0.5 2.4 168.7 284.7 50.37 47.11 110 0.458 8603K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 1.8 6.5 14.0 7.5 0.4 2.4 168.7 284.7 50.37 47.11 110 0.458 8603K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 1.8 6.5 8.3 1.8 0.0 0.0 250.8 250.3 33.88 32.42 25 1.355 8603K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.4 16.48 14.69 85 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.4 total, 24.2 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.00 GB write, 588.32 MB/s write, 8.30 GB read, 348.64 MB/s read, 50.4 seconds Interval compaction: 14.00 GB write, 593.32 MB/s write, 8.30 GB read, 351.60 MB/s read, 50.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 19, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2305230 Average: 2.3074 StdDev: 12.59 Min: 0 Median: 1.4344 Max: 4225 Percentiles: P50: 1.43 P75: 1.82 P99: 5.75 P99.9: 87.86 P99.99: 167.61 ------------------------------------------------------ [ 0, 1 ] 498640 21.631% 21.631% #### ( 1, 2 ] 1505609 65.313% 86.944% ############# ( 2, 3 ] 166915 7.241% 94.184% # ( 3, 4 ] 76939 3.338% 97.522% # ( 4, 6 ] 39006 1.692% 99.214% ( 6, 10 ] 13662 0.593% 99.807% ( 10, 15 ] 1450 0.063% 99.869% ( 15, 22 ] 219 0.010% 99.879% ( 22, 34 ] 20 0.001% 99.880% ( 34, 51 ] 22 0.001% 99.881% ( 51, 76 ] 23 0.001% 99.882% ( 76, 110 ] 1206 0.052% 99.934% ( 110, 170 ] 1343 0.058% 99.992% ( 170, 250 ] 355 0.015% 100.008% ( 250, 380 ] 255 0.011% 100.019% ( 380, 580 ] 132 0.006% 100.025% ( 580, 870 ] 74 0.003% 100.028% ( 870, 1300 ] 42 0.002% 100.030% ( 1300, 1900 ] 9 0.000% 100.030% ( 1900, 2900 ] 8 0.000% 100.030% ( 2900, 4400 ] 9 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 328090 Average: 2.6110 StdDev: 16.58 Min: 1 Median: 1.4846 Max: 4092 Percentiles: P50: 1.48 P75: 1.87 P99: 8.20 P99.9: 141.55 P99.99: 555.80 ------------------------------------------------------ [ 0, 1 ] 60775 18.524% 18.524% #### ( 1, 2 ] 213093 64.950% 83.473% ############# ( 2, 3 ] 28209 8.598% 92.071% ## ( 3, 4 ] 12190 3.715% 95.787% # ( 4, 6 ] 8032 2.448% 98.235% ( 6, 10 ] 4554 1.388% 99.623% ( 10, 15 ] 388 0.118% 99.741% ( 15, 22 ] 50 0.015% 99.756% ( 22, 34 ] 5 0.002% 99.758% ( 34, 51 ] 32 0.010% 99.768% ( 51, 76 ] 30 0.009% 99.777% ( 76, 110 ] 243 0.074% 99.851% ( 110, 170 ] 306 0.093% 99.944% ( 170, 250 ] 59 0.018% 99.962% ( 250, 380 ] 49 0.015% 99.977% ( 380, 580 ] 48 0.015% 99.992% ( 580, 870 ] 12 0.004% 99.995% ( 870, 1300 ] 8 0.002% 99.998% ( 1300, 1900 ] 3 0.001% 99.999% ( 1900, 2900 ] 1 0.000% 99.999% ( 2900, 4400 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 198456 Average: 3.4439 StdDev: 35.84 Min: 0 Median: 1.5853 Max: 5061 Percentiles: P50: 1.59 P75: 2.08 P99: 9.28 P99.9: 218.27 P99.99: 685.17 ------------------------------------------------------ [ 0, 1 ] 32181 16.216% 16.216% ### ( 1, 2 ] 114547 57.719% 73.935% ############ ( 2, 3 ] 26830 13.519% 87.454% ### ( 3, 4 ] 11629 5.860% 93.314% # ( 4, 6 ] 8251 4.158% 97.471% # ( 6, 10 ] 3698 1.863% 99.335% ( 10, 15 ] 514 0.259% 99.594% ( 15, 22 ] 116 0.058% 99.652% ( 22, 34 ] 58 0.029% 99.682% ( 34, 51 ] 15 0.008% 99.689% ( 51, 76 ] 4 0.002% 99.691% ( 76, 110 ] 103 0.052% 99.743% ( 110, 170 ] 250 0.126% 99.869% ( 170, 250 ] 102 0.051% 99.920% ( 250, 380 ] 65 0.033% 99.953% ( 380, 580 ] 63 0.032% 99.985% ( 580, 870 ] 28 0.014% 99.999% ( 870, 1300 ] 16 0.008% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ( 1900, 2900 ] 6 0.003% 100.013% ( 2900, 4400 ] 9 0.005% 100.017% ( 4400, 6600 ] 2 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1782.6286 StdDev: 1435.38 Min: 217 Median: 1138.7500 Max: 4933 Percentiles: P50: 1138.75 P75: 2608.33 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 7 20.000% 25.714% #### ( 580, 870 ] 6 17.143% 42.857% ### ( 870, 1300 ] 4 11.429% 54.286% ## ( 1300, 1900 ] 3 8.571% 62.857% ## ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 4 11.429% 91.429% ## ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 24.4 total, 8.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 242.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.065 H:M:S, 33.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.992 H:M:S, 67.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/18-09:20:07 ... thread 0: (1000000,7000000) ops and (199401.1,239876.5) ops/second in (5.015018,29.181682) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 3.01 GB 194.7 6.2 0.0 6.2 12.7 6.6 0.0 1.9 147.7 305.6 42.64 39.96 118 0.361 6395K 10K 0.0 0.0 L1 19/0 1.67 GB 170.9 4.7 3.4 1.2 4.6 3.4 0.1 1.3 226.2 223.7 21.13 20.09 3 7.044 4854K 52K 0.0 0.0 L2 1/0 50.19 MB 0.5 0.1 0.1 0.0 0.1 0.1 1.8 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 18/0 973.11 MB 1.0 2.0 1.1 0.8 2.0 1.1 0.7 1.7 173.8 173.6 11.67 8.85 20 0.584 1996K 1826 0.0 0.0 L4 175/0 9.44 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 121.0 121.0 1.12 0.65 1 1.116 122K 0 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/8 102.65 GB 0.0 13.0 4.8 8.3 19.6 11.3 5.7 3.0 173.3 259.9 77.06 70.04 143 0.539 13M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 4.8 8.3 19.6 11.3 5.7 3.0 173.3 259.9 77.06 70.04 143 0.539 13M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 4.8 8.3 13.0 4.7 0.0 0.0 230.0 228.9 58.06 53.16 45 1.290 13M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 354.7 19.00 16.87 98 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.4 total, 29.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.56 GB write, 681.53 MB/s write, 13.04 GB read, 454.43 MB/s read, 77.1 seconds Interval compaction: 19.56 GB write, 686.34 MB/s write, 13.04 GB read, 457.63 MB/s read, 77.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 37, total-stops: 22, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2721559 Average: 2.3175 StdDev: 13.45 Min: 0 Median: 1.4355 Max: 4680 Percentiles: P50: 1.44 P75: 1.82 P99: 5.82 P99.9: 84.49 P99.99: 173.55 ------------------------------------------------------ [ 0, 1 ] 589369 21.656% 21.656% #### ( 1, 2 ] 1771360 65.086% 86.742% ############# ( 2, 3 ] 197506 7.257% 93.999% # ( 3, 4 ] 91699 3.369% 97.368% # ( 4, 6 ] 48793 1.793% 99.161% ( 6, 10 ] 17436 0.641% 99.802% ( 10, 15 ] 1994 0.073% 99.875% ( 15, 22 ] 280 0.010% 99.885% ( 22, 34 ] 23 0.001% 99.886% ( 34, 51 ] 26 0.001% 99.887% ( 51, 76 ] 29 0.001% 99.888% ( 76, 110 ] 1299 0.048% 99.936% ( 110, 170 ] 1457 0.054% 99.989% ( 170, 250 ] 402 0.015% 100.004% ( 250, 380 ] 299 0.011% 100.015% ( 380, 580 ] 186 0.007% 100.022% ( 580, 870 ] 106 0.004% 100.026% ( 870, 1300 ] 47 0.002% 100.028% ( 1300, 1900 ] 11 0.000% 100.028% ( 1900, 2900 ] 11 0.000% 100.028% ( 2900, 4400 ] 12 0.000% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 582974 Average: 3.0603 StdDev: 30.94 Min: 1 Median: 1.6245 Max: 4092 Percentiles: P50: 1.62 P75: 2.24 P99: 8.25 P99.9: 14.67 P99.99: 100.35 ------------------------------------------------------ [ 0, 1 ] 78134 13.403% 13.403% ### ( 1, 2 ] 341659 58.606% 72.009% ############ ( 2, 3 ] 73506 12.609% 84.618% ### ( 3, 4 ] 41002 7.033% 91.651% # ( 4, 6 ] 37418 6.418% 98.069% # ( 6, 10 ] 9631 1.652% 99.721% ( 10, 15 ] 1115 0.191% 99.913% ( 15, 22 ] 123 0.021% 99.934% ( 22, 34 ] 14 0.002% 99.936% ( 34, 51 ] 33 0.006% 99.942% ( 51, 76 ] 53 0.009% 99.951% ( 76, 110 ] 318 0.055% 100.005% ( 110, 170 ] 347 0.060% 100.065% ( 170, 250 ] 87 0.015% 100.080% ( 250, 380 ] 91 0.016% 100.096% ( 380, 580 ] 62 0.011% 100.106% ( 580, 870 ] 32 0.005% 100.112% ( 870, 1300 ] 39 0.007% 100.118% ( 1300, 1900 ] 11 0.002% 100.120% ( 1900, 2900 ] 4 0.001% 100.121% ( 2900, 4400 ] 28 0.005% 100.126% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 252495 Average: 6.4475 StdDev: 80.81 Min: 0 Median: 1.6136 Max: 12317 Percentiles: P50: 1.61 P75: 2.18 P99: 12.34 P99.9: 794.11 P99.99: 2472.38 ------------------------------------------------------ [ 0, 1 ] 36361 14.401% 14.401% ### ( 1, 2 ] 146486 58.015% 72.416% ############ ( 2, 3 ] 35890 14.214% 86.630% ### ( 3, 4 ] 15505 6.141% 92.771% # ( 4, 6 ] 10735 4.252% 97.023% # ( 6, 10 ] 4655 1.844% 98.866% ( 10, 15 ] 722 0.286% 99.152% ( 15, 22 ] 130 0.051% 99.204% ( 22, 34 ] 59 0.023% 99.227% ( 34, 51 ] 16 0.006% 99.233% ( 51, 76 ] 5 0.002% 99.235% ( 76, 110 ] 138 0.055% 99.290% ( 110, 170 ] 430 0.170% 99.460% ( 170, 250 ] 325 0.129% 99.589% ( 250, 380 ] 306 0.121% 99.710% ( 380, 580 ] 306 0.121% 99.831% ( 580, 870 ] 235 0.093% 99.924% ( 870, 1300 ] 104 0.041% 99.966% ( 1300, 1900 ] 40 0.016% 99.981% ( 1900, 2900 ] 38 0.015% 99.996% ( 2900, 4400 ] 38 0.015% 100.011% ( 4400, 6600 ] 14 0.006% 100.017% ( 9900, 14000 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 175 Average: 364.6057 StdDev: 956.97 Min: 0 Median: 1.9500 Max: 4933 Percentiles: P50: 1.95 P75: 17.25 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ [ 0, 1 ] 40 22.857% 22.857% ##### ( 1, 2 ] 50 28.571% 51.429% ###### ( 2, 3 ] 7 4.000% 55.429% # ( 3, 4 ] 8 4.571% 60.000% # ( 4, 6 ] 4 2.286% 62.286% ( 6, 10 ] 8 4.571% 66.857% # ( 10, 15 ] 12 6.857% 73.714% # ( 15, 22 ] 7 4.000% 77.714% # ( 170, 250 ] 4 2.286% 80.000% ( 250, 380 ] 2 1.143% 81.143% ( 380, 580 ] 7 4.000% 85.143% # ( 580, 870 ] 6 3.429% 88.571% # ( 870, 1300 ] 4 2.286% 90.857% ( 1300, 1900 ] 3 1.714% 92.571% ( 1900, 2900 ] 6 3.429% 96.000% # ( 2900, 4400 ] 4 2.286% 98.286% ( 4400, 6600 ] 3 1.714% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1438.4900 StdDev: 2070.01 Min: 77 Median: 580.0000 Max: 14301 Percentiles: P50: 580.00 P75: 1900.00 P99: 9900.00 P99.9: 14301.00 P99.99: 14301.00 ------------------------------------------------------ ( 76, 110 ] 16 16.000% 16.000% ### ( 110, 170 ] 2 2.000% 18.000% ( 170, 250 ] 8 8.000% 26.000% ## ( 250, 380 ] 14 14.000% 40.000% ### ( 380, 580 ] 10 10.000% 50.000% ## ( 580, 870 ] 8 8.000% 58.000% ## ( 870, 1300 ] 11 11.000% 69.000% ## ( 1300, 1900 ] 6 6.000% 75.000% # ( 1900, 2900 ] 9 9.000% 84.000% ## ( 2900, 4400 ] 10 10.000% 94.000% ## ( 4400, 6600 ] 3 3.000% 97.000% # ( 6600, 9900 ] 2 2.000% 99.000% ( 14000, 22000 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 29.4 total, 5.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 234.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.338 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.273 H:M:S, 45.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-09:20:33 ... thread 0: (1000000,8000000) ops and (38537.2,145109.8) ops/second in (25.948970,55.130652) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/3 818.46 MB 18.9 8.0 0.0 8.0 15.6 7.6 0.0 2.0 151.1 295.0 54.19 49.86 138 0.393 8313K 13K 0.0 0.0 L1 4/4 320.15 MB 0.0 9.6 6.7 2.9 9.4 6.5 0.1 1.4 222.8 219.3 44.06 40.99 4 11.016 8235K 52K 0.0 0.0 L2 7/5 901.46 MB 2.6 0.1 0.1 0.0 0.1 0.1 6.3 1.8 221.6 221.6 0.50 0.48 1 0.504 113K 32 0.0 0.0 L3 43/13 4.08 GB 3.1 2.6 1.6 0.9 2.6 1.6 3.9 1.6 152.9 152.5 17.24 11.61 24 0.719 2353K 5116 0.0 0.0 L4 182/7 9.98 GB 1.0 0.5 0.4 0.0 0.5 0.4 1.7 1.0 105.9 105.7 4.52 2.30 4 1.131 470K 799 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/32 103.59 GB 0.0 20.7 8.8 11.9 28.2 16.3 13.7 3.7 176.2 239.5 120.53 105.23 171 0.705 19M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 8.8 11.9 28.2 16.3 13.6 3.7 176.2 239.5 120.53 105.23 171 0.705 19M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 8.8 11.9 20.6 8.7 0.0 0.0 218.0 216.2 97.39 85.53 58 1.679 19M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 337.6 23.14 19.70 113 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.3 total, 55.1 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.19 GB write, 521.69 MB/s write, 20.74 GB read, 383.74 MB/s read, 120.5 seconds Interval compaction: 28.19 GB write, 523.63 MB/s write, 20.74 GB read, 385.17 MB/s read, 120.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 30, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 35, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3900402 Average: 2.6235 StdDev: 18.95 Min: 0 Median: 1.4111 Max: 7614 Percentiles: P50: 1.41 P75: 1.80 P99: 6.73 P99.9: 146.85 P99.99: 325.01 ------------------------------------------------------ [ 0, 1 ] 927094 23.769% 23.769% ##### ( 1, 2 ] 2488421 63.799% 87.568% ############# ( 2, 3 ] 251965 6.460% 94.028% # ( 3, 4 ] 119789 3.071% 97.099% # ( 4, 6 ] 69227 1.775% 98.874% ( 6, 10 ] 26866 0.689% 99.563% ( 10, 15 ] 3351 0.086% 99.649% ( 15, 22 ] 690 0.018% 99.667% ( 22, 34 ] 37 0.001% 99.668% ( 34, 51 ] 62 0.002% 99.669% ( 51, 76 ] 104 0.003% 99.672% ( 76, 110 ] 5684 0.146% 99.818% ( 110, 170 ] 5229 0.134% 99.952% ( 170, 250 ] 1055 0.027% 99.979% ( 250, 380 ] 759 0.019% 99.998% ( 380, 580 ] 591 0.015% 100.013% ( 580, 870 ] 255 0.007% 100.020% ( 870, 1300 ] 67 0.002% 100.022% ( 1300, 1900 ] 23 0.001% 100.022% ( 1900, 2900 ] 29 0.001% 100.023% ( 2900, 4400 ] 22 0.001% 100.024% ( 4400, 6600 ] 7 0.000% 100.024% ( 6600, 9900 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1441520 Average: 3.9089 StdDev: 61.20 Min: 1 Median: 1.5770 Max: 9447 Percentiles: P50: 1.58 P75: 2.15 P99: 8.92 P99.9: 106.97 P99.99: 147.68 ------------------------------------------------------ [ 0, 1 ] 263756 18.297% 18.297% #### ( 1, 2 ] 791980 54.941% 73.238% ########### ( 2, 3 ] 168314 11.676% 84.914% ## ( 3, 4 ] 95754 6.643% 91.556% # ( 4, 6 ] 89753 6.226% 97.783% # ( 6, 10 ] 24084 1.671% 99.453% ( 10, 15 ] 3622 0.251% 99.705% ( 15, 22 ] 568 0.039% 99.744% ( 22, 34 ] 42 0.003% 99.747% ( 34, 51 ] 37 0.003% 99.750% ( 51, 76 ] 162 0.011% 99.761% ( 76, 110 ] 2207 0.153% 99.914% ( 110, 170 ] 1753 0.122% 100.036% ( 170, 250 ] 321 0.022% 100.058% ( 250, 380 ] 308 0.021% 100.079% ( 380, 580 ] 269 0.019% 100.098% ( 580, 870 ] 215 0.015% 100.113% ( 870, 1300 ] 150 0.010% 100.123% ( 1300, 1900 ] 63 0.004% 100.128% ( 1900, 2900 ] 55 0.004% 100.131% ( 2900, 4400 ] 133 0.009% 100.141% ( 4400, 6600 ] 53 0.004% 100.144% ( 6600, 9900 ] 22 0.002% 100.146% ** Level 2 read latency histogram (micros): Count: 28362 Average: 1.8983 StdDev: 5.76 Min: 1 Median: 1.3106 Max: 899 Percentiles: P50: 1.31 P75: 1.74 P99: 4.84 P99.9: 9.18 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 9009 31.764% 31.764% ###### ( 1, 2 ] 16653 58.716% 90.480% ############ ( 2, 3 ] 1586 5.592% 96.072% # ( 3, 4 ] 680 2.398% 98.470% ( 4, 6 ] 358 1.262% 99.732% ( 6, 10 ] 60 0.212% 99.944% ( 10, 15 ] 6 0.021% 99.965% ( 15, 22 ] 4 0.014% 99.979% ( 51, 76 ] 2 0.007% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 297147 Average: 7.2321 StdDev: 95.43 Min: 0 Median: 1.6452 Max: 12317 Percentiles: P50: 1.65 P75: 2.30 P99: 12.39 P99.9: 860.29 P99.99: 2869.92 ------------------------------------------------------ [ 0, 1 ] 37773 12.712% 12.712% ### ( 1, 2 ] 171729 57.793% 70.504% ############ ( 2, 3 ] 44098 14.840% 85.345% ### ( 3, 4 ] 20052 6.748% 92.093% # ( 4, 6 ] 14736 4.959% 97.052% # ( 6, 10 ] 5387 1.813% 98.865% ( 10, 15 ] 838 0.282% 99.147% ( 15, 22 ] 157 0.053% 99.200% ( 22, 34 ] 60 0.020% 99.220% ( 34, 51 ] 16 0.005% 99.226% ( 51, 76 ] 5 0.002% 99.227% ( 76, 110 ] 142 0.048% 99.275% ( 110, 170 ] 462 0.155% 99.431% ( 170, 250 ] 362 0.122% 99.552% ( 250, 380 ] 366 0.123% 99.676% ( 380, 580 ] 374 0.126% 99.801% ( 580, 870 ] 303 0.102% 99.903% ( 870, 1300 ] 145 0.049% 99.952% ( 1300, 1900 ] 57 0.019% 99.971% ( 1900, 2900 ] 57 0.019% 99.991% ( 2900, 4400 ] 63 0.021% 100.012% ( 4400, 6600 ] 26 0.009% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ( 9900, 14000 ] 2 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 8504 Average: 45.4710 StdDev: 244.72 Min: 0 Median: 1.9431 Max: 6748 Percentiles: P50: 1.94 P75: 3.41 P99: 1035.05 P99.9: 3649.14 P99.99: 6748.00 ------------------------------------------------------ [ 0, 1 ] 471 5.539% 5.539% # ( 1, 2 ] 4009 47.143% 52.681% ######### ( 2, 3 ] 1495 17.580% 70.261% #### ( 3, 4 ] 975 11.465% 81.726% ## ( 4, 6 ] 666 7.832% 89.558% ## ( 6, 10 ] 250 2.940% 92.498% # ( 10, 15 ] 50 0.588% 93.086% ( 15, 22 ] 22 0.259% 93.344% ( 22, 34 ] 2 0.024% 93.368% ( 34, 51 ] 1 0.012% 93.380% ( 76, 110 ] 21 0.247% 93.627% ( 110, 170 ] 63 0.741% 94.367% ( 170, 250 ] 59 0.694% 95.061% ( 250, 380 ] 88 1.035% 96.096% ( 380, 580 ] 125 1.470% 97.566% ( 580, 870 ] 102 1.199% 98.765% ( 870, 1300 ] 52 0.611% 99.377% ( 1300, 1900 ] 28 0.329% 99.706% ( 1900, 2900 ] 13 0.153% 99.859% ( 2900, 4400 ] 7 0.082% 99.941% ( 4400, 6600 ] 4 0.047% 99.988% ( 6600, 9900 ] 1 0.012% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1438.4900 StdDev: 2070.01 Min: 77 Median: 580.0000 Max: 14301 Percentiles: P50: 580.00 P75: 1900.00 P99: 9900.00 P99.9: 14301.00 P99.99: 14301.00 ------------------------------------------------------ ( 76, 110 ] 16 16.000% 16.000% ### ( 110, 170 ] 2 2.000% 18.000% ( 170, 250 ] 8 8.000% 26.000% ## ( 250, 380 ] 14 14.000% 40.000% ### ( 380, 580 ] 10 10.000% 50.000% ## ( 580, 870 ] 8 8.000% 58.000% ## ( 870, 1300 ] 11 11.000% 69.000% ## ( 1300, 1900 ] 6 6.000% 75.000% # ( 1900, 2900 ] 9 9.000% 84.000% ## ( 2900, 4400 ] 10 10.000% 94.000% ## ( 4400, 6600 ] 3 3.000% 97.000% # ( 6600, 9900 ] 2 2.000% 99.000% ( 14000, 22000 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 55.3 total, 26.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 142.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.901 H:M:S, 59.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 37.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.564 H:M:S, 86.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.941 micros/op 144077 ops/sec 60.003 seconds 8644999 operations; 139.6 MB/s Microseconds per write: Count: 8644999 Average: 6.9405 StdDev: 619.21 Min: 0 Median: 1.7362 Max: 899437 Percentiles: P50: 1.74 P75: 2.76 P99: 9.94 P99.9: 1255.12 P99.99: 2789.44 ------------------------------------------------------ [ 0, 1 ] 1194783 13.821% 13.821% ### ( 1, 2 ] 4248422 49.143% 62.964% ########## ( 2, 3 ] 1376978 15.928% 78.892% ### ( 3, 4 ] 1155422 13.365% 92.257% ### ( 4, 6 ] 463442 5.361% 97.618% # ( 6, 10 ] 121432 1.405% 99.022% ( 10, 15 ] 42794 0.495% 99.517% ( 15, 22 ] 9747 0.113% 99.630% ( 22, 34 ] 1993 0.023% 99.653% ( 34, 51 ] 255 0.003% 99.656% ( 51, 76 ] 87 0.001% 99.657% ( 76, 110 ] 5781 0.067% 99.724% ( 110, 170 ] 2510 0.029% 99.753% ( 170, 250 ] 252 0.003% 99.756% ( 250, 380 ] 206 0.002% 99.758% ( 380, 580 ] 24 0.000% 99.759% ( 580, 870 ] 24 0.000% 99.759% ( 870, 1300 ] 13624 0.158% 99.916% ( 1300, 1900 ] 39 0.000% 99.917% ( 1900, 2900 ] 7105 0.082% 99.999% ( 2900, 4400 ] 46 0.001% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 207402 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8644999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 8921638968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 549 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35843162 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29449016840 rocksdb.compact.write.bytes COUNT : 29236236034 rocksdb.flush.write.bytes COUNT : 8785719847 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 39 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 245 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8714812416 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3321856 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29529431554 rocksdb.non.last.level.read.count COUNT : 7136991 rocksdb.block.checksum.compute.count COUNT : 7135932 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.385415 P95 : 3.962631 P99 : 8.721397 P100 : 899435.000000 COUNT : 8644999 SUM : 55899431 rocksdb.compaction.times.micros P50 : 1013000.000000 P95 : 3810000.000000 P99 : 22550000.000000 P100 : 22929381.000000 COUNT : 95 SUM : 141763328 rocksdb.compaction.times.cpu_micros P50 : 728809.523810 P95 : 3075000.000000 P99 : 18200000.000000 P100 : 20896383.000000 COUNT : 95 SUM : 109995366 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 702.847222 P95 : 10976.250000 P99 : 70250.000000 P100 : 229192.000000 COUNT : 119 SUM : 450040 rocksdb.compaction.outfile.sync.micros P50 : 1135.068493 P95 : 155857.142857 P99 : 323171.428571 P100 : 683779.000000 COUNT : 406 SUM : 10966455 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 141.250000 P95 : 3232.812500 P99 : 4121.000000 P100 : 4121.000000 COUNT : 249 SUM : 151404 rocksdb.table.open.io.micros P50 : 1332.530120 P95 : 7558.269231 P99 : 12298.500000 P100 : 26544.000000 COUNT : 549 SUM : 1115924 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.573303 P95 : 7.859864 P99 : 12.273658 P100 : 28040.000000 COUNT : 7134643 SUM : 50476933 rocksdb.read.block.get.micros P50 : 356.183206 P95 : 3413.000000 P99 : 5676.000000 P100 : 8751.000000 COUNT : 1098 SUM : 900110 rocksdb.write.raw.block.micros P50 : 0.515453 P95 : 0.979361 P99 : 2.987633 P100 : 40945.000000 COUNT : 9217693 SUM : 20824480 rocksdb.numfiles.in.singlecompaction P50 : 2.869565 P95 : 4.533333 P99 : 24.160000 P100 : 33.000000 COUNT : 164 SUM : 583 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571407 P95 : 1262.145043 P99 : 2670.008459 P100 : 899252.000000 COUNT : 166933 SUM : 35862592 rocksdb.sst.read.micros P50 : 1.544113 P95 : 4.719252 P99 : 8.995308 P100 : 28037.000000 COUNT : 7137579 SUM : 35969075 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8644999 SUM : 8921638968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206111.111111 P95 : 574833.333333 P99 : 1014770.000000 P100 : 1014770.000000 COUNT : 119 SUM : 27534187 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 368 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0