[2024-07-27 05:59:33.036080] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... [2024-07-27 05:59:33.036228] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid171299 ] Set seed to 1722052773032737 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-27 05:59:33.138529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-27 05:59:33.175830] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-27 05:59:33.175874] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 171299' to capture a snapshot of events at runtime. [2024-07-27 05:59:33.175886] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid171299 for offline analysis/debug. [2024-07-27 05:59:33.175929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 27 05:59:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/27-05:59:47 ... thread 0: (1000000,1000000) ops and (101105.9,101105.9) ops/second in (9.890620,9.890620) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.32 GB 31.5 0.3 0.0 0.3 1.2 0.9 0.0 1.4 53.1 201.6 5.93 3.81 13 0.456 319K 352 0.0 0.0 L1 12/12 1.39 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 977.47 MB 1.0 3.8 2.7 1.1 3.8 2.7 0.0 1.4 131.5 130.7 29.90 18.10 11 2.718 1013K 0 0.0 0.0 L4 168/0 9.67 GB 1.0 4.1 3.0 1.1 4.1 3.0 0.0 1.4 118.9 117.6 35.42 20.36 33 1.073 3216K 0 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1327/23 106.18 GB 0.0 8.3 5.7 2.5 9.1 6.5 3.0 10.5 118.7 130.1 71.25 42.27 57 1.250 4549K 352 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 5.7 2.5 9.1 6.5 3.0 10.5 118.7 130.1 71.25 42.27 57 1.250 4549K 352 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 5.7 2.5 8.2 5.7 0.0 0.0 126.5 125.5 66.83 39.73 45 1.485 4549K 352 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 199.3 4.42 2.54 12 0.369 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.1 total, 9.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.05 GB write, 917.41 MB/s write, 8.26 GB read, 836.81 MB/s read, 71.3 seconds Interval compaction: 9.05 GB write, 937.22 MB/s write, 8.26 GB read, 854.88 MB/s read, 71.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 19, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 474580 Average: 11.5719 StdDev: 183.20 Min: 0 Median: 1.8767 Max: 42914 Percentiles: P50: 1.88 P75: 2.94 P99: 117.70 P99.9: 1592.91 P99.99: 3691.56 ------------------------------------------------------ [ 0, 1 ] 29079 6.127% 6.127% # ( 1, 2 ] 237490 50.042% 56.169% ########## ( 2, 3 ] 94904 19.997% 76.167% #### ( 3, 4 ] 41766 8.801% 84.968% ## ( 4, 6 ] 49811 10.496% 95.463% ## ( 6, 10 ] 12926 2.724% 98.187% # ( 10, 15 ] 2996 0.631% 98.818% ( 15, 22 ] 444 0.094% 98.912% ( 22, 34 ] 52 0.011% 98.923% ( 34, 51 ] 35 0.007% 98.930% ( 51, 76 ] 23 0.005% 98.935% ( 76, 110 ] 199 0.042% 98.977% ( 110, 170 ] 866 0.182% 99.159% ( 170, 250 ] 803 0.169% 99.329% ( 250, 380 ] 677 0.143% 99.471% ( 380, 580 ] 789 0.166% 99.638% ( 580, 870 ] 670 0.141% 99.779% ( 870, 1300 ] 450 0.095% 99.874% ( 1300, 1900 ] 261 0.055% 99.929% ( 1900, 2900 ] 188 0.040% 99.968% ( 2900, 4400 ] 200 0.042% 100.010% ( 4400, 6600 ] 48 0.010% 100.020% ( 6600, 9900 ] 16 0.003% 100.024% ( 9900, 14000 ] 8 0.002% 100.025% ( 14000, 22000 ] 6 0.001% 100.027% ( 22000, 33000 ] 3 0.001% 100.027% ( 33000, 50000 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 17832 Average: 32.5410 StdDev: 335.16 Min: 1 Median: 1.8786 Max: 22093 Percentiles: P50: 1.88 P75: 2.92 P99: 693.57 P99.9: 4473.92 P99.99: 12394.44 ------------------------------------------------------ [ 0, 1 ] 571 3.202% 3.202% # ( 1, 2 ] 9498 53.264% 56.466% ########### ( 2, 3 ] 3604 20.211% 76.677% #### ( 3, 4 ] 1642 9.208% 85.885% ## ( 4, 6 ] 1242 6.965% 92.850% # ( 6, 10 ] 459 2.574% 95.424% # ( 10, 15 ] 83 0.465% 95.889% ( 15, 22 ] 26 0.146% 96.035% ( 76, 110 ] 35 0.196% 96.231% ( 110, 170 ] 128 0.718% 96.949% ( 170, 250 ] 119 0.667% 97.617% ( 250, 380 ] 96 0.538% 98.155% ( 380, 580 ] 117 0.656% 98.811% ( 580, 870 ] 86 0.482% 99.293% ( 870, 1300 ] 49 0.275% 99.568% ( 1300, 1900 ] 27 0.151% 99.720% ( 1900, 2900 ] 12 0.067% 99.787% ( 2900, 4400 ] 20 0.112% 99.899% ( 4400, 6600 ] 5 0.028% 99.927% ( 6600, 9900 ] 10 0.056% 99.983% ( 9900, 14000 ] 2 0.011% 99.994% ( 22000, 33000 ] 1 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 483308 Average: 12.1440 StdDev: 178.58 Min: 1 Median: 1.9414 Max: 31797 Percentiles: P50: 1.94 P75: 3.22 P99: 13.02 P99.9: 1302.58 P99.99: 2074.68 ------------------------------------------------------ [ 0, 1 ] 19242 3.981% 3.981% # ( 1, 2 ] 236266 48.885% 52.866% ########## ( 2, 3 ] 95461 19.752% 72.618% #### ( 3, 4 ] 53172 11.002% 83.620% ## ( 4, 6 ] 57470 11.891% 95.511% ## ( 6, 10 ] 14673 3.036% 98.547% # ( 10, 15 ] 3633 0.752% 99.298% ( 15, 22 ] 480 0.099% 99.398% ( 22, 34 ] 58 0.012% 99.410% ( 34, 51 ] 38 0.008% 99.418% ( 51, 76 ] 40 0.008% 99.426% ( 76, 110 ] 46 0.010% 99.435% ( 110, 170 ] 75 0.016% 99.451% ( 170, 250 ] 123 0.025% 99.476% ( 250, 380 ] 241 0.050% 99.526% ( 380, 580 ] 490 0.101% 99.628% ( 580, 870 ] 679 0.140% 99.768% ( 870, 1300 ] 636 0.132% 99.900% ( 1300, 1900 ] 393 0.081% 99.981% ( 1900, 2900 ] 250 0.052% 100.033% ( 2900, 4400 ] 260 0.054% 100.086% ( 4400, 6600 ] 70 0.014% 100.101% ( 6600, 9900 ] 17 0.004% 100.104% ( 9900, 14000 ] 7 0.001% 100.106% ( 14000, 22000 ] 5 0.001% 100.107% ( 22000, 33000 ] 5 0.001% 100.108% ** Level 3 read latency histogram (micros): Count: 981453 Average: 7.7340 StdDev: 171.93 Min: 1 Median: 1.8871 Max: 43461 Percentiles: P50: 1.89 P75: 2.99 P99: 9.34 P99.9: 159.57 P99.99: 607.36 ------------------------------------------------------ [ 0, 1 ] 39444 4.019% 4.019% # ( 1, 2 ] 508697 51.831% 55.850% ########## ( 2, 3 ] 189623 19.321% 75.171% #### ( 3, 4 ] 105330 10.732% 85.903% ## ( 4, 6 ] 110990 11.309% 97.211% ## ( 6, 10 ] 21038 2.144% 99.355% ( 10, 15 ] 4448 0.453% 99.808% ( 15, 22 ] 538 0.055% 99.863% ( 22, 34 ] 46 0.005% 99.868% ( 34, 51 ] 35 0.004% 99.871% ( 51, 76 ] 62 0.006% 99.878% ( 76, 110 ] 71 0.007% 99.885% ( 110, 170 ] 181 0.018% 99.903% ( 170, 250 ] 206 0.021% 99.924% ( 250, 380 ] 260 0.026% 99.951% ( 380, 580 ] 350 0.036% 99.986% ( 580, 870 ] 380 0.039% 100.025% ( 870, 1300 ] 385 0.039% 100.064% ( 1300, 1900 ] 309 0.031% 100.096% ( 1900, 2900 ] 292 0.030% 100.126% ( 2900, 4400 ] 274 0.028% 100.153% ( 4400, 6600 ] 115 0.012% 100.165% ( 6600, 9900 ] 35 0.004% 100.169% ( 9900, 14000 ] 11 0.001% 100.170% ( 14000, 22000 ] 18 0.002% 100.172% ( 22000, 33000 ] 6 0.001% 100.172% ( 33000, 50000 ] 4 0.000% 100.173% ** Level 4 read latency histogram (micros): Count: 289175 Average: 34.5295 StdDev: 414.80 Min: 1 Median: 1.9124 Max: 81432 Percentiles: P50: 1.91 P75: 3.24 P99: 859.63 P99.9: 3594.88 P99.99: 4432.49 ------------------------------------------------------ [ 0, 1 ] 12571 4.347% 4.347% # ( 1, 2 ] 144689 50.035% 54.382% ########## ( 2, 3 ] 52291 18.083% 72.465% #### ( 3, 4 ] 30804 10.652% 83.117% ## ( 4, 6 ] 31389 10.855% 93.972% ## ( 6, 10 ] 7403 2.560% 96.532% # ( 10, 15 ] 1746 0.604% 97.136% ( 15, 22 ] 208 0.072% 97.208% ( 22, 34 ] 16 0.006% 97.213% ( 34, 51 ] 22 0.008% 97.221% ( 51, 76 ] 12 0.004% 97.225% ( 76, 110 ] 241 0.083% 97.309% ( 110, 170 ] 1013 0.350% 97.659% ( 170, 250 ] 849 0.294% 97.952% ( 250, 380 ] 770 0.266% 98.219% ( 380, 580 ] 1107 0.383% 98.602% ( 580, 870 ] 1195 0.413% 99.015% ( 870, 1300 ] 1144 0.396% 99.410% ( 1300, 1900 ] 706 0.244% 99.655% ( 1900, 2900 ] 487 0.168% 99.823% ( 2900, 4400 ] 481 0.166% 99.989% ( 4400, 6600 ] 141 0.049% 100.038% ( 6600, 9900 ] 36 0.012% 100.050% ( 9900, 14000 ] 11 0.004% 100.054% ( 14000, 22000 ] 14 0.005% 100.059% ( 22000, 33000 ] 14 0.005% 100.064% ( 33000, 50000 ] 4 0.001% 100.065% ( 50000, 75000 ] 1 0.000% 100.066% ( 75000, 110000 ] 1 0.000% 100.066% ** Level 5 read latency histogram (micros): Count: 34757 Average: 843.5260 StdDev: 1490.09 Min: 76 Median: 390.1940 Max: 56762 Percentiles: P50: 390.19 P75: 891.38 P99: 5908.67 P99.9: 13793.09 P99.99: 41582.62 ------------------------------------------------------ ( 51, 76 ] 1 0.003% 0.003% ( 76, 110 ] 1598 4.598% 4.601% # ( 110, 170 ] 6241 17.956% 22.557% #### ( 170, 250 ] 5214 15.001% 37.558% ### ( 250, 380 ] 4088 11.762% 49.320% ## ( 380, 580 ] 4640 13.350% 62.669% ### ( 580, 870 ] 4131 11.885% 74.555% ## ( 870, 1300 ] 3113 8.956% 83.511% ## ( 1300, 1900 ] 1817 5.228% 88.739% # ( 1900, 2900 ] 1491 4.290% 93.029% # ( 2900, 4400 ] 1629 4.687% 97.716% # ( 4400, 6600 ] 651 1.873% 99.589% ( 6600, 9900 ] 94 0.270% 99.859% ( 9900, 14000 ] 15 0.043% 99.902% ( 14000, 22000 ] 6 0.017% 99.919% ( 22000, 33000 ] 22 0.063% 99.983% ( 33000, 50000 ] 5 0.014% 99.997% ( 50000, 75000 ] 3 0.009% 100.006% ** DB Stats ** Uptime(secs): 10.1 total, 9.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 97.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.904 H:M:S, 58.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 99.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.904 H:M:S, 59.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/27-05:59:50 ... thread 0: (1000000,2000000) ops and (288684.8,149761.1) ops/second in (3.463986,13.354606) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 3.30 GB 138.4 1.4 0.0 1.4 3.2 1.8 0.0 1.7 105.1 248.4 13.18 10.54 33 0.399 1407K 1503 0.0 0.0 L1 12/12 1.39 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 977.47 MB 1.0 3.8 2.7 1.1 3.8 2.7 0.0 1.4 131.5 130.7 29.90 18.10 11 2.718 1013K 0 0.0 0.0 L4 168/0 9.67 GB 1.0 4.1 3.0 1.1 4.1 3.0 0.0 1.4 118.9 117.6 35.42 20.36 33 1.073 3216K 0 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1331/23 107.16 GB 0.0 9.3 5.7 3.6 11.1 7.5 3.0 6.0 121.4 144.6 78.50 48.99 77 1.019 5636K 1503 0.0 0.0 Int 0/0 0.00 KB 0.0 9.3 5.7 3.6 11.1 7.5 3.0 6.0 121.4 144.6 78.50 48.99 77 1.019 5636K 1503 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.3 5.7 3.6 9.2 5.7 0.0 0.0 134.5 133.5 70.86 43.67 49 1.446 5636K 1503 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 247.2 7.64 5.32 28 0.273 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.6 total, 13.4 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.08 GB write, 836.34 MB/s write, 9.30 GB read, 702.13 MB/s read, 78.5 seconds Interval compaction: 11.08 GB write, 849.72 MB/s write, 9.30 GB read, 713.35 MB/s read, 78.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 19, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 756470 Average: 10.9816 StdDev: 148.75 Min: 0 Median: 1.6962 Max: 42914 Percentiles: P50: 1.70 P75: 2.57 P99: 196.41 P99.9: 1100.56 P99.99: 2798.73 ------------------------------------------------------ [ 0, 1 ] 98832 13.065% 13.065% ### ( 1, 2 ] 401301 53.049% 66.114% ########### ( 2, 3 ] 117731 15.563% 81.677% ### ( 3, 4 ] 50139 6.628% 88.305% # ( 4, 6 ] 55475 7.333% 95.639% # ( 6, 10 ] 13891 1.836% 97.475% ( 10, 15 ] 3239 0.428% 97.903% ( 15, 22 ] 484 0.064% 97.967% ( 22, 34 ] 54 0.007% 97.974% ( 34, 51 ] 36 0.005% 97.979% ( 51, 76 ] 31 0.004% 97.983% ( 76, 110 ] 1456 0.192% 98.176% ( 110, 170 ] 5220 0.690% 98.866% ( 170, 250 ] 3084 0.408% 99.273% ( 250, 380 ] 1828 0.242% 99.515% ( 380, 580 ] 1682 0.222% 99.737% ( 580, 870 ] 958 0.127% 99.864% ( 870, 1300 ] 512 0.068% 99.932% ( 1300, 1900 ] 269 0.036% 99.967% ( 1900, 2900 ] 194 0.026% 99.993% ( 2900, 4400 ] 208 0.027% 100.020% ( 4400, 6600 ] 48 0.006% 100.027% ( 6600, 9900 ] 16 0.002% 100.029% ( 9900, 14000 ] 8 0.001% 100.030% ( 14000, 22000 ] 6 0.001% 100.031% ( 22000, 33000 ] 3 0.000% 100.031% ( 33000, 50000 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 92105 Average: 11.0180 StdDev: 150.41 Min: 1 Median: 2.0127 Max: 22093 Percentiles: P50: 2.01 P75: 3.13 P99: 177.04 P99.9: 1201.79 P99.99: 7850.53 ------------------------------------------------------ [ 0, 1 ] 3495 3.795% 3.795% # ( 1, 2 ] 42277 45.901% 49.695% ######### ( 2, 3 ] 22042 23.931% 73.627% ##### ( 3, 4 ] 9692 10.523% 84.150% ## ( 4, 6 ] 9207 9.996% 94.146% ## ( 6, 10 ] 2780 3.018% 97.164% # ( 10, 15 ] 664 0.721% 97.885% ( 15, 22 ] 265 0.288% 98.173% ( 22, 34 ] 21 0.023% 98.196% ( 76, 110 ] 157 0.170% 98.366% ( 110, 170 ] 555 0.603% 98.969% ( 170, 250 ] 329 0.357% 99.326% ( 250, 380 ] 177 0.192% 99.518% ( 380, 580 ] 191 0.207% 99.725% ( 580, 870 ] 120 0.130% 99.856% ( 870, 1300 ] 53 0.058% 99.913% ( 1300, 1900 ] 29 0.031% 99.945% ( 1900, 2900 ] 13 0.014% 99.959% ( 2900, 4400 ] 20 0.022% 99.980% ( 4400, 6600 ] 5 0.005% 99.986% ( 6600, 9900 ] 10 0.011% 99.997% ( 9900, 14000 ] 2 0.002% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 483308 Average: 12.1440 StdDev: 178.58 Min: 1 Median: 1.9414 Max: 31797 Percentiles: P50: 1.94 P75: 3.22 P99: 13.02 P99.9: 1302.58 P99.99: 2074.68 ------------------------------------------------------ [ 0, 1 ] 19242 3.981% 3.981% # ( 1, 2 ] 236266 48.885% 52.866% ########## ( 2, 3 ] 95461 19.752% 72.618% #### ( 3, 4 ] 53172 11.002% 83.620% ## ( 4, 6 ] 57470 11.891% 95.511% ## ( 6, 10 ] 14673 3.036% 98.547% # ( 10, 15 ] 3633 0.752% 99.298% ( 15, 22 ] 480 0.099% 99.398% ( 22, 34 ] 58 0.012% 99.410% ( 34, 51 ] 38 0.008% 99.418% ( 51, 76 ] 40 0.008% 99.426% ( 76, 110 ] 46 0.010% 99.435% ( 110, 170 ] 75 0.016% 99.451% ( 170, 250 ] 123 0.025% 99.476% ( 250, 380 ] 241 0.050% 99.526% ( 380, 580 ] 490 0.101% 99.628% ( 580, 870 ] 679 0.140% 99.768% ( 870, 1300 ] 636 0.132% 99.900% ( 1300, 1900 ] 393 0.081% 99.981% ( 1900, 2900 ] 250 0.052% 100.033% ( 2900, 4400 ] 260 0.054% 100.086% ( 4400, 6600 ] 70 0.014% 100.101% ( 6600, 9900 ] 17 0.004% 100.104% ( 9900, 14000 ] 7 0.001% 100.106% ( 14000, 22000 ] 5 0.001% 100.107% ( 22000, 33000 ] 5 0.001% 100.108% ** Level 3 read latency histogram (micros): Count: 982136 Average: 7.8761 StdDev: 172.03 Min: 1 Median: 1.8878 Max: 43461 Percentiles: P50: 1.89 P75: 2.99 P99: 9.47 P99.9: 227.11 P99.99: 623.56 ------------------------------------------------------ [ 0, 1 ] 39444 4.016% 4.016% # ( 1, 2 ] 508697 51.795% 55.811% ########## ( 2, 3 ] 189623 19.307% 75.118% #### ( 3, 4 ] 105330 10.725% 85.843% ## ( 4, 6 ] 110990 11.301% 97.144% ## ( 6, 10 ] 21038 2.142% 99.286% ( 10, 15 ] 4448 0.453% 99.739% ( 15, 22 ] 538 0.055% 99.794% ( 22, 34 ] 46 0.005% 99.798% ( 34, 51 ] 35 0.004% 99.802% ( 51, 76 ] 62 0.006% 99.808% ( 76, 110 ] 162 0.016% 99.825% ( 110, 170 ] 506 0.052% 99.876% ( 170, 250 ] 329 0.033% 99.910% ( 250, 380 ] 324 0.033% 99.943% ( 380, 580 ] 406 0.041% 99.984% ( 580, 870 ] 398 0.041% 100.024% ( 870, 1300 ] 389 0.040% 100.064% ( 1300, 1900 ] 309 0.031% 100.096% ( 1900, 2900 ] 294 0.030% 100.125% ( 2900, 4400 ] 274 0.028% 100.153% ( 4400, 6600 ] 115 0.012% 100.165% ( 6600, 9900 ] 35 0.004% 100.169% ( 9900, 14000 ] 11 0.001% 100.170% ( 14000, 22000 ] 18 0.002% 100.172% ( 22000, 33000 ] 6 0.001% 100.172% ( 33000, 50000 ] 4 0.000% 100.173% ** Level 4 read latency histogram (micros): Count: 295994 Average: 38.0193 StdDev: 411.33 Min: 1 Median: 1.9356 Max: 81432 Percentiles: P50: 1.94 P75: 3.39 P99: 854.31 P99.9: 3573.62 P99.99: 4421.85 ------------------------------------------------------ [ 0, 1 ] 12571 4.247% 4.247% # ( 1, 2 ] 144742 48.900% 53.147% ########## ( 2, 3 ] 52583 17.765% 70.912% #### ( 3, 4 ] 30961 10.460% 81.372% ## ( 4, 6 ] 31609 10.679% 92.051% ## ( 6, 10 ] 7443 2.515% 94.566% # ( 10, 15 ] 1756 0.593% 95.159% ( 15, 22 ] 209 0.071% 95.230% ( 22, 34 ] 17 0.006% 95.235% ( 34, 51 ] 22 0.007% 95.243% ( 51, 76 ] 13 0.004% 95.247% ( 76, 110 ] 1057 0.357% 95.604% ( 110, 170 ] 3752 1.268% 96.872% ( 170, 250 ] 2092 0.707% 97.579% ( 250, 380 ] 1351 0.456% 98.035% ( 380, 580 ] 1581 0.534% 98.569% ( 580, 870 ] 1348 0.455% 99.025% ( 870, 1300 ] 1177 0.398% 99.422% ( 1300, 1900 ] 707 0.239% 99.661% ( 1900, 2900 ] 491 0.166% 99.827% ( 2900, 4400 ] 481 0.163% 99.990% ( 4400, 6600 ] 141 0.048% 100.037% ( 6600, 9900 ] 36 0.012% 100.049% ( 9900, 14000 ] 11 0.004% 100.053% ( 14000, 22000 ] 14 0.005% 100.058% ( 22000, 33000 ] 14 0.005% 100.063% ( 33000, 50000 ] 4 0.001% 100.064% ( 50000, 75000 ] 1 0.000% 100.064% ( 75000, 110000 ] 1 0.000% 100.065% ** Level 5 read latency histogram (micros): Count: 78756 Average: 488.6077 StdDev: 1045.16 Min: 76 Median: 201.7862 Max: 56762 Percentiles: P50: 201.79 P75: 446.96 P99: 4408.25 P99.9: 8714.95 P99.99: 30062.20 ------------------------------------------------------ ( 51, 76 ] 3 0.004% 0.004% ( 76, 110 ] 7382 9.373% 9.377% ## ( 110, 170 ] 26254 33.336% 42.713% ####### ( 170, 250 ] 14444 18.340% 61.053% #### ( 250, 380 ] 8281 10.515% 71.568% ## ( 380, 580 ] 8074 10.252% 81.820% ## ( 580, 870 ] 5238 6.651% 88.471% # ( 870, 1300 ] 3303 4.194% 92.665% # ( 1300, 1900 ] 1839 2.335% 95.000% ( 1900, 2900 ] 1518 1.927% 96.927% ( 2900, 4400 ] 1630 2.070% 98.997% ( 4400, 6600 ] 651 0.827% 99.824% ( 6600, 9900 ] 94 0.119% 99.943% ( 9900, 14000 ] 15 0.019% 99.962% ( 14000, 22000 ] 6 0.008% 99.970% ( 22000, 33000 ] 22 0.028% 99.997% ( 33000, 50000 ] 5 0.006% 100.004% ( 50000, 75000 ] 3 0.004% 100.008% ** DB Stats ** Uptime(secs): 13.6 total, 3.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 145.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.904 H:M:S, 43.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/27-05:59:54 ... thread 0: (1000000,3000000) ops and (266834.5,175415.5) ops/second in (3.747642,17.102248) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 4.29 GB 264.3 2.6 0.0 2.6 5.4 2.8 0.0 1.9 126.0 263.8 21.00 17.84 54 0.389 2686K 2687 0.0 0.0 L1 12/12 1.39 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 977.47 MB 1.0 3.8 2.7 1.1 3.8 2.7 0.0 1.4 131.5 130.7 29.90 18.10 11 2.718 1013K 0 0.0 0.0 L4 168/0 9.67 GB 1.0 4.1 3.0 1.1 4.1 3.0 0.0 1.4 118.9 117.6 35.42 20.36 33 1.073 3216K 0 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1332/19 108.14 GB 0.0 10.5 5.7 4.8 13.3 8.5 3.0 4.7 125.0 157.7 86.32 56.30 98 0.881 6916K 2687 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 5.7 4.8 13.3 8.5 3.0 4.7 125.0 157.7 86.32 56.30 98 0.881 6916K 2687 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 5.7 4.8 10.5 5.7 0.0 0.0 142.8 141.9 75.54 48.24 54 1.399 6916K 2687 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 268.9 10.78 8.05 44 0.245 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.3 total, 17.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.30 GB write, 786.22 MB/s write, 10.53 GB read, 622.92 MB/s read, 86.3 seconds Interval compaction: 13.30 GB write, 796.04 MB/s write, 10.53 GB read, 630.70 MB/s read, 86.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 19, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1060150 Average: 10.3181 StdDev: 128.27 Min: 0 Median: 1.6197 Max: 42914 Percentiles: P50: 1.62 P75: 2.31 P99: 201.98 P99.9: 841.27 P99.99: 1891.27 ------------------------------------------------------ [ 0, 1 ] 170520 16.085% 16.085% ### ( 1, 2 ] 580202 54.728% 70.813% ########### ( 2, 3 ] 144218 13.604% 84.416% ### ( 3, 4 ] 59861 5.646% 90.063% # ( 4, 6 ] 61698 5.820% 95.883% # ( 6, 10 ] 15147 1.429% 97.311% ( 10, 15 ] 3567 0.336% 97.648% ( 15, 22 ] 532 0.050% 97.698% ( 22, 34 ] 63 0.006% 97.704% ( 34, 51 ] 37 0.003% 97.707% ( 51, 76 ] 32 0.003% 97.710% ( 76, 110 ] 2421 0.228% 97.939% ( 110, 170 ] 9204 0.868% 98.807% ( 170, 250 ] 5119 0.483% 99.290% ( 250, 380 ] 2854 0.269% 99.559% ( 380, 580 ] 2486 0.234% 99.794% ( 580, 870 ] 1253 0.118% 99.912% ( 870, 1300 ] 558 0.053% 99.964% ( 1300, 1900 ] 276 0.026% 99.990% ( 1900, 2900 ] 202 0.019% 100.009% ( 2900, 4400 ] 211 0.020% 100.029% ( 4400, 6600 ] 48 0.005% 100.034% ( 6600, 9900 ] 16 0.002% 100.035% ( 9900, 14000 ] 8 0.001% 100.036% ( 14000, 22000 ] 6 0.001% 100.037% ( 22000, 33000 ] 3 0.000% 100.037% ( 33000, 50000 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 205110 Average: 7.6597 StdDev: 102.57 Min: 1 Median: 1.9134 Max: 22093 Percentiles: P50: 1.91 P75: 2.91 P99: 134.05 P99.9: 735.22 P99.99: 3986.67 ------------------------------------------------------ [ 0, 1 ] 9979 4.865% 4.865% # ( 1, 2 ] 101348 49.412% 54.277% ########## ( 2, 3 ] 46530 22.685% 76.962% ##### ( 3, 4 ] 20040 9.770% 86.732% ## ( 4, 6 ] 17037 8.306% 95.039% ## ( 6, 10 ] 5475 2.669% 97.708% # ( 10, 15 ] 1364 0.665% 98.373% ( 15, 22 ] 484 0.236% 98.609% ( 22, 34 ] 38 0.019% 98.628% ( 51, 76 ] 1 0.000% 98.628% ( 76, 110 ] 353 0.172% 98.800% ( 110, 170 ] 1025 0.500% 99.300% ( 170, 250 ] 572 0.279% 99.579% ( 250, 380 ] 292 0.142% 99.721% ( 380, 580 ] 286 0.139% 99.861% ( 580, 870 ] 153 0.075% 99.935% ( 870, 1300 ] 56 0.027% 99.962% ( 1300, 1900 ] 30 0.015% 99.977% ( 1900, 2900 ] 13 0.006% 99.983% ( 2900, 4400 ] 20 0.010% 99.993% ( 4400, 6600 ] 5 0.002% 99.996% ( 6600, 9900 ] 10 0.005% 100.000% ( 9900, 14000 ] 2 0.001% 100.001% ( 22000, 33000 ] 1 0.000% 100.002% ** Level 2 read latency histogram (micros): Count: 483308 Average: 12.1440 StdDev: 178.58 Min: 1 Median: 1.9414 Max: 31797 Percentiles: P50: 1.94 P75: 3.22 P99: 13.02 P99.9: 1302.58 P99.99: 2074.68 ------------------------------------------------------ [ 0, 1 ] 19242 3.981% 3.981% # ( 1, 2 ] 236266 48.885% 52.866% ########## ( 2, 3 ] 95461 19.752% 72.618% #### ( 3, 4 ] 53172 11.002% 83.620% ## ( 4, 6 ] 57470 11.891% 95.511% ## ( 6, 10 ] 14673 3.036% 98.547% # ( 10, 15 ] 3633 0.752% 99.298% ( 15, 22 ] 480 0.099% 99.398% ( 22, 34 ] 58 0.012% 99.410% ( 34, 51 ] 38 0.008% 99.418% ( 51, 76 ] 40 0.008% 99.426% ( 76, 110 ] 46 0.010% 99.435% ( 110, 170 ] 75 0.016% 99.451% ( 170, 250 ] 123 0.025% 99.476% ( 250, 380 ] 241 0.050% 99.526% ( 380, 580 ] 490 0.101% 99.628% ( 580, 870 ] 679 0.140% 99.768% ( 870, 1300 ] 636 0.132% 99.900% ( 1300, 1900 ] 393 0.081% 99.981% ( 1900, 2900 ] 250 0.052% 100.033% ( 2900, 4400 ] 260 0.054% 100.086% ( 4400, 6600 ] 70 0.014% 100.101% ( 6600, 9900 ] 17 0.004% 100.104% ( 9900, 14000 ] 7 0.001% 100.106% ( 14000, 22000 ] 5 0.001% 100.107% ( 22000, 33000 ] 5 0.001% 100.108% ** Level 3 read latency histogram (micros): Count: 982871 Average: 8.0289 StdDev: 172.11 Min: 1 Median: 1.8885 Max: 43461 Percentiles: P50: 1.89 P75: 3.00 P99: 9.60 P99.9: 271.18 P99.99: 637.10 ------------------------------------------------------ [ 0, 1 ] 39444 4.013% 4.013% # ( 1, 2 ] 508697 51.756% 55.769% ########## ( 2, 3 ] 189623 19.293% 75.062% #### ( 3, 4 ] 105330 10.717% 85.779% ## ( 4, 6 ] 110990 11.292% 97.071% ## ( 6, 10 ] 21038 2.140% 99.212% ( 10, 15 ] 4448 0.453% 99.664% ( 15, 22 ] 538 0.055% 99.719% ( 22, 34 ] 46 0.005% 99.724% ( 34, 51 ] 35 0.004% 99.727% ( 51, 76 ] 62 0.006% 99.733% ( 76, 110 ] 250 0.025% 99.759% ( 110, 170 ] 828 0.084% 99.843% ( 170, 250 ] 492 0.050% 99.893% ( 250, 380 ] 412 0.042% 99.935% ( 380, 580 ] 458 0.047% 99.982% ( 580, 870 ] 415 0.042% 100.024% ( 870, 1300 ] 392 0.040% 100.064% ( 1300, 1900 ] 310 0.032% 100.095% ( 1900, 2900 ] 295 0.030% 100.125% ( 2900, 4400 ] 274 0.028% 100.153% ( 4400, 6600 ] 115 0.012% 100.165% ( 6600, 9900 ] 35 0.004% 100.168% ( 9900, 14000 ] 11 0.001% 100.170% ( 14000, 22000 ] 18 0.002% 100.171% ( 22000, 33000 ] 6 0.001% 100.172% ( 33000, 50000 ] 4 0.000% 100.172% ** Level 4 read latency histogram (micros): Count: 303212 Average: 41.9617 StdDev: 407.83 Min: 1 Median: 1.9603 Max: 81432 Percentiles: P50: 1.96 P75: 3.56 P99: 850.04 P99.9: 3551.11 P99.99: 4410.59 ------------------------------------------------------ [ 0, 1 ] 12571 4.146% 4.146% # ( 1, 2 ] 144784 47.750% 51.896% ########## ( 2, 3 ] 52692 17.378% 69.274% ### ( 3, 4 ] 30998 10.223% 79.497% ## ( 4, 6 ] 31652 10.439% 89.936% ## ( 6, 10 ] 7449 2.457% 92.393% ( 10, 15 ] 1756 0.579% 92.972% ( 15, 22 ] 209 0.069% 93.041% ( 22, 34 ] 17 0.006% 93.046% ( 34, 51 ] 22 0.007% 93.054% ( 51, 76 ] 13 0.004% 93.058% ( 76, 110 ] 2049 0.676% 93.734% ( 110, 170 ] 6833 2.254% 95.987% ( 170, 250 ] 3512 1.158% 97.146% ( 250, 380 ] 2036 0.671% 97.817% ( 380, 580 ] 2138 0.705% 98.522% ( 580, 870 ] 1556 0.513% 99.035% ( 870, 1300 ] 1214 0.400% 99.436% ( 1300, 1900 ] 708 0.233% 99.669% ( 1900, 2900 ] 491 0.162% 99.831% ( 2900, 4400 ] 481 0.159% 99.990% ( 4400, 6600 ] 141 0.047% 100.036% ( 6600, 9900 ] 36 0.012% 100.048% ( 9900, 14000 ] 11 0.004% 100.052% ( 14000, 22000 ] 14 0.005% 100.056% ( 22000, 33000 ] 14 0.005% 100.061% ( 33000, 50000 ] 4 0.001% 100.062% ( 50000, 75000 ] 1 0.000% 100.063% ( 75000, 110000 ] 1 0.000% 100.063% ** Level 5 read latency histogram (micros): Count: 125713 Average: 384.2293 StdDev: 843.25 Min: 74 Median: 175.9237 Max: 56762 Percentiles: P50: 175.92 P75: 341.60 P99: 3967.90 P99.9: 6961.14 P99.99: 26214.35 ------------------------------------------------------ ( 51, 76 ] 9 0.007% 0.007% ( 76, 110 ] 14225 11.315% 11.323% ## ( 110, 170 ] 46836 37.256% 48.579% ####### ( 170, 250 ] 24127 19.192% 67.771% #### ( 250, 380 ] 12897 10.259% 78.030% ## ( 380, 580 ] 11777 9.368% 87.398% ## ( 580, 870 ] 6499 5.170% 92.568% # ( 870, 1300 ] 3531 2.809% 95.377% # ( 1300, 1900 ] 1860 1.480% 96.856% ( 1900, 2900 ] 1533 1.219% 98.076% ( 2900, 4400 ] 1632 1.298% 99.374% ( 4400, 6600 ] 651 0.518% 99.892% ( 6600, 9900 ] 94 0.075% 99.967% ( 9900, 14000 ] 15 0.012% 99.979% ( 14000, 22000 ] 6 0.005% 99.983% ( 22000, 33000 ] 22 0.018% 100.001% ( 33000, 50000 ] 5 0.004% 100.005% ( 50000, 75000 ] 3 0.002% 100.007% ** DB Stats ** Uptime(secs): 17.3 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 170.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.163 H:M:S, 35.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 262.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.259 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/27-06:00:08 ... thread 0: (1000000,4000000) ops and (70836.8,128126.3) ops/second in (14.116948,31.219196) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 3.74 GB 62.9 4.8 0.0 4.8 8.5 3.7 0.0 2.3 143.1 254.6 34.34 28.72 73 0.470 4987K 13K 0.0 0.0 L1 11/11 1.30 GB 0.0 2.8 1.5 1.4 2.8 1.4 0.0 1.9 122.6 121.6 23.81 15.41 1 23.806 2963K 23K 0.0 0.0 L2 1/0 76.18 MB 0.8 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/0 976.38 MB 1.0 5.3 3.5 1.8 5.2 3.5 0.7 1.5 133.0 132.1 40.63 25.61 21 1.935 2280K 5938 0.0 0.0 L4 170/0 9.46 GB 1.0 7.7 4.5 3.2 7.6 4.4 0.0 1.7 136.6 134.8 57.40 37.18 52 1.104 5093K 3774 0.0 0.0 L5 1136/0 93.44 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1354/22 108.97 GB 0.0 20.6 9.4 11.2 24.2 13.0 6.8 6.4 134.9 158.4 156.17 106.93 147 1.062 15M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 9.4 11.2 24.2 13.0 6.8 6.4 134.9 158.4 156.17 106.93 147 1.062 15M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 9.4 11.2 20.4 9.2 0.0 0.0 148.1 146.9 142.29 96.29 88 1.617 15M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 276.8 13.88 10.64 59 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.4 total, 31.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.17 GB write, 787.22 MB/s write, 20.58 GB read, 670.33 MB/s read, 156.2 seconds Interval compaction: 24.17 GB write, 792.60 MB/s write, 20.58 GB read, 674.92 MB/s read, 156.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 59, pending-compaction-bytes-stops: 0, total-delays: 60, total-stops: 19, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1735024 Average: 15.7238 StdDev: 144.48 Min: 0 Median: 1.5412 Max: 42914 Percentiles: P50: 1.54 P75: 2.02 P99: 297.03 P99.9: 1133.08 P99.99: 2060.93 ------------------------------------------------------ [ 0, 1 ] 359500 20.720% 20.720% #### ( 1, 2 ] 938607 54.098% 74.818% ########### ( 2, 3 ] 184949 10.660% 85.478% ## ( 3, 4 ] 75418 4.347% 89.824% # ( 4, 6 ] 72083 4.155% 93.979% # ( 6, 10 ] 17006 0.980% 94.959% ( 10, 15 ] 4010 0.231% 95.190% ( 15, 22 ] 588 0.034% 95.224% ( 22, 34 ] 69 0.004% 95.228% ( 34, 51 ] 38 0.002% 95.230% ( 51, 76 ] 37 0.002% 95.232% ( 76, 110 ] 10463 0.603% 95.835% ( 110, 170 ] 36854 2.124% 97.960% ( 170, 250 ] 15403 0.888% 98.847% ( 250, 380 ] 7322 0.422% 99.269% ( 380, 580 ] 6263 0.361% 99.630% ( 580, 870 ] 3552 0.205% 99.835% ( 870, 1300 ] 1842 0.106% 99.941% ( 1300, 1900 ] 781 0.045% 99.986% ( 1900, 2900 ] 407 0.023% 100.010% ( 2900, 4400 ] 370 0.021% 100.031% ( 4400, 6600 ] 73 0.004% 100.035% ( 6600, 9900 ] 22 0.001% 100.036% ( 9900, 14000 ] 9 0.001% 100.037% ( 14000, 22000 ] 16 0.001% 100.038% ( 22000, 33000 ] 8 0.000% 100.038% ( 33000, 50000 ] 3 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 660393 Average: 8.1473 StdDev: 115.09 Min: 1 Median: 1.9344 Max: 22093 Percentiles: P50: 1.93 P75: 3.22 P99: 104.42 P99.9: 663.02 P99.99: 1071.08 ------------------------------------------------------ [ 0, 1 ] 30749 4.656% 4.656% # ( 1, 2 ] 320485 48.529% 53.186% ########## ( 2, 3 ] 127295 19.276% 72.461% #### ( 3, 4 ] 75741 11.469% 83.930% ## ( 4, 6 ] 73300 11.099% 95.030% ## ( 6, 10 ] 19933 3.018% 98.048% # ( 10, 15 ] 4004 0.606% 98.654% ( 15, 22 ] 1347 0.204% 98.858% ( 22, 34 ] 94 0.014% 98.873% ( 34, 51 ] 36 0.005% 98.878% ( 51, 76 ] 26 0.004% 98.882% ( 76, 110 ] 932 0.141% 99.023% ( 110, 170 ] 2759 0.418% 99.441% ( 170, 250 ] 1260 0.191% 99.632% ( 250, 380 ] 786 0.119% 99.751% ( 380, 580 ] 817 0.124% 99.874% ( 580, 870 ] 589 0.089% 99.964% ( 870, 1300 ] 372 0.056% 100.020% ( 1300, 1900 ] 139 0.021% 100.041% ( 1900, 2900 ] 71 0.011% 100.052% ( 2900, 4400 ] 87 0.013% 100.065% ( 4400, 6600 ] 19 0.003% 100.068% ( 6600, 9900 ] 25 0.004% 100.072% ( 9900, 14000 ] 7 0.001% 100.073% ( 14000, 22000 ] 10 0.002% 100.074% ( 22000, 33000 ] 1 0.000% 100.074% ** Level 2 read latency histogram (micros): Count: 483308 Average: 12.1440 StdDev: 178.58 Min: 1 Median: 1.9414 Max: 31797 Percentiles: P50: 1.94 P75: 3.22 P99: 13.02 P99.9: 1302.58 P99.99: 2074.68 ------------------------------------------------------ [ 0, 1 ] 19242 3.981% 3.981% # ( 1, 2 ] 236266 48.885% 52.866% ########## ( 2, 3 ] 95461 19.752% 72.618% #### ( 3, 4 ] 53172 11.002% 83.620% ## ( 4, 6 ] 57470 11.891% 95.511% ## ( 6, 10 ] 14673 3.036% 98.547% # ( 10, 15 ] 3633 0.752% 99.298% ( 15, 22 ] 480 0.099% 99.398% ( 22, 34 ] 58 0.012% 99.410% ( 34, 51 ] 38 0.008% 99.418% ( 51, 76 ] 40 0.008% 99.426% ( 76, 110 ] 46 0.010% 99.435% ( 110, 170 ] 75 0.016% 99.451% ( 170, 250 ] 123 0.025% 99.476% ( 250, 380 ] 241 0.050% 99.526% ( 380, 580 ] 490 0.101% 99.628% ( 580, 870 ] 679 0.140% 99.768% ( 870, 1300 ] 636 0.132% 99.900% ( 1300, 1900 ] 393 0.081% 99.981% ( 1900, 2900 ] 250 0.052% 100.033% ( 2900, 4400 ] 260 0.054% 100.086% ( 4400, 6600 ] 70 0.014% 100.101% ( 6600, 9900 ] 17 0.004% 100.104% ( 9900, 14000 ] 7 0.001% 100.106% ( 14000, 22000 ] 5 0.001% 100.107% ( 22000, 33000 ] 5 0.001% 100.108% ** Level 3 read latency histogram (micros): Count: 1440007 Average: 7.8202 StdDev: 160.57 Min: 1 Median: 1.8792 Max: 43461 Percentiles: P50: 1.88 P75: 2.99 P99: 9.81 P99.9: 345.27 P99.99: 685.72 ------------------------------------------------------ [ 0, 1 ] 61841 4.294% 4.294% # ( 1, 2 ] 748622 51.987% 56.282% ########## ( 2, 3 ] 271579 18.860% 75.141% #### ( 3, 4 ] 151521 10.522% 85.664% ## ( 4, 6 ] 161813 11.237% 96.901% ## ( 6, 10 ] 31727 2.203% 99.104% ( 10, 15 ] 6409 0.445% 99.549% ( 15, 22 ] 739 0.051% 99.600% ( 22, 34 ] 63 0.004% 99.605% ( 34, 51 ] 62 0.004% 99.609% ( 51, 76 ] 82 0.006% 99.615% ( 76, 110 ] 569 0.040% 99.654% ( 110, 170 ] 2046 0.142% 99.796% ( 170, 250 ] 959 0.067% 99.863% ( 250, 380 ] 730 0.051% 99.914% ( 380, 580 ] 813 0.056% 99.970% ( 580, 870 ] 790 0.055% 100.025% ( 870, 1300 ] 651 0.045% 100.070% ( 1300, 1900 ] 411 0.029% 100.099% ( 1900, 2900 ] 331 0.023% 100.122% ( 2900, 4400 ] 332 0.023% 100.145% ( 4400, 6600 ] 132 0.009% 100.154% ( 6600, 9900 ] 48 0.003% 100.157% ( 9900, 14000 ] 21 0.001% 100.159% ( 14000, 22000 ] 29 0.002% 100.161% ( 22000, 33000 ] 6 0.000% 100.161% ( 33000, 50000 ] 4 0.000% 100.161% ** Level 4 read latency histogram (micros): Count: 869684 Average: 26.6803 StdDev: 282.98 Min: 0 Median: 1.9484 Max: 81432 Percentiles: P50: 1.95 P75: 3.44 P99: 476.68 P99.9: 1439.22 P99.99: 1862.69 ------------------------------------------------------ [ 0, 1 ] 33070 3.803% 3.803% # ( 1, 2 ] 423627 48.710% 52.513% ########## ( 2, 3 ] 156729 18.021% 70.534% #### ( 3, 4 ] 88467 10.172% 80.707% ## ( 4, 6 ] 93476 10.748% 91.455% ## ( 6, 10 ] 22791 2.621% 94.076% # ( 10, 15 ] 5118 0.588% 94.664% ( 15, 22 ] 502 0.058% 94.722% ( 22, 34 ] 44 0.005% 94.727% ( 34, 51 ] 89 0.010% 94.737% ( 51, 76 ] 29 0.003% 94.740% ( 76, 110 ] 5388 0.620% 95.360% ( 110, 170 ] 17969 2.066% 97.426% ( 170, 250 ] 7615 0.876% 98.302% ( 250, 380 ] 4057 0.466% 98.768% ( 380, 580 ] 4171 0.480% 99.248% ( 580, 870 ] 3114 0.358% 99.606% ( 870, 1300 ] 2301 0.265% 99.870% ( 1300, 1900 ] 1109 0.128% 99.998% ( 1900, 2900 ] 692 0.080% 100.077% ( 2900, 4400 ] 622 0.072% 100.149% ( 4400, 6600 ] 171 0.020% 100.169% ( 6600, 9900 ] 52 0.006% 100.175% ( 9900, 14000 ] 20 0.002% 100.177% ( 14000, 22000 ] 24 0.003% 100.180% ( 22000, 33000 ] 21 0.002% 100.182% ( 33000, 50000 ] 6 0.001% 100.183% ( 50000, 75000 ] 1 0.000% 100.183% ( 75000, 110000 ] 1 0.000% 100.183% ** Level 5 read latency histogram (micros): Count: 276120 Average: 309.7259 StdDev: 678.44 Min: 73 Median: 160.9641 Max: 56762 Percentiles: P50: 160.96 P75: 259.87 P99: 2983.35 P99.9: 6348.38 P99.99: 23035.22 ------------------------------------------------------ ( 51, 76 ] 11 0.004% 0.004% ( 76, 110 ] 36069 13.063% 13.067% ### ( 110, 170 ] 120061 43.481% 56.548% ######### ( 170, 250 ] 49154 17.802% 74.350% #### ( 250, 380 ] 23645 8.563% 82.913% ## ( 380, 580 ] 21218 7.684% 90.598% ## ( 580, 870 ] 11674 4.228% 94.825% # ( 870, 1300 ] 6397 2.317% 97.142% ( 1300, 1900 ] 2962 1.073% 98.215% ( 1900, 2900 ] 2059 0.746% 98.961% ( 2900, 4400 ] 1958 0.709% 99.670% ( 4400, 6600 ] 718 0.260% 99.930% ( 6600, 9900 ] 108 0.039% 99.969% ( 9900, 14000 ] 27 0.010% 99.979% ( 14000, 22000 ] 28 0.010% 99.989% ( 22000, 33000 ] 36 0.013% 100.002% ( 33000, 50000 ] 6 0.002% 100.004% ( 50000, 75000 ] 3 0.001% 100.005% ** DB Stats ** Uptime(secs): 31.4 total, 14.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 125.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.395 H:M:S, 52.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 69.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.231 H:M:S, 72.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 243.693 micros/op 16404 ops/sec 60.166 seconds 986996 operations; 15.9 MB/s (244999 of 244999 found) Microseconds per read: Count: 986996 Average: 243.6945 StdDev: 664.73 Min: 1 Median: 169.1164 Max: 89251 Percentiles: P50: 169.12 P75: 232.27 P99: 1245.82 P99.9: 11052.42 P99.99: 27010.19 ------------------------------------------------------ [ 0, 1 ] 2 0.000% 0.000% ( 1, 2 ] 20 0.002% 0.002% ( 2, 3 ] 49 0.005% 0.007% ( 3, 4 ] 51 0.005% 0.012% ( 4, 6 ] 98 0.010% 0.022% ( 6, 10 ] 451 0.046% 0.068% ( 10, 15 ] 4044 0.410% 0.478% ( 15, 22 ] 4705 0.477% 0.954% ( 22, 34 ] 11240 1.139% 2.093% ( 34, 51 ] 2495 0.253% 2.346% ( 51, 76 ] 259 0.026% 2.372% ( 76, 110 ] 23902 2.422% 4.794% ( 110, 170 ] 452851 45.882% 50.676% ######### ( 170, 250 ] 308462 31.253% 81.928% ###### ( 250, 380 ] 97503 9.879% 91.807% ## ( 380, 580 ] 44077 4.466% 96.273% # ( 580, 870 ] 19482 1.974% 98.247% ( 870, 1300 ] 8507 0.862% 99.109% ( 1300, 1900 ] 3363 0.341% 99.449% ( 1900, 2900 ] 2055 0.208% 99.658% ( 2900, 4400 ] 1491 0.151% 99.809% ( 4400, 6600 ] 454 0.046% 99.855% ( 6600, 9900 ] 301 0.030% 99.885% ( 9900, 14000 ] 523 0.053% 99.938% ( 14000, 22000 ] 454 0.046% 99.984% ( 22000, 33000 ] 128 0.013% 99.997% ( 33000, 50000 ] 20 0.002% 99.999% ( 50000, 75000 ] 8 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 11859822 rocksdb.bloom.filter.full.positive COUNT : 1102049 rocksdb.bloom.filter.full.true.positive COUNT : 986606 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 390 rocksdb.memtable.miss COUNT : 986606 rocksdb.l0.hit COUNT : 38264 rocksdb.l1.hit COUNT : 13206 rocksdb.l2andup.hit COUNT : 935136 rocksdb.compaction.key.drop.new COUNT : 183012 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4182236 rocksdb.number.keys.read COUNT : 986996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4316067552 rocksdb.bytes.read COUNT : 986996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1651 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44130836 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24495736972 rocksdb.compact.write.bytes COUNT : 24301751740 rocksdb.flush.write.bytes COUNT : 4293933563 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 36 rocksdb.number.superversion_acquires COUNT : 973 rocksdb.number.superversion_releases COUNT : 925 rocksdb.number.superversion_cleanups COUNT : 240 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 216 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4259090432 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1464320 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28443324096 rocksdb.non.last.level.read.count COUNT : 6731620 rocksdb.block.checksum.compute.count COUNT : 7043393 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 168.238023 P95 : 522.197917 P99 : 1245.177276 P100 : 89251.000000 COUNT : 986996 SUM : 239698733 rocksdb.db.write.micros P50 : 1.572714 P95 : 4.650290 P99 : 13.046903 P100 : 604028.000000 COUNT : 4182236 SUM : 54691620 rocksdb.compaction.times.micros P50 : 1083125.000000 P95 : 3530000.000000 P99 : 22990000.000000 P100 : 23805785.000000 COUNT : 91 SUM : 147741206 rocksdb.compaction.times.cpu_micros P50 : 820961.538462 P95 : 3215000.000000 P99 : 14720000.000000 P100 : 15407968.000000 COUNT : 91 SUM : 101674985 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 756.351351 P95 : 1855.000000 P99 : 39290.000000 P100 : 48979.000000 COUNT : 63 SUM : 112753 rocksdb.compaction.outfile.sync.micros P50 : 12265.384615 P95 : 161000.000000 P99 : 235600.000000 P100 : 262929.000000 COUNT : 280 SUM : 9892414 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 175.454545 P95 : 2975.000000 P99 : 6050.000000 P100 : 7024.000000 COUNT : 175 SUM : 125871 rocksdb.table.open.io.micros P50 : 8164.980916 P95 : 17888.435374 P99 : 21482.448980 P100 : 84920.000000 COUNT : 1651 SUM : 13318350 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.841897 P95 : 12.629201 P99 : 180.201409 P100 : 81437.000000 COUNT : 5931076 SUM : 90268008 rocksdb.read.block.get.micros P50 : 142.621024 P95 : 438.234911 P99 : 1200.824323 P100 : 56768.000000 COUNT : 1110678 SUM : 208901496 rocksdb.write.raw.block.micros P50 : 0.528694 P95 : 1.121947 P99 : 3.570316 P100 : 64002.000000 COUNT : 6926166 SUM : 16565669 rocksdb.numfiles.in.singlecompaction P50 : 2.796875 P95 : 5.471429 P99 : 14.150000 P100 : 18.000000 COUNT : 117 SUM : 408 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563256 P95 : 1218.694064 P99 : 2639.249046 P100 : 603847.000000 COUNT : 271139 SUM : 44150075 rocksdb.sst.read.micros P50 : 1.951624 P95 : 166.172529 P99 : 491.422213 P100 : 81432.000000 COUNT : 6731697 SUM : 280146604 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 986996 SUM : 986996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4182236 SUM : 4316067552 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214210.526316 P95 : 460750.000000 P99 : 985800.000000 P100 : 989377.000000 COUNT : 63 SUM : 14727420 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 302 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0