[2024-07-23 18:58:02.197596] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 22.11.4 initialization... [2024-07-23 18:58:02.197736] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1774011 ] Set seed to 1721753882194282 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-23 18:58:02.283437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-23 18:58:02.322969] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-23 18:58:02.323019] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1774011' to capture a snapshot of events at runtime. [2024-07-23 18:58:02.323034] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1774011 for offline analysis/debug. [2024-07-23 18:58:02.323070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Jul 23 18:58:06 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/23-18:58:15 ... thread 0: (1000000,1000000) ops and (108932.4,108932.4) ops/second in (9.180007,9.180007) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.56 GB 44.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 32.6 117.3 9.66 3.91 11 0.878 319K 365 0.0 0.0 L1 7/7 556.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 32/8 2.68 GB 1.8 2.4 1.9 0.5 2.4 1.9 0.3 1.3 104.2 103.2 23.47 11.81 11 2.134 550K 0 0.0 0.0 L4 214/30 12.43 GB 1.2 4.4 2.7 1.7 4.4 2.6 0.0 1.6 105.0 103.4 43.25 21.81 33 1.311 1766K 6707 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/55 106.41 GB 0.0 7.1 4.6 2.6 7.8 5.3 0.3 9.8 95.6 105.1 76.38 37.53 55 1.389 2636K 7072 0.0 0.0 Int 0/0 0.00 KB 0.0 7.1 4.6 2.6 7.8 5.3 0.3 9.8 95.6 105.1 76.38 37.53 55 1.389 2636K 7072 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.1 4.6 2.6 7.0 4.5 0.0 0.0 105.5 104.2 69.21 34.99 45 1.538 2636K 7072 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 114.1 7.18 2.54 10 0.718 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.2 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.84 GB write, 856.83 MB/s write, 7.13 GB read, 779.48 MB/s read, 76.4 seconds Interval compaction: 7.84 GB write, 874.33 MB/s write, 7.13 GB read, 795.40 MB/s read, 76.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 9, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 331389 Average: 17.3601 StdDev: 293.08 Min: 1 Median: 1.8629 Max: 36957 Percentiles: P50: 1.86 P75: 2.98 P99: 14.43 P99.9: 3048.45 P99.99: 5612.88 ------------------------------------------------------ [ 0, 1 ] 20030 6.044% 6.044% # ( 1, 2 ] 168811 50.940% 56.985% ########## ( 2, 3 ] 60942 18.390% 75.375% #### ( 3, 4 ] 33095 9.987% 85.361% ## ( 4, 6 ] 35207 10.624% 95.985% ## ( 6, 10 ] 8339 2.516% 98.502% # ( 10, 15 ] 1864 0.562% 99.064% ( 15, 22 ] 226 0.068% 99.132% ( 22, 34 ] 35 0.011% 99.143% ( 34, 51 ] 25 0.008% 99.151% ( 51, 76 ] 28 0.008% 99.159% ( 76, 110 ] 16 0.005% 99.164% ( 110, 170 ] 27 0.008% 99.172% ( 170, 250 ] 65 0.020% 99.192% ( 250, 380 ] 195 0.059% 99.250% ( 380, 580 ] 365 0.110% 99.361% ( 580, 870 ] 578 0.174% 99.535% ( 870, 1300 ] 572 0.173% 99.708% ( 1300, 1900 ] 341 0.103% 99.810% ( 1900, 2900 ] 269 0.081% 99.892% ( 2900, 4400 ] 279 0.084% 99.976% ( 4400, 6600 ] 85 0.026% 100.002% ( 6600, 9900 ] 16 0.005% 100.006% ( 9900, 14000 ] 11 0.003% 100.010% ( 14000, 22000 ] 13 0.004% 100.014% ( 22000, 33000 ] 13 0.004% 100.018% ( 33000, 50000 ] 3 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 40709 Average: 20.6909 StdDev: 377.01 Min: 1 Median: 2.1441 Max: 35183 Percentiles: P50: 2.14 P75: 3.48 P99: 17.77 P99.9: 3795.19 P99.99: 20286.56 ------------------------------------------------------ [ 0, 1 ] 767 1.884% 1.884% ( 1, 2 ] 18265 44.867% 46.751% ######### ( 2, 3 ] 9179 22.548% 69.299% ##### ( 3, 4 ] 4854 11.924% 81.223% ## ( 4, 6 ] 5418 13.309% 94.532% ### ( 6, 10 ] 1465 3.599% 98.131% # ( 10, 15 ] 329 0.808% 98.939% ( 15, 22 ] 63 0.155% 99.094% ( 22, 34 ] 8 0.020% 99.113% ( 34, 51 ] 10 0.025% 99.138% ( 51, 76 ] 10 0.025% 99.162% ( 76, 110 ] 3 0.007% 99.170% ( 110, 170 ] 4 0.010% 99.180% ( 170, 250 ] 5 0.012% 99.192% ( 250, 380 ] 13 0.032% 99.224% ( 380, 580 ] 50 0.123% 99.347% ( 580, 870 ] 63 0.155% 99.501% ( 870, 1300 ] 70 0.172% 99.673% ( 1300, 1900 ] 37 0.091% 99.764% ( 1900, 2900 ] 35 0.086% 99.850% ( 2900, 4400 ] 34 0.084% 99.934% ( 4400, 6600 ] 11 0.027% 99.961% ( 6600, 9900 ] 5 0.012% 99.973% ( 9900, 14000 ] 3 0.007% 99.980% ( 14000, 22000 ] 5 0.012% 99.993% ( 22000, 33000 ] 2 0.005% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 283132 Average: 14.0949 StdDev: 204.58 Min: 1 Median: 1.9464 Max: 24574 Percentiles: P50: 1.95 P75: 3.15 P99: 13.47 P99.9: 2704.83 P99.99: 4793.11 ------------------------------------------------------ [ 0, 1 ] 10967 3.873% 3.873% # ( 1, 2 ] 137990 48.737% 52.610% ########## ( 2, 3 ] 58821 20.775% 73.386% #### ( 3, 4 ] 30540 10.786% 84.172% ## ( 4, 6 ] 32182 11.366% 95.538% ## ( 6, 10 ] 8389 2.963% 98.501% # ( 10, 15 ] 2036 0.719% 99.221% ( 15, 22 ] 294 0.104% 99.324% ( 22, 34 ] 51 0.018% 99.342% ( 34, 51 ] 16 0.006% 99.348% ( 51, 76 ] 26 0.009% 99.357% ( 76, 110 ] 14 0.005% 99.362% ( 110, 170 ] 33 0.012% 99.374% ( 170, 250 ] 48 0.017% 99.391% ( 250, 380 ] 117 0.041% 99.432% ( 380, 580 ] 208 0.073% 99.506% ( 580, 870 ] 337 0.119% 99.625% ( 870, 1300 ] 347 0.123% 99.747% ( 1300, 1900 ] 255 0.090% 99.837% ( 1900, 2900 ] 221 0.078% 99.915% ( 2900, 4400 ] 199 0.070% 99.986% ( 4400, 6600 ] 71 0.025% 100.011% ( 6600, 9900 ] 19 0.007% 100.017% ( 9900, 14000 ] 5 0.002% 100.019% ( 14000, 22000 ] 7 0.002% 100.022% ( 22000, 33000 ] 2 0.001% 100.022% ** Level 3 read latency histogram (micros): Count: 841511 Average: 12.2135 StdDev: 229.55 Min: 1 Median: 1.9157 Max: 60834 Percentiles: P50: 1.92 P75: 3.08 P99: 10.41 P99.9: 1090.23 P99.99: 1635.17 ------------------------------------------------------ [ 0, 1 ] 33831 4.020% 4.020% # ( 1, 2 ] 422542 50.212% 54.233% ########## ( 2, 3 ] 167493 19.904% 74.136% #### ( 3, 4 ] 90704 10.779% 84.915% ## ( 4, 6 ] 96726 11.494% 96.409% ## ( 6, 10 ] 21384 2.541% 98.951% # ( 10, 15 ] 5077 0.603% 99.554% ( 15, 22 ] 606 0.072% 99.626% ( 22, 34 ] 69 0.008% 99.634% ( 34, 51 ] 61 0.007% 99.641% ( 51, 76 ] 66 0.008% 99.649% ( 76, 110 ] 28 0.003% 99.653% ( 110, 170 ] 54 0.006% 99.659% ( 170, 250 ] 101 0.012% 99.671% ( 250, 380 ] 215 0.026% 99.696% ( 380, 580 ] 490 0.058% 99.755% ( 580, 870 ] 783 0.093% 99.848% ( 870, 1300 ] 862 0.102% 99.950% ( 1300, 1900 ] 603 0.072% 100.022% ( 1900, 2900 ] 495 0.059% 100.081% ( 2900, 4400 ] 476 0.057% 100.137% ( 4400, 6600 ] 141 0.017% 100.154% ( 6600, 9900 ] 42 0.005% 100.159% ( 9900, 14000 ] 25 0.003% 100.162% ( 14000, 22000 ] 22 0.003% 100.165% ( 22000, 33000 ] 11 0.001% 100.166% ( 33000, 50000 ] 4 0.000% 100.166% ( 50000, 75000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 570687 Average: 26.9830 StdDev: 394.01 Min: 1 Median: 1.8978 Max: 59489 Percentiles: P50: 1.90 P75: 3.08 P99: 500.18 P99.9: 2724.54 P99.99: 3614.82 ------------------------------------------------------ [ 0, 1 ] 25877 4.534% 4.534% # ( 1, 2 ] 288998 50.640% 55.175% ########## ( 2, 3 ] 108470 19.007% 74.182% #### ( 3, 4 ] 60686 10.634% 84.815% ## ( 4, 6 ] 60928 10.676% 95.492% ## ( 6, 10 ] 14826 2.598% 98.090% # ( 10, 15 ] 3473 0.609% 98.698% ( 15, 22 ] 416 0.073% 98.771% ( 22, 34 ] 44 0.008% 98.779% ( 34, 51 ] 49 0.009% 98.787% ( 51, 76 ] 39 0.007% 98.794% ( 76, 110 ] 20 0.004% 98.798% ( 110, 170 ] 74 0.013% 98.811% ( 170, 250 ] 175 0.031% 98.841% ( 250, 380 ] 411 0.072% 98.913% ( 380, 580 ] 824 0.144% 99.058% ( 580, 870 ] 1418 0.248% 99.306% ( 870, 1300 ] 1564 0.274% 99.580% ( 1300, 1900 ] 1089 0.191% 99.771% ( 1900, 2900 ] 893 0.156% 99.928% ( 2900, 4400 ] 749 0.131% 100.059% ( 4400, 6600 ] 266 0.047% 100.105% ( 6600, 9900 ] 52 0.009% 100.115% ( 9900, 14000 ] 25 0.004% 100.119% ( 14000, 22000 ] 46 0.008% 100.127% ( 22000, 33000 ] 28 0.005% 100.132% ( 33000, 50000 ] 7 0.001% 100.133% ( 50000, 75000 ] 4 0.001% 100.134% ** Level 5 read latency histogram (micros): Count: 14094 Average: 1834.1950 StdDev: 2409.45 Min: 83 Median: 1168.1740 Max: 77320 Percentiles: P50: 1168.17 P75: 2398.41 P99: 8764.18 P99.9: 32950.76 P99.99: 69882.50 ------------------------------------------------------ ( 76, 110 ] 4 0.028% 0.028% ( 110, 170 ] 72 0.511% 0.539% ( 170, 250 ] 221 1.568% 2.107% ( 250, 380 ] 693 4.917% 7.024% # ( 380, 580 ] 1634 11.594% 18.618% ## ( 580, 870 ] 2566 18.206% 36.824% #### ( 870, 1300 ] 2678 19.001% 55.825% #### ( 1300, 1900 ] 1918 13.609% 69.434% ### ( 1900, 2900 ] 1574 11.168% 80.602% ## ( 2900, 4400 ] 1716 12.175% 92.777% ## ( 4400, 6600 ] 780 5.534% 98.311% # ( 6600, 9900 ] 148 1.050% 99.361% ( 9900, 14000 ] 24 0.170% 99.532% ( 14000, 22000 ] 31 0.220% 99.752% ( 22000, 33000 ] 21 0.149% 99.901% ( 33000, 50000 ] 11 0.078% 99.979% ( 50000, 75000 ] 2 0.014% 99.993% ( 75000, 110000 ] 1 0.007% 100.000% ** DB Stats ** Uptime(secs): 9.4 total, 9.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 105.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.111 H:M:S, 54.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 107.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.111 H:M:S, 55.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/23-18:58:20 ... thread 0: (1000000,2000000) ops and (224959.5,146786.3) ops/second in (4.445245,13.625252) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.61 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 77.4 170.1 20.35 12.05 30 0.678 1599K 1879 0.0 0.0 L1 7/7 556.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 990.07 MB 1.0 2.4 1.9 0.5 2.4 1.9 0.3 1.3 104.2 103.2 23.47 11.81 11 2.134 550K 0 0.0 0.0 L4 171/0 9.48 GB 1.0 7.4 4.3 3.1 7.3 4.2 0.1 1.7 111.4 109.7 68.07 36.69 46 1.480 2853K 6869 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/17 107.41 GB 0.0 11.3 6.2 5.1 13.0 7.9 5.0 7.1 103.7 119.3 111.90 60.55 87 1.286 5003K 8748 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 6.2 5.1 13.0 7.9 5.0 7.1 103.7 119.3 111.90 60.55 87 1.286 5003K 8748 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 6.2 5.1 11.2 6.1 0.0 0.0 115.6 114.2 100.36 55.03 62 1.619 5003K 8748 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 163.8 11.54 5.52 25 0.461 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.8 total, 13.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.04 GB write, 966.63 MB/s write, 11.33 GB read, 839.89 MB/s read, 111.9 seconds Interval compaction: 13.04 GB write, 979.93 MB/s write, 11.33 GB read, 851.45 MB/s read, 111.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 17, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 619132 Average: 17.6950 StdDev: 238.54 Min: 0 Median: 1.7250 Max: 36957 Percentiles: P50: 1.73 P75: 2.66 P99: 340.12 P99.9: 2399.69 P99.99: 4143.69 ------------------------------------------------------ [ 0, 1 ] 66786 10.787% 10.787% ## ( 1, 2 ] 334862 54.086% 64.873% ########### ( 2, 3 ] 94620 15.283% 80.155% ### ( 3, 4 ] 47943 7.744% 87.899% ## ( 4, 6 ] 48518 7.836% 95.735% ## ( 6, 10 ] 10838 1.751% 97.486% ( 10, 15 ] 2403 0.388% 97.874% ( 15, 22 ] 275 0.044% 97.919% ( 22, 34 ] 37 0.006% 97.925% ( 34, 51 ] 27 0.004% 97.929% ( 51, 76 ] 33 0.005% 97.934% ( 76, 110 ] 588 0.095% 98.029% ( 110, 170 ] 2879 0.465% 98.494% ( 170, 250 ] 2078 0.336% 98.830% ( 250, 380 ] 1520 0.246% 99.075% ( 380, 580 ] 1627 0.263% 99.338% ( 580, 870 ] 1535 0.248% 99.586% ( 870, 1300 ] 1150 0.186% 99.772% ( 1300, 1900 ] 581 0.094% 99.866% ( 1900, 2900 ] 426 0.069% 99.934% ( 2900, 4400 ] 415 0.067% 100.001% ( 4400, 6600 ] 109 0.018% 100.019% ( 6600, 9900 ] 20 0.003% 100.022% ( 9900, 14000 ] 11 0.002% 100.024% ( 14000, 22000 ] 13 0.002% 100.026% ( 22000, 33000 ] 15 0.002% 100.029% ( 33000, 50000 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 105590 Average: 11.4143 StdDev: 236.31 Min: 1 Median: 2.5892 Max: 35183 Percentiles: P50: 2.59 P75: 3.88 P99: 16.98 P99.9: 1863.00 P99.99: 10502.70 ------------------------------------------------------ [ 0, 1 ] 1341 1.270% 1.270% ( 1, 2 ] 35921 34.019% 35.289% ####### ( 2, 3 ] 26364 24.968% 60.258% ##### ( 3, 4 ] 17719 16.781% 77.039% ### ( 4, 6 ] 16819 15.929% 92.967% ### ( 6, 10 ] 5147 4.875% 97.842% # ( 10, 15 ] 1116 1.057% 98.899% ( 15, 22 ] 378 0.358% 99.257% ( 22, 34 ] 42 0.040% 99.296% ( 34, 51 ] 16 0.015% 99.311% ( 51, 76 ] 19 0.018% 99.329% ( 76, 110 ] 40 0.038% 99.367% ( 110, 170 ] 134 0.127% 99.494% ( 170, 250 ] 83 0.079% 99.573% ( 250, 380 ] 57 0.054% 99.627% ( 380, 580 ] 86 0.081% 99.708% ( 580, 870 ] 82 0.078% 99.786% ( 870, 1300 ] 81 0.077% 99.863% ( 1300, 1900 ] 42 0.040% 99.902% ( 1900, 2900 ] 40 0.038% 99.940% ( 2900, 4400 ] 35 0.033% 99.973% ( 4400, 6600 ] 12 0.011% 99.985% ( 6600, 9900 ] 5 0.005% 99.990% ( 9900, 14000 ] 3 0.003% 99.992% ( 14000, 22000 ] 5 0.005% 99.997% ( 22000, 33000 ] 2 0.002% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 283190 Average: 14.1617 StdDev: 204.66 Min: 1 Median: 1.9466 Max: 24574 Percentiles: P50: 1.95 P75: 3.15 P99: 13.61 P99.9: 2704.57 P99.99: 4792.93 ------------------------------------------------------ [ 0, 1 ] 10967 3.873% 3.873% # ( 1, 2 ] 137990 48.727% 52.600% ########## ( 2, 3 ] 58821 20.771% 73.371% #### ( 3, 4 ] 30540 10.784% 84.155% ## ( 4, 6 ] 32182 11.364% 95.519% ## ( 6, 10 ] 8389 2.962% 98.481% # ( 10, 15 ] 2036 0.719% 99.200% ( 15, 22 ] 294 0.104% 99.304% ( 22, 34 ] 51 0.018% 99.322% ( 34, 51 ] 16 0.006% 99.328% ( 51, 76 ] 26 0.009% 99.337% ( 76, 110 ] 21 0.007% 99.344% ( 110, 170 ] 49 0.017% 99.362% ( 170, 250 ] 62 0.022% 99.383% ( 250, 380 ] 122 0.043% 99.427% ( 380, 580 ] 213 0.075% 99.502% ( 580, 870 ] 342 0.121% 99.623% ( 870, 1300 ] 352 0.124% 99.747% ( 1300, 1900 ] 256 0.090% 99.837% ( 1900, 2900 ] 221 0.078% 99.915% ( 2900, 4400 ] 199 0.070% 99.986% ( 4400, 6600 ] 71 0.025% 100.011% ( 6600, 9900 ] 19 0.007% 100.017% ( 9900, 14000 ] 5 0.002% 100.019% ( 14000, 22000 ] 7 0.002% 100.022% ( 22000, 33000 ] 2 0.001% 100.022% ** Level 3 read latency histogram (micros): Count: 1130163 Average: 11.0231 StdDev: 204.81 Min: 1 Median: 1.9054 Max: 60834 Percentiles: P50: 1.91 P75: 3.01 P99: 10.48 P99.9: 957.89 P99.99: 1448.93 ------------------------------------------------------ [ 0, 1 ] 42565 3.766% 3.766% # ( 1, 2 ] 577132 51.066% 54.833% ########## ( 2, 3 ] 226475 20.039% 74.872% #### ( 3, 4 ] 118070 10.447% 85.319% ## ( 4, 6 ] 125382 11.094% 96.413% ## ( 6, 10 ] 28574 2.528% 98.941% # ( 10, 15 ] 6982 0.618% 99.559% ( 15, 22 ] 828 0.073% 99.632% ( 22, 34 ] 83 0.007% 99.640% ( 34, 51 ] 84 0.007% 99.647% ( 51, 76 ] 84 0.007% 99.655% ( 76, 110 ] 82 0.007% 99.662% ( 110, 170 ] 214 0.019% 99.681% ( 170, 250 ] 214 0.019% 99.700% ( 250, 380 ] 333 0.029% 99.729% ( 380, 580 ] 693 0.061% 99.790% ( 580, 870 ] 1022 0.090% 99.881% ( 870, 1300 ] 1056 0.093% 99.974% ( 1300, 1900 ] 713 0.063% 100.037% ( 1900, 2900 ] 580 0.051% 100.089% ( 2900, 4400 ] 564 0.050% 100.139% ( 4400, 6600 ] 157 0.014% 100.153% ( 6600, 9900 ] 42 0.004% 100.156% ( 9900, 14000 ] 25 0.002% 100.158% ( 14000, 22000 ] 23 0.002% 100.161% ( 22000, 33000 ] 11 0.001% 100.161% ( 33000, 50000 ] 4 0.000% 100.162% ( 50000, 75000 ] 1 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 806113 Average: 24.0695 StdDev: 342.32 Min: 1 Median: 1.8817 Max: 59489 Percentiles: P50: 1.88 P75: 3.00 P99: 420.82 P99.9: 2459.44 P99.99: 3349.81 ------------------------------------------------------ [ 0, 1 ] 35221 4.369% 4.369% # ( 1, 2 ] 417212 51.756% 56.125% ########## ( 2, 3 ] 152352 18.900% 75.025% #### ( 3, 4 ] 81933 10.164% 85.189% ## ( 4, 6 ] 80994 10.047% 95.236% ## ( 6, 10 ] 20073 2.490% 97.726% ( 10, 15 ] 4758 0.590% 98.317% ( 15, 22 ] 578 0.072% 98.388% ( 22, 34 ] 61 0.008% 98.396% ( 34, 51 ] 62 0.008% 98.404% ( 51, 76 ] 54 0.007% 98.410% ( 76, 110 ] 386 0.048% 98.458% ( 110, 170 ] 1616 0.200% 98.659% ( 170, 250 ] 1264 0.157% 98.815% ( 250, 380 ] 1164 0.144% 98.960% ( 380, 580 ] 1587 0.197% 99.157% ( 580, 870 ] 2054 0.255% 99.411% ( 870, 1300 ] 2033 0.252% 99.664% ( 1300, 1900 ] 1313 0.163% 99.827% ( 1900, 2900 ] 1058 0.131% 99.958% ( 2900, 4400 ] 865 0.107% 100.065% ( 4400, 6600 ] 288 0.036% 100.101% ( 6600, 9900 ] 56 0.007% 100.108% ( 9900, 14000 ] 27 0.003% 100.111% ( 14000, 22000 ] 48 0.006% 100.117% ( 22000, 33000 ] 28 0.003% 100.121% ( 33000, 50000 ] 7 0.001% 100.121% ( 50000, 75000 ] 4 0.000% 100.122% ** Level 5 read latency histogram (micros): Count: 45542 Average: 832.5268 StdDev: 1567.49 Min: 74 Median: 353.8738 Max: 77320 Percentiles: P50: 353.87 P75: 881.54 P99: 6044.91 P99.9: 19279.48 P99.99: 44507.15 ------------------------------------------------------ ( 51, 76 ] 2 0.004% 0.004% ( 76, 110 ] 2454 5.388% 5.393% # ( 110, 170 ] 10122 22.226% 27.618% #### ( 170, 250 ] 6571 14.428% 42.047% ### ( 250, 380 ] 4533 9.953% 52.000% ## ( 380, 580 ] 5295 11.627% 63.627% ## ( 580, 870 ] 5072 11.137% 74.764% ## ( 870, 1300 ] 4006 8.796% 83.560% ## ( 1300, 1900 ] 2508 5.507% 89.067% # ( 1900, 2900 ] 1910 4.194% 93.261% # ( 2900, 4400 ] 1993 4.376% 97.637% # ( 4400, 6600 ] 830 1.822% 99.460% ( 6600, 9900 ] 154 0.338% 99.798% ( 9900, 14000 ] 26 0.057% 99.855% ( 14000, 22000 ] 31 0.068% 99.923% ( 22000, 33000 ] 23 0.051% 99.974% ( 33000, 50000 ] 11 0.024% 99.998% ( 50000, 75000 ] 2 0.004% 100.002% ( 75000, 110000 ] 1 0.002% 100.004% ** DB Stats ** Uptime(secs): 13.8 total, 4.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 142.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.013 H:M:S, 43.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 221.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.902 H:M:S, 20.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/23-18:58:23 ... thread 0: (1000000,3000000) ops and (289188.2,175611.0) ops/second in (3.457956,17.083208) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.77 GB 6.3 2.3 0.0 2.3 5.0 2.8 0.0 1.8 88.8 196.7 26.25 17.43 48 0.547 2366K 2673 0.0 0.0 L1 15/15 1.30 GB 0.0 1.3 0.8 0.5 1.3 0.8 0.0 1.7 86.2 85.8 15.52 7.55 1 15.518 1358K 6751 0.0 0.0 L3 16/0 990.07 MB 1.0 2.4 1.9 0.5 2.4 1.9 0.3 1.3 104.2 103.2 23.47 11.81 11 2.134 550K 0 0.0 0.0 L4 171/0 9.48 GB 1.0 7.4 4.3 3.1 7.3 4.2 0.1 1.7 111.4 109.7 68.07 36.69 46 1.480 2853K 6869 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1358/30 108.32 GB 0.0 13.4 7.0 6.4 16.0 9.6 5.0 5.8 102.7 122.9 133.31 73.48 106 1.258 7129K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 7.0 6.4 16.0 9.6 5.0 5.8 102.7 122.9 133.31 73.48 106 1.258 7129K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 7.0 6.4 13.2 6.8 0.0 0.0 115.3 114.1 118.76 65.36 66 1.799 7129K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 194.9 14.54 8.12 40 0.364 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.3 total, 17.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.00 GB write, 948.60 MB/s write, 13.38 GB read, 792.96 MB/s read, 133.3 seconds Interval compaction: 16.00 GB write, 959.01 MB/s write, 13.38 GB read, 801.66 MB/s read, 133.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 17, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 843182 Average: 16.0735 StdDev: 206.67 Min: 0 Median: 1.6523 Max: 36957 Percentiles: P50: 1.65 P75: 2.46 P99: 293.43 P99.9: 1797.95 P99.99: 3705.74 ------------------------------------------------------ [ 0, 1 ] 123292 14.622% 14.622% ### ( 1, 2 ] 457312 54.236% 68.859% ########### ( 2, 3 ] 113415 13.451% 82.310% ### ( 3, 4 ] 57217 6.786% 89.095% # ( 4, 6 ] 54143 6.421% 95.517% # ( 6, 10 ] 11972 1.420% 96.936% ( 10, 15 ] 2695 0.320% 97.256% ( 15, 22 ] 296 0.035% 97.291% ( 22, 34 ] 40 0.005% 97.296% ( 34, 51 ] 28 0.003% 97.299% ( 51, 76 ] 35 0.004% 97.303% ( 76, 110 ] 1791 0.212% 97.516% ( 110, 170 ] 7372 0.874% 98.390% ( 170, 250 ] 4309 0.511% 98.901% ( 250, 380 ] 2494 0.296% 99.197% ( 380, 580 ] 2439 0.289% 99.486% ( 580, 870 ] 1810 0.215% 99.701% ( 870, 1300 ] 1190 0.141% 99.842% ( 1300, 1900 ] 589 0.070% 99.912% ( 1900, 2900 ] 432 0.051% 99.963% ( 2900, 4400 ] 422 0.050% 100.013% ( 4400, 6600 ] 110 0.013% 100.026% ( 6600, 9900 ] 20 0.002% 100.029% ( 9900, 14000 ] 11 0.001% 100.030% ( 14000, 22000 ] 13 0.002% 100.031% ( 22000, 33000 ] 15 0.002% 100.033% ( 33000, 50000 ] 3 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 145364 Average: 10.9165 StdDev: 203.03 Min: 1 Median: 2.7388 Max: 35183 Percentiles: P50: 2.74 P75: 3.97 P99: 118.35 P99.9: 1335.95 P99.99: 7565.98 ------------------------------------------------------ [ 0, 1 ] 1954 1.344% 1.344% ( 1, 2 ] 43600 29.994% 31.338% ###### ( 2, 3 ] 36721 25.261% 56.599% ##### ( 3, 4 ] 27683 19.044% 75.643% #### ( 4, 6 ] 24118 16.591% 92.235% ### ( 6, 10 ] 7250 4.987% 97.222% # ( 10, 15 ] 1575 1.083% 98.306% ( 15, 22 ] 669 0.460% 98.766% ( 22, 34 ] 63 0.043% 98.809% ( 34, 51 ] 18 0.012% 98.822% ( 51, 76 ] 20 0.014% 98.835% ( 76, 110 ] 160 0.110% 98.945% ( 110, 170 ] 570 0.392% 99.338% ( 170, 250 ] 279 0.192% 99.529% ( 250, 380 ] 165 0.114% 99.643% ( 380, 580 ] 158 0.109% 99.752% ( 580, 870 ] 113 0.078% 99.829% ( 870, 1300 ] 100 0.069% 99.898% ( 1300, 1900 ] 44 0.030% 99.928% ( 1900, 2900 ] 40 0.028% 99.956% ( 2900, 4400 ] 36 0.025% 99.981% ( 4400, 6600 ] 12 0.008% 99.989% ( 6600, 9900 ] 5 0.003% 99.992% ( 9900, 14000 ] 3 0.002% 99.994% ( 14000, 22000 ] 5 0.003% 99.998% ( 22000, 33000 ] 2 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 283285 Average: 14.2263 StdDev: 204.67 Min: 1 Median: 1.9470 Max: 24574 Percentiles: P50: 1.95 P75: 3.15 P99: 13.84 P99.9: 2704.14 P99.99: 4792.64 ------------------------------------------------------ [ 0, 1 ] 10967 3.871% 3.871% # ( 1, 2 ] 137990 48.711% 52.582% ########## ( 2, 3 ] 58821 20.764% 73.346% #### ( 3, 4 ] 30540 10.781% 84.127% ## ( 4, 6 ] 32182 11.360% 95.487% ## ( 6, 10 ] 8389 2.961% 98.448% # ( 10, 15 ] 2036 0.719% 99.167% ( 15, 22 ] 294 0.104% 99.271% ( 22, 34 ] 51 0.018% 99.289% ( 34, 51 ] 16 0.006% 99.294% ( 51, 76 ] 26 0.009% 99.304% ( 76, 110 ] 30 0.011% 99.314% ( 110, 170 ] 91 0.032% 99.346% ( 170, 250 ] 90 0.032% 99.378% ( 250, 380 ] 128 0.045% 99.423% ( 380, 580 ] 220 0.078% 99.501% ( 580, 870 ] 345 0.122% 99.623% ( 870, 1300 ] 352 0.124% 99.747% ( 1300, 1900 ] 256 0.090% 99.837% ( 1900, 2900 ] 221 0.078% 99.915% ( 2900, 4400 ] 199 0.070% 99.986% ( 4400, 6600 ] 71 0.025% 100.011% ( 6600, 9900 ] 19 0.007% 100.017% ( 9900, 14000 ] 5 0.002% 100.019% ( 14000, 22000 ] 7 0.002% 100.022% ( 22000, 33000 ] 2 0.001% 100.022% ** Level 3 read latency histogram (micros): Count: 1130764 Average: 11.1239 StdDev: 204.82 Min: 1 Median: 1.9059 Max: 60834 Percentiles: P50: 1.91 P75: 3.02 P99: 10.90 P99.9: 958.05 P99.99: 1449.52 ------------------------------------------------------ [ 0, 1 ] 42565 3.764% 3.764% # ( 1, 2 ] 577132 51.039% 54.803% ########## ( 2, 3 ] 226475 20.028% 74.832% #### ( 3, 4 ] 118070 10.442% 85.273% ## ( 4, 6 ] 125382 11.088% 96.362% ## ( 6, 10 ] 28574 2.527% 98.889% # ( 10, 15 ] 6982 0.617% 99.506% ( 15, 22 ] 828 0.073% 99.579% ( 22, 34 ] 83 0.007% 99.587% ( 34, 51 ] 84 0.007% 99.594% ( 51, 76 ] 84 0.007% 99.602% ( 76, 110 ] 161 0.014% 99.616% ( 110, 170 ] 498 0.044% 99.660% ( 170, 250 ] 340 0.030% 99.690% ( 250, 380 ] 381 0.034% 99.724% ( 380, 580 ] 747 0.066% 99.790% ( 580, 870 ] 1031 0.091% 99.881% ( 870, 1300 ] 1056 0.093% 99.974% ( 1300, 1900 ] 714 0.063% 100.037% ( 1900, 2900 ] 580 0.051% 100.089% ( 2900, 4400 ] 564 0.050% 100.139% ( 4400, 6600 ] 157 0.014% 100.152% ( 6600, 9900 ] 42 0.004% 100.156% ( 9900, 14000 ] 25 0.002% 100.158% ( 14000, 22000 ] 23 0.002% 100.160% ( 22000, 33000 ] 11 0.001% 100.161% ( 33000, 50000 ] 4 0.000% 100.162% ( 50000, 75000 ] 1 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 813466 Average: 25.5307 StdDev: 341.40 Min: 1 Median: 1.8904 Max: 59489 Percentiles: P50: 1.89 P75: 3.06 P99: 469.93 P99.9: 2453.86 P99.99: 3349.75 ------------------------------------------------------ [ 0, 1 ] 35221 4.330% 4.330% # ( 1, 2 ] 417254 51.293% 55.623% ########## ( 2, 3 ] 152584 18.757% 74.380% #### ( 3, 4 ] 82071 10.089% 84.469% ## ( 4, 6 ] 81201 9.982% 94.452% ## ( 6, 10 ] 20107 2.472% 96.923% ( 10, 15 ] 4766 0.586% 97.509% ( 15, 22 ] 579 0.071% 97.580% ( 22, 34 ] 61 0.007% 97.588% ( 34, 51 ] 62 0.008% 97.595% ( 51, 76 ] 54 0.007% 97.602% ( 76, 110 ] 1297 0.159% 97.762% ( 110, 170 ] 4751 0.584% 98.346% ( 170, 250 ] 2617 0.322% 98.667% ( 250, 380 ] 1776 0.218% 98.886% ( 380, 580 ] 2069 0.254% 99.140% ( 580, 870 ] 2230 0.274% 99.414% ( 870, 1300 ] 2049 0.252% 99.666% ( 1300, 1900 ] 1317 0.162% 99.828% ( 1900, 2900 ] 1059 0.130% 99.958% ( 2900, 4400 ] 866 0.106% 100.065% ( 4400, 6600 ] 288 0.035% 100.100% ( 6600, 9900 ] 56 0.007% 100.107% ( 9900, 14000 ] 27 0.003% 100.110% ( 14000, 22000 ] 48 0.006% 100.116% ( 22000, 33000 ] 28 0.003% 100.119% ( 33000, 50000 ] 7 0.001% 100.120% ( 50000, 75000 ] 4 0.000% 100.121% ** Level 5 read latency histogram (micros): Count: 88153 Average: 531.0496 StdDev: 1174.33 Min: 74 Median: 202.0865 Max: 77320 Percentiles: P50: 202.09 P75: 484.53 P99: 4904.86 P99.9: 9896.72 P99.99: 32610.07 ------------------------------------------------------ ( 51, 76 ] 5 0.006% 0.006% ( 76, 110 ] 8070 9.155% 9.160% ## ( 110, 170 ] 29879 33.894% 43.055% ####### ( 170, 250 ] 15265 17.316% 60.371% ### ( 250, 380 ] 8429 9.562% 69.933% ## ( 380, 580 ] 8546 9.695% 79.627% ## ( 580, 870 ] 6207 7.041% 86.669% # ( 870, 1300 ] 4204 4.769% 91.438% # ( 1300, 1900 ] 2541 2.882% 94.320% # ( 1900, 2900 ] 1931 2.191% 96.511% ( 2900, 4400 ] 2004 2.273% 98.784% ( 4400, 6600 ] 830 0.942% 99.725% ( 6600, 9900 ] 154 0.175% 99.900% ( 9900, 14000 ] 26 0.029% 99.930% ( 14000, 22000 ] 31 0.035% 99.965% ( 22000, 33000 ] 23 0.026% 99.991% ( 33000, 50000 ] 11 0.012% 100.003% ( 50000, 75000 ] 2 0.002% 100.006% ( 75000, 110000 ] 1 0.001% 100.007% ** DB Stats ** Uptime(secs): 17.3 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 170.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.066 H:M:S, 35.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.052 H:M:S, 1.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/23-18:58:28 ... thread 0: (1000000,4000000) ops and (201890.9,181518.0) ops/second in (4.953170,22.036378) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.81 GB 138.5 3.5 0.0 3.5 7.3 3.8 0.0 1.9 104.9 218.9 34.23 24.88 70 0.489 3646K 3980 0.0 0.0 L1 15/15 1.30 GB 0.0 1.3 0.8 0.5 1.3 0.8 0.0 1.7 86.2 85.8 15.52 7.55 1 15.518 1358K 6751 0.0 0.0 L3 16/0 990.07 MB 1.0 2.4 1.9 0.5 2.4 1.9 0.3 1.3 104.2 103.2 23.47 11.81 11 2.134 550K 0 0.0 0.0 L4 171/0 9.48 GB 1.0 7.4 4.3 3.1 7.3 4.2 0.1 1.7 111.4 109.7 68.07 36.69 46 1.480 2853K 6869 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1360/26 109.37 GB 0.0 14.6 7.0 7.6 18.3 10.6 5.0 4.8 105.9 132.5 141.29 80.93 128 1.104 8409K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 7.0 7.6 18.3 10.6 5.0 4.8 105.9 132.5 141.29 80.93 128 1.104 8409K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 7.0 7.6 14.5 6.8 0.0 0.0 121.2 120.0 123.44 69.96 71 1.739 8409K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 218.9 17.85 10.97 57 0.313 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.2 total, 22.0 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.28 GB write, 842.01 MB/s write, 14.61 GB read, 672.93 MB/s read, 141.3 seconds Interval compaction: 18.28 GB write, 849.17 MB/s write, 14.61 GB read, 678.66 MB/s read, 141.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 41, total-stops: 17, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1233218 Average: 14.6817 StdDev: 173.46 Min: 0 Median: 1.5875 Max: 36957 Percentiles: P50: 1.59 P75: 2.23 P99: 246.67 P99.9: 1243.10 P99.99: 2676.07 ------------------------------------------------------ [ 0, 1 ] 224397 18.196% 18.196% #### ( 1, 2 ] 667640 54.138% 72.334% ########### ( 2, 3 ] 145190 11.773% 84.107% ## ( 3, 4 ] 72563 5.884% 89.991% # ( 4, 6 ] 63371 5.139% 95.130% # ( 6, 10 ] 13979 1.134% 96.264% ( 10, 15 ] 3139 0.255% 96.518% ( 15, 22 ] 352 0.029% 96.547% ( 22, 34 ] 47 0.004% 96.550% ( 34, 51 ] 29 0.002% 96.553% ( 51, 76 ] 44 0.004% 96.556% ( 76, 110 ] 4912 0.398% 96.955% ( 110, 170 ] 17263 1.400% 98.355% ( 170, 250 ] 8306 0.674% 99.028% ( 250, 380 ] 3967 0.322% 99.350% ( 380, 580 ] 3567 0.289% 99.639% ( 580, 870 ] 2142 0.174% 99.813% ( 870, 1300 ] 1241 0.101% 99.913% ( 1300, 1900 ] 598 0.048% 99.962% ( 1900, 2900 ] 448 0.036% 99.998% ( 2900, 4400 ] 425 0.034% 100.033% ( 4400, 6600 ] 110 0.009% 100.042% ( 6600, 9900 ] 20 0.002% 100.043% ( 9900, 14000 ] 11 0.001% 100.044% ( 14000, 22000 ] 13 0.001% 100.045% ( 22000, 33000 ] 15 0.001% 100.046% ( 33000, 50000 ] 3 0.000% 100.047% ** Level 1 read latency histogram (micros): Count: 171480 Average: 11.5652 StdDev: 188.30 Min: 1 Median: 2.6249 Max: 35183 Percentiles: P50: 2.62 P75: 3.92 P99: 162.51 P99.9: 1215.32 P99.99: 6206.20 ------------------------------------------------------ [ 0, 1 ] 4392 2.561% 2.561% # ( 1, 2 ] 55761 32.517% 35.079% ####### ( 2, 3 ] 40944 23.877% 58.956% ##### ( 3, 4 ] 29858 17.412% 76.368% ### ( 4, 6 ] 26539 15.476% 91.844% ### ( 6, 10 ] 7962 4.643% 96.487% # ( 10, 15 ] 1732 1.010% 97.497% ( 15, 22 ] 733 0.427% 97.925% ( 22, 34 ] 71 0.041% 97.966% ( 34, 51 ] 18 0.010% 97.976% ( 51, 76 ] 20 0.012% 97.988% ( 76, 110 ] 440 0.257% 98.245% ( 110, 170 ] 1480 0.863% 99.108% ( 170, 250 ] 600 0.350% 99.458% ( 250, 380 ] 292 0.170% 99.628% ( 380, 580 ] 246 0.143% 99.771% ( 580, 870 ] 137 0.080% 99.851% ( 870, 1300 ] 104 0.061% 99.912% ( 1300, 1900 ] 47 0.027% 99.939% ( 1900, 2900 ] 41 0.024% 99.963% ( 2900, 4400 ] 36 0.021% 99.984% ( 4400, 6600 ] 12 0.007% 99.991% ( 6600, 9900 ] 5 0.003% 99.994% ( 9900, 14000 ] 3 0.002% 99.996% ( 14000, 22000 ] 5 0.003% 99.999% ( 22000, 33000 ] 2 0.001% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 283445 Average: 14.3243 StdDev: 204.68 Min: 1 Median: 1.9476 Max: 24574 Percentiles: P50: 1.95 P75: 3.16 P99: 14.23 P99.9: 2703.42 P99.99: 4792.14 ------------------------------------------------------ [ 0, 1 ] 10967 3.869% 3.869% # ( 1, 2 ] 137990 48.683% 52.552% ########## ( 2, 3 ] 58821 20.752% 73.305% #### ( 3, 4 ] 30540 10.775% 84.079% ## ( 4, 6 ] 32182 11.354% 95.433% ## ( 6, 10 ] 8389 2.960% 98.393% # ( 10, 15 ] 2036 0.718% 99.111% ( 15, 22 ] 294 0.104% 99.215% ( 22, 34 ] 51 0.018% 99.233% ( 34, 51 ] 16 0.006% 99.238% ( 51, 76 ] 26 0.009% 99.247% ( 76, 110 ] 50 0.018% 99.265% ( 110, 170 ] 174 0.061% 99.327% ( 170, 250 ] 127 0.045% 99.371% ( 250, 380 ] 139 0.049% 99.420% ( 380, 580 ] 225 0.079% 99.500% ( 580, 870 ] 347 0.122% 99.622% ( 870, 1300 ] 354 0.125% 99.747% ( 1300, 1900 ] 256 0.090% 99.837% ( 1900, 2900 ] 221 0.078% 99.915% ( 2900, 4400 ] 199 0.070% 99.986% ( 4400, 6600 ] 71 0.025% 100.011% ( 6600, 9900 ] 19 0.007% 100.017% ( 9900, 14000 ] 5 0.002% 100.019% ( 14000, 22000 ] 7 0.002% 100.022% ( 22000, 33000 ] 2 0.001% 100.022% ** Level 3 read latency histogram (micros): Count: 1131659 Average: 11.2609 StdDev: 204.83 Min: 1 Median: 1.9067 Max: 60834 Percentiles: P50: 1.91 P75: 3.02 P99: 11.54 P99.9: 959.38 P99.99: 1450.07 ------------------------------------------------------ [ 0, 1 ] 42565 3.761% 3.761% # ( 1, 2 ] 577132 50.999% 54.760% ########## ( 2, 3 ] 226475 20.013% 74.773% #### ( 3, 4 ] 118070 10.433% 85.206% ## ( 4, 6 ] 125382 11.079% 96.286% ## ( 6, 10 ] 28574 2.525% 98.811% # ( 10, 15 ] 6982 0.617% 99.427% ( 15, 22 ] 828 0.073% 99.501% ( 22, 34 ] 83 0.007% 99.508% ( 34, 51 ] 84 0.007% 99.515% ( 51, 76 ] 84 0.007% 99.523% ( 76, 110 ] 301 0.027% 99.549% ( 110, 170 ] 946 0.084% 99.633% ( 170, 250 ] 521 0.046% 99.679% ( 250, 380 ] 452 0.040% 99.719% ( 380, 580 ] 780 0.069% 99.788% ( 580, 870 ] 1048 0.093% 99.881% ( 870, 1300 ] 1060 0.094% 99.974% ( 1300, 1900 ] 715 0.063% 100.037% ( 1900, 2900 ] 580 0.051% 100.089% ( 2900, 4400 ] 564 0.050% 100.138% ( 4400, 6600 ] 157 0.014% 100.152% ( 6600, 9900 ] 42 0.004% 100.156% ( 9900, 14000 ] 25 0.002% 100.158% ( 14000, 22000 ] 23 0.002% 100.160% ( 22000, 33000 ] 11 0.001% 100.161% ( 33000, 50000 ] 4 0.000% 100.162% ( 50000, 75000 ] 1 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 825075 Average: 27.7111 StdDev: 339.82 Min: 1 Median: 1.9042 Max: 59489 Percentiles: P50: 1.90 P75: 3.17 P99: 501.25 P99.9: 2444.70 P99.99: 3348.95 ------------------------------------------------------ [ 0, 1 ] 35221 4.269% 4.269% # ( 1, 2 ] 417276 50.574% 54.843% ########## ( 2, 3 ] 152680 18.505% 73.348% #### ( 3, 4 ] 82128 9.954% 83.302% ## ( 4, 6 ] 81302 9.854% 93.156% ## ( 6, 10 ] 20119 2.438% 95.594% ( 10, 15 ] 4772 0.578% 96.173% ( 15, 22 ] 579 0.070% 96.243% ( 22, 34 ] 61 0.007% 96.250% ( 34, 51 ] 62 0.008% 96.258% ( 51, 76 ] 54 0.007% 96.264% ( 76, 110 ] 3034 0.368% 96.632% ( 110, 170 ] 10591 1.284% 97.916% ( 170, 250 ] 4770 0.578% 98.494% ( 250, 380 ] 2556 0.310% 98.804% ( 380, 580 ] 2671 0.324% 99.127% ( 580, 870 ] 2400 0.291% 99.418% ( 870, 1300 ] 2076 0.252% 99.670% ( 1300, 1900 ] 1320 0.160% 99.830% ( 1900, 2900 ] 1061 0.129% 99.959% ( 2900, 4400 ] 867 0.105% 100.064% ( 4400, 6600 ] 288 0.035% 100.099% ( 6600, 9900 ] 56 0.007% 100.105% ( 9900, 14000 ] 27 0.003% 100.109% ( 14000, 22000 ] 48 0.006% 100.114% ( 22000, 33000 ] 28 0.003% 100.118% ( 33000, 50000 ] 7 0.001% 100.119% ( 50000, 75000 ] 4 0.000% 100.119% ** Level 5 read latency histogram (micros): Count: 154763 Average: 382.9572 StdDev: 906.41 Min: 74 Median: 165.3481 Max: 77320 Percentiles: P50: 165.35 P75: 309.84 P99: 4037.43 P99.9: 8276.51 P99.99: 25120.03 ------------------------------------------------------ ( 51, 76 ] 11 0.007% 0.007% ( 76, 110 ] 18196 11.757% 11.764% ## ( 110, 170 ] 64149 41.450% 53.214% ######## ( 170, 250 ] 27652 17.867% 71.082% #### ( 250, 380 ] 13176 8.514% 79.595% ## ( 380, 580 ] 12360 7.986% 87.582% ## ( 580, 870 ] 7283 4.706% 92.288% # ( 870, 1300 ] 4345 2.808% 95.095% # ( 1300, 1900 ] 2567 1.659% 96.754% ( 1900, 2900 ] 1957 1.265% 98.018% ( 2900, 4400 ] 2005 1.296% 99.314% ( 4400, 6600 ] 830 0.536% 99.850% ( 6600, 9900 ] 154 0.100% 99.950% ( 9900, 14000 ] 26 0.017% 99.966% ( 14000, 22000 ] 31 0.020% 99.986% ( 22000, 33000 ] 23 0.015% 100.001% ( 33000, 50000 ] 11 0.007% 100.008% ( 50000, 75000 ] 2 0.001% 100.010% ( 75000, 110000 ] 1 0.001% 100.010% ** DB Stats ** Uptime(secs): 22.2 total, 5.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 177.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.522 H:M:S, 33.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 198.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.456 H:M:S, 29.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 245.541 micros/op 16282 ops/sec 60.127 seconds 978996 operations; 15.8 MB/s (234999 of 234999 found) Microseconds per read: Count: 978996 Average: 245.5471 StdDev: 834.46 Min: 2 Median: 174.6872 Max: 126932 Percentiles: P50: 174.69 P75: 234.27 P99: 1135.46 P99.9: 12084.71 P99.99: 32608.58 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 30 0.003% 0.004% ( 3, 4 ] 50 0.005% 0.009% ( 4, 6 ] 112 0.011% 0.021% ( 6, 10 ] 466 0.048% 0.068% ( 10, 15 ] 3239 0.331% 0.399% ( 15, 22 ] 2894 0.296% 0.695% ( 22, 34 ] 7242 0.740% 1.435% ( 34, 51 ] 2142 0.219% 1.653% ( 51, 76 ] 345 0.035% 1.689% ( 76, 110 ] 19151 1.956% 3.645% ( 110, 170 ] 434562 44.389% 48.033% ######### ( 170, 250 ] 328620 33.567% 81.600% ####### ( 250, 380 ] 109819 11.218% 92.818% ## ( 380, 580 ] 41591 4.248% 97.066% # ( 580, 870 ] 15265 1.559% 98.625% ( 870, 1300 ] 5940 0.607% 99.232% ( 1300, 1900 ] 2550 0.260% 99.493% ( 1900, 2900 ] 1740 0.178% 99.670% ( 2900, 4400 ] 1325 0.135% 99.806% ( 4400, 6600 ] 484 0.049% 99.855% ( 6600, 9900 ] 220 0.022% 99.878% ( 9900, 14000 ] 411 0.042% 99.920% ( 14000, 22000 ] 475 0.049% 99.968% ( 22000, 33000 ] 222 0.023% 99.991% ( 33000, 50000 ] 63 0.006% 99.997% ( 50000, 75000 ] 13 0.001% 99.999% ( 75000, 110000 ] 11 0.001% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 16925679 rocksdb.bloom.filter.full.positive COUNT : 1143690 rocksdb.bloom.filter.full.true.positive COUNT : 978545 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 451 rocksdb.memtable.miss COUNT : 978545 rocksdb.l0.hit COUNT : 41755 rocksdb.l1.hit COUNT : 11984 rocksdb.l2andup.hit COUNT : 924806 rocksdb.compaction.key.drop.new COUNT : 185693 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4801418 rocksdb.number.keys.read COUNT : 978996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4955063376 rocksdb.bytes.read COUNT : 978996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1630 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41864175 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19876523711 rocksdb.compact.write.bytes COUNT : 19685201485 rocksdb.flush.write.bytes COUNT : 4954536652 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 947 rocksdb.number.superversion_releases COUNT : 916 rocksdb.number.superversion_cleanups COUNT : 237 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 234 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914405376 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1746944 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23947064025 rocksdb.non.last.level.read.count COUNT : 5642784 rocksdb.block.checksum.compute.count COUNT : 5969876 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 173.024783 P95 : 481.442799 P99 : 1134.322162 P100 : 126930.000000 COUNT : 978996 SUM : 239528719 rocksdb.db.write.micros P50 : 1.527375 P95 : 4.463983 P99 : 10.249264 P100 : 741636.000000 COUNT : 4801418 SUM : 53909967 rocksdb.compaction.times.micros P50 : 1356896.551724 P95 : 3950000.000000 P99 : 15517594.000000 P100 : 15517594.000000 COUNT : 75 SUM : 131898142 rocksdb.compaction.times.cpu_micros P50 : 802878.787879 P95 : 1865000.000000 P99 : 7325000.000000 P100 : 7546772.000000 COUNT : 75 SUM : 78293172 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 817.948718 P95 : 56250.000000 P99 : 119963.000000 P100 : 119963.000000 COUNT : 70 SUM : 532403 rocksdb.compaction.outfile.sync.micros P50 : 38913.043478 P95 : 214800.000000 P99 : 366133.333333 P100 : 857099.000000 COUNT : 232 SUM : 15989430 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 218.888889 P95 : 4250.000000 P99 : 6365.333333 P100 : 8824.000000 COUNT : 164 SUM : 162831 rocksdb.table.open.io.micros P50 : 9108.855292 P95 : 21333.333333 P99 : 40650.000000 P100 : 113927.000000 COUNT : 1630 SUM : 16425241 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.841410 P95 : 83.859706 P99 : 203.589284 P100 : 60839.000000 COUNT : 4813758 SUM : 90062549 rocksdb.read.block.get.micros P50 : 140.353470 P95 : 347.369232 P99 : 1062.856385 P100 : 77402.000000 COUNT : 1154480 SUM : 202980618 rocksdb.write.raw.block.micros P50 : 0.532021 P95 : 1.245877 P99 : 3.678656 P100 : 55924.000000 COUNT : 5967922 SUM : 18360345 rocksdb.numfiles.in.singlecompaction P50 : 3.081081 P95 : 5.840000 P99 : 22.480000 P100 : 26.000000 COUNT : 96 SUM : 361 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571974 P95 : 1969.501466 P99 : 2724.897361 P100 : 741452.000000 COUNT : 206072 SUM : 41882942 rocksdb.sst.read.micros P50 : 2.072764 P95 : 168.266762 P99 : 486.383474 P100 : 77320.000000 COUNT : 5642820 SUM : 276124199 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 978996 SUM : 978996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4801418 SUM : 4955063376 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221851.851852 P95 : 902500.000000 P99 : 1020261.000000 P100 : 1020261.000000 COUNT : 70 SUM : 20488544 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 276 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0