[2024-07-10 14:23:15.065088] Starting SPDK v24.09-pre git sha1 968224f46 / DPDK 24.03.0 initialization... [2024-07-10 14:23:15.065238] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1762619 ] Set seed to 1720614195061691 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-10 14:23:15.218622] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-10 14:23:15.547107] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-10 14:23:15.547160] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1762619' to capture a snapshot of events at runtime. [2024-07-10 14:23:15.547176] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-10 14:23:15.547191] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-10 14:23:15.547203] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1762619 for offline analysis/debug. [2024-07-10 14:23:15.547321] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 10 14:23:28 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/10-14:23:39 ... thread 0: (1000000,1000000) ops and (91979.4,91979.4) ops/second in (10.872002,10.872002) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.35 GB 50.3 0.4 0.0 0.4 1.2 0.8 0.0 1.5 30.5 96.6 12.39 4.82 10 1.239 383K 507 0.0 0.0 L1 4/4 365.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/1 257.56 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 40/9 3.03 GB 2.3 4.9 2.9 2.0 4.8 2.9 0.0 1.7 83.0 82.5 60.10 31.66 22 2.732 2629K 7136 0.0 0.0 L4 229/13 11.67 GB 1.2 2.1 2.0 0.1 2.1 2.0 0.0 1.0 85.8 85.6 25.48 13.38 22 1.158 2129K 0 0.0 0.0 L5 1356/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1641/35 103.77 GB 0.0 7.4 4.9 2.4 8.1 5.7 0.0 10.2 77.1 85.1 97.97 49.86 54 1.814 5143K 7643 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 4.9 2.4 8.1 5.7 0.0 10.2 77.1 85.1 97.97 49.86 54 1.814 5143K 7643 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 4.9 2.4 7.3 4.9 0.0 0.0 85.6 85.2 88.22 47.03 45 1.961 5143K 7643 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 84.0 9.75 2.83 9 1.083 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.2 total, 10.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.14 GB write, 742.42 MB/s write, 7.38 GB read, 672.85 MB/s read, 98.0 seconds Interval compaction: 8.14 GB write, 766.12 MB/s write, 7.38 GB read, 694.33 MB/s read, 98.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 310470 Average: 14.5257 StdDev: 209.77 Min: 1 Median: 2.9205 Max: 28848 Percentiles: P50: 2.92 P75: 4.90 P99: 14.56 P99.9: 2841.77 P99.99: 4303.32 ------------------------------------------------------ [ 0, 1 ] 562 0.181% 0.181% ( 1, 2 ] 41126 13.246% 13.427% ### ( 2, 3 ] 123360 39.733% 53.161% ######## ( 3, 4 ] 39163 12.614% 65.775% ### ( 4, 6 ] 63694 20.515% 86.290% #### ( 6, 10 ] 34391 11.077% 97.367% ## ( 10, 15 ] 5564 1.792% 99.159% ( 15, 22 ] 1356 0.437% 99.596% ( 22, 34 ] 142 0.046% 99.642% ( 34, 51 ] 15 0.005% 99.647% ( 51, 76 ] 11 0.004% 99.650% ( 76, 110 ] 4 0.001% 99.651% ( 110, 170 ] 5 0.002% 99.653% ( 170, 250 ] 9 0.003% 99.656% ( 250, 380 ] 20 0.006% 99.662% ( 380, 580 ] 36 0.012% 99.674% ( 580, 870 ] 82 0.026% 99.700% ( 870, 1300 ] 137 0.044% 99.745% ( 1300, 1900 ] 202 0.065% 99.810% ( 1900, 2900 ] 300 0.097% 99.906% ( 2900, 4400 ] 280 0.090% 99.996% ( 4400, 6600 ] 116 0.037% 100.034% ( 6600, 9900 ] 21 0.007% 100.041% ( 9900, 14000 ] 4 0.001% 100.042% ( 14000, 22000 ] 2 0.001% 100.043% ( 22000, 33000 ] 3 0.001% 100.043% ** Level 1 read latency histogram (micros): Count: 82001 Average: 27.0002 StdDev: 337.05 Min: 1 Median: 3.0851 Max: 23573 Percentiles: P50: 3.09 P75: 5.14 P99: 18.66 P99.9: 5113.48 P99.99: 11744.90 ------------------------------------------------------ [ 0, 1 ] 123 0.150% 0.150% ( 1, 2 ] 9982 12.173% 12.323% ## ( 2, 3 ] 29992 36.575% 48.898% ####### ( 3, 4 ] 10621 12.952% 61.850% ### ( 4, 6 ] 18913 23.064% 84.915% ##### ( 6, 10 ] 9446 11.519% 96.434% ## ( 10, 15 ] 1881 2.294% 98.728% ( 15, 22 ] 427 0.521% 99.249% ( 22, 34 ] 43 0.052% 99.301% ( 34, 51 ] 6 0.007% 99.309% ( 51, 76 ] 3 0.004% 99.312% ( 76, 110 ] 2 0.002% 99.315% ( 250, 380 ] 1 0.001% 99.316% ( 380, 580 ] 8 0.010% 99.326% ( 580, 870 ] 23 0.028% 99.354% ( 870, 1300 ] 41 0.050% 99.404% ( 1300, 1900 ] 72 0.088% 99.491% ( 1900, 2900 ] 146 0.178% 99.670% ( 2900, 4400 ] 165 0.201% 99.871% ( 4400, 6600 ] 74 0.090% 99.961% ( 6600, 9900 ] 22 0.027% 99.988% ( 9900, 14000 ] 4 0.005% 99.993% ( 14000, 22000 ] 5 0.006% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 604993 Average: 23.7600 StdDev: 310.70 Min: 1 Median: 2.8984 Max: 38072 Percentiles: P50: 2.90 P75: 4.77 P99: 14.74 P99.9: 2570.57 P99.99: 3235.11 ------------------------------------------------------ [ 0, 1 ] 1173 0.194% 0.194% ( 1, 2 ] 81047 13.396% 13.590% ### ( 2, 3 ] 245199 40.529% 54.119% ######## ( 3, 4 ] 80927 13.377% 67.496% ### ( 4, 6 ] 117323 19.392% 86.888% #### ( 6, 10 ] 62338 10.304% 97.192% ## ( 10, 15 ] 11528 1.905% 99.098% ( 15, 22 ] 2654 0.439% 99.537% ( 22, 34 ] 327 0.054% 99.591% ( 34, 51 ] 63 0.010% 99.601% ( 51, 76 ] 43 0.007% 99.608% ( 76, 110 ] 38 0.006% 99.614% ( 110, 170 ] 25 0.004% 99.619% ( 170, 250 ] 19 0.003% 99.622% ( 250, 380 ] 37 0.006% 99.628% ( 380, 580 ] 85 0.014% 99.642% ( 580, 870 ] 172 0.028% 99.670% ( 870, 1300 ] 283 0.047% 99.717% ( 1300, 1900 ] 533 0.088% 99.805% ( 1900, 2900 ] 856 0.141% 99.947% ( 2900, 4400 ] 1175 0.194% 100.141% ( 4400, 6600 ] 482 0.080% 100.220% ( 6600, 9900 ] 128 0.021% 100.242% ( 9900, 14000 ] 12 0.002% 100.244% ( 14000, 22000 ] 17 0.003% 100.246% ( 22000, 33000 ] 11 0.002% 100.248% ( 33000, 50000 ] 2 0.000% 100.249% ** Level 3 read latency histogram (micros): Count: 1070339 Average: 15.9657 StdDev: 217.89 Min: 1 Median: 2.8622 Max: 30977 Percentiles: P50: 2.86 P75: 4.57 P99: 12.72 P99.9: 21.33 P99.99: 523.57 ------------------------------------------------------ [ 0, 1 ] 1752 0.164% 0.164% ( 1, 2 ] 137727 12.868% 13.031% ### ( 2, 3 ] 458951 42.879% 55.910% ######### ( 3, 4 ] 145652 13.608% 69.518% ### ( 4, 6 ] 204406 19.097% 88.616% #### ( 6, 10 ] 102875 9.611% 98.227% ## ( 10, 15 ] 15200 1.420% 99.647% ( 15, 22 ] 2992 0.280% 99.927% ( 22, 34 ] 243 0.023% 99.949% ( 34, 51 ] 64 0.006% 99.955% ( 51, 76 ] 80 0.007% 99.963% ( 76, 110 ] 59 0.006% 99.968% ( 110, 170 ] 33 0.003% 99.972% ( 170, 250 ] 55 0.005% 99.977% ( 250, 380 ] 65 0.006% 99.983% ( 380, 580 ] 110 0.010% 99.993% ( 580, 870 ] 223 0.021% 100.014% ( 870, 1300 ] 466 0.044% 100.057% ( 1300, 1900 ] 685 0.064% 100.121% ( 1900, 2900 ] 1133 0.106% 100.227% ( 2900, 4400 ] 1161 0.108% 100.336% ( 4400, 6600 ] 532 0.050% 100.385% ( 6600, 9900 ] 146 0.014% 100.399% ( 9900, 14000 ] 4 0.000% 100.399% ( 14000, 22000 ] 8 0.001% 100.400% ( 22000, 33000 ] 2 0.000% 100.400% ** Level 4 read latency histogram (micros): Count: 31106 Average: 339.5819 StdDev: 1387.11 Min: 0 Median: 2.9176 Max: 51074 Percentiles: P50: 2.92 P75: 5.15 P99: 5618.39 P99.9: 9761.74 P99.99: 26278.34 ------------------------------------------------------ [ 0, 1 ] 87 0.280% 0.280% ( 1, 2 ] 4669 15.010% 15.290% ### ( 2, 3 ] 11766 37.825% 53.115% ######## ( 3, 4 ] 4025 12.940% 66.055% ### ( 4, 6 ] 4839 15.556% 81.611% ### ( 6, 10 ] 1573 5.057% 86.668% # ( 10, 15 ] 342 1.099% 87.768% ( 15, 22 ] 67 0.215% 87.983% ( 22, 34 ] 6 0.019% 88.002% ( 34, 51 ] 4 0.013% 88.015% ( 51, 76 ] 4 0.013% 88.028% ( 76, 110 ] 2 0.006% 88.034% ( 110, 170 ] 18 0.058% 88.092% ( 170, 250 ] 34 0.109% 88.202% ( 250, 380 ] 47 0.151% 88.353% ( 380, 580 ] 124 0.399% 88.751% ( 580, 870 ] 246 0.791% 89.542% ( 870, 1300 ] 435 1.398% 90.941% ( 1300, 1900 ] 652 2.096% 93.037% ( 1900, 2900 ] 814 2.617% 95.654% # ( 2900, 4400 ] 810 2.604% 98.258% # ( 4400, 6600 ] 417 1.341% 99.598% ( 6600, 9900 ] 98 0.315% 99.913% ( 9900, 14000 ] 8 0.026% 99.939% ( 14000, 22000 ] 12 0.039% 99.977% ( 22000, 33000 ] 10 0.032% 100.010% ( 33000, 50000 ] 7 0.023% 100.032% ( 50000, 75000 ] 1 0.003% 100.035% ** Level 5 read latency histogram (micros): Count: 9805 Average: 3110.5712 StdDev: 2559.39 Min: 135 Median: 2617.3326 Max: 71553 Percentiles: P50: 2617.33 P75: 4293.55 P99: 9751.93 P99.9: 30518.13 P99.99: 70097.50 ------------------------------------------------------ ( 110, 170 ] 7 0.071% 0.071% ( 170, 250 ] 33 0.337% 0.408% ( 250, 380 ] 82 0.836% 1.244% ( 380, 580 ] 287 2.927% 4.171% # ( 580, 870 ] 554 5.650% 9.822% # ( 870, 1300 ] 1068 10.892% 20.714% ## ( 1300, 1900 ] 1543 15.737% 36.451% ### ( 1900, 2900 ] 1852 18.888% 55.339% #### ( 2900, 4400 ] 2075 21.163% 76.502% #### ( 4400, 6600 ] 1694 17.277% 93.779% ### ( 6600, 9900 ] 536 5.467% 99.245% # ( 9900, 14000 ] 50 0.510% 99.755% ( 14000, 22000 ] 8 0.082% 99.837% ( 22000, 33000 ] 8 0.082% 99.918% ( 33000, 50000 ] 3 0.031% 99.949% ( 50000, 75000 ] 5 0.051% 100.000% ** DB Stats ** Uptime(secs): 11.2 total, 10.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 87.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.109 H:M:S, 45.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 90.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.109 H:M:S, 47.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/10-14:23:46 ... thread 0: (1000000,2000000) ops and (143301.0,112042.8) ops/second in (6.978319,17.850321) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.84 GB 75.5 1.3 0.0 1.3 3.1 1.8 0.0 1.7 53.2 129.0 24.88 13.16 28 0.889 1343K 1636 0.0 0.0 L1 8/8 631.24 MB 0.0 0.9 0.6 0.4 0.9 0.5 0.0 1.6 80.6 80.4 11.54 6.72 1 11.539 944K 3202 0.0 0.0 L2 1/0 55.61 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 993.14 MB 1.0 5.7 3.3 2.4 5.6 3.2 0.1 1.7 85.5 85.0 67.96 36.79 26 2.614 3205K 8673 0.0 0.0 L4 182/0 9.76 GB 1.0 5.2 4.4 0.9 5.2 4.3 0.2 1.2 91.1 90.5 58.90 34.01 48 1.227 3728K 207 0.0 0.0 L5 1428/0 91.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1647/16 104.78 GB 0.0 13.1 8.2 4.9 14.9 10.0 5.1 8.1 82.3 93.4 163.28 90.67 103 1.585 9222K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 8.2 4.9 14.9 10.0 5.1 8.1 82.3 93.4 163.28 90.67 103 1.585 9222K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 8.2 4.9 13.0 8.1 0.0 0.0 91.7 91.2 146.49 84.38 79 1.854 9222K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 112.5 16.79 6.29 24 0.700 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.2 total, 17.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.89 GB write, 837.74 MB/s write, 13.12 GB read, 737.90 MB/s read, 163.3 seconds Interval compaction: 14.89 GB write, 854.03 MB/s write, 13.12 GB read, 752.25 MB/s read, 163.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 598976 Average: 15.4410 StdDev: 191.52 Min: 1 Median: 2.7673 Max: 30957 Percentiles: P50: 2.77 P75: 4.30 P99: 224.60 P99.9: 2332.04 P99.99: 3996.25 ------------------------------------------------------ [ 0, 1 ] 2510 0.419% 0.419% ( 1, 2 ] 106597 17.797% 18.216% #### ( 2, 3 ] 248126 41.425% 59.641% ######## ( 3, 4 ] 77497 12.938% 72.579% ### ( 4, 6 ] 98184 16.392% 88.971% ### ( 6, 10 ] 48620 8.117% 97.088% ## ( 10, 15 ] 7612 1.271% 98.359% ( 15, 22 ] 1682 0.281% 98.640% ( 22, 34 ] 166 0.028% 98.667% ( 34, 51 ] 23 0.004% 98.671% ( 51, 76 ] 29 0.005% 98.676% ( 76, 110 ] 12 0.002% 98.678% ( 110, 170 ] 514 0.086% 98.764% ( 170, 250 ] 2072 0.346% 99.110% ( 250, 380 ] 1906 0.318% 99.428% ( 380, 580 ] 1132 0.189% 99.617% ( 580, 870 ] 731 0.122% 99.739% ( 870, 1300 ] 435 0.073% 99.812% ( 1300, 1900 ] 349 0.058% 99.870% ( 1900, 2900 ] 419 0.070% 99.940% ( 2900, 4400 ] 412 0.069% 100.009% ( 4400, 6600 ] 157 0.026% 100.035% ( 6600, 9900 ] 27 0.005% 100.039% ( 9900, 14000 ] 5 0.001% 100.040% ( 14000, 22000 ] 8 0.001% 100.042% ( 22000, 33000 ] 4 0.001% 100.042% ** Level 1 read latency histogram (micros): Count: 196764 Average: 20.5054 StdDev: 292.14 Min: 1 Median: 2.9058 Max: 33798 Percentiles: P50: 2.91 P75: 4.83 P99: 20.30 P99.9: 3743.66 P99.99: 6020.11 ------------------------------------------------------ [ 0, 1 ] 551 0.280% 0.280% ( 1, 2 ] 29095 14.787% 15.067% ### ( 2, 3 ] 75884 38.566% 53.633% ######## ( 3, 4 ] 25122 12.768% 66.400% ### ( 4, 6 ] 40889 20.781% 87.181% #### ( 6, 10 ] 19130 9.722% 96.903% ## ( 10, 15 ] 3485 1.771% 98.675% ( 15, 22 ] 846 0.430% 99.105% ( 22, 34 ] 65 0.033% 99.138% ( 34, 51 ] 28 0.014% 99.152% ( 51, 76 ] 25 0.013% 99.164% ( 76, 110 ] 7 0.004% 99.168% ( 110, 170 ] 58 0.029% 99.198% ( 170, 250 ] 192 0.098% 99.295% ( 250, 380 ] 188 0.096% 99.391% ( 380, 580 ] 144 0.073% 99.464% ( 580, 870 ] 185 0.094% 99.558% ( 870, 1300 ] 161 0.082% 99.640% ( 1300, 1900 ] 162 0.082% 99.722% ( 1900, 2900 ] 222 0.113% 99.835% ( 2900, 4400 ] 228 0.116% 99.951% ( 4400, 6600 ] 105 0.053% 100.004% ( 6600, 9900 ] 30 0.015% 100.019% ( 9900, 14000 ] 4 0.002% 100.021% ( 14000, 22000 ] 8 0.004% 100.025% ( 22000, 33000 ] 5 0.003% 100.028% ( 33000, 50000 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 618959 Average: 23.5440 StdDev: 308.41 Min: 1 Median: 2.8969 Max: 38072 Percentiles: P50: 2.90 P75: 4.76 P99: 14.74 P99.9: 2580.60 P99.99: 3255.53 ------------------------------------------------------ [ 0, 1 ] 1175 0.190% 0.190% ( 1, 2 ] 81959 13.241% 13.431% ### ( 2, 3 ] 252366 40.773% 54.204% ######## ( 3, 4 ] 82984 13.407% 67.611% ### ( 4, 6 ] 119606 19.324% 86.935% #### ( 6, 10 ] 63533 10.264% 97.199% ## ( 10, 15 ] 11764 1.901% 99.100% ( 15, 22 ] 2686 0.434% 99.534% ( 22, 34 ] 329 0.053% 99.587% ( 34, 51 ] 65 0.011% 99.597% ( 51, 76 ] 43 0.007% 99.604% ( 76, 110 ] 38 0.006% 99.610% ( 110, 170 ] 27 0.004% 99.615% ( 170, 250 ] 29 0.005% 99.620% ( 250, 380 ] 49 0.008% 99.627% ( 380, 580 ] 87 0.014% 99.641% ( 580, 870 ] 177 0.029% 99.670% ( 870, 1300 ] 291 0.047% 99.717% ( 1300, 1900 ] 544 0.088% 99.805% ( 1900, 2900 ] 864 0.140% 99.945% ( 2900, 4400 ] 1186 0.192% 100.136% ( 4400, 6600 ] 490 0.079% 100.215% ( 6600, 9900 ] 129 0.021% 100.236% ( 9900, 14000 ] 12 0.002% 100.238% ( 14000, 22000 ] 17 0.003% 100.241% ( 22000, 33000 ] 11 0.002% 100.243% ( 33000, 50000 ] 2 0.000% 100.243% ** Level 3 read latency histogram (micros): Count: 1691565 Average: 14.5616 StdDev: 204.20 Min: 1 Median: 2.8669 Max: 30977 Percentiles: P50: 2.87 P75: 4.61 P99: 12.95 P99.9: 21.57 P99.99: 235.18 ------------------------------------------------------ [ 0, 1 ] 2980 0.176% 0.176% ( 1, 2 ] 215095 12.716% 12.892% ### ( 2, 3 ] 724114 42.807% 55.699% ######### ( 3, 4 ] 227689 13.460% 69.160% ### ( 4, 6 ] 325988 19.271% 88.431% #### ( 6, 10 ] 163720 9.679% 98.110% ## ( 10, 15 ] 25511 1.508% 99.618% ( 15, 22 ] 5090 0.301% 99.919% ( 22, 34 ] 443 0.026% 99.945% ( 34, 51 ] 146 0.009% 99.953% ( 51, 76 ] 272 0.016% 99.969% ( 76, 110 ] 118 0.007% 99.976% ( 110, 170 ] 84 0.005% 99.981% ( 170, 250 ] 179 0.011% 99.992% ( 250, 380 ] 225 0.013% 100.005% ( 380, 580 ] 300 0.018% 100.023% ( 580, 870 ] 539 0.032% 100.055% ( 870, 1300 ] 915 0.054% 100.109% ( 1300, 1900 ] 1151 0.068% 100.177% ( 1900, 2900 ] 1469 0.087% 100.264% ( 2900, 4400 ] 1556 0.092% 100.356% ( 4400, 6600 ] 647 0.038% 100.394% ( 6600, 9900 ] 171 0.010% 100.404% ( 9900, 14000 ] 18 0.001% 100.405% ( 14000, 22000 ] 17 0.001% 100.406% ( 22000, 33000 ] 5 0.000% 100.407% ** Level 4 read latency histogram (micros): Count: 231917 Average: 76.2060 StdDev: 596.76 Min: 0 Median: 2.8682 Max: 51074 Percentiles: P50: 2.87 P75: 4.75 P99: 2356.78 P99.9: 5667.93 P99.99: 6564.80 ------------------------------------------------------ [ 0, 1 ] 781 0.337% 0.337% ( 1, 2 ] 31565 13.610% 13.947% ### ( 2, 3 ] 96305 41.526% 55.473% ######## ( 3, 4 ] 29749 12.827% 68.300% ### ( 4, 6 ] 41196 17.763% 86.064% #### ( 6, 10 ] 18353 7.914% 93.977% ## ( 10, 15 ] 3122 1.346% 95.323% ( 15, 22 ] 709 0.306% 95.629% ( 22, 34 ] 56 0.024% 95.653% ( 34, 51 ] 35 0.015% 95.668% ( 51, 76 ] 48 0.021% 95.689% ( 76, 110 ] 28 0.012% 95.701% ( 110, 170 ] 329 0.142% 95.843% ( 170, 250 ] 1227 0.529% 96.372% ( 250, 380 ] 1160 0.500% 96.872% ( 380, 580 ] 975 0.420% 97.293% ( 580, 870 ] 1014 0.437% 97.730% ( 870, 1300 ] 1175 0.507% 98.236% ( 1300, 1900 ] 1230 0.530% 98.767% ( 1900, 2900 ] 1184 0.511% 99.277% ( 2900, 4400 ] 1149 0.495% 99.773% ( 4400, 6600 ] 512 0.221% 99.994% ( 6600, 9900 ] 119 0.051% 100.045% ( 9900, 14000 ] 12 0.005% 100.050% ( 14000, 22000 ] 22 0.009% 100.060% ( 22000, 33000 ] 14 0.006% 100.066% ( 33000, 50000 ] 8 0.003% 100.069% ( 50000, 75000 ] 1 0.000% 100.069% ** Level 5 read latency histogram (micros): Count: 39567 Average: 1294.9779 StdDev: 1952.44 Min: 98 Median: 536.1125 Max: 71553 Percentiles: P50: 536.11 P75: 1576.32 P99: 8243.40 P99.9: 17716.50 P99.99: 55216.50 ------------------------------------------------------ ( 76, 110 ] 32 0.081% 0.081% ( 110, 170 ] 2202 5.565% 5.646% # ( 170, 250 ] 7407 18.720% 24.366% #### ( 250, 380 ] 6452 16.307% 40.673% ### ( 380, 580 ] 4728 11.949% 52.622% ## ( 580, 870 ] 4115 10.400% 63.022% ## ( 870, 1300 ] 3383 8.550% 71.572% ## ( 1300, 1900 ] 2945 7.443% 79.015% # ( 1900, 2900 ] 2722 6.879% 85.895% # ( 2900, 4400 ] 2849 7.200% 93.095% # ( 4400, 6600 ] 2045 5.168% 98.264% # ( 6600, 9900 ] 585 1.479% 99.742% ( 9900, 14000 ] 55 0.139% 99.881% ( 14000, 22000 ] 16 0.040% 99.922% ( 22000, 33000 ] 15 0.038% 99.960% ( 33000, 50000 ] 11 0.028% 99.987% ( 50000, 75000 ] 5 0.013% 100.000% ** DB Stats ** Uptime(secs): 18.2 total, 7.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 108.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.026 H:M:S, 38.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 141.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.917 H:M:S, 27.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-14:23:51 ... thread 0: (1000000,3000000) ops and (191524.5,130030.1) ops/second in (5.221264,23.071585) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.83 GB 176.2 2.3 0.0 2.3 5.1 2.8 0.0 1.8 65.8 147.4 35.44 22.79 47 0.754 2366K 2579 0.0 0.0 L1 8/8 631.24 MB 0.0 0.9 0.6 0.4 0.9 0.5 0.0 1.6 80.6 80.4 11.54 6.72 1 11.539 944K 3202 0.0 0.0 L2 1/0 55.61 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 993.14 MB 1.0 5.7 3.3 2.4 5.6 3.2 0.1 1.7 85.5 85.0 67.96 36.79 26 2.614 3205K 8673 0.0 0.0 L4 182/0 9.76 GB 1.0 5.2 4.4 0.9 5.2 4.3 0.2 1.2 91.1 90.5 58.90 34.01 48 1.227 3728K 207 0.0 0.0 L5 1428/0 91.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1650/16 105.77 GB 0.0 14.1 8.2 5.9 16.9 10.9 5.1 6.0 83.1 99.3 173.85 100.31 122 1.425 10M 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 8.2 5.9 16.9 10.9 5.1 6.0 83.1 99.3 173.85 100.31 122 1.425 10M 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 8.2 5.9 14.0 8.1 0.0 0.0 94.8 94.3 152.38 90.10 83 1.836 10M 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 135.0 21.47 10.21 39 0.551 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.4 total, 23.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.86 GB write, 737.03 MB/s write, 14.10 GB read, 616.45 MB/s read, 173.8 seconds Interval compaction: 16.86 GB write, 748.12 MB/s write, 14.10 GB read, 625.73 MB/s read, 173.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 67, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 907225 Average: 15.2788 StdDev: 160.12 Min: 1 Median: 2.6067 Max: 30957 Percentiles: P50: 2.61 P75: 3.84 P99: 292.15 P99.9: 1264.26 P99.99: 2898.28 ------------------------------------------------------ [ 0, 1 ] 17292 1.906% 1.906% ( 1, 2 ] 228520 25.189% 27.095% ##### ( 2, 3 ] 342526 37.755% 64.850% ######## ( 3, 4 ] 109559 12.076% 76.927% ## ( 4, 6 ] 122800 13.536% 90.462% ### ( 6, 10 ] 54715 6.031% 96.493% # ( 10, 15 ] 8583 0.946% 97.439% ( 15, 22 ] 1857 0.205% 97.644% ( 22, 34 ] 196 0.022% 97.666% ( 34, 51 ] 26 0.003% 97.669% ( 51, 76 ] 31 0.003% 97.672% ( 76, 110 ] 28 0.003% 97.675% ( 110, 170 ] 2127 0.234% 97.910% ( 170, 250 ] 7993 0.881% 98.791% ( 250, 380 ] 5863 0.646% 99.437% ( 380, 580 ] 2494 0.275% 99.712% ( 580, 870 ] 1243 0.137% 99.849% ( 870, 1300 ] 508 0.056% 99.905% ( 1300, 1900 ] 354 0.039% 99.944% ( 1900, 2900 ] 421 0.046% 99.990% ( 2900, 4400 ] 419 0.046% 100.036% ( 4400, 6600 ] 157 0.017% 100.054% ( 6600, 9900 ] 27 0.003% 100.057% ( 9900, 14000 ] 5 0.001% 100.057% ( 14000, 22000 ] 8 0.001% 100.058% ( 22000, 33000 ] 4 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 239565 Average: 18.5525 StdDev: 265.46 Min: 1 Median: 2.8227 Max: 33798 Percentiles: P50: 2.82 P75: 4.62 P99: 177.95 P99.9: 3455.49 P99.99: 5909.48 ------------------------------------------------------ [ 0, 1 ] 1498 0.625% 0.625% ( 1, 2 ] 43642 18.217% 18.842% #### ( 2, 3 ] 90733 37.874% 56.717% ######## ( 3, 4 ] 29710 12.402% 69.118% ## ( 4, 6 ] 45784 19.111% 88.229% #### ( 6, 10 ] 20602 8.600% 96.829% ## ( 10, 15 ] 3816 1.593% 98.422% ( 15, 22 ] 966 0.403% 98.825% ( 22, 34 ] 73 0.030% 98.856% ( 34, 51 ] 30 0.013% 98.868% ( 51, 76 ] 25 0.010% 98.879% ( 76, 110 ] 8 0.003% 98.882% ( 110, 170 ] 215 0.090% 98.972% ( 170, 250 ] 688 0.287% 99.259% ( 250, 380 ] 467 0.195% 99.454% ( 380, 580 ] 213 0.089% 99.543% ( 580, 870 ] 221 0.092% 99.635% ( 870, 1300 ] 167 0.070% 99.705% ( 1300, 1900 ] 162 0.068% 99.773% ( 1900, 2900 ] 222 0.093% 99.865% ( 2900, 4400 ] 228 0.095% 99.960% ( 4400, 6600 ] 105 0.044% 100.004% ( 6600, 9900 ] 30 0.013% 100.017% ( 9900, 14000 ] 4 0.002% 100.018% ( 14000, 22000 ] 8 0.003% 100.022% ( 22000, 33000 ] 5 0.002% 100.024% ( 33000, 50000 ] 1 0.000% 100.024% ** Level 2 read latency histogram (micros): Count: 619055 Average: 23.5804 StdDev: 308.40 Min: 1 Median: 2.8971 Max: 38072 Percentiles: P50: 2.90 P75: 4.77 P99: 14.78 P99.9: 2580.49 P99.99: 3255.52 ------------------------------------------------------ [ 0, 1 ] 1175 0.190% 0.190% ( 1, 2 ] 81959 13.239% 13.429% ### ( 2, 3 ] 252366 40.766% 54.196% ######## ( 3, 4 ] 82984 13.405% 67.600% ### ( 4, 6 ] 119606 19.321% 86.921% #### ( 6, 10 ] 63533 10.263% 97.184% ## ( 10, 15 ] 11764 1.900% 99.084% ( 15, 22 ] 2686 0.434% 99.518% ( 22, 34 ] 329 0.053% 99.571% ( 34, 51 ] 65 0.010% 99.582% ( 51, 76 ] 43 0.007% 99.589% ( 76, 110 ] 38 0.006% 99.595% ( 110, 170 ] 39 0.006% 99.601% ( 170, 250 ] 77 0.012% 99.614% ( 250, 380 ] 76 0.012% 99.626% ( 380, 580 ] 94 0.015% 99.641% ( 580, 870 ] 179 0.029% 99.670% ( 870, 1300 ] 291 0.047% 99.717% ( 1300, 1900 ] 544 0.088% 99.805% ( 1900, 2900 ] 864 0.140% 99.945% ( 2900, 4400 ] 1186 0.192% 100.136% ( 4400, 6600 ] 490 0.079% 100.215% ( 6600, 9900 ] 129 0.021% 100.236% ( 9900, 14000 ] 12 0.002% 100.238% ( 14000, 22000 ] 17 0.003% 100.241% ( 22000, 33000 ] 11 0.002% 100.243% ( 33000, 50000 ] 2 0.000% 100.243% ** Level 3 read latency histogram (micros): Count: 1692393 Average: 14.6548 StdDev: 204.22 Min: 1 Median: 2.8674 Max: 30977 Percentiles: P50: 2.87 P75: 4.61 P99: 13.08 P99.9: 30.87 P99.99: 319.82 ------------------------------------------------------ [ 0, 1 ] 2980 0.176% 0.176% ( 1, 2 ] 215106 12.710% 12.886% ### ( 2, 3 ] 724170 42.790% 55.676% ######### ( 3, 4 ] 227722 13.456% 69.132% ### ( 4, 6 ] 326059 19.266% 88.398% #### ( 6, 10 ] 163733 9.675% 98.072% ## ( 10, 15 ] 25513 1.508% 99.580% ( 15, 22 ] 5090 0.301% 99.881% ( 22, 34 ] 443 0.026% 99.907% ( 34, 51 ] 146 0.009% 99.915% ( 51, 76 ] 272 0.016% 99.932% ( 76, 110 ] 118 0.007% 99.938% ( 110, 170 ] 180 0.011% 99.949% ( 170, 250 ] 485 0.029% 99.978% ( 250, 380 ] 385 0.023% 100.001% ( 380, 580 ] 357 0.021% 100.022% ( 580, 870 ] 561 0.033% 100.055% ( 870, 1300 ] 916 0.054% 100.109% ( 1300, 1900 ] 1151 0.068% 100.177% ( 1900, 2900 ] 1469 0.087% 100.264% ( 2900, 4400 ] 1556 0.092% 100.356% ( 4400, 6600 ] 647 0.038% 100.394% ( 6600, 9900 ] 171 0.010% 100.404% ( 9900, 14000 ] 18 0.001% 100.405% ( 14000, 22000 ] 17 0.001% 100.406% ( 22000, 33000 ] 5 0.000% 100.406% ** Level 4 read latency histogram (micros): Count: 240949 Average: 82.6571 StdDev: 587.16 Min: 0 Median: 2.9128 Max: 51074 Percentiles: P50: 2.91 P75: 5.06 P99: 2283.43 P99.9: 5629.13 P99.99: 6560.92 ------------------------------------------------------ [ 0, 1 ] 781 0.324% 0.324% ( 1, 2 ] 31613 13.120% 13.444% ### ( 2, 3 ] 96500 40.050% 53.494% ######## ( 3, 4 ] 29891 12.406% 65.900% ## ( 4, 6 ] 41520 17.232% 83.132% ### ( 6, 10 ] 18398 7.636% 90.767% ## ( 10, 15 ] 3138 1.302% 92.070% ( 15, 22 ] 711 0.295% 92.365% ( 22, 34 ] 56 0.023% 92.388% ( 34, 51 ] 35 0.015% 92.403% ( 51, 76 ] 48 0.020% 92.422% ( 76, 110 ] 36 0.015% 92.437% ( 110, 170 ] 1560 0.647% 93.085% ( 170, 250 ] 4987 2.070% 95.155% ( 250, 380 ] 3269 1.357% 96.511% ( 380, 580 ] 1785 0.741% 97.252% ( 580, 870 ] 1304 0.541% 97.793% ( 870, 1300 ] 1219 0.506% 98.299% ( 1300, 1900 ] 1233 0.512% 98.811% ( 1900, 2900 ] 1188 0.493% 99.304% ( 2900, 4400 ] 1150 0.477% 99.781% ( 4400, 6600 ] 512 0.212% 99.994% ( 6600, 9900 ] 119 0.049% 100.043% ( 9900, 14000 ] 12 0.005% 100.048% ( 14000, 22000 ] 22 0.009% 100.057% ( 22000, 33000 ] 14 0.006% 100.063% ( 33000, 50000 ] 8 0.003% 100.066% ( 50000, 75000 ] 1 0.000% 100.067% ** Level 5 read latency histogram (micros): Count: 92085 Average: 709.8744 StdDev: 1381.11 Min: 95 Median: 279.8433 Max: 71553 Percentiles: P50: 279.84 P75: 536.84 P99: 6348.41 P99.9: 10639.04 P99.99: 43495.80 ------------------------------------------------------ ( 76, 110 ] 114 0.124% 0.124% ( 110, 170 ] 10153 11.026% 11.149% ## ( 170, 250 ] 31185 33.865% 45.015% ####### ( 250, 380 ] 20001 21.720% 66.735% #### ( 380, 580 ] 9706 10.540% 77.275% ## ( 580, 870 ] 6002 6.518% 83.793% # ( 870, 1300 ] 3632 3.944% 87.737% # ( 1300, 1900 ] 2964 3.219% 90.956% # ( 1900, 2900 ] 2744 2.980% 93.936% # ( 2900, 4400 ] 2853 3.098% 97.034% # ( 4400, 6600 ] 2045 2.221% 99.255% ( 6600, 9900 ] 585 0.635% 99.890% ( 9900, 14000 ] 55 0.060% 99.950% ( 14000, 22000 ] 16 0.017% 99.967% ( 22000, 33000 ] 15 0.016% 99.984% ( 33000, 50000 ] 11 0.012% 99.996% ( 50000, 75000 ] 5 0.005% 100.001% ** DB Stats ** Uptime(secs): 23.4 total, 5.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 126.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.394 H:M:S, 31.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 188.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.368 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/10-14:23:56 ... thread 0: (1000000,4000000) ops and (196760.8,142076.2) ops/second in (5.082313,28.153898) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.89 GB 0.0 3.3 0.0 3.3 7.0 3.7 0.0 1.9 75.4 162.0 44.30 30.84 66 0.671 3390K 3570 0.0 0.0 L1 15/15 1.47 GB 0.0 2.4 1.4 1.0 2.4 1.4 0.0 1.7 88.7 88.3 27.54 16.34 2 13.771 2480K 11K 0.0 0.0 L2 1/0 55.61 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 993.14 MB 1.0 5.7 3.3 2.4 5.6 3.2 0.1 1.7 85.5 85.0 67.96 36.79 26 2.614 3205K 8673 0.0 0.0 L4 182/0 9.76 GB 1.0 5.2 4.4 0.9 5.2 4.3 0.2 1.2 91.1 90.5 58.90 34.01 48 1.227 3728K 207 0.0 0.0 L5 1428/0 91.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1656/29 106.68 GB 0.0 16.6 9.0 7.5 20.2 12.7 5.1 5.4 85.4 104.3 198.70 117.97 142 1.399 12M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.6 9.0 7.5 20.2 12.7 5.1 5.4 85.4 104.3 198.70 117.97 142 1.399 12M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.6 9.0 7.5 16.5 9.0 0.0 0.0 97.9 97.5 173.16 104.41 88 1.968 12M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 150.4 25.55 13.56 54 0.473 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.5 total, 28.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.23 GB write, 726.86 MB/s write, 16.56 GB read, 594.96 MB/s read, 198.7 seconds Interval compaction: 20.23 GB write, 735.82 MB/s write, 16.56 GB read, 602.30 MB/s read, 198.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 67, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1240650 Average: 14.2129 StdDev: 140.22 Min: 1 Median: 2.4129 Max: 30957 Percentiles: P50: 2.41 P75: 3.38 P99: 295.55 P99.9: 925.46 P99.99: 2450.20 ------------------------------------------------------ [ 0, 1 ] 40648 3.276% 3.276% # ( 1, 2 ] 394666 31.811% 35.088% ###### ( 2, 3 ] 448038 36.113% 71.201% ####### ( 3, 4 ] 123283 9.937% 81.138% ## ( 4, 6 ] 133780 10.783% 91.921% ## ( 6, 10 ] 57823 4.661% 96.581% # ( 10, 15 ] 9090 0.733% 97.314% ( 15, 22 ] 1937 0.156% 97.470% ( 22, 34 ] 201 0.016% 97.486% ( 34, 51 ] 30 0.002% 97.489% ( 51, 76 ] 32 0.003% 97.491% ( 76, 110 ] 33 0.003% 97.494% ( 110, 170 ] 3392 0.273% 97.768% ( 170, 250 ] 12249 0.987% 98.755% ( 250, 380 ] 8680 0.700% 99.454% ( 380, 580 ] 3720 0.300% 99.754% ( 580, 870 ] 1731 0.140% 99.894% ( 870, 1300 ] 592 0.048% 99.942% ( 1300, 1900 ] 366 0.030% 99.971% ( 1900, 2900 ] 427 0.034% 100.005% ( 2900, 4400 ] 423 0.034% 100.040% ( 4400, 6600 ] 157 0.013% 100.052% ( 6600, 9900 ] 27 0.002% 100.054% ( 9900, 14000 ] 5 0.000% 100.055% ( 14000, 22000 ] 8 0.001% 100.055% ( 22000, 33000 ] 4 0.000% 100.056% ** Level 1 read latency histogram (micros): Count: 316570 Average: 15.8471 StdDev: 232.06 Min: 1 Median: 2.7717 Max: 33798 Percentiles: P50: 2.77 P75: 4.48 P99: 181.29 P99.9: 2929.02 P99.99: 5664.33 ------------------------------------------------------ [ 0, 1 ] 4104 1.296% 1.296% ( 1, 2 ] 69511 21.958% 23.254% #### ( 2, 3 ] 109714 34.657% 57.911% ####### ( 3, 4 ] 39576 12.502% 70.413% ### ( 4, 6 ] 60268 19.038% 89.450% #### ( 6, 10 ] 23759 7.505% 96.955% ## ( 10, 15 ] 4494 1.420% 98.375% ( 15, 22 ] 1305 0.412% 98.787% ( 22, 34 ] 91 0.029% 98.816% ( 34, 51 ] 31 0.010% 98.826% ( 51, 76 ] 25 0.008% 98.834% ( 76, 110 ] 9 0.003% 98.837% ( 110, 170 ] 360 0.114% 98.950% ( 170, 250 ] 1115 0.352% 99.303% ( 250, 380 ] 721 0.228% 99.530% ( 380, 580 ] 326 0.103% 99.633% ( 580, 870 ] 269 0.085% 99.718% ( 870, 1300 ] 174 0.055% 99.773% ( 1300, 1900 ] 169 0.053% 99.827% ( 1900, 2900 ] 228 0.072% 99.899% ( 2900, 4400 ] 229 0.072% 99.971% ( 4400, 6600 ] 105 0.033% 100.004% ( 6600, 9900 ] 30 0.009% 100.014% ( 9900, 14000 ] 4 0.001% 100.015% ( 14000, 22000 ] 8 0.003% 100.017% ( 22000, 33000 ] 5 0.002% 100.019% ( 33000, 50000 ] 1 0.000% 100.019% ** Level 2 read latency histogram (micros): Count: 619140 Average: 23.6177 StdDev: 308.40 Min: 1 Median: 2.8973 Max: 38072 Percentiles: P50: 2.90 P75: 4.77 P99: 14.81 P99.9: 2580.39 P99.99: 3255.51 ------------------------------------------------------ [ 0, 1 ] 1175 0.190% 0.190% ( 1, 2 ] 81959 13.238% 13.427% ### ( 2, 3 ] 252366 40.761% 54.188% ######## ( 3, 4 ] 82984 13.403% 67.591% ### ( 4, 6 ] 119606 19.318% 86.909% #### ( 6, 10 ] 63533 10.261% 97.171% ## ( 10, 15 ] 11764 1.900% 99.071% ( 15, 22 ] 2686 0.434% 99.505% ( 22, 34 ] 329 0.053% 99.558% ( 34, 51 ] 65 0.010% 99.568% ( 51, 76 ] 43 0.007% 99.575% ( 76, 110 ] 40 0.006% 99.582% ( 110, 170 ] 46 0.007% 99.589% ( 170, 250 ] 117 0.019% 99.608% ( 250, 380 ] 97 0.016% 99.624% ( 380, 580 ] 102 0.016% 99.640% ( 580, 870 ] 186 0.030% 99.670% ( 870, 1300 ] 291 0.047% 99.717% ( 1300, 1900 ] 544 0.088% 99.805% ( 1900, 2900 ] 864 0.140% 99.945% ( 2900, 4400 ] 1186 0.192% 100.136% ( 4400, 6600 ] 490 0.079% 100.215% ( 6600, 9900 ] 129 0.021% 100.236% ( 9900, 14000 ] 12 0.002% 100.238% ( 14000, 22000 ] 17 0.003% 100.241% ( 22000, 33000 ] 11 0.002% 100.243% ( 33000, 50000 ] 2 0.000% 100.243% ** Level 3 read latency histogram (micros): Count: 1693160 Average: 14.7729 StdDev: 204.27 Min: 1 Median: 2.8679 Max: 30977 Percentiles: P50: 2.87 P75: 4.61 P99: 13.22 P99.9: 131.64 P99.99: 366.57 ------------------------------------------------------ [ 0, 1 ] 2980 0.176% 0.176% ( 1, 2 ] 215106 12.704% 12.880% ### ( 2, 3 ] 724173 42.771% 55.651% ######### ( 3, 4 ] 227724 13.450% 69.101% ### ( 4, 6 ] 326061 19.258% 88.358% #### ( 6, 10 ] 163733 9.670% 98.028% ## ( 10, 15 ] 25513 1.507% 99.535% ( 15, 22 ] 5090 0.301% 99.836% ( 22, 34 ] 443 0.026% 99.862% ( 34, 51 ] 146 0.009% 99.871% ( 51, 76 ] 272 0.016% 99.887% ( 76, 110 ] 118 0.007% 99.894% ( 110, 170 ] 299 0.018% 99.911% ( 170, 250 ] 809 0.048% 99.959% ( 250, 380 ] 584 0.034% 99.994% ( 380, 580 ] 435 0.026% 100.019% ( 580, 870 ] 596 0.035% 100.054% ( 870, 1300 ] 919 0.054% 100.109% ( 1300, 1900 ] 1153 0.068% 100.177% ( 1900, 2900 ] 1469 0.087% 100.264% ( 2900, 4400 ] 1556 0.092% 100.355% ( 4400, 6600 ] 647 0.038% 100.394% ( 6600, 9900 ] 171 0.010% 100.404% ( 9900, 14000 ] 18 0.001% 100.405% ( 14000, 22000 ] 17 0.001% 100.406% ( 22000, 33000 ] 5 0.000% 100.406% ** Level 4 read latency histogram (micros): Count: 249276 Average: 88.9611 StdDev: 578.94 Min: 0 Median: 2.9553 Max: 51074 Percentiles: P50: 2.96 P75: 5.35 P99: 2214.49 P99.9: 5593.35 P99.99: 6557.34 ------------------------------------------------------ [ 0, 1 ] 781 0.313% 0.313% ( 1, 2 ] 31618 12.684% 12.997% ### ( 2, 3 ] 96557 38.735% 51.732% ######## ( 3, 4 ] 29918 12.002% 63.734% ## ( 4, 6 ] 41566 16.675% 80.409% ### ( 6, 10 ] 18409 7.385% 87.794% # ( 10, 15 ] 3140 1.260% 89.053% ( 15, 22 ] 711 0.285% 89.339% ( 22, 34 ] 56 0.022% 89.361% ( 34, 51 ] 35 0.014% 89.375% ( 51, 76 ] 48 0.019% 89.394% ( 76, 110 ] 53 0.021% 89.416% ( 110, 170 ] 2825 1.133% 90.549% ( 170, 250 ] 8527 3.421% 93.970% # ( 250, 380 ] 5370 2.154% 96.124% ( 380, 580 ] 2638 1.058% 97.182% ( 580, 870 ] 1645 0.660% 97.842% ( 870, 1300 ] 1270 0.509% 98.352% ( 1300, 1900 ] 1242 0.498% 98.850% ( 1900, 2900 ] 1190 0.477% 99.327% ( 2900, 4400 ] 1150 0.461% 99.789% ( 4400, 6600 ] 512 0.205% 99.994% ( 6600, 9900 ] 119 0.048% 100.042% ( 9900, 14000 ] 12 0.005% 100.047% ( 14000, 22000 ] 22 0.009% 100.055% ( 22000, 33000 ] 14 0.006% 100.061% ( 33000, 50000 ] 8 0.003% 100.064% ( 50000, 75000 ] 1 0.000% 100.065% ** Level 5 read latency histogram (micros): Count: 140120 Average: 562.1873 StdDev: 1141.69 Min: 95 Median: 252.3315 Max: 71553 Percentiles: P50: 252.33 P75: 427.39 P99: 5831.67 P99.9: 9684.96 P99.99: 36072.36 ------------------------------------------------------ ( 76, 110 ] 210 0.150% 0.150% ( 110, 170 ] 17802 12.705% 12.855% ### ( 170, 250 ] 51474 36.736% 49.590% ####### ( 250, 380 ] 32005 22.841% 72.431% ##### ( 380, 580 ] 15188 10.839% 83.271% ## ( 580, 870 ] 8113 5.790% 89.061% # ( 870, 1300 ] 3978 2.839% 91.900% # ( 1300, 1900 ] 3007 2.146% 94.046% ( 1900, 2900 ] 2755 1.966% 96.012% ( 2900, 4400 ] 2856 2.038% 98.050% ( 4400, 6600 ] 2045 1.459% 99.510% ( 6600, 9900 ] 585 0.417% 99.927% ( 9900, 14000 ] 55 0.039% 99.966% ( 14000, 22000 ] 16 0.011% 99.978% ( 22000, 33000 ] 15 0.011% 99.989% ( 33000, 50000 ] 11 0.008% 99.996% ( 50000, 75000 ] 5 0.004% 100.000% ** DB Stats ** Uptime(secs): 28.5 total, 5.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 138.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.699 H:M:S, 27.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.305 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 369.431 micros/op 10822 ops/sec 60.153 seconds 650996 operations; 10.5 MB/s (165999 of 165999 found) Microseconds per read: Count: 650996 Average: 369.4334 StdDev: 1423.89 Min: 2 Median: 246.7497 Max: 160196 Percentiles: P50: 246.75 P75: 342.32 P99: 1720.67 P99.9: 26263.75 P99.99: 47865.80 ------------------------------------------------------ ( 1, 2 ] 10 0.002% 0.002% ( 2, 3 ] 46 0.007% 0.009% ( 3, 4 ] 48 0.007% 0.016% ( 4, 6 ] 66 0.010% 0.026% ( 6, 10 ] 228 0.035% 0.061% ( 10, 15 ] 2681 0.412% 0.473% ( 15, 22 ] 4383 0.673% 1.146% ( 22, 34 ] 5502 0.845% 1.991% ( 34, 51 ] 3202 0.492% 2.483% ( 51, 76 ] 453 0.070% 2.553% ( 76, 110 ] 33 0.005% 2.558% ( 110, 170 ] 27564 4.234% 6.792% # ( 170, 250 ] 293194 45.038% 51.830% ######### ( 250, 380 ] 212391 32.626% 84.455% ####### ( 380, 580 ] 64705 9.939% 94.395% ## ( 580, 870 ] 21564 3.312% 97.707% # ( 870, 1300 ] 6434 0.988% 98.696% ( 1300, 1900 ] 2827 0.434% 99.130% ( 1900, 2900 ] 1803 0.277% 99.407% ( 2900, 4400 ] 1402 0.215% 99.622% ( 4400, 6600 ] 676 0.104% 99.726% ( 6600, 9900 ] 175 0.027% 99.753% ( 9900, 14000 ] 61 0.009% 99.762% ( 14000, 22000 ] 628 0.096% 99.859% ( 22000, 33000 ] 694 0.107% 99.965% ( 33000, 50000 ] 184 0.028% 99.994% ( 50000, 75000 ] 25 0.004% 99.997% ( 75000, 110000 ] 11 0.002% 99.999% ( 110000, 170000 ] 6 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12264959 rocksdb.bloom.filter.full.positive COUNT : 769860 rocksdb.bloom.filter.full.true.positive COUNT : 650630 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 366 rocksdb.memtable.miss COUNT : 650630 rocksdb.l0.hit COUNT : 22225 rocksdb.l1.hit COUNT : 8142 rocksdb.l2andup.hit COUNT : 620263 rocksdb.compaction.key.drop.new COUNT : 101436 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4725725 rocksdb.number.keys.read COUNT : 650996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4876948200 rocksdb.bytes.read COUNT : 650996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1933 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36100303 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19604704301 rocksdb.compact.write.bytes COUNT : 19497672308 rocksdb.flush.write.bytes COUNT : 4822245276 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 1018 rocksdb.number.superversion_releases COUNT : 987 rocksdb.number.superversion_cleanups COUNT : 254 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 263 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4783314944 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1816576 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 22536297975 rocksdb.non.last.level.read.count COUNT : 5303809 rocksdb.block.checksum.compute.count COUNT : 5528252 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 245.743036 P95 : 630.888453 P99 : 1718.816182 P100 : 160192.000000 COUNT : 650996 SUM : 239894488 rocksdb.db.write.micros P50 : 2.150306 P95 : 5.855801 P99 : 10.683284 P100 : 1257932.000000 COUNT : 4725725 SUM : 52204542 rocksdb.compaction.times.micros P50 : 1593750.000000 P95 : 3866000.000000 P99 : 14720000.000000 P100 : 16002346.000000 COUNT : 91 SUM : 177860611 rocksdb.compaction.times.cpu_micros P50 : 951538.461538 P95 : 2390000.000000 P99 : 8298500.000000 P100 : 9622217.000000 COUNT : 91 SUM : 109021735 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1414.285714 P95 : 11335.000000 P99 : 19360.000000 P100 : 20796.000000 COUNT : 66 SUM : 186973 rocksdb.compaction.outfile.sync.micros P50 : 6627.500000 P95 : 20373.333333 P99 : 44007.500000 P100 : 70741.000000 COUNT : 241 SUM : 1876966 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 676.666667 P95 : 5481.666667 P99 : 15440.000000 P100 : 40350.000000 COUNT : 182 SUM : 327846 rocksdb.table.open.io.micros P50 : 15412.042503 P95 : 30033.262712 P99 : 41938.076923 P100 : 157527.000000 COUNT : 1933 SUM : 29174193 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.552764 P95 : 14.251658 P99 : 270.056680 P100 : 51085.000000 COUNT : 4747407 SUM : 108544745 rocksdb.read.block.get.micros P50 : 210.218262 P95 : 502.184082 P99 : 2034.130265 P100 : 71633.000000 COUNT : 778909 SUM : 204090713 rocksdb.write.raw.block.micros P50 : 0.621138 P95 : 1.899812 P99 : 4.665309 P100 : 72992.000000 COUNT : 5890631 SUM : 27313771 rocksdb.numfiles.in.singlecompaction P50 : 2.571429 P95 : 3.930000 P99 : 14.200000 P100 : 29.000000 COUNT : 116 SUM : 384 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570439 P95 : 2001.026097 P99 : 2721.438909 P100 : 1257742.000000 COUNT : 151827 SUM : 36113605 rocksdb.sst.read.micros P50 : 2.986284 P95 : 242.558257 P99 : 556.194905 P100 : 71553.000000 COUNT : 5303849 SUM : 298348337 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 650996 SUM : 650996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4725725 SUM : 4876948200 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 302962.962963 P95 : 1322500.000000 P99 : 1588072.000000 P100 : 1588072.000000 COUNT : 66 SUM : 28436559 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 276 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0