[2024-07-14 11:18:51.513659] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... [2024-07-14 11:18:51.513804] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid789901 ] Set seed to 1720948731510295 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 11:18:51.596197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 11:18:51.635900] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 11:18:51.635951] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 789901' to capture a snapshot of events at runtime. [2024-07-14 11:18:51.635963] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid789901 for offline analysis/debug. [2024-07-14 11:18:51.635986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 11:18:55 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-11:18:58 ... thread 0: (1000000,1000000) ops and (338425.7,338425.7) ops/second in (2.954858,2.954858) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 629.98 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.8 2.50 2.26 12 0.208 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 10/0 804.25 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 94.2 313.9 4.01 3.71 14 0.287 383K 218 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.4 94.2 313.9 4.01 3.71 14 0.287 383K 218 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.8 2.50 2.26 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 396.67 MB/s write, 0.37 GB read, 119.01 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 425.99 MB/s write, 0.37 GB read, 127.81 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 113119 Average: 1.8899 StdDev: 18.82 Min: 1 Median: 1.2187 Max: 3405 Percentiles: P50: 1.22 P75: 1.66 P99: 3.98 P99.9: 11.00 P99.99: 264.91 ------------------------------------------------------ [ 0, 1 ] 42584 37.645% 37.645% ######## ( 1, 2 ] 63911 56.499% 94.144% ########### ( 2, 3 ] 3929 3.473% 97.618% # ( 3, 4 ] 1603 1.417% 99.035% ( 4, 6 ] 729 0.644% 99.679% ( 6, 10 ] 231 0.204% 99.883% ( 10, 15 ] 94 0.083% 99.966% ( 15, 22 ] 13 0.011% 99.978% ( 22, 34 ] 2 0.002% 99.980% ( 110, 170 ] 8 0.007% 99.987% ( 170, 250 ] 3 0.003% 99.989% ( 250, 380 ] 6 0.005% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 3 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 60801 Average: 2.0983 StdDev: 24.79 Min: 1 Median: 1.2500 Max: 3259 Percentiles: P50: 1.25 P75: 1.69 P99: 4.92 P99.9: 11.90 P99.99: 1067.78 ------------------------------------------------------ [ 0, 1 ] 21682 35.661% 35.661% ####### ( 1, 2 ] 34872 57.354% 93.015% ########### ( 2, 3 ] 2264 3.724% 96.739% # ( 3, 4 ] 1135 1.867% 98.605% ( 4, 6 ] 524 0.862% 99.467% ( 6, 10 ] 245 0.403% 99.870% ( 10, 15 ] 48 0.079% 99.949% ( 15, 22 ] 6 0.010% 99.959% ( 22, 34 ] 5 0.008% 99.967% ( 34, 51 ] 1 0.002% 99.969% ( 51, 76 ] 2 0.003% 99.972% ( 110, 170 ] 1 0.002% 99.974% ( 250, 380 ] 2 0.003% 99.977% ( 380, 580 ] 5 0.008% 99.985% ( 580, 870 ] 2 0.003% 99.988% ( 870, 1300 ] 2 0.003% 99.992% ( 1300, 1900 ] 1 0.002% 99.993% ( 1900, 2900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1662.1500 StdDev: 1335.54 Min: 184 Median: 821.6667 Max: 4394 Percentiles: P50: 821.67 P75: 2900.00 P99: 4340.00 P99.9: 4394.00 P99.99: 4394.00 ------------------------------------------------------ ( 170, 250 ] 2 5.000% 5.000% # ( 250, 380 ] 2 5.000% 10.000% # ( 380, 580 ] 6 15.000% 25.000% ### ( 580, 870 ] 12 30.000% 55.000% ###### ( 870, 1300 ] 1 2.500% 57.500% # ( 1300, 1900 ] 2 5.000% 62.500% # ( 1900, 2900 ] 5 12.500% 75.000% ### ( 2900, 4400 ] 10 25.000% 100.000% ##### ** Level 4 read latency histogram (micros): Count: 30 Average: 2000.5667 StdDev: 1719.17 Min: 210 Median: 1128.0000 Max: 6850 Percentiles: P50: 1128.00 P75: 3368.75 P99: 6850.00 P99.9: 6850.00 P99.99: 6850.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 3 10.000% 16.667% ## ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 5 16.667% 56.667% ### ( 1300, 1900 ] 1 3.333% 60.000% # ( 1900, 2900 ] 2 6.667% 66.667% # ( 2900, 4400 ] 8 26.667% 93.333% ##### ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.382 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.382 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-11:19:01 ... thread 0: (1000000,2000000) ops and (348971.4,343617.7) ops/second in (2.865564,5.820422) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.2 325.9 7.34 6.74 28 0.262 575K 641 0.0 0.0 L1 1/0 3.11 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 239.0 238.6 1.58 1.54 1 1.582 383K 600 0.0 0.0 L2 2/1 54.24 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 20/10 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 234.9 234.9 1.06 1.00 1 1.063 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 152.0 152.1 1.48 1.11 1 1.479 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/19 97.92 GB 0.0 1.8 1.0 0.7 3.5 2.8 1.1 2.0 138.5 279.1 12.98 11.84 33 0.393 1825K 1459 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.0 0.7 3.5 2.8 1.0 2.0 138.5 279.1 12.98 11.84 33 0.393 1825K 1459 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.0 0.7 1.8 1.0 0.0 0.0 229.6 229.4 7.83 7.25 7 1.119 1825K 1459 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.8 5.15 4.59 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.54 GB write, 599.69 MB/s write, 1.76 GB read, 297.53 MB/s read, 13.0 seconds Interval compaction: 3.54 GB write, 622.20 MB/s write, 1.76 GB read, 308.70 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 391731 Average: 2.1798 StdDev: 12.10 Min: 1 Median: 1.4547 Max: 3405 Percentiles: P50: 1.45 P75: 1.86 P99: 5.79 P99.9: 12.29 P99.99: 20.23 ------------------------------------------------------ [ 0, 1 ] 85141 21.735% 21.735% #### ( 1, 2 ] 243502 62.161% 83.895% ############ ( 2, 3 ] 32825 8.379% 92.275% ## ( 3, 4 ] 16093 4.108% 96.383% # ( 4, 6 ] 11444 2.921% 99.304% # ( 6, 10 ] 2081 0.531% 99.835% ( 10, 15 ] 556 0.142% 99.977% ( 15, 22 ] 68 0.017% 99.995% ( 22, 34 ] 25 0.006% 100.001% ( 34, 51 ] 4 0.001% 100.002% ( 110, 170 ] 13 0.003% 100.005% ( 170, 250 ] 10 0.003% 100.008% ( 250, 380 ] 13 0.003% 100.011% ( 380, 580 ] 5 0.001% 100.013% ( 580, 870 ] 4 0.001% 100.014% ( 870, 1300 ] 4 0.001% 100.015% ( 1300, 1900 ] 2 0.001% 100.015% ( 1900, 2900 ] 2 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 25 Average: 189.2400 StdDev: 453.77 Min: 1 Median: 1.6875 Max: 2231 Percentiles: P50: 1.69 P75: 230.00 P99: 2231.00 P99.9: 2231.00 P99.99: 2231.00 ------------------------------------------------------ [ 0, 1 ] 7 28.000% 28.000% ###### ( 1, 2 ] 8 32.000% 60.000% ###### ( 2, 3 ] 1 4.000% 64.000% # ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 3 12.000% 88.000% ## ( 380, 580 ] 1 4.000% 92.000% # ( 580, 870 ] 1 4.000% 96.000% # ( 1900, 2900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 95705 Average: 2.1202 StdDev: 19.77 Min: 1 Median: 1.3497 Max: 3259 Percentiles: P50: 1.35 P75: 1.77 P99: 5.48 P99.9: 11.13 P99.99: 557.18 ------------------------------------------------------ [ 0, 1 ] 27822 29.071% 29.071% ###### ( 1, 2 ] 57287 59.858% 88.928% ############ ( 2, 3 ] 5577 5.827% 94.756% # ( 3, 4 ] 2850 2.978% 97.734% # ( 4, 6 ] 1640 1.714% 99.447% ( 6, 10 ] 415 0.434% 99.881% ( 10, 15 ] 81 0.085% 99.966% ( 15, 22 ] 7 0.007% 99.973% ( 22, 34 ] 5 0.005% 99.978% ( 34, 51 ] 2 0.002% 99.980% ( 51, 76 ] 2 0.002% 99.982% ( 110, 170 ] 1 0.001% 99.983% ( 250, 380 ] 2 0.002% 99.985% ( 380, 580 ] 5 0.005% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 3 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 178518 Average: 3.4002 StdDev: 35.37 Min: 1 Median: 1.6309 Max: 4394 Percentiles: P50: 1.63 P75: 2.19 P99: 9.24 P99.9: 151.76 P99.99: 370.37 ------------------------------------------------------ [ 0, 1 ] 21579 12.088% 12.088% ## ( 1, 2 ] 107274 60.091% 72.179% ############ ( 2, 3 ] 26178 14.664% 86.843% ### ( 3, 4 ] 9792 5.485% 92.329% # ( 4, 6 ] 9388 5.259% 97.587% # ( 6, 10 ] 3118 1.747% 99.334% ( 10, 15 ] 675 0.378% 99.712% ( 15, 22 ] 100 0.056% 99.768% ( 22, 34 ] 39 0.022% 99.790% ( 34, 51 ] 7 0.004% 99.794% ( 51, 76 ] 4 0.002% 99.796% ( 76, 110 ] 64 0.036% 99.832% ( 110, 170 ] 176 0.099% 99.931% ( 170, 250 ] 59 0.033% 99.964% ( 250, 380 ] 52 0.029% 99.993% ( 380, 580 ] 54 0.030% 100.023% ( 580, 870 ] 25 0.014% 100.037% ( 870, 1300 ] 8 0.004% 100.041% ( 1300, 1900 ] 5 0.003% 100.044% ( 1900, 2900 ] 5 0.003% 100.047% ( 2900, 4400 ] 10 0.006% 100.053% ** Level 4 read latency histogram (micros): Count: 320 Average: 193.9625 StdDev: 784.56 Min: 0 Median: 1.9623 Max: 6850 Percentiles: P50: 1.96 P75: 8.46 P99: 4175.00 P99.9: 6850.00 P99.99: 6850.00 ------------------------------------------------------ [ 0, 1 ] 58 18.125% 18.125% #### ( 1, 2 ] 106 33.125% 51.250% ####### ( 2, 3 ] 49 15.312% 66.562% ### ( 3, 4 ] 12 3.750% 70.312% # ( 4, 6 ] 7 2.188% 72.500% ( 6, 10 ] 13 4.062% 76.562% # ( 10, 15 ] 27 8.438% 85.000% ## ( 15, 22 ] 14 4.375% 89.375% # ( 22, 34 ] 1 0.312% 89.688% ( 170, 250 ] 3 0.938% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 7 2.188% 94.375% ( 870, 1300 ] 5 1.562% 95.938% ( 1300, 1900 ] 1 0.312% 96.250% ( 1900, 2900 ] 2 0.625% 96.875% ( 2900, 4400 ] 8 2.500% 99.375% # ( 4400, 6600 ] 1 0.312% 99.688% ( 6600, 9900 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 6.0 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.573 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.191 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-11:19:04 ... thread 0: (1000000,3000000) ops and (333359.1,340128.7) ops/second in (2.999768,8.820190) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.15 GB 31.5 1.7 0.0 1.7 4.4 2.8 0.0 1.6 118.6 316.0 14.35 13.39 46 0.312 1727K 1870 0.0 0.0 L1 1/1 3.11 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 239.0 238.6 1.58 1.54 1 1.582 383K 600 0.0 0.0 L2 1/0 52.18 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 19/0 893.64 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 241.3 240.8 4.38 4.04 2 2.188 1072K 2090 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 152.0 152.1 1.48 1.11 1 1.479 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/10 98.90 GB 0.0 3.7 1.0 2.6 6.4 3.8 1.7 2.3 160.4 281.9 23.30 21.53 52 0.448 3795K 4778 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.0 2.6 6.4 3.8 1.6 2.3 160.4 281.9 23.30 21.53 52 0.448 3795K 4778 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.0 2.6 3.6 1.0 0.0 0.0 242.7 242.4 15.40 14.46 12 1.283 3795K 4778 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.0 7.90 7.06 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.41 GB write, 726.44 MB/s write, 3.65 GB read, 413.42 MB/s read, 23.3 seconds Interval compaction: 6.41 GB write, 744.43 MB/s write, 3.65 GB read, 423.66 MB/s read, 23.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 631354 Average: 2.1272 StdDev: 12.19 Min: 0 Median: 1.4206 Max: 3405 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 12.18 P99.99: 29.32 ------------------------------------------------------ [ 0, 1 ] 149722 23.714% 23.714% ##### ( 1, 2 ] 394590 62.499% 86.213% ############ ( 2, 3 ] 46292 7.332% 93.546% # ( 3, 4 ] 21963 3.479% 97.024% # ( 4, 6 ] 14913 2.362% 99.386% ( 6, 10 ] 2885 0.457% 99.843% ( 10, 15 ] 821 0.130% 99.973% ( 15, 22 ] 89 0.014% 99.987% ( 22, 34 ] 26 0.004% 99.992% ( 34, 51 ] 4 0.001% 99.992% ( 51, 76 ] 4 0.001% 99.993% ( 76, 110 ] 26 0.004% 99.997% ( 110, 170 ] 29 0.005% 100.002% ( 170, 250 ] 17 0.003% 100.004% ( 250, 380 ] 18 0.003% 100.007% ( 380, 580 ] 9 0.001% 100.009% ( 580, 870 ] 8 0.001% 100.010% ( 870, 1300 ] 10 0.002% 100.011% ( 1300, 1900 ] 5 0.001% 100.012% ( 1900, 2900 ] 4 0.001% 100.013% ( 2900, 4400 ] 4 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 26 Average: 182.0769 StdDev: 446.40 Min: 1 Median: 1.7500 Max: 2231 Percentiles: P50: 1.75 P75: 210.00 P99: 2231.00 P99.9: 2231.00 P99.99: 2231.00 ------------------------------------------------------ [ 0, 1 ] 7 26.923% 26.923% ##### ( 1, 2 ] 8 30.769% 57.692% ###### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 3 11.538% 88.462% ## ( 380, 580 ] 1 3.846% 92.308% # ( 580, 870 ] 1 3.846% 96.154% # ( 1900, 2900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233010 Average: 3.2883 StdDev: 32.28 Min: 1 Median: 1.5920 Max: 4394 Percentiles: P50: 1.59 P75: 2.00 P99: 9.12 P99.9: 163.61 P99.99: 419.07 ------------------------------------------------------ [ 0, 1 ] 31931 13.704% 13.704% ### ( 1, 2 ] 142856 61.309% 75.013% ############ ( 2, 3 ] 30301 13.004% 88.017% ### ( 3, 4 ] 11697 5.020% 93.037% # ( 4, 6 ] 10721 4.601% 97.638% # ( 6, 10 ] 4074 1.748% 99.386% ( 10, 15 ] 738 0.317% 99.703% ( 15, 22 ] 109 0.047% 99.750% ( 22, 34 ] 39 0.017% 99.767% ( 34, 51 ] 7 0.003% 99.770% ( 51, 76 ] 4 0.002% 99.771% ( 76, 110 ] 65 0.028% 99.799% ( 110, 170 ] 263 0.113% 99.912% ( 170, 250 ] 94 0.040% 99.952% ( 250, 380 ] 75 0.032% 99.985% ( 380, 580 ] 65 0.028% 100.012% ( 580, 870 ] 32 0.014% 100.026% ( 870, 1300 ] 10 0.004% 100.030% ( 1300, 1900 ] 6 0.003% 100.033% ( 1900, 2900 ] 6 0.003% 100.036% ( 2900, 4400 ] 10 0.004% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 193.9625 StdDev: 784.56 Min: 0 Median: 1.9623 Max: 6850 Percentiles: P50: 1.96 P75: 8.46 P99: 4175.00 P99.9: 6850.00 P99.99: 6850.00 ------------------------------------------------------ [ 0, 1 ] 58 18.125% 18.125% #### ( 1, 2 ] 106 33.125% 51.250% ####### ( 2, 3 ] 49 15.312% 66.562% ### ( 3, 4 ] 12 3.750% 70.312% # ( 4, 6 ] 7 2.188% 72.500% ( 6, 10 ] 13 4.062% 76.562% # ( 10, 15 ] 27 8.438% 85.000% ## ( 15, 22 ] 14 4.375% 89.375% # ( 22, 34 ] 1 0.312% 89.688% ( 170, 250 ] 3 0.938% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 7 2.188% 94.375% ( 870, 1300 ] 5 1.562% 95.938% ( 1300, 1900 ] 1 0.312% 96.250% ( 1900, 2900 ] 2 0.625% 96.875% ( 2900, 4400 ] 8 2.500% 99.375% # ( 4400, 6600 ] 1 0.312% 99.688% ( 6600, 9900 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1098.1000 StdDev: 1231.11 Min: 120 Median: 580.0000 Max: 3871 Percentiles: P50: 580.00 P75: 1300.00 P99: 3871.00 P99.9: 3871.00 P99.99: 3871.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 4 20.000% 35.000% #### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 2 10.000% 75.000% ## ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.971 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-11:19:07 ... thread 0: (1000000,4000000) ops and (330599.6,337695.3) ops/second in (3.024807,11.844997) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.13 GB 100.7 2.5 0.0 2.5 6.2 3.7 0.0 1.7 124.6 314.5 20.22 18.91 63 0.321 2558K 2745 0.0 0.0 L1 1/1 3.11 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 239.0 238.6 1.58 1.54 1 1.582 383K 600 0.0 0.0 L2 1/0 52.18 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 19/0 893.64 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 241.3 240.8 4.38 4.04 2 2.188 1072K 2090 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 152.0 152.1 1.48 1.11 1 1.479 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/14 99.88 GB 0.0 4.4 1.0 3.4 8.2 4.8 1.7 2.2 156.2 287.7 29.17 27.04 69 0.423 4626K 5653 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.0 3.4 8.2 4.8 1.6 2.2 156.2 287.7 29.17 27.04 69 0.423 4626K 5653 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.0 3.4 4.4 1.0 0.0 0.0 247.1 246.8 18.44 17.46 15 1.229 4626K 5653 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 358.2 10.73 9.59 54 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.20 GB write, 695.65 MB/s write, 4.45 GB read, 377.65 MB/s read, 29.2 seconds Interval compaction: 8.20 GB write, 708.49 MB/s write, 4.45 GB read, 384.62 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 10, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1032057 Average: 2.1395 StdDev: 10.62 Min: 0 Median: 1.4415 Max: 3405 Percentiles: P50: 1.44 P75: 1.83 P99: 5.67 P99.9: 11.25 P99.99: 15.74 ------------------------------------------------------ [ 0, 1 ] 222877 21.595% 21.595% #### ( 1, 2 ] 664042 64.342% 85.937% ############# ( 2, 3 ] 79291 7.683% 93.620% ## ( 3, 4 ] 35493 3.439% 97.059% # ( 4, 6 ] 24028 2.328% 99.387% ( 6, 10 ] 4991 0.484% 99.871% ( 10, 15 ] 1222 0.118% 99.989% ( 15, 22 ] 112 0.011% 100.000% ( 22, 34 ] 29 0.003% 100.003% ( 34, 51 ] 6 0.001% 100.003% ( 51, 76 ] 9 0.001% 100.004% ( 76, 110 ] 58 0.006% 100.010% ( 110, 170 ] 52 0.005% 100.015% ( 170, 250 ] 24 0.002% 100.017% ( 250, 380 ] 34 0.003% 100.020% ( 380, 580 ] 20 0.002% 100.022% ( 580, 870 ] 17 0.002% 100.024% ( 870, 1300 ] 11 0.001% 100.025% ( 1300, 1900 ] 7 0.001% 100.026% ( 1900, 2900 ] 6 0.001% 100.026% ( 2900, 4400 ] 4 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 26 Average: 182.0769 StdDev: 446.40 Min: 1 Median: 1.7500 Max: 2231 Percentiles: P50: 1.75 P75: 210.00 P99: 2231.00 P99.9: 2231.00 P99.99: 2231.00 ------------------------------------------------------ [ 0, 1 ] 7 26.923% 26.923% ##### ( 1, 2 ] 8 30.769% 57.692% ###### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 3 11.538% 88.462% ## ( 380, 580 ] 1 3.846% 92.308% # ( 580, 870 ] 1 3.846% 96.154% # ( 1900, 2900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233010 Average: 3.2883 StdDev: 32.28 Min: 1 Median: 1.5920 Max: 4394 Percentiles: P50: 1.59 P75: 2.00 P99: 9.12 P99.9: 163.61 P99.99: 419.07 ------------------------------------------------------ [ 0, 1 ] 31931 13.704% 13.704% ### ( 1, 2 ] 142856 61.309% 75.013% ############ ( 2, 3 ] 30301 13.004% 88.017% ### ( 3, 4 ] 11697 5.020% 93.037% # ( 4, 6 ] 10721 4.601% 97.638% # ( 6, 10 ] 4074 1.748% 99.386% ( 10, 15 ] 738 0.317% 99.703% ( 15, 22 ] 109 0.047% 99.750% ( 22, 34 ] 39 0.017% 99.767% ( 34, 51 ] 7 0.003% 99.770% ( 51, 76 ] 4 0.002% 99.771% ( 76, 110 ] 65 0.028% 99.799% ( 110, 170 ] 263 0.113% 99.912% ( 170, 250 ] 94 0.040% 99.952% ( 250, 380 ] 75 0.032% 99.985% ( 380, 580 ] 65 0.028% 100.012% ( 580, 870 ] 32 0.014% 100.026% ( 870, 1300 ] 10 0.004% 100.030% ( 1300, 1900 ] 6 0.003% 100.033% ( 1900, 2900 ] 6 0.003% 100.036% ( 2900, 4400 ] 10 0.004% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 193.9625 StdDev: 784.56 Min: 0 Median: 1.9623 Max: 6850 Percentiles: P50: 1.96 P75: 8.46 P99: 4175.00 P99.9: 6850.00 P99.99: 6850.00 ------------------------------------------------------ [ 0, 1 ] 58 18.125% 18.125% #### ( 1, 2 ] 106 33.125% 51.250% ####### ( 2, 3 ] 49 15.312% 66.562% ### ( 3, 4 ] 12 3.750% 70.312% # ( 4, 6 ] 7 2.188% 72.500% ( 6, 10 ] 13 4.062% 76.562% # ( 10, 15 ] 27 8.438% 85.000% ## ( 15, 22 ] 14 4.375% 89.375% # ( 22, 34 ] 1 0.312% 89.688% ( 170, 250 ] 3 0.938% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 7 2.188% 94.375% ( 870, 1300 ] 5 1.562% 95.938% ( 1300, 1900 ] 1 0.312% 96.250% ( 1900, 2900 ] 2 0.625% 96.875% ( 2900, 4400 ] 8 2.500% 99.375% # ( 4400, 6600 ] 1 0.312% 99.688% ( 6600, 9900 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1098.1000 StdDev: 1231.11 Min: 120 Median: 580.0000 Max: 3871 Percentiles: P50: 580.00 P75: 1300.00 P99: 3871.00 P99.9: 3871.00 P99.99: 3871.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 4 20.000% 35.000% #### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 2 10.000% 75.000% ## ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.374 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-11:19:12 ... thread 0: (1000000,5000000) ops and (199698.1,296690.9) ops/second in (5.007559,16.852556) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.21 GB 144.8 3.5 0.0 3.5 8.2 4.7 0.0 1.7 133.4 311.2 26.91 25.23 82 0.328 3645K 3855 0.0 0.0 L1 8/0 844.77 MB 84.5 2.2 2.2 0.0 2.2 2.2 0.2 1.0 236.4 234.7 9.60 9.31 2 4.799 2304K 16K 0.0 0.0 L2 8/6 1.01 GB 2.6 0.4 0.2 0.2 0.4 0.2 1.4 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 19/2 945.74 MB 0.8 1.1 0.3 0.8 1.1 0.3 0.4 3.7 229.9 229.5 4.93 4.42 3 1.643 1150K 2172 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 152.0 152.1 1.48 1.11 1 1.479 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/12 100.79 GB 0.0 7.4 2.9 4.5 12.1 7.6 2.7 2.6 171.0 278.2 44.43 41.53 90 0.494 7712K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 2.9 4.5 12.1 7.6 2.6 2.6 171.0 278.2 44.43 41.53 90 0.494 7712K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 2.9 4.5 7.4 2.9 0.0 0.0 244.8 244.1 31.03 29.57 21 1.477 7712K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.1 13.41 11.97 69 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.1 total, 16.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.07 GB write, 723.95 MB/s write, 7.42 GB read, 444.89 MB/s read, 44.4 seconds Interval compaction: 12.07 GB write, 733.34 MB/s write, 7.42 GB read, 450.66 MB/s read, 44.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 10, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1603308 Average: 2.1563 StdDev: 9.91 Min: 0 Median: 1.4478 Max: 3405 Percentiles: P50: 1.45 P75: 1.83 P99: 5.73 P99.9: 11.00 P99.99: 17.48 ------------------------------------------------------ [ 0, 1 ] 333588 20.806% 20.806% #### ( 1, 2 ] 1045206 65.191% 85.997% ############# ( 2, 3 ] 121923 7.604% 93.601% ## ( 3, 4 ] 54571 3.404% 97.005% # ( 4, 6 ] 36997 2.308% 99.312% ( 6, 10 ] 9073 0.566% 99.878% ( 10, 15 ] 1733 0.108% 99.986% ( 15, 22 ] 163 0.010% 99.997% ( 22, 34 ] 35 0.002% 99.999% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 12 0.001% 100.000% ( 76, 110 ] 145 0.009% 100.009% ( 110, 170 ] 117 0.007% 100.016% ( 170, 250 ] 61 0.004% 100.020% ( 250, 380 ] 61 0.004% 100.024% ( 380, 580 ] 40 0.002% 100.027% ( 580, 870 ] 30 0.002% 100.028% ( 870, 1300 ] 17 0.001% 100.030% ( 1300, 1900 ] 9 0.001% 100.030% ( 1900, 2900 ] 8 0.000% 100.031% ( 2900, 4400 ] 5 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 81004 Average: 3.8962 StdDev: 28.63 Min: 1 Median: 1.7200 Max: 3179 Percentiles: P50: 1.72 P75: 2.48 P99: 9.49 P99.9: 193.07 P99.99: 349.30 ------------------------------------------------------ [ 0, 1 ] 4873 6.016% 6.016% # ( 1, 2 ] 49486 61.091% 67.107% ############ ( 2, 3 ] 13211 16.309% 83.416% ### ( 3, 4 ] 5886 7.266% 90.682% # ( 4, 6 ] 5570 6.876% 97.558% # ( 6, 10 ] 1338 1.652% 99.210% ( 10, 15 ] 372 0.459% 99.669% ( 15, 22 ] 59 0.073% 99.742% ( 22, 34 ] 5 0.006% 99.748% ( 76, 110 ] 31 0.038% 99.786% ( 110, 170 ] 77 0.095% 99.881% ( 170, 250 ] 52 0.064% 99.946% ( 250, 380 ] 47 0.058% 100.004% ( 380, 580 ] 51 0.063% 100.067% ( 580, 870 ] 27 0.033% 100.100% ( 870, 1300 ] 12 0.015% 100.115% ( 1300, 1900 ] 2 0.002% 100.117% ( 1900, 2900 ] 1 0.001% 100.119% ( 2900, 4400 ] 1 0.001% 100.120% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239363 Average: 3.7493 StdDev: 34.95 Min: 1 Median: 1.5976 Max: 4394 Percentiles: P50: 1.60 P75: 2.03 P99: 9.56 P99.9: 269.58 P99.99: 550.80 ------------------------------------------------------ [ 0, 1 ] 32338 13.510% 13.510% ### ( 1, 2 ] 146168 61.065% 74.575% ############ ( 2, 3 ] 31462 13.144% 87.719% ### ( 3, 4 ] 12191 5.093% 92.813% # ( 4, 6 ] 11075 4.627% 97.439% # ( 6, 10 ] 4202 1.755% 99.195% ( 10, 15 ] 772 0.323% 99.517% ( 15, 22 ] 119 0.050% 99.567% ( 22, 34 ] 41 0.017% 99.584% ( 34, 51 ] 7 0.003% 99.587% ( 51, 76 ] 4 0.002% 99.589% ( 76, 110 ] 153 0.064% 99.653% ( 110, 170 ] 393 0.164% 99.817% ( 170, 250 ] 178 0.074% 99.891% ( 250, 380 ] 137 0.057% 99.949% ( 380, 580 ] 116 0.048% 99.997% ( 580, 870 ] 58 0.024% 100.021% ( 870, 1300 ] 18 0.008% 100.029% ( 1300, 1900 ] 7 0.003% 100.032% ( 1900, 2900 ] 7 0.003% 100.035% ( 2900, 4400 ] 10 0.004% 100.039% ** Level 4 read latency histogram (micros): Count: 320 Average: 193.9625 StdDev: 784.56 Min: 0 Median: 1.9623 Max: 6850 Percentiles: P50: 1.96 P75: 8.46 P99: 4175.00 P99.9: 6850.00 P99.99: 6850.00 ------------------------------------------------------ [ 0, 1 ] 58 18.125% 18.125% #### ( 1, 2 ] 106 33.125% 51.250% ####### ( 2, 3 ] 49 15.312% 66.562% ### ( 3, 4 ] 12 3.750% 70.312% # ( 4, 6 ] 7 2.188% 72.500% ( 6, 10 ] 13 4.062% 76.562% # ( 10, 15 ] 27 8.438% 85.000% ## ( 15, 22 ] 14 4.375% 89.375% # ( 22, 34 ] 1 0.312% 89.688% ( 170, 250 ] 3 0.938% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 7 2.188% 94.375% ( 870, 1300 ] 5 1.562% 95.938% ( 1300, 1900 ] 1 0.312% 96.250% ( 1900, 2900 ] 2 0.625% 96.875% ( 2900, 4400 ] 8 2.500% 99.375% # ( 4400, 6600 ] 1 0.312% 99.688% ( 6600, 9900 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1098.1000 StdDev: 1231.11 Min: 120 Median: 580.0000 Max: 3871 Percentiles: P50: 580.00 P75: 1300.00 P99: 3871.00 P99.9: 3871.00 P99.99: 3871.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 4 20.000% 35.000% #### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 2 10.000% 75.000% ## ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 17.1 total, 5.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 288.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.716 H:M:S, 21.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.342 H:M:S, 46.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-11:19:15 ... thread 0: (1000000,6000000) ops and (314982.6,299590.5) ops/second in (3.174779,20.027335) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 3.19 GB 12.6 5.1 0.0 5.1 10.8 5.7 0.0 1.9 144.3 304.1 36.22 34.06 100 0.362 5308K 7248 0.0 0.0 L1 8/8 844.77 MB 0.0 2.2 2.2 0.0 2.2 2.2 0.2 1.0 236.4 234.7 9.60 9.31 2 4.799 2304K 16K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.4 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 23/3 1.06 GB 0.9 2.3 1.2 1.2 2.3 1.2 0.4 2.0 221.3 220.8 10.87 10.02 6 1.812 2443K 5578 0.0 0.0 L4 177/0 9.76 GB 1.0 0.4 0.4 0.0 0.4 0.4 0.8 1.1 164.3 164.1 2.78 2.19 4 0.695 455K 342 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/24 101.77 GB 0.0 10.5 4.0 6.5 16.1 9.6 3.9 2.8 176.1 270.6 60.99 57.04 114 0.535 10M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 4.0 6.5 16.1 9.6 3.8 2.8 176.1 270.6 60.99 57.04 114 0.535 10M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 4.0 6.5 10.5 4.0 0.0 0.0 240.5 239.9 44.64 42.50 31 1.440 10M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.6 16.34 14.55 83 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.2 total, 20.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.12 GB write, 815.04 MB/s write, 10.49 GB read, 530.32 MB/s read, 61.0 seconds Interval compaction: 16.12 GB write, 823.94 MB/s write, 10.49 GB read, 536.10 MB/s read, 61.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 22, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1972935 Average: 2.2907 StdDev: 11.02 Min: 0 Median: 1.4867 Max: 3405 Percentiles: P50: 1.49 P75: 1.88 P99: 5.87 P99.9: 11.59 P99.99: 78.99 ------------------------------------------------------ [ 0, 1 ] 369053 18.706% 18.706% #### ( 1, 2 ] 1268546 64.297% 83.003% ############# ( 2, 3 ] 173127 8.775% 91.778% ## ( 3, 4 ] 82958 4.205% 95.983% # ( 4, 6 ] 63704 3.229% 99.212% # ( 6, 10 ] 12885 0.653% 99.865% ( 10, 15 ] 2180 0.110% 99.976% ( 15, 22 ] 207 0.010% 99.986% ( 22, 34 ] 38 0.002% 99.988% ( 34, 51 ] 9 0.000% 99.988% ( 51, 76 ] 16 0.001% 99.989% ( 76, 110 ] 190 0.010% 99.999% ( 110, 170 ] 280 0.014% 100.013% ( 170, 250 ] 160 0.008% 100.021% ( 250, 380 ] 117 0.006% 100.027% ( 380, 580 ] 91 0.005% 100.032% ( 580, 870 ] 63 0.003% 100.035% ( 870, 1300 ] 30 0.002% 100.036% ( 1300, 1900 ] 12 0.001% 100.037% ( 1900, 2900 ] 11 0.001% 100.038% ( 2900, 4400 ] 5 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 345374 Average: 3.3176 StdDev: 18.71 Min: 1 Median: 1.7424 Max: 3179 Percentiles: P50: 1.74 P75: 2.56 P99: 9.25 P99.9: 123.42 P99.99: 268.79 ------------------------------------------------------ [ 0, 1 ] 18983 5.496% 5.496% # ( 1, 2 ] 207035 59.945% 65.442% ############ ( 2, 3 ] 58644 16.980% 82.421% ### ( 3, 4 ] 25713 7.445% 89.866% # ( 4, 6 ] 26232 7.595% 97.462% ## ( 6, 10 ] 6540 1.894% 99.355% ( 10, 15 ] 1533 0.444% 99.799% ( 15, 22 ] 170 0.049% 99.848% ( 22, 34 ] 15 0.004% 99.853% ( 34, 51 ] 2 0.001% 99.853% ( 51, 76 ] 3 0.001% 99.854% ( 76, 110 ] 114 0.033% 99.887% ( 110, 170 ] 204 0.059% 99.946% ( 170, 250 ] 137 0.040% 99.986% ( 250, 380 ] 107 0.031% 100.017% ( 380, 580 ] 101 0.029% 100.046% ( 580, 870 ] 53 0.015% 100.061% ( 870, 1300 ] 23 0.007% 100.068% ( 1300, 1900 ] 5 0.001% 100.069% ( 1900, 2900 ] 1 0.000% 100.070% ( 2900, 4400 ] 1 0.000% 100.070% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 325759 Average: 3.5386 StdDev: 30.37 Min: 0 Median: 1.6566 Max: 4394 Percentiles: P50: 1.66 P75: 2.30 P99: 9.20 P99.9: 173.75 P99.99: 347.20 ------------------------------------------------------ [ 0, 1 ] 35793 10.988% 10.988% ## ( 1, 2 ] 193549 59.415% 70.402% ############ ( 2, 3 ] 49333 15.144% 85.546% ### ( 3, 4 ] 20084 6.165% 91.712% # ( 4, 6 ] 19232 5.904% 97.615% # ( 6, 10 ] 5642 1.732% 99.347% ( 10, 15 ] 1029 0.316% 99.663% ( 15, 22 ] 157 0.048% 99.711% ( 22, 34 ] 43 0.013% 99.725% ( 34, 51 ] 8 0.002% 99.727% ( 51, 76 ] 5 0.002% 99.729% ( 76, 110 ] 153 0.047% 99.776% ( 110, 170 ] 396 0.122% 99.897% ( 170, 250 ] 197 0.060% 99.958% ( 250, 380 ] 141 0.043% 100.001% ( 380, 580 ] 122 0.037% 100.038% ( 580, 870 ] 65 0.020% 100.058% ( 870, 1300 ] 18 0.006% 100.064% ( 1300, 1900 ] 8 0.002% 100.066% ( 1900, 2900 ] 7 0.002% 100.068% ( 2900, 4400 ] 10 0.003% 100.072% ** Level 4 read latency histogram (micros): Count: 6235 Average: 36.2733 StdDev: 215.75 Min: 0 Median: 1.8522 Max: 6850 Percentiles: P50: 1.85 P75: 3.03 P99: 780.15 P99.9: 3605.94 P99.99: 6850.00 ------------------------------------------------------ [ 0, 1 ] 427 6.848% 6.848% # ( 1, 2 ] 3157 50.634% 57.482% ########## ( 2, 3 ] 1074 17.225% 74.707% ### ( 3, 4 ] 589 9.447% 84.154% ## ( 4, 6 ] 359 5.758% 89.912% # ( 6, 10 ] 120 1.925% 91.836% ( 10, 15 ] 59 0.946% 92.783% ( 15, 22 ] 18 0.289% 93.071% ( 22, 34 ] 6 0.096% 93.168% ( 76, 110 ] 30 0.481% 93.649% ( 110, 170 ] 82 1.315% 94.964% ( 170, 250 ] 76 1.219% 96.183% ( 250, 380 ] 54 0.866% 97.049% ( 380, 580 ] 83 1.331% 98.380% ( 580, 870 ] 56 0.898% 99.278% ( 870, 1300 ] 25 0.401% 99.679% ( 1300, 1900 ] 8 0.128% 99.808% ( 1900, 2900 ] 2 0.032% 99.840% ( 2900, 4400 ] 8 0.128% 99.968% ( 4400, 6600 ] 1 0.016% 99.984% ( 6600, 9900 ] 1 0.016% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 988.4833 StdDev: 1097.66 Min: 88 Median: 546.6667 Max: 4049 Percentiles: P50: 546.67 P75: 1204.44 P99: 4049.00 P99.9: 4049.00 P99.99: 4049.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 6 10.000% 20.000% ## ( 170, 250 ] 11 18.333% 38.333% #### ( 250, 380 ] 2 3.333% 41.667% # ( 380, 580 ] 6 10.000% 51.667% ## ( 580, 870 ] 7 11.667% 63.333% ## ( 870, 1300 ] 9 15.000% 78.333% ### ( 1300, 1900 ] 2 3.333% 81.667% # ( 1900, 2900 ] 4 6.667% 88.333% # ( 2900, 4400 ] 7 11.667% 100.000% ## ** DB Stats ** Uptime(secs): 20.2 total, 3.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 291.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.144 H:M:S, 20.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.428 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-11:19:19 ... thread 0: (1000000,7000000) ops and (258417.0,292923.2) ops/second in (3.869715,23.897050) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.18 GB 88.1 6.0 0.0 6.0 12.6 6.6 0.0 1.9 143.9 303.9 42.46 39.88 117 0.363 6203K 8245 0.0 0.0 L1 8/8 844.77 MB 0.0 2.2 2.2 0.0 2.2 2.2 0.2 1.0 236.4 234.7 9.60 9.31 2 4.799 2304K 16K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.4 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 20/0 940.03 MB 0.9 2.6 1.3 1.3 2.6 1.3 0.4 2.0 221.3 220.8 12.14 11.23 7 1.734 2728K 6106 0.0 0.0 L4 177/0 9.66 GB 1.0 0.7 0.7 0.1 0.7 0.7 0.8 1.1 169.3 169.0 4.51 3.58 8 0.564 760K 913 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/24 102.75 GB 0.0 11.9 4.4 7.5 18.5 11.0 4.2 2.8 173.8 270.2 70.23 65.45 136 0.516 12M 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 4.4 7.5 18.5 11.0 4.1 2.8 173.8 270.2 70.23 65.45 136 0.516 12M 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 4.4 7.5 11.9 4.4 0.0 0.0 239.6 238.9 50.96 48.33 39 1.307 12M 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 353.1 19.27 17.12 97 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.1 total, 23.9 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.53 GB write, 786.89 MB/s write, 11.92 GB read, 506.15 MB/s read, 70.2 seconds Interval compaction: 18.53 GB write, 794.09 MB/s write, 11.92 GB read, 510.78 MB/s read, 70.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 29, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2424244 Average: 2.2784 StdDev: 10.83 Min: 0 Median: 1.4866 Max: 3405 Percentiles: P50: 1.49 P75: 1.87 P99: 5.89 P99.9: 11.43 P99.99: 21.56 ------------------------------------------------------ [ 0, 1 ] 449420 18.539% 18.539% #### ( 1, 2 ] 1567403 64.655% 83.194% ############# ( 2, 3 ] 209875 8.657% 91.851% ## ( 3, 4 ] 100676 4.153% 96.004% # ( 4, 6 ] 76912 3.173% 99.177% # ( 6, 10 ] 16761 0.691% 99.868% ( 10, 15 ] 2709 0.112% 99.980% ( 15, 22 ] 262 0.011% 99.991% ( 22, 34 ] 39 0.002% 99.992% ( 34, 51 ] 11 0.000% 99.993% ( 51, 76 ] 19 0.001% 99.994% ( 76, 110 ] 205 0.008% 100.002% ( 110, 170 ] 304 0.013% 100.015% ( 170, 250 ] 180 0.007% 100.022% ( 250, 380 ] 128 0.005% 100.027% ( 380, 580 ] 103 0.004% 100.031% ( 580, 870 ] 67 0.003% 100.034% ( 870, 1300 ] 35 0.001% 100.036% ( 1300, 1900 ] 12 0.000% 100.036% ( 1900, 2900 ] 14 0.001% 100.037% ( 2900, 4400 ] 7 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 356930 Average: 3.2806 StdDev: 18.41 Min: 1 Median: 1.7332 Max: 3179 Percentiles: P50: 1.73 P75: 2.53 P99: 9.22 P99.9: 120.02 P99.99: 267.38 ------------------------------------------------------ [ 0, 1 ] 20525 5.750% 5.750% # ( 1, 2 ] 215405 60.349% 66.100% ############ ( 2, 3 ] 59550 16.684% 82.784% ### ( 3, 4 ] 26057 7.300% 90.084% # ( 4, 6 ] 26427 7.404% 97.488% # ( 6, 10 ] 6711 1.880% 99.368% ( 10, 15 ] 1558 0.437% 99.805% ( 15, 22 ] 172 0.048% 99.853% ( 22, 34 ] 15 0.004% 99.857% ( 34, 51 ] 2 0.001% 99.858% ( 51, 76 ] 3 0.001% 99.859% ( 76, 110 ] 114 0.032% 99.890% ( 110, 170 ] 204 0.057% 99.948% ( 170, 250 ] 137 0.038% 99.986% ( 250, 380 ] 107 0.030% 100.016% ( 380, 580 ] 101 0.028% 100.044% ( 580, 870 ] 53 0.015% 100.059% ( 870, 1300 ] 23 0.006% 100.066% ( 1300, 1900 ] 5 0.001% 100.067% ( 1900, 2900 ] 1 0.000% 100.067% ( 2900, 4400 ] 1 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 413160 Average: 3.3821 StdDev: 27.03 Min: 0 Median: 1.6888 Max: 4394 Percentiles: P50: 1.69 P75: 2.43 P99: 8.87 P99.9: 144.98 P99.99: 252.42 ------------------------------------------------------ [ 0, 1 ] 39649 9.597% 9.597% ## ( 1, 2 ] 242336 58.654% 68.251% ############ ( 2, 3 ] 65552 15.866% 84.117% ### ( 3, 4 ] 28643 6.933% 91.049% # ( 4, 6 ] 27953 6.766% 97.815% # ( 6, 10 ] 6817 1.650% 99.465% ( 10, 15 ] 1180 0.286% 99.751% ( 15, 22 ] 176 0.043% 99.793% ( 22, 34 ] 43 0.010% 99.804% ( 34, 51 ] 8 0.002% 99.806% ( 51, 76 ] 5 0.001% 99.807% ( 76, 110 ] 154 0.037% 99.844% ( 110, 170 ] 396 0.096% 99.940% ( 170, 250 ] 204 0.049% 99.989% ( 250, 380 ] 144 0.035% 100.024% ( 380, 580 ] 124 0.030% 100.054% ( 580, 870 ] 66 0.016% 100.070% ( 870, 1300 ] 18 0.004% 100.075% ( 1300, 1900 ] 8 0.002% 100.076% ( 1900, 2900 ] 7 0.002% 100.078% ( 2900, 4400 ] 10 0.002% 100.081% ** Level 4 read latency histogram (micros): Count: 14135 Average: 31.2527 StdDev: 172.56 Min: 0 Median: 1.8639 Max: 6850 Percentiles: P50: 1.86 P75: 3.09 P99: 688.50 P99.9: 2273.00 P99.99: 4337.97 ------------------------------------------------------ [ 0, 1 ] 924 6.537% 6.537% # ( 1, 2 ] 7111 50.308% 56.845% ########## ( 2, 3 ] 2443 17.283% 74.128% ### ( 3, 4 ] 1406 9.947% 84.075% ## ( 4, 6 ] 890 6.296% 90.371% # ( 6, 10 ] 273 1.931% 92.303% ( 10, 15 ] 103 0.729% 93.031% ( 15, 22 ] 27 0.191% 93.222% ( 22, 34 ] 8 0.057% 93.279% ( 76, 110 ] 64 0.453% 93.732% ( 110, 170 ] 192 1.358% 95.090% ( 170, 250 ] 191 1.351% 96.441% ( 250, 380 ] 131 0.927% 97.368% ( 380, 580 ] 188 1.330% 98.698% ( 580, 870 ] 114 0.807% 99.505% ( 870, 1300 ] 41 0.290% 99.795% ( 1300, 1900 ] 13 0.092% 99.887% ( 1900, 2900 ] 5 0.035% 99.922% ( 2900, 4400 ] 10 0.071% 99.993% ( 4400, 6600 ] 1 0.007% 100.000% ( 6600, 9900 ] 1 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 80 Average: 962.0375 StdDev: 1086.45 Min: 80 Median: 480.0000 Max: 4049 Percentiles: P50: 480.00 P75: 1252.22 P99: 4049.00 P99.9: 4049.00 P99.99: 4049.00 ------------------------------------------------------ ( 76, 110 ] 10 12.500% 12.500% ### ( 110, 170 ] 8 10.000% 22.500% ## ( 170, 250 ] 12 15.000% 37.500% ### ( 250, 380 ] 7 8.750% 46.250% ## ( 380, 580 ] 6 7.500% 53.750% ## ( 580, 870 ] 9 11.250% 65.000% ## ( 870, 1300 ] 9 11.250% 76.250% ## ( 1300, 1900 ] 5 6.250% 82.500% # ( 1900, 2900 ] 5 6.250% 88.750% # ( 2900, 4400 ] 9 11.250% 100.000% ## ** DB Stats ** Uptime(secs): 24.1 total, 3.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 285.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.373 H:M:S, 22.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.228 H:M:S, 31.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-11:19:36 ... thread 0: (1000000,8000000) ops and (59682.2,196790.1) ops/second in (16.755405,40.652455) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 2.08 GB 0.0 8.5 0.0 8.5 16.2 7.6 0.0 2.1 158.3 299.1 55.32 52.05 139 0.398 8888K 17K 0.0 0.0 L1 12/12 1.40 GB 0.0 6.1 5.3 0.8 6.0 5.2 0.2 1.1 227.2 224.0 27.55 26.19 3 9.183 6354K 87K 0.0 0.0 L2 10/7 1.21 GB 3.9 0.4 0.2 0.2 0.4 0.2 3.9 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 34/9 1.50 GB 1.0 4.4 2.4 1.9 4.3 2.4 0.5 1.8 191.5 190.6 23.29 19.46 15 1.553 4529K 21K 0.0 0.0 L4 176/4 9.66 GB 1.0 1.4 1.3 0.1 1.4 1.3 0.8 1.1 162.0 161.6 8.81 6.70 16 0.551 1422K 1953 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/36 103.64 GB 0.0 20.8 9.2 11.6 28.3 16.7 7.4 3.7 182.7 248.6 116.48 105.85 175 0.666 21M 128K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.8 9.2 11.6 28.3 16.7 7.3 3.7 182.7 248.6 116.48 105.85 175 0.666 21M 128K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.8 9.2 11.6 20.7 9.1 0.0 0.0 225.6 224.2 94.34 86.15 62 1.522 21M 128K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 352.7 22.15 19.70 113 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.9 total, 40.7 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.28 GB write, 708.53 MB/s write, 20.78 GB read, 520.57 MB/s read, 116.5 seconds Interval compaction: 28.28 GB write, 712.34 MB/s write, 20.78 GB read, 523.37 MB/s read, 116.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 29, interval: 75 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3724796 Average: 2.5033 StdDev: 16.92 Min: 0 Median: 1.4660 Max: 5315 Percentiles: P50: 1.47 P75: 1.85 P99: 6.63 P99.9: 101.27 P99.99: 204.95 ------------------------------------------------------ [ 0, 1 ] 746267 20.035% 20.035% #### ( 1, 2 ] 2394880 64.296% 84.331% ############# ( 2, 3 ] 292385 7.850% 92.180% ## ( 3, 4 ] 141231 3.792% 95.972% # ( 4, 6 ] 107849 2.895% 98.867% # ( 6, 10 ] 31335 0.841% 99.709% ( 10, 15 ] 4700 0.126% 99.835% ( 15, 22 ] 723 0.019% 99.854% ( 22, 34 ] 73 0.002% 99.856% ( 34, 51 ] 18 0.000% 99.857% ( 51, 76 ] 42 0.001% 99.858% ( 76, 110 ] 2110 0.057% 99.915% ( 110, 170 ] 2527 0.068% 99.982% ( 170, 250 ] 649 0.017% 100.000% ( 250, 380 ] 459 0.012% 100.012% ( 380, 580 ] 397 0.011% 100.023% ( 580, 870 ] 196 0.005% 100.028% ( 870, 1300 ] 98 0.003% 100.031% ( 1300, 1900 ] 29 0.001% 100.031% ( 1900, 2900 ] 24 0.001% 100.032% ( 2900, 4400 ] 30 0.001% 100.033% ( 4400, 6600 ] 2 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 1020795 Average: 4.4052 StdDev: 55.87 Min: 1 Median: 1.7489 Max: 8364 Percentiles: P50: 1.75 P75: 2.71 P99: 9.53 P99.9: 102.60 P99.99: 225.93 ------------------------------------------------------ [ 0, 1 ] 89779 8.795% 8.795% ## ( 1, 2 ] 561626 55.018% 63.813% ########### ( 2, 3 ] 160455 15.719% 79.532% ### ( 3, 4 ] 86664 8.490% 88.022% ## ( 4, 6 ] 91365 8.950% 96.972% ## ( 6, 10 ] 23474 2.300% 99.272% ( 10, 15 ] 5288 0.518% 99.790% ( 15, 22 ] 661 0.065% 99.855% ( 22, 34 ] 41 0.004% 99.859% ( 34, 51 ] 7 0.001% 99.859% ( 51, 76 ] 103 0.010% 99.870% ( 76, 110 ] 399 0.039% 99.909% ( 110, 170 ] 604 0.059% 99.968% ( 170, 250 ] 326 0.032% 100.000% ( 250, 380 ] 313 0.031% 100.030% ( 380, 580 ] 392 0.038% 100.069% ( 580, 870 ] 359 0.035% 100.104% ( 870, 1300 ] 221 0.022% 100.126% ( 1300, 1900 ] 97 0.010% 100.135% ( 1900, 2900 ] 59 0.006% 100.141% ( 2900, 4400 ] 89 0.009% 100.150% ( 4400, 6600 ] 18 0.002% 100.151% ( 6600, 9900 ] 8 0.001% 100.152% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 826750 Average: 4.1859 StdDev: 46.84 Min: 0 Median: 1.8277 Max: 7821 Percentiles: P50: 1.83 P75: 2.88 P99: 9.29 P99.9: 96.78 P99.99: 243.21 ------------------------------------------------------ [ 0, 1 ] 49937 6.040% 6.040% # ( 1, 2 ] 439107 53.112% 59.153% ########### ( 2, 3 ] 148619 17.976% 77.129% #### ( 3, 4 ] 80895 9.785% 86.914% ## ( 4, 6 ] 85508 10.343% 97.256% ## ( 6, 10 ] 17540 2.122% 99.378% ( 10, 15 ] 3663 0.443% 99.821% ( 15, 22 ] 429 0.052% 99.873% ( 22, 34 ] 71 0.009% 99.881% ( 34, 51 ] 16 0.002% 99.883% ( 51, 76 ] 40 0.005% 99.888% ( 76, 110 ] 164 0.020% 99.908% ( 110, 170 ] 425 0.051% 99.959% ( 170, 250 ] 279 0.034% 99.993% ( 250, 380 ] 290 0.035% 100.028% ( 380, 580 ] 326 0.039% 100.068% ( 580, 870 ] 260 0.031% 100.099% ( 870, 1300 ] 148 0.018% 100.117% ( 1300, 1900 ] 50 0.006% 100.123% ( 1900, 2900 ] 30 0.004% 100.127% ( 2900, 4400 ] 51 0.006% 100.133% ( 4400, 6600 ] 12 0.001% 100.134% ( 6600, 9900 ] 2 0.000% 100.135% ** Level 4 read latency histogram (micros): Count: 25125 Average: 57.0399 StdDev: 309.48 Min: 0 Median: 1.9349 Max: 7679 Percentiles: P50: 1.93 P75: 3.32 P99: 1273.71 P99.9: 4218.10 P99.99: 6274.85 ------------------------------------------------------ [ 0, 1 ] 1361 5.417% 5.417% # ( 1, 2 ] 11981 47.686% 53.102% ########## ( 2, 3 ] 4580 18.229% 71.331% #### ( 3, 4 ] 2854 11.359% 82.691% ## ( 4, 6 ] 1807 7.192% 89.883% # ( 6, 10 ] 515 2.050% 91.932% ( 10, 15 ] 177 0.704% 92.637% ( 15, 22 ] 37 0.147% 92.784% ( 22, 34 ] 12 0.048% 92.832% ( 34, 51 ] 1 0.004% 92.836% ( 51, 76 ] 1 0.004% 92.840% ( 76, 110 ] 68 0.271% 93.110% ( 110, 170 ] 206 0.820% 93.930% ( 170, 250 ] 229 0.911% 94.842% ( 250, 380 ] 223 0.888% 95.729% ( 380, 580 ] 339 1.349% 97.079% ( 580, 870 ] 310 1.234% 98.312% ( 870, 1300 ] 184 0.732% 99.045% ( 1300, 1900 ] 97 0.386% 99.431% ( 1900, 2900 ] 59 0.235% 99.666% ( 2900, 4400 ] 67 0.267% 99.932% ( 4400, 6600 ] 17 0.068% 100.000% ( 6600, 9900 ] 3 0.012% 100.012% ** Level 5 read latency histogram (micros): Count: 120 Average: 1122.2250 StdDev: 1278.85 Min: 80 Median: 540.0000 Max: 4737 Percentiles: P50: 540.00 P75: 1600.00 P99: 4737.00 P99.9: 4737.00 P99.99: 4737.00 ------------------------------------------------------ ( 76, 110 ] 12 10.000% 10.000% ## ( 110, 170 ] 13 10.833% 20.833% ## ( 170, 250 ] 13 10.833% 31.667% ## ( 250, 380 ] 14 11.667% 43.333% ## ( 380, 580 ] 10 8.333% 51.667% ## ( 580, 870 ] 12 10.000% 61.667% ## ( 870, 1300 ] 11 9.167% 70.833% ## ( 1300, 1900 ] 10 8.333% 79.167% ## ( 1900, 2900 ] 7 5.833% 85.000% # ( 2900, 4400 ] 14 11.667% 96.667% ## ( 4400, 6600 ] 4 3.333% 100.000% # ** DB Stats ** Uptime(secs): 40.9 total, 16.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 192.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.333 H:M:S, 47.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.960 H:M:S, 83.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 0 2024/07/14-11:19:40 ... thread 0: (1000000,9000000) ops and (240423.6,200840.0) ops/second in (4.159325,44.811780) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 3.00 GB 63.0 8.9 0.0 8.9 17.4 8.5 0.0 2.0 150.3 295.2 60.33 55.76 152 0.397 9208K 17K 0.0 0.0 L1 12/12 1.40 GB 0.0 6.1 5.3 0.8 6.0 5.2 0.2 1.1 227.2 224.0 27.55 26.19 3 9.183 6354K 87K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.9 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 25/0 953.60 MB 1.0 6.2 3.6 2.5 6.2 3.6 0.5 1.7 184.6 183.7 34.38 27.94 21 1.637 6446K 31K 0.0 0.0 L4 175/0 9.76 GB 1.0 3.3 3.1 0.3 3.3 3.1 0.8 1.1 150.3 149.9 22.82 15.92 39 0.585 3373K 2931 0.0 0.0 L5 1088/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/20 104.55 GB 0.0 24.9 12.2 12.7 33.3 20.6 9.0 3.9 173.8 232.6 146.60 127.27 217 0.676 25M 139K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.9 12.2 12.7 33.3 20.6 8.9 3.9 173.8 232.6 146.60 127.27 217 0.676 25M 139K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.9 12.2 12.7 24.7 12.0 0.0 0.0 211.0 209.8 120.76 105.10 92 1.313 25M 139K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 338.9 25.84 22.17 125 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.0 total, 44.8 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.29 GB write, 757.06 MB/s write, 24.88 GB read, 565.84 MB/s read, 146.6 seconds Interval compaction: 33.29 GB write, 760.75 MB/s write, 24.88 GB read, 568.60 MB/s read, 146.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 42, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4073125 Average: 2.5897 StdDev: 21.34 Min: 0 Median: 1.4906 Max: 8130 Percentiles: P50: 1.49 P75: 1.88 P99: 7.06 P99.9: 97.03 P99.99: 202.39 ------------------------------------------------------ [ 0, 1 ] 766594 18.821% 18.821% #### ( 1, 2 ] 2588816 63.558% 82.379% ############# ( 2, 3 ] 355853 8.737% 91.116% ## ( 3, 4 ] 169615 4.164% 95.280% # ( 4, 6 ] 141323 3.470% 98.750% # ( 6, 10 ] 38406 0.943% 99.693% ( 10, 15 ] 6097 0.150% 99.842% ( 15, 22 ] 856 0.021% 99.863% ( 22, 34 ] 85 0.002% 99.865% ( 34, 51 ] 27 0.001% 99.866% ( 51, 76 ] 50 0.001% 99.867% ( 76, 110 ] 2153 0.053% 99.920% ( 110, 170 ] 2571 0.063% 99.983% ( 170, 250 ] 676 0.017% 100.000% ( 250, 380 ] 485 0.012% 100.012% ( 380, 580 ] 421 0.010% 100.022% ( 580, 870 ] 207 0.005% 100.027% ( 870, 1300 ] 113 0.003% 100.030% ( 1300, 1900 ] 37 0.001% 100.031% ( 1900, 2900 ] 45 0.001% 100.032% ( 2900, 4400 ] 55 0.001% 100.033% ( 4400, 6600 ] 7 0.000% 100.034% ( 6600, 9900 ] 3 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1178493 Average: 4.7303 StdDev: 65.43 Min: 1 Median: 1.7621 Max: 11082 Percentiles: P50: 1.76 P75: 2.74 P99: 9.58 P99.9: 123.10 P99.99: 318.51 ------------------------------------------------------ [ 0, 1 ] 95309 8.087% 8.087% ## ( 1, 2 ] 648116 54.995% 63.083% ########### ( 2, 3 ] 190779 16.188% 79.271% ### ( 3, 4 ] 101309 8.596% 87.868% ## ( 4, 6 ] 106744 9.058% 96.925% ## ( 6, 10 ] 27329 2.319% 99.244% ( 10, 15 ] 6266 0.532% 99.776% ( 15, 22 ] 758 0.064% 99.840% ( 22, 34 ] 46 0.004% 99.844% ( 34, 51 ] 13 0.001% 99.845% ( 51, 76 ] 105 0.009% 99.854% ( 76, 110 ] 403 0.034% 99.888% ( 110, 170 ] 630 0.053% 99.942% ( 170, 250 ] 370 0.031% 99.973% ( 250, 380 ] 376 0.032% 100.005% ( 380, 580 ] 473 0.040% 100.045% ( 580, 870 ] 421 0.036% 100.081% ( 870, 1300 ] 270 0.023% 100.104% ( 1300, 1900 ] 132 0.011% 100.115% ( 1900, 2900 ] 103 0.009% 100.124% ( 2900, 4400 ] 134 0.011% 100.135% ( 4400, 6600 ] 37 0.003% 100.138% ( 6600, 9900 ] 11 0.001% 100.139% ( 9900, 14000 ] 1 0.000% 100.139% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1346277 Average: 4.4338 StdDev: 57.10 Min: 0 Median: 1.8497 Max: 11480 Percentiles: P50: 1.85 P75: 2.91 P99: 9.07 P99.9: 17.15 P99.99: 167.38 ------------------------------------------------------ [ 0, 1 ] 64407 4.784% 4.784% # ( 1, 2 ] 716394 53.213% 57.997% ########### ( 2, 3 ] 252911 18.786% 76.783% #### ( 3, 4 ] 135589 10.071% 86.854% ## ( 4, 6 ] 142891 10.614% 97.468% ## ( 6, 10 ] 26875 1.996% 99.464% ( 10, 15 ] 5662 0.421% 99.885% ( 15, 22 ] 658 0.049% 99.934% ( 22, 34 ] 88 0.007% 99.940% ( 34, 51 ] 21 0.002% 99.942% ( 51, 76 ] 43 0.003% 99.945% ( 76, 110 ] 174 0.013% 99.958% ( 110, 170 ] 449 0.033% 99.991% ( 170, 250 ] 312 0.023% 100.015% ( 250, 380 ] 353 0.026% 100.041% ( 380, 580 ] 436 0.032% 100.073% ( 580, 870 ] 398 0.030% 100.103% ( 870, 1300 ] 259 0.019% 100.122% ( 1300, 1900 ] 128 0.010% 100.132% ( 1900, 2900 ] 120 0.009% 100.140% ( 2900, 4400 ] 136 0.010% 100.151% ( 4400, 6600 ] 22 0.002% 100.152% ( 6600, 9900 ] 6 0.000% 100.153% ( 9900, 14000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 73399 Average: 50.4051 StdDev: 316.79 Min: 0 Median: 1.9085 Max: 10836 Percentiles: P50: 1.91 P75: 3.14 P99: 1360.70 P99.9: 4233.66 P99.99: 6315.35 ------------------------------------------------------ [ 0, 1 ] 3070 4.183% 4.183% # ( 1, 2 ] 37018 50.434% 54.617% ########## ( 2, 3 ] 13858 18.880% 73.497% #### ( 3, 4 ] 7770 10.586% 84.083% ## ( 4, 6 ] 5866 7.992% 92.075% ## ( 6, 10 ] 1529 2.083% 94.158% ( 10, 15 ] 489 0.666% 94.824% ( 15, 22 ] 75 0.102% 94.926% ( 22, 34 ] 22 0.030% 94.956% ( 34, 51 ] 3 0.004% 94.960% ( 51, 76 ] 10 0.014% 94.974% ( 76, 110 ] 113 0.154% 95.128% ( 110, 170 ] 347 0.473% 95.601% ( 170, 250 ] 395 0.538% 96.139% ( 250, 380 ] 416 0.567% 96.706% ( 380, 580 ] 614 0.837% 97.542% ( 580, 870 ] 626 0.853% 98.395% ( 870, 1300 ] 417 0.568% 98.963% ( 1300, 1900 ] 267 0.364% 99.327% ( 1900, 2900 ] 233 0.317% 99.644% ( 2900, 4400 ] 211 0.287% 99.932% ( 4400, 6600 ] 49 0.067% 99.999% ( 6600, 9900 ] 10 0.014% 100.012% ( 9900, 14000 ] 1 0.001% 100.014% ** Level 5 read latency histogram (micros): Count: 220 Average: 1470.5182 StdDev: 1653.62 Min: 80 Median: 739.5000 Max: 8042 Percentiles: P50: 739.50 P75: 2263.64 P99: 8042.00 P99.9: 8042.00 P99.99: 8042.00 ------------------------------------------------------ ( 76, 110 ] 12 5.455% 5.455% # ( 110, 170 ] 21 9.545% 15.000% ## ( 170, 250 ] 20 9.091% 24.091% ## ( 250, 380 ] 23 10.455% 34.545% ## ( 380, 580 ] 23 10.455% 45.000% ## ( 580, 870 ] 20 9.091% 54.091% ## ( 870, 1300 ] 20 9.091% 63.182% ## ( 1300, 1900 ] 18 8.182% 71.364% ## ( 1900, 2900 ] 22 10.000% 81.364% ## ( 2900, 4400 ] 26 11.818% 93.182% ## ( 4400, 6600 ] 10 4.545% 97.727% # ( 6600, 9900 ] 5 2.273% 100.000% ** DB Stats ** Uptime(secs): 45.0 total, 4.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 196.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.590 H:M:S, 45.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.257 H:M:S, 30.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-11:19:43 ... thread 0: (1000000,10000000) ops and (332381.5,209115.9) ops/second in (3.008591,47.820371) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.93 GB 132.2 9.7 0.0 9.7 19.2 9.5 0.0 2.0 150.0 296.0 66.34 61.43 168 0.395 10M 18K 0.0 0.0 L1 12/12 1.40 GB 0.0 6.1 5.3 0.8 6.0 5.2 0.2 1.1 227.2 224.0 27.55 26.19 3 9.183 6354K 87K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.9 2.0 249.9 249.7 1.51 1.45 2 0.756 383K 218 0.0 0.0 L3 25/0 953.60 MB 1.0 6.2 3.6 2.5 6.2 3.6 0.5 1.7 184.6 183.7 34.38 27.94 21 1.637 6446K 31K 0.0 0.0 L4 175/0 9.76 GB 1.0 3.3 3.1 0.3 3.3 3.1 0.8 1.1 150.3 149.9 22.82 15.92 39 0.585 3373K 2931 0.0 0.0 L5 1088/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/24 105.47 GB 0.0 25.7 12.2 13.6 35.1 21.5 9.0 3.7 172.8 235.4 152.60 132.93 233 0.655 26M 140K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.7 12.2 13.6 35.1 21.5 8.9 3.7 172.8 235.4 152.60 132.93 233 0.655 26M 140K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.7 12.2 13.6 25.6 12.0 0.0 0.0 212.5 211.3 124.09 108.37 95 1.306 26M 140K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 340.2 28.51 24.56 138 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.0 total, 47.8 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.08 GB write, 747.66 MB/s write, 25.75 GB read, 548.76 MB/s read, 152.6 seconds Interval compaction: 35.08 GB write, 751.07 MB/s write, 25.75 GB read, 551.27 MB/s read, 152.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 44, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4426174 Average: 2.5644 StdDev: 20.64 Min: 0 Median: 1.4926 Max: 8130 Percentiles: P50: 1.49 P75: 1.88 P99: 6.99 P99.9: 91.09 P99.99: 189.49 ------------------------------------------------------ [ 0, 1 ] 819732 18.520% 18.520% #### ( 1, 2 ] 2828632 63.907% 82.427% ############# ( 2, 3 ] 391600 8.847% 91.274% ## ( 3, 4 ] 181987 4.112% 95.386% # ( 4, 6 ] 149709 3.382% 98.768% # ( 6, 10 ] 41393 0.935% 99.704% ( 10, 15 ] 6663 0.151% 99.854% ( 15, 22 ] 900 0.020% 99.874% ( 22, 34 ] 90 0.002% 99.876% ( 34, 51 ] 28 0.001% 99.877% ( 51, 76 ] 58 0.001% 99.878% ( 76, 110 ] 2158 0.049% 99.927% ( 110, 170 ] 2615 0.059% 99.986% ( 170, 250 ] 691 0.016% 100.002% ( 250, 380 ] 495 0.011% 100.013% ( 380, 580 ] 433 0.010% 100.023% ( 580, 870 ] 217 0.005% 100.028% ( 870, 1300 ] 118 0.003% 100.030% ( 1300, 1900 ] 39 0.001% 100.031% ( 1900, 2900 ] 47 0.001% 100.032% ( 2900, 4400 ] 55 0.001% 100.034% ( 4400, 6600 ] 7 0.000% 100.034% ( 6600, 9900 ] 3 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1221347 Average: 4.6611 StdDev: 64.31 Min: 1 Median: 1.7534 Max: 11082 Percentiles: P50: 1.75 P75: 2.71 P99: 9.56 P99.9: 125.34 P99.99: 320.53 ------------------------------------------------------ [ 0, 1 ] 100024 8.190% 8.190% ## ( 1, 2 ] 677772 55.494% 63.683% ########### ( 2, 3 ] 195484 16.006% 79.689% ### ( 3, 4 ] 102949 8.429% 88.118% ## ( 4, 6 ] 107933 8.837% 96.955% ## ( 6, 10 ] 28058 2.297% 99.253% ( 10, 15 ] 6348 0.520% 99.772% ( 15, 22 ] 768 0.063% 99.835% ( 22, 34 ] 47 0.004% 99.839% ( 34, 51 ] 13 0.001% 99.840% ( 51, 76 ] 106 0.009% 99.849% ( 76, 110 ] 448 0.037% 99.886% ( 110, 170 ] 691 0.057% 99.942% ( 170, 250 ] 376 0.031% 99.973% ( 250, 380 ] 385 0.032% 100.005% ( 380, 580 ] 477 0.039% 100.044% ( 580, 870 ] 423 0.035% 100.078% ( 870, 1300 ] 270 0.022% 100.100% ( 1300, 1900 ] 132 0.011% 100.111% ( 1900, 2900 ] 103 0.008% 100.120% ( 2900, 4400 ] 134 0.011% 100.131% ( 4400, 6600 ] 37 0.003% 100.134% ( 6600, 9900 ] 11 0.001% 100.134% ( 9900, 14000 ] 1 0.000% 100.135% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.2785 StdDev: 18.90 Min: 1 Median: 1.3778 Max: 3259 Percentiles: P50: 1.38 P75: 1.79 P99: 5.94 P99.9: 88.48 P99.99: 613.73 ------------------------------------------------------ [ 0, 1 ] 33286 26.804% 26.804% ##### ( 1, 2 ] 76239 61.391% 88.195% ############ ( 2, 3 ] 7656 6.165% 94.360% # ( 3, 4 ] 3692 2.973% 97.333% # ( 4, 6 ] 2132 1.717% 99.050% ( 6, 10 ] 890 0.717% 99.766% ( 10, 15 ] 115 0.093% 99.859% ( 15, 22 ] 18 0.014% 99.874% ( 22, 34 ] 6 0.005% 99.878% ( 34, 51 ] 2 0.002% 99.880% ( 51, 76 ] 5 0.004% 99.884% ( 76, 110 ] 54 0.043% 99.928% ( 110, 170 ] 56 0.045% 99.973% ( 170, 250 ] 5 0.004% 99.977% ( 250, 380 ] 7 0.006% 99.982% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1346277 Average: 4.4338 StdDev: 57.10 Min: 0 Median: 1.8497 Max: 11480 Percentiles: P50: 1.85 P75: 2.91 P99: 9.07 P99.9: 17.15 P99.99: 167.38 ------------------------------------------------------ [ 0, 1 ] 64407 4.784% 4.784% # ( 1, 2 ] 716394 53.213% 57.997% ########### ( 2, 3 ] 252911 18.786% 76.783% #### ( 3, 4 ] 135589 10.071% 86.854% ## ( 4, 6 ] 142891 10.614% 97.468% ## ( 6, 10 ] 26875 1.996% 99.464% ( 10, 15 ] 5662 0.421% 99.885% ( 15, 22 ] 658 0.049% 99.934% ( 22, 34 ] 88 0.007% 99.940% ( 34, 51 ] 21 0.002% 99.942% ( 51, 76 ] 43 0.003% 99.945% ( 76, 110 ] 174 0.013% 99.958% ( 110, 170 ] 449 0.033% 99.991% ( 170, 250 ] 312 0.023% 100.015% ( 250, 380 ] 353 0.026% 100.041% ( 380, 580 ] 436 0.032% 100.073% ( 580, 870 ] 398 0.030% 100.103% ( 870, 1300 ] 259 0.019% 100.122% ( 1300, 1900 ] 128 0.010% 100.132% ( 1900, 2900 ] 120 0.009% 100.140% ( 2900, 4400 ] 136 0.010% 100.151% ( 4400, 6600 ] 22 0.002% 100.152% ( 6600, 9900 ] 6 0.000% 100.153% ( 9900, 14000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 73399 Average: 50.4051 StdDev: 316.79 Min: 0 Median: 1.9085 Max: 10836 Percentiles: P50: 1.91 P75: 3.14 P99: 1360.70 P99.9: 4233.66 P99.99: 6315.35 ------------------------------------------------------ [ 0, 1 ] 3070 4.183% 4.183% # ( 1, 2 ] 37018 50.434% 54.617% ########## ( 2, 3 ] 13858 18.880% 73.497% #### ( 3, 4 ] 7770 10.586% 84.083% ## ( 4, 6 ] 5866 7.992% 92.075% ## ( 6, 10 ] 1529 2.083% 94.158% ( 10, 15 ] 489 0.666% 94.824% ( 15, 22 ] 75 0.102% 94.926% ( 22, 34 ] 22 0.030% 94.956% ( 34, 51 ] 3 0.004% 94.960% ( 51, 76 ] 10 0.014% 94.974% ( 76, 110 ] 113 0.154% 95.128% ( 110, 170 ] 347 0.473% 95.601% ( 170, 250 ] 395 0.538% 96.139% ( 250, 380 ] 416 0.567% 96.706% ( 380, 580 ] 614 0.837% 97.542% ( 580, 870 ] 626 0.853% 98.395% ( 870, 1300 ] 417 0.568% 98.963% ( 1300, 1900 ] 267 0.364% 99.327% ( 1900, 2900 ] 233 0.317% 99.644% ( 2900, 4400 ] 211 0.287% 99.932% ( 4400, 6600 ] 49 0.067% 99.999% ( 6600, 9900 ] 10 0.014% 100.012% ( 9900, 14000 ] 1 0.001% 100.014% ** Level 5 read latency histogram (micros): Count: 220 Average: 1470.5182 StdDev: 1653.62 Min: 80 Median: 739.5000 Max: 8042 Percentiles: P50: 739.50 P75: 2263.64 P99: 8042.00 P99.9: 8042.00 P99.99: 8042.00 ------------------------------------------------------ ( 76, 110 ] 12 5.455% 5.455% # ( 110, 170 ] 21 9.545% 15.000% ## ( 170, 250 ] 20 9.091% 24.091% ## ( 250, 380 ] 23 10.455% 34.545% ## ( 380, 580 ] 23 10.455% 45.000% ## ( 580, 870 ] 20 9.091% 54.091% ## ( 870, 1300 ] 20 9.091% 63.182% ## ( 1300, 1900 ] 18 8.182% 71.364% ## ( 1900, 2900 ] 22 10.000% 81.364% ## ( 2900, 4400 ] 26 11.818% 93.182% ## ( 4400, 6600 ] 10 4.545% 97.727% # ( 6600, 9900 ] 5 2.273% 100.000% ** DB Stats ** Uptime(secs): 48.0 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 204.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.964 H:M:S, 43.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.373 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.653 micros/op 176893 ops/sec 60.002 seconds 10613999 operations; 171.4 MB/s Microseconds per write: Count: 10613999 Average: 5.6531 StdDev: 318.05 Min: 1 Median: 1.7611 Max: 631825 Percentiles: P50: 1.76 P75: 2.73 P99: 6.81 P99.9: 1147.90 P99.99: 2757.58 ------------------------------------------------------ [ 0, 1 ] 1243615 11.717% 11.717% ## ( 1, 2 ] 5338930 50.301% 62.018% ########## ( 2, 3 ] 1891817 17.824% 79.841% #### ( 3, 4 ] 1484701 13.988% 93.830% ### ( 4, 6 ] 535040 5.041% 98.870% # ( 6, 10 ] 67726 0.638% 99.508% ( 10, 15 ] 13290 0.125% 99.634% ( 15, 22 ] 6025 0.057% 99.690% ( 22, 34 ] 1659 0.016% 99.706% ( 34, 51 ] 182 0.002% 99.708% ( 51, 76 ] 41 0.000% 99.708% ( 76, 110 ] 7625 0.072% 99.780% ( 110, 170 ] 2839 0.027% 99.807% ( 170, 250 ] 284 0.003% 99.809% ( 250, 380 ] 40 0.000% 99.810% ( 380, 580 ] 17 0.000% 99.810% ( 580, 870 ] 24 0.000% 99.810% ( 870, 1300 ] 14746 0.139% 99.949% ( 1300, 1900 ] 119 0.001% 99.950% ( 1900, 2900 ] 4918 0.046% 99.997% ( 2900, 4400 ] 267 0.003% 99.999% ( 4400, 6600 ] 56 0.001% 100.000% ( 6600, 9900 ] 12 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 254201 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10613999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10953646968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 650 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31216493 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 39187845925 rocksdb.compact.write.bytes COUNT : 38923861676 rocksdb.flush.write.bytes COUNT : 10767425499 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 58 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 347 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10680572928 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4122624 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 39288645832 rocksdb.non.last.level.read.count COUNT : 9497023 rocksdb.block.checksum.compute.count COUNT : 9495781 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.416191 P95 : 3.787773 P99 : 5.870781 P100 : 631821.000000 COUNT : 10613999 SUM : 55120008 rocksdb.compaction.times.micros P50 : 990465.116279 P95 : 3716666.666667 P99 : 17000000.000000 P100 : 17950515.000000 COUNT : 125 SUM : 170012372 rocksdb.compaction.times.cpu_micros P50 : 878478.260870 P95 : 3250000.000000 P99 : 16879589.000000 P100 : 16879589.000000 COUNT : 125 SUM : 143965773 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 710.853659 P95 : 1257.000000 P99 : 8382.000000 P100 : 33953.000000 COUNT : 146 SUM : 151289 rocksdb.compaction.outfile.sync.micros P50 : 1207.857143 P95 : 75972.222222 P99 : 157250.000000 P100 : 187330.000000 COUNT : 455 SUM : 5864302 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 119.512195 P95 : 1727.500000 P99 : 4392.500000 P100 : 8896.000000 COUNT : 303 SUM : 121679 rocksdb.table.open.io.micros P50 : 1387.179487 P95 : 8167.500000 P99 : 13638.235294 P100 : 23887.000000 COUNT : 650 SUM : 1382565 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.711046 P95 : 8.479864 P99 : 12.439829 P100 : 20306.000000 COUNT : 9494083 SUM : 61242145 rocksdb.read.block.get.micros P50 : 456.119403 P95 : 3483.333333 P99 : 6217.391304 P100 : 12122.000000 COUNT : 1300 SUM : 1143295 rocksdb.write.raw.block.micros P50 : 0.513457 P95 : 0.975569 P99 : 2.931208 P100 : 15806.000000 COUNT : 12053861 SUM : 23319786 rocksdb.numfiles.in.singlecompaction P50 : 3.006757 P95 : 5.312500 P99 : 15.875000 P100 : 20.000000 COUNT : 175 SUM : 604 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.554454 P95 : 1156.325466 P99 : 2546.413863 P100 : 631632.000000 COUNT : 204934 SUM : 31227188 rocksdb.sst.read.micros P50 : 1.628113 P95 : 5.158341 P99 : 9.056725 P100 : 20303.000000 COUNT : 9497478 SUM : 41308228 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10613999 SUM : 10953646968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211509.433962 P95 : 356166.666667 P99 : 540866.666667 P100 : 756794.000000 COUNT : 146 SUM : 30134174 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 442 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0