[2024-07-11 04:40:37.117474] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... [2024-07-11 04:40:37.117574] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699629 ] Set seed to 1720665637115098 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-11 04:40:37.224903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-11 04:40:37.268906] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-11 04:40:37.268960] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2699629' to capture a snapshot of events at runtime. [2024-07-11 04:40:37.268978] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2699629 for offline analysis/debug. [2024-07-11 04:40:37.269014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 11 04:40:41 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/11-04:40:45 ... thread 0: (1000000,1000000) ops and (267603.3,267603.3) ops/second in (3.736875,3.736875) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 567.00 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 279.5 3.16 2.84 14 0.225 0 0 0.0 0.0 L1 3/3 188.86 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 183.4 183.2 1.03 1.00 1 1.031 191K 129 0.0 0.0 L2 2/1 125.95 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 11/0 867.23 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 108/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1165/12 97.00 GB 0.0 0.3 0.2 0.1 1.2 1.1 0.4 1.4 64.5 245.1 4.88 4.52 16 0.305 319K 166 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.1 0.4 1.4 64.5 245.1 4.88 4.52 16 0.305 319K 166 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 182.4 182.2 1.73 1.68 2 0.864 319K 166 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 279.5 3.16 2.84 14 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.0 total, 3.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 300.70 MB/s write, 0.31 GB read, 79.14 MB/s read, 4.9 seconds Interval compaction: 1.17 GB write, 320.15 MB/s write, 0.31 GB read, 84.26 MB/s read, 4.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 131748 Average: 2.5202 StdDev: 20.40 Min: 1 Median: 1.6568 Max: 3640 Percentiles: P50: 1.66 P75: 2.04 P99: 5.86 P99.9: 9.85 P99.99: 20.97 ------------------------------------------------------ [ 0, 1 ] 4839 3.673% 3.673% # ( 1, 2 ] 92921 70.529% 74.202% ############## ( 2, 3 ] 26504 20.117% 94.319% #### ( 3, 4 ] 3293 2.499% 96.819% ( 4, 6 ] 3083 2.340% 99.159% ( 6, 10 ] 1014 0.770% 99.929% ( 10, 15 ] 74 0.056% 99.985% ( 15, 22 ] 8 0.006% 99.991% ( 22, 34 ] 2 0.002% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 51, 76 ] 3 0.002% 99.995% ( 170, 250 ] 14 0.011% 100.006% ( 250, 380 ] 6 0.005% 100.011% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 1300, 1900 ] 1 0.001% 100.013% ( 1900, 2900 ] 1 0.001% 100.014% ( 2900, 4400 ] 4 0.003% 100.017% ** Level 1 read latency histogram (micros): Count: 21607 Average: 3.0142 StdDev: 32.23 Min: 1 Median: 1.7795 Max: 3379 Percentiles: P50: 1.78 P75: 2.38 P99: 6.81 P99.9: 11.69 P99.99: 1230.90 ------------------------------------------------------ [ 0, 1 ] 43 0.199% 0.199% ( 1, 2 ] 13805 63.891% 64.090% ############# ( 2, 3 ] 6152 28.472% 92.563% ###### ( 3, 4 ] 688 3.184% 95.747% # ( 4, 6 ] 655 3.031% 98.778% # ( 6, 10 ] 238 1.101% 99.880% ( 10, 15 ] 13 0.060% 99.940% ( 15, 22 ] 4 0.019% 99.958% ( 170, 250 ] 1 0.005% 99.963% ( 380, 580 ] 1 0.005% 99.968% ( 580, 870 ] 4 0.019% 99.986% ( 870, 1300 ] 1 0.005% 99.991% ( 1900, 2900 ] 1 0.005% 99.995% ( 2900, 4400 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 8551 Average: 5.7598 StdDev: 18.39 Min: 1 Median: 4.4679 Max: 1624 Percentiles: P50: 4.47 P75: 5.80 P99: 14.96 P99.9: 26.60 P99.99: 1386.94 ------------------------------------------------------ [ 0, 1 ] 4 0.047% 0.047% ( 1, 2 ] 4 0.047% 0.094% ( 2, 3 ] 37 0.433% 0.526% ( 3, 4 ] 3481 40.709% 41.235% ######## ( 4, 6 ] 3204 37.469% 78.704% ####### ( 6, 10 ] 1533 17.928% 96.632% #### ( 10, 15 ] 204 2.386% 99.018% ( 15, 22 ] 72 0.842% 99.860% ( 22, 34 ] 9 0.105% 99.965% ( 34, 51 ] 1 0.012% 99.977% ( 380, 580 ] 1 0.012% 99.988% ( 1300, 1900 ] 1 0.012% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 2103.6600 StdDev: 1425.23 Min: 591 Median: 1300.0000 Max: 5464 Percentiles: P50: 1300.00 P75: 3275.00 P99: 5464.00 P99.9: 5464.00 P99.99: 5464.00 ------------------------------------------------------ ( 580, 870 ] 7 14.000% 14.000% ### ( 870, 1300 ] 18 36.000% 50.000% ####### ( 1300, 1900 ] 3 6.000% 56.000% # ( 1900, 2900 ] 7 14.000% 70.000% ### ( 2900, 4400 ] 10 20.000% 90.000% #### ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 4.0 total, 3.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 247.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/11-04:40:49 ... thread 0: (1000000,2000000) ops and (262211.7,264880.0) ops/second in (3.813713,7.550588) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.29 GB 81.8 0.7 0.0 0.7 2.6 1.8 0.0 1.4 74.1 259.2 10.21 9.41 33 0.309 767K 736 0.0 0.0 L1 1/0 3.82 MB 0.4 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.8 179.5 3.50 3.41 2 1.752 639K 869 0.0 0.0 L2 5/3 437.42 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 19/1 992.02 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 93.6 93.6 1.33 1.25 1 1.333 126K 0 0.0 0.0 L4 108/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1177/12 97.98 GB 0.0 1.6 0.6 1.0 3.4 2.5 0.8 1.9 104.0 224.0 15.74 14.74 37 0.425 1661K 1642 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.6 1.0 3.4 2.5 0.8 1.9 104.0 224.0 15.74 14.74 37 0.425 1661K 1642 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 181.8 181.6 9.00 8.71 7 1.286 1661K 1642 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 280.6 6.74 6.03 30 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.8 total, 7.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.44 GB write, 452.28 MB/s write, 1.60 GB read, 210.00 MB/s read, 15.7 seconds Interval compaction: 3.44 GB write, 466.76 MB/s write, 1.60 GB read, 216.72 MB/s read, 15.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 412044 Average: 2.7374 StdDev: 13.91 Min: 1 Median: 1.8591 Max: 3640 Percentiles: P50: 1.86 P75: 2.54 P99: 7.50 P99.9: 11.79 P99.99: 16.93 ------------------------------------------------------ [ 0, 1 ] 12278 2.980% 2.980% # ( 1, 2 ] 225512 54.730% 57.710% ########### ( 2, 3 ] 131338 31.875% 89.585% ###### ( 3, 4 ] 17256 4.188% 93.773% # ( 4, 6 ] 19444 4.719% 98.491% # ( 6, 10 ] 5609 1.361% 99.853% ( 10, 15 ] 549 0.133% 99.986% ( 15, 22 ] 68 0.017% 100.002% ( 22, 34 ] 9 0.002% 100.005% ( 34, 51 ] 4 0.001% 100.006% ( 51, 76 ] 3 0.001% 100.006% ( 170, 250 ] 30 0.007% 100.014% ( 250, 380 ] 11 0.003% 100.016% ( 380, 580 ] 5 0.001% 100.017% ( 580, 870 ] 6 0.001% 100.019% ( 870, 1300 ] 4 0.001% 100.020% ( 1300, 1900 ] 3 0.001% 100.021% ( 1900, 2900 ] 3 0.001% 100.021% ( 2900, 4400 ] 4 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 134513 Average: 2.5436 StdDev: 14.62 Min: 1 Median: 1.6837 Max: 3379 Percentiles: P50: 1.68 P75: 2.27 P99: 6.39 P99.9: 11.82 P99.99: 407.43 ------------------------------------------------------ [ 0, 1 ] 11406 8.479% 8.479% ## ( 1, 2 ] 81689 60.729% 69.209% ############ ( 2, 3 ] 28591 21.255% 90.464% #### ( 3, 4 ] 5582 4.150% 94.614% # ( 4, 6 ] 5778 4.295% 98.909% # ( 6, 10 ] 1275 0.948% 99.857% ( 10, 15 ] 161 0.120% 99.977% ( 15, 22 ] 12 0.009% 99.986% ( 22, 34 ] 1 0.001% 99.987% ( 34, 51 ] 2 0.001% 99.988% ( 170, 250 ] 2 0.001% 99.990% ( 250, 380 ] 1 0.001% 99.990% ( 380, 580 ] 4 0.003% 99.993% ( 580, 870 ] 4 0.003% 99.996% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 31688 Average: 5.5062 StdDev: 9.73 Min: 1 Median: 4.5010 Max: 1624 Percentiles: P50: 4.50 P75: 5.74 P99: 14.23 P99.9: 21.76 P99.99: 49.57 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 4 0.013% 0.025% ( 2, 3 ] 70 0.221% 0.246% ( 3, 4 ] 12572 39.674% 39.920% ######## ( 4, 6 ] 12750 40.236% 80.157% ######## ( 6, 10 ] 5426 17.123% 97.280% ### ( 10, 15 ] 644 2.032% 99.312% ( 15, 22 ] 193 0.609% 99.921% ( 22, 34 ] 20 0.063% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 24867 Average: 6.4656 StdDev: 113.96 Min: 1 Median: 1.5230 Max: 5464 Percentiles: P50: 1.52 P75: 1.90 P99: 5.92 P99.9: 1326.60 P99.99: 5464.00 ------------------------------------------------------ [ 0, 1 ] 3833 15.414% 15.414% ### ( 1, 2 ] 16445 66.132% 81.546% ############# ( 2, 3 ] 2575 10.355% 91.901% ## ( 3, 4 ] 900 3.619% 95.520% # ( 4, 6 ] 903 3.631% 99.151% # ( 6, 10 ] 117 0.471% 99.622% ( 10, 15 ] 41 0.165% 99.787% ( 15, 22 ] 1 0.004% 99.791% ( 580, 870 ] 9 0.036% 99.827% ( 870, 1300 ] 18 0.072% 99.899% ( 1300, 1900 ] 3 0.012% 99.912% ( 1900, 2900 ] 7 0.028% 99.940% ( 2900, 4400 ] 10 0.040% 99.980% ( 4400, 6600 ] 5 0.020% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 7.8 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 252.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 258.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/11-04:40:52 ... thread 0: (1000000,3000000) ops and (265175.0,264978.3) ops/second in (3.771095,11.321683) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.21 GB 6.3 2.0 0.0 2.0 4.7 2.8 0.0 1.7 104.0 250.2 19.38 18.12 53 0.366 2046K 1971 0.0 0.0 L1 1/1 3.82 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.8 179.5 3.50 3.41 2 1.752 639K 869 0.0 0.0 L2 2/0 51.13 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 31/0 984.85 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 160.8 160.7 3.88 3.39 2 1.938 632K 495 0.0 0.0 L4 148/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1230/12 98.90 GB 0.0 3.3 1.0 2.3 6.1 3.8 1.6 2.2 123.6 226.8 27.46 25.59 58 0.473 3447K 3372 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.0 2.3 6.1 3.8 1.6 2.2 123.6 226.8 27.46 25.59 58 0.473 3447K 3372 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.0 2.3 3.3 1.0 0.0 0.0 194.7 194.5 17.44 16.64 13 1.341 3447K 3372 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 282.8 10.03 8.95 45 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.6 total, 11.3 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.08 GB write, 538.41 MB/s write, 3.32 GB read, 293.58 MB/s read, 27.5 seconds Interval compaction: 6.08 GB write, 549.90 MB/s write, 3.32 GB read, 299.85 MB/s read, 27.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 666748 Average: 2.6179 StdDev: 11.87 Min: 1 Median: 1.7904 Max: 3640 Percentiles: P50: 1.79 P75: 2.44 P99: 6.73 P99.9: 11.15 P99.99: 16.97 ------------------------------------------------------ [ 0, 1 ] 33004 4.950% 4.950% # ( 1, 2 ] 380038 56.999% 61.949% ########### ( 2, 3 ] 196946 29.538% 91.487% ###### ( 3, 4 ] 23445 3.516% 95.003% # ( 4, 6 ] 25353 3.802% 98.806% # ( 6, 10 ] 7125 1.069% 99.874% ( 10, 15 ] 744 0.112% 99.986% ( 15, 22 ] 97 0.015% 100.001% ( 22, 34 ] 10 0.001% 100.002% ( 34, 51 ] 6 0.001% 100.003% ( 51, 76 ] 4 0.001% 100.004% ( 170, 250 ] 43 0.006% 100.010% ( 250, 380 ] 19 0.003% 100.013% ( 380, 580 ] 11 0.002% 100.015% ( 580, 870 ] 11 0.002% 100.016% ( 870, 1300 ] 11 0.002% 100.018% ( 1300, 1900 ] 4 0.001% 100.018% ( 1900, 2900 ] 3 0.000% 100.019% ( 2900, 4400 ] 4 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 146065 Average: 2.5112 StdDev: 14.03 Min: 1 Median: 1.6689 Max: 3379 Percentiles: P50: 1.67 P75: 2.23 P99: 6.12 P99.9: 11.58 P99.99: 301.15 ------------------------------------------------------ [ 0, 1 ] 13043 8.930% 8.930% ## ( 1, 2 ] 89679 61.397% 70.326% ############ ( 2, 3 ] 29823 20.418% 90.744% #### ( 3, 4 ] 5927 4.058% 94.802% # ( 4, 6 ] 6092 4.171% 98.972% # ( 6, 10 ] 1303 0.892% 99.864% ( 10, 15 ] 164 0.112% 99.977% ( 15, 22 ] 13 0.009% 99.986% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 3 0.002% 99.988% ( 170, 250 ] 2 0.001% 99.990% ( 250, 380 ] 1 0.001% 99.990% ( 380, 580 ] 4 0.003% 99.993% ( 580, 870 ] 4 0.003% 99.996% ( 870, 1300 ] 2 0.001% 99.997% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 5.5062 StdDev: 9.73 Min: 1 Median: 4.5010 Max: 1624 Percentiles: P50: 4.50 P75: 5.74 P99: 14.23 P99.9: 21.76 P99.99: 49.57 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 4 0.013% 0.025% ( 2, 3 ] 70 0.221% 0.246% ( 3, 4 ] 12572 39.674% 39.920% ######## ( 4, 6 ] 12750 40.236% 80.157% ######## ( 6, 10 ] 5426 17.123% 97.280% ### ( 10, 15 ] 644 2.032% 99.312% ( 15, 22 ] 193 0.609% 99.921% ( 22, 34 ] 20 0.063% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 5.9451 StdDev: 105.85 Min: 0 Median: 1.5169 Max: 5464 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 1207.48 P99.99: 5329.59 ------------------------------------------------------ [ 0, 1 ] 4593 15.908% 15.908% ### ( 1, 2 ] 19043 65.954% 81.862% ############# ( 2, 3 ] 2913 10.089% 91.951% ## ( 3, 4 ] 1030 3.567% 95.518% # ( 4, 6 ] 1010 3.498% 99.016% # ( 6, 10 ] 127 0.440% 99.456% ( 10, 15 ] 44 0.152% 99.609% ( 15, 22 ] 2 0.007% 99.616% ( 22, 34 ] 54 0.187% 99.803% ( 110, 170 ] 1 0.003% 99.806% ( 170, 250 ] 3 0.010% 99.816% ( 380, 580 ] 1 0.003% 99.820% ( 580, 870 ] 9 0.031% 99.851% ( 870, 1300 ] 18 0.062% 99.913% ( 1300, 1900 ] 3 0.010% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 10 0.035% 99.983% ( 4400, 6600 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 743.2000 StdDev: 881.71 Min: 93 Median: 315.0000 Max: 3170 Percentiles: P50: 315.00 P75: 870.00 P99: 3170.00 P99.9: 3170.00 P99.99: 3170.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 1 5.000% 30.000% # ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 4 20.000% 60.000% #### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 11.6 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 255.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/11-04:40:57 ... thread 0: (1000000,4000000) ops and (208666.4,248231.0) ops/second in (4.792338,16.114021) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.20 GB 18.9 2.7 0.0 2.7 6.5 3.8 0.0 1.7 100.4 239.4 27.62 25.91 71 0.389 2814K 2731 0.0 0.0 L1 1/1 3.82 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.8 179.5 3.50 3.41 2 1.752 639K 869 0.0 0.0 L2 2/0 51.13 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 31/0 984.85 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 160.8 160.7 3.88 3.39 2 1.938 632K 495 0.0 0.0 L4 148/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/16 99.89 GB 0.0 4.1 1.0 3.1 7.8 4.7 1.6 2.1 116.3 223.8 35.70 33.38 76 0.470 4215K 4132 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.0 3.1 7.8 4.7 1.6 2.1 116.3 223.8 35.70 33.38 76 0.470 4215K 4132 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.0 3.1 4.0 1.0 0.0 0.0 187.1 186.9 22.19 21.31 16 1.387 4215K 4132 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 284.5 13.51 12.07 60 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.80 GB write, 488.46 MB/s write, 4.05 GB read, 253.79 MB/s read, 35.7 seconds Interval compaction: 7.80 GB write, 495.79 MB/s write, 4.05 GB read, 257.60 MB/s read, 35.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 1, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1143828 Average: 2.8484 StdDev: 11.01 Min: 1 Median: 1.9369 Max: 3640 Percentiles: P50: 1.94 P75: 2.68 P99: 8.44 P99.9: 12.22 P99.99: 14.34 ------------------------------------------------------ [ 0, 1 ] 49629 4.339% 4.339% # ( 1, 2 ] 557435 48.734% 53.073% ########## ( 2, 3 ] 366397 32.033% 85.106% ###### ( 3, 4 ] 71116 6.217% 91.323% # ( 4, 6 ] 73326 6.411% 97.733% # ( 6, 10 ] 23708 2.073% 99.806% ( 10, 15 ] 2425 0.212% 100.018% ( 15, 22 ] 323 0.028% 100.046% ( 22, 34 ] 28 0.002% 100.049% ( 34, 51 ] 11 0.001% 100.050% ( 51, 76 ] 8 0.001% 100.051% ( 76, 110 ] 13 0.001% 100.052% ( 110, 170 ] 17 0.001% 100.053% ( 170, 250 ] 67 0.006% 100.059% ( 250, 380 ] 29 0.003% 100.062% ( 380, 580 ] 18 0.002% 100.063% ( 580, 870 ] 13 0.001% 100.064% ( 870, 1300 ] 19 0.002% 100.066% ( 1300, 1900 ] 7 0.001% 100.067% ( 1900, 2900 ] 3 0.000% 100.067% ( 2900, 4400 ] 6 0.001% 100.067% ** Level 1 read latency histogram (micros): Count: 146065 Average: 2.5112 StdDev: 14.03 Min: 1 Median: 1.6689 Max: 3379 Percentiles: P50: 1.67 P75: 2.23 P99: 6.12 P99.9: 11.58 P99.99: 301.15 ------------------------------------------------------ [ 0, 1 ] 13043 8.930% 8.930% ## ( 1, 2 ] 89679 61.397% 70.326% ############ ( 2, 3 ] 29823 20.418% 90.744% #### ( 3, 4 ] 5927 4.058% 94.802% # ( 4, 6 ] 6092 4.171% 98.972% # ( 6, 10 ] 1303 0.892% 99.864% ( 10, 15 ] 164 0.112% 99.977% ( 15, 22 ] 13 0.009% 99.986% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 3 0.002% 99.988% ( 170, 250 ] 2 0.001% 99.990% ( 250, 380 ] 1 0.001% 99.990% ( 380, 580 ] 4 0.003% 99.993% ( 580, 870 ] 4 0.003% 99.996% ( 870, 1300 ] 2 0.001% 99.997% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 5.5062 StdDev: 9.73 Min: 1 Median: 4.5010 Max: 1624 Percentiles: P50: 4.50 P75: 5.74 P99: 14.23 P99.9: 21.76 P99.99: 49.57 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 4 0.013% 0.025% ( 2, 3 ] 70 0.221% 0.246% ( 3, 4 ] 12572 39.674% 39.920% ######## ( 4, 6 ] 12750 40.236% 80.157% ######## ( 6, 10 ] 5426 17.123% 97.280% ### ( 10, 15 ] 644 2.032% 99.312% ( 15, 22 ] 193 0.609% 99.921% ( 22, 34 ] 20 0.063% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 5.9451 StdDev: 105.85 Min: 0 Median: 1.5169 Max: 5464 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 1207.48 P99.99: 5329.59 ------------------------------------------------------ [ 0, 1 ] 4593 15.908% 15.908% ### ( 1, 2 ] 19043 65.954% 81.862% ############# ( 2, 3 ] 2913 10.089% 91.951% ## ( 3, 4 ] 1030 3.567% 95.518% # ( 4, 6 ] 1010 3.498% 99.016% # ( 6, 10 ] 127 0.440% 99.456% ( 10, 15 ] 44 0.152% 99.609% ( 15, 22 ] 2 0.007% 99.616% ( 22, 34 ] 54 0.187% 99.803% ( 110, 170 ] 1 0.003% 99.806% ( 170, 250 ] 3 0.010% 99.816% ( 380, 580 ] 1 0.003% 99.820% ( 580, 870 ] 9 0.031% 99.851% ( 870, 1300 ] 18 0.062% 99.913% ( 1300, 1900 ] 3 0.010% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 10 0.035% 99.983% ( 4400, 6600 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 743.2000 StdDev: 881.71 Min: 93 Median: 315.0000 Max: 3170 Percentiles: P50: 315.00 P75: 870.00 P99: 3170.00 P99.9: 3170.00 P99.99: 3170.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 1 5.000% 30.000% # ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 4 20.000% 60.000% #### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.4 total, 4.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 240.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.293 H:M:S, 7.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.293 H:M:S, 27.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-04:41:04 ... thread 0: (1000000,5000000) ops and (152092.6,220371.4) ops/second in (6.574944,22.688965) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.12 GB 175.9 4.4 0.0 4.4 9.1 4.7 0.0 1.9 114.6 235.3 39.59 37.37 88 0.450 4604K 6797 0.0 0.0 L1 1/1 3.82 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.8 179.5 3.50 3.41 2 1.752 639K 869 0.0 0.0 L2 2/0 51.13 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 31/0 984.85 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 160.8 160.7 3.88 3.39 2 1.938 632K 495 0.0 0.0 L4 148/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/16 100.80 GB 0.0 5.8 1.0 4.8 10.4 5.7 1.6 2.2 124.1 224.4 47.66 44.84 93 0.513 6005K 8198 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 1.0 4.8 10.4 5.7 1.6 2.2 124.1 224.4 47.66 44.84 93 0.513 6005K 8198 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 1.0 4.8 5.8 1.0 0.0 0.0 192.0 191.7 30.80 29.78 20 1.540 6005K 8198 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 284.0 16.86 15.06 73 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.44 GB write, 466.33 MB/s write, 5.78 GB read, 257.91 MB/s read, 47.7 seconds Interval compaction: 10.44 GB write, 471.30 MB/s write, 5.78 GB read, 260.66 MB/s read, 47.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 3, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1810847 Average: 2.9441 StdDev: 11.17 Min: 1 Median: 1.9888 Max: 3785 Percentiles: P50: 1.99 P75: 2.75 P99: 8.71 P99.9: 12.29 P99.99: 13.94 ------------------------------------------------------ [ 0, 1 ] 73374 4.052% 4.052% # ( 1, 2 ] 841488 46.469% 50.521% ######### ( 2, 3 ] 591444 32.661% 83.182% ####### ( 3, 4 ] 123191 6.803% 89.985% # ( 4, 6 ] 133778 7.388% 97.373% # ( 6, 10 ] 43494 2.402% 99.775% ( 10, 15 ] 4950 0.273% 100.048% ( 15, 22 ] 544 0.030% 100.078% ( 22, 34 ] 58 0.003% 100.081% ( 34, 51 ] 19 0.001% 100.082% ( 51, 76 ] 11 0.001% 100.083% ( 76, 110 ] 55 0.003% 100.086% ( 110, 170 ] 138 0.008% 100.094% ( 170, 250 ] 126 0.007% 100.101% ( 250, 380 ] 57 0.003% 100.104% ( 380, 580 ] 38 0.002% 100.106% ( 580, 870 ] 24 0.001% 100.107% ( 870, 1300 ] 26 0.001% 100.109% ( 1300, 1900 ] 11 0.001% 100.109% ( 1900, 2900 ] 8 0.000% 100.110% ( 2900, 4400 ] 8 0.000% 100.110% ** Level 1 read latency histogram (micros): Count: 146065 Average: 2.5112 StdDev: 14.03 Min: 1 Median: 1.6689 Max: 3379 Percentiles: P50: 1.67 P75: 2.23 P99: 6.12 P99.9: 11.58 P99.99: 301.15 ------------------------------------------------------ [ 0, 1 ] 13043 8.930% 8.930% ## ( 1, 2 ] 89679 61.397% 70.326% ############ ( 2, 3 ] 29823 20.418% 90.744% #### ( 3, 4 ] 5927 4.058% 94.802% # ( 4, 6 ] 6092 4.171% 98.972% # ( 6, 10 ] 1303 0.892% 99.864% ( 10, 15 ] 164 0.112% 99.977% ( 15, 22 ] 13 0.009% 99.986% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 3 0.002% 99.988% ( 170, 250 ] 2 0.001% 99.990% ( 250, 380 ] 1 0.001% 99.990% ( 380, 580 ] 4 0.003% 99.993% ( 580, 870 ] 4 0.003% 99.996% ( 870, 1300 ] 2 0.001% 99.997% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 5.5062 StdDev: 9.73 Min: 1 Median: 4.5010 Max: 1624 Percentiles: P50: 4.50 P75: 5.74 P99: 14.23 P99.9: 21.76 P99.99: 49.57 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 4 0.013% 0.025% ( 2, 3 ] 70 0.221% 0.246% ( 3, 4 ] 12572 39.674% 39.920% ######## ( 4, 6 ] 12750 40.236% 80.157% ######## ( 6, 10 ] 5426 17.123% 97.280% ### ( 10, 15 ] 644 2.032% 99.312% ( 15, 22 ] 193 0.609% 99.921% ( 22, 34 ] 20 0.063% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 5.9451 StdDev: 105.85 Min: 0 Median: 1.5169 Max: 5464 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 1207.48 P99.99: 5329.59 ------------------------------------------------------ [ 0, 1 ] 4593 15.908% 15.908% ### ( 1, 2 ] 19043 65.954% 81.862% ############# ( 2, 3 ] 2913 10.089% 91.951% ## ( 3, 4 ] 1030 3.567% 95.518% # ( 4, 6 ] 1010 3.498% 99.016% # ( 6, 10 ] 127 0.440% 99.456% ( 10, 15 ] 44 0.152% 99.609% ( 15, 22 ] 2 0.007% 99.616% ( 22, 34 ] 54 0.187% 99.803% ( 110, 170 ] 1 0.003% 99.806% ( 170, 250 ] 3 0.010% 99.816% ( 380, 580 ] 1 0.003% 99.820% ( 580, 870 ] 9 0.031% 99.851% ( 870, 1300 ] 18 0.062% 99.913% ( 1300, 1900 ] 3 0.010% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 10 0.035% 99.983% ( 4400, 6600 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 743.2000 StdDev: 881.71 Min: 93 Median: 315.0000 Max: 3170 Percentiles: P50: 315.00 P75: 870.00 P99: 3170.00 P99.9: 3170.00 P99.99: 3170.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 1 5.000% 30.000% # ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 4 20.000% 60.000% #### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 22.9 total, 6.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 214.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.891 H:M:S, 21.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 149.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.598 H:M:S, 54.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-04:41:08 ... thread 0: (1000000,6000000) ops and (216400.0,219699.4) ops/second in (4.621072,27.310037) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.95 GB 6.3 5.2 0.0 5.2 10.8 5.7 0.0 1.9 111.4 233.2 47.51 44.80 107 0.444 5372K 7530 0.0 0.0 L1 14/14 1.63 GB 0.0 2.8 2.6 0.2 2.7 2.6 0.1 1.1 175.6 174.1 16.15 15.73 3 5.385 2880K 23K 0.0 0.0 L2 2/0 51.13 MB 0.5 0.1 0.1 0.1 0.1 0.1 1.1 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 14/0 764.93 MB 0.8 0.6 0.5 0.1 0.6 0.5 0.6 1.2 160.8 160.7 3.88 3.39 2 1.938 632K 495 0.0 0.0 L4 161/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/28 101.77 GB 0.0 8.7 3.1 5.5 14.3 8.8 4.0 2.5 130.1 214.6 68.24 64.59 113 0.604 9013K 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.7 3.1 5.5 14.3 8.8 4.0 2.5 130.1 214.6 68.24 64.59 113 0.604 9013K 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.7 3.1 5.5 8.6 3.1 0.0 0.0 185.6 184.9 47.84 46.37 24 1.993 9013K 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 284.1 20.40 18.22 89 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.6 total, 27.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.30 GB write, 531.37 MB/s write, 8.67 GB read, 322.18 MB/s read, 68.2 seconds Interval compaction: 14.30 GB write, 536.07 MB/s write, 8.67 GB read, 325.03 MB/s read, 68.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 3, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2114573 Average: 2.9664 StdDev: 11.75 Min: 1 Median: 1.9919 Max: 3785 Percentiles: P50: 1.99 P75: 2.78 P99: 8.75 P99.9: 12.61 P99.99: 14.20 ------------------------------------------------------ [ 0, 1 ] 93801 4.436% 4.436% # ( 1, 2 ] 971375 45.937% 50.373% ######### ( 2, 3 ] 667027 31.544% 81.917% ###### ( 3, 4 ] 165848 7.843% 89.760% ## ( 4, 6 ] 160418 7.586% 97.347% ## ( 6, 10 ] 50861 2.405% 99.752% ( 10, 15 ] 5991 0.283% 100.035% ( 15, 22 ] 640 0.030% 100.066% ( 22, 34 ] 64 0.003% 100.069% ( 34, 51 ] 21 0.001% 100.070% ( 51, 76 ] 16 0.001% 100.070% ( 76, 110 ] 105 0.005% 100.075% ( 110, 170 ] 202 0.010% 100.085% ( 170, 250 ] 151 0.007% 100.092% ( 250, 380 ] 75 0.004% 100.096% ( 380, 580 ] 44 0.002% 100.098% ( 580, 870 ] 28 0.001% 100.099% ( 870, 1300 ] 30 0.001% 100.100% ( 1300, 1900 ] 13 0.001% 100.101% ( 1900, 2900 ] 9 0.000% 100.101% ( 2900, 4400 ] 12 0.001% 100.102% ** Level 1 read latency histogram (micros): Count: 147126 Average: 2.7529 StdDev: 19.95 Min: 1 Median: 1.6709 Max: 3379 Percentiles: P50: 1.67 P75: 2.24 P99: 6.47 P99.9: 14.61 P99.99: 1046.70 ------------------------------------------------------ [ 0, 1 ] 13076 8.888% 8.888% ## ( 1, 2 ] 90158 61.279% 70.167% ############ ( 2, 3 ] 30170 20.506% 90.673% #### ( 3, 4 ] 5956 4.048% 94.722% # ( 4, 6 ] 6141 4.174% 98.896% # ( 6, 10 ] 1321 0.898% 99.793% ( 10, 15 ] 170 0.116% 99.909% ( 15, 22 ] 14 0.010% 99.918% ( 22, 34 ] 1 0.001% 99.919% ( 34, 51 ] 3 0.002% 99.921% ( 76, 110 ] 44 0.030% 99.951% ( 110, 170 ] 15 0.010% 99.961% ( 170, 250 ] 3 0.002% 99.963% ( 250, 380 ] 3 0.002% 99.965% ( 380, 580 ] 25 0.017% 99.982% ( 580, 870 ] 8 0.005% 99.988% ( 870, 1300 ] 8 0.005% 99.993% ( 1300, 1900 ] 7 0.005% 99.998% ( 1900, 2900 ] 2 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 5.5062 StdDev: 9.73 Min: 1 Median: 4.5010 Max: 1624 Percentiles: P50: 4.50 P75: 5.74 P99: 14.23 P99.9: 21.76 P99.99: 49.57 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 4 0.013% 0.025% ( 2, 3 ] 70 0.221% 0.246% ( 3, 4 ] 12572 39.674% 39.920% ######## ( 4, 6 ] 12750 40.236% 80.157% ######## ( 6, 10 ] 5426 17.123% 97.280% ### ( 10, 15 ] 644 2.032% 99.312% ( 15, 22 ] 193 0.609% 99.921% ( 22, 34 ] 20 0.063% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 5.9451 StdDev: 105.85 Min: 0 Median: 1.5169 Max: 5464 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 1207.48 P99.99: 5329.59 ------------------------------------------------------ [ 0, 1 ] 4593 15.908% 15.908% ### ( 1, 2 ] 19043 65.954% 81.862% ############# ( 2, 3 ] 2913 10.089% 91.951% ## ( 3, 4 ] 1030 3.567% 95.518% # ( 4, 6 ] 1010 3.498% 99.016% # ( 6, 10 ] 127 0.440% 99.456% ( 10, 15 ] 44 0.152% 99.609% ( 15, 22 ] 2 0.007% 99.616% ( 22, 34 ] 54 0.187% 99.803% ( 110, 170 ] 1 0.003% 99.806% ( 170, 250 ] 3 0.010% 99.816% ( 380, 580 ] 1 0.003% 99.820% ( 580, 870 ] 9 0.031% 99.851% ( 870, 1300 ] 18 0.062% 99.913% ( 1300, 1900 ] 3 0.010% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 10 0.035% 99.983% ( 4400, 6600 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 750.4500 StdDev: 843.72 Min: 87 Median: 358.3333 Max: 3170 Percentiles: P50: 358.33 P75: 1085.00 P99: 3170.00 P99.9: 3170.00 P99.99: 3170.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 7 11.667% 31.667% ## ( 170, 250 ] 6 10.000% 41.667% ## ( 250, 380 ] 6 10.000% 51.667% ## ( 380, 580 ] 6 10.000% 61.667% ## ( 580, 870 ] 7 11.667% 73.333% ## ( 870, 1300 ] 2 3.333% 76.667% # ( 1300, 1900 ] 6 10.000% 86.667% ## ( 1900, 2900 ] 7 11.667% 98.333% ## ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 27.6 total, 4.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 214.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.785 H:M:S, 21.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 212.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.894 H:M:S, 19.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-04:41:33 ... thread 0: (1000000,7000000) ops and (40835.9,135139.6) ops/second in (24.488248,51.798285) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/3 1.35 GB 0.0 7.6 0.0 7.6 14.3 6.7 0.0 2.1 121.1 227.3 64.50 61.04 130 0.496 7930K 15K 0.0 0.0 L1 11/11 1.18 GB 0.0 7.0 5.2 1.8 6.9 5.1 0.1 1.3 173.1 170.7 41.64 39.67 4 10.411 7320K 100K 0.0 0.0 L2 22/19 2.57 GB 3.9 0.1 0.1 0.1 0.1 0.1 4.1 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 18/13 1.25 GB 0.6 0.6 0.5 0.1 0.6 0.5 1.1 1.2 160.8 160.7 3.88 3.39 2 1.938 632K 495 0.0 0.0 L4 161/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/46 102.73 GB 0.0 15.4 5.8 9.6 22.0 12.4 7.6 3.3 142.4 203.4 110.72 104.78 137 0.808 16M 116K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 5.8 9.6 22.0 12.4 7.6 3.3 142.4 203.4 110.72 104.78 137 0.808 16M 116K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 5.8 9.6 15.3 5.7 0.0 0.0 182.3 181.0 86.47 83.15 31 2.789 16M 116K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 283.2 24.25 21.63 106 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.0 total, 51.8 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.99 GB write, 432.70 MB/s write, 15.40 GB read, 302.99 MB/s read, 110.7 seconds Interval compaction: 21.99 GB write, 434.72 MB/s write, 15.40 GB read, 304.40 MB/s read, 110.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 3, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3367681 Average: 3.2186 StdDev: 13.82 Min: 1 Median: 2.0035 Max: 4865 Percentiles: P50: 2.00 P75: 2.74 P99: 8.97 P99.9: 86.57 P99.99: 141.77 ------------------------------------------------------ [ 0, 1 ] 103387 3.070% 3.070% # ( 1, 2 ] 1576492 46.812% 49.882% ######### ( 2, 3 ] 1136663 33.752% 83.634% ####### ( 3, 4 ] 227417 6.753% 90.387% # ( 4, 6 ] 233429 6.931% 97.319% # ( 6, 10 ] 76133 2.261% 99.580% ( 10, 15 ] 9222 0.274% 99.853% ( 15, 22 ] 905 0.027% 99.880% ( 22, 34 ] 97 0.003% 99.883% ( 34, 51 ] 30 0.001% 99.884% ( 51, 76 ] 22 0.001% 99.885% ( 76, 110 ] 1661 0.049% 99.934% ( 110, 170 ] 3562 0.106% 100.040% ( 170, 250 ] 563 0.017% 100.056% ( 250, 380 ] 399 0.012% 100.068% ( 380, 580 ] 340 0.010% 100.078% ( 580, 870 ] 137 0.004% 100.082% ( 870, 1300 ] 52 0.002% 100.084% ( 1300, 1900 ] 20 0.001% 100.085% ( 1900, 2900 ] 14 0.000% 100.085% ( 2900, 4400 ] 14 0.000% 100.085% ( 4400, 6600 ] 1 0.000% 100.085% ** Level 1 read latency histogram (micros): Count: 571550 Average: 3.3630 StdDev: 19.94 Min: 1 Median: 1.7977 Max: 4118 Percentiles: P50: 1.80 P75: 2.43 P99: 9.22 P99.9: 165.09 P99.99: 818.94 ------------------------------------------------------ [ 0, 1 ] 13276 2.323% 2.323% ( 1, 2 ] 341589 59.765% 62.088% ############ ( 2, 3 ] 173537 30.363% 92.451% ###### ( 3, 4 ] 12886 2.255% 94.705% ( 4, 6 ] 17540 3.069% 97.774% # ( 6, 10 ] 8692 1.521% 99.295% ( 10, 15 ] 1488 0.260% 99.555% ( 15, 22 ] 71 0.012% 99.568% ( 22, 34 ] 7 0.001% 99.569% ( 34, 51 ] 5 0.001% 99.570% ( 76, 110 ] 917 0.160% 99.730% ( 110, 170 ] 1057 0.185% 99.915% ( 170, 250 ] 120 0.021% 99.936% ( 250, 380 ] 121 0.021% 99.957% ( 380, 580 ] 144 0.025% 99.983% ( 580, 870 ] 52 0.009% 99.992% ( 870, 1300 ] 27 0.005% 99.996% ( 1300, 1900 ] 13 0.002% 99.999% ( 1900, 2900 ] 5 0.001% 99.999% ( 2900, 4400 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31824 Average: 6.2521 StdDev: 21.80 Min: 1 Median: 4.5011 Max: 1681 Percentiles: P50: 4.50 P75: 5.75 P99: 14.73 P99.9: 357.40 P99.99: 843.55 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 24 0.075% 0.088% ( 2, 3 ] 108 0.339% 0.427% ( 3, 4 ] 12581 39.533% 39.960% ######## ( 4, 6 ] 12752 40.070% 80.031% ######## ( 6, 10 ] 5428 17.056% 97.087% ### ( 10, 15 ] 644 2.024% 99.111% ( 15, 22 ] 194 0.610% 99.720% ( 22, 34 ] 20 0.063% 99.783% ( 34, 51 ] 2 0.006% 99.789% ( 76, 110 ] 1 0.003% 99.793% ( 110, 170 ] 4 0.013% 99.805% ( 170, 250 ] 12 0.038% 99.843% ( 250, 380 ] 22 0.069% 99.912% ( 380, 580 ] 23 0.072% 99.984% ( 580, 870 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1300, 1900 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 28875 Average: 5.9648 StdDev: 105.87 Min: 0 Median: 1.5170 Max: 5464 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 1207.43 P99.99: 5329.50 ------------------------------------------------------ [ 0, 1 ] 4593 15.906% 15.906% ### ( 1, 2 ] 19043 65.950% 81.856% ############# ( 2, 3 ] 2913 10.088% 91.945% ## ( 3, 4 ] 1030 3.567% 95.512% # ( 4, 6 ] 1010 3.498% 99.010% # ( 6, 10 ] 127 0.440% 99.449% ( 10, 15 ] 44 0.152% 99.602% ( 15, 22 ] 2 0.007% 99.609% ( 22, 34 ] 54 0.187% 99.796% ( 110, 170 ] 1 0.003% 99.799% ( 170, 250 ] 3 0.010% 99.810% ( 250, 380 ] 2 0.007% 99.816% ( 380, 580 ] 1 0.003% 99.820% ( 580, 870 ] 9 0.031% 99.851% ( 870, 1300 ] 18 0.062% 99.913% ( 1300, 1900 ] 3 0.010% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 10 0.035% 99.983% ( 4400, 6600 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2403.5600 StdDev: 1182.34 Min: 695 Median: 2350.0000 Max: 5674 Percentiles: P50: 2350.00 P75: 3087.50 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 580, 870 ] 1 4.000% 4.000% # ( 870, 1300 ] 5 20.000% 24.000% #### ( 1300, 1900 ] 2 8.000% 32.000% ## ( 1900, 2900 ] 10 40.000% 72.000% ######## ( 2900, 4400 ] 6 24.000% 96.000% ##### ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 750.4500 StdDev: 843.72 Min: 87 Median: 358.3333 Max: 3170 Percentiles: P50: 358.33 P75: 1085.00 P99: 3170.00 P99.9: 3170.00 P99.99: 3170.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 7 11.667% 31.667% ## ( 170, 250 ] 6 10.000% 41.667% ## ( 250, 380 ] 6 10.000% 51.667% ## ( 380, 580 ] 6 10.000% 61.667% ## ( 580, 870 ] 7 11.667% 73.333% ## ( 870, 1300 ] 2 3.333% 76.667% # ( 1300, 1900 ] 6 10.000% 86.667% ## ( 1900, 2900 ] 7 11.667% 98.333% ## ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 52.0 total, 24.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 132.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.423 H:M:S, 50.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 40.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.637 H:M:S, 84.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 2024/07/11-04:41:40 ... thread 0: (1000000,8000000) ops and (137162.5,135389.2) ops/second in (7.290622,59.088907) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/3 2.21 GB 88.1 8.2 0.0 8.2 15.8 7.6 0.0 2.1 112.9 216.3 74.75 67.30 143 0.523 8569K 15K 0.0 0.0 L1 11/11 1.18 GB 0.0 7.0 5.2 1.8 6.9 5.1 0.1 1.3 173.1 170.7 41.64 39.67 4 10.411 7320K 100K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 4.1 2.0 180.9 180.8 0.70 0.67 1 0.697 127K 37 0.0 0.0 L3 17/2 1.14 GB 0.9 2.2 1.2 1.0 2.2 1.2 3.0 1.9 118.4 117.7 19.19 13.19 9 2.132 2307K 12K 0.0 0.0 L4 160/6 9.66 GB 1.0 3.1 2.6 0.5 3.1 2.5 1.2 1.2 96.8 96.3 32.44 19.33 27 1.201 3132K 13K 0.0 0.0 L5 1072/0 89.38 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/22 103.56 GB 0.0 20.7 9.0 11.7 28.1 16.4 12.1 3.7 125.6 170.6 168.72 140.16 184 0.917 21M 141K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 9.0 11.7 28.1 16.4 12.1 3.7 125.6 170.6 168.72 140.16 184 0.917 21M 141K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 9.0 11.7 20.5 8.9 0.0 0.0 153.4 152.4 138.07 115.68 67 2.061 21M 141K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 252.8 30.65 24.49 117 0.262 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.3 total, 59.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.11 GB write, 485.23 MB/s write, 20.69 GB read, 357.05 MB/s read, 168.7 seconds Interval compaction: 28.11 GB write, 487.21 MB/s write, 20.69 GB read, 358.52 MB/s read, 168.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 29, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3736613 Average: 3.6627 StdDev: 38.99 Min: 1 Median: 2.0792 Max: 10653 Percentiles: P50: 2.08 P75: 2.82 P99: 9.56 P99.9: 86.07 P99.99: 146.62 ------------------------------------------------------ [ 0, 1 ] 109151 2.921% 2.921% # ( 1, 2 ] 1659828 44.421% 47.342% ######### ( 2, 3 ] 1254071 33.562% 80.903% ####### ( 3, 4 ] 268716 7.191% 88.095% # ( 4, 6 ] 304134 8.139% 96.234% ## ( 6, 10 ] 116272 3.112% 99.346% # ( 10, 15 ] 17580 0.470% 99.816% ( 15, 22 ] 2246 0.060% 99.876% ( 22, 34 ] 305 0.008% 99.885% ( 34, 51 ] 49 0.001% 99.886% ( 51, 76 ] 31 0.001% 99.887% ( 76, 110 ] 1669 0.045% 99.931% ( 110, 170 ] 3585 0.096% 100.027% ( 170, 250 ] 598 0.016% 100.043% ( 250, 380 ] 445 0.012% 100.055% ( 380, 580 ] 416 0.011% 100.066% ( 580, 870 ] 212 0.006% 100.072% ( 870, 1300 ] 120 0.003% 100.075% ( 1300, 1900 ] 70 0.002% 100.077% ( 1900, 2900 ] 75 0.002% 100.079% ( 2900, 4400 ] 155 0.004% 100.083% ( 4400, 6600 ] 44 0.001% 100.085% ( 6600, 9900 ] 24 0.001% 100.085% ( 9900, 14000 ] 1 0.000% 100.085% ** Level 1 read latency histogram (micros): Count: 1357537 Average: 7.8854 StdDev: 127.78 Min: 1 Median: 2.3857 Max: 15180 Percentiles: P50: 2.39 P75: 3.42 P99: 12.57 P99.9: 82.22 P99.99: 133.11 ------------------------------------------------------ [ 0, 1 ] 15847 1.167% 1.167% ( 1, 2 ] 477685 35.188% 36.355% ####### ( 2, 3 ] 480258 35.377% 71.732% ####### ( 3, 4 ] 105828 7.796% 79.528% ## ( 4, 6 ] 171464 12.631% 92.158% ### ( 6, 10 ] 83959 6.185% 98.343% # ( 10, 15 ] 17324 1.276% 99.619% ( 15, 22 ] 3156 0.232% 99.851% ( 22, 34 ] 385 0.028% 99.880% ( 34, 51 ] 61 0.004% 99.884% ( 51, 76 ] 38 0.003% 99.887% ( 76, 110 ] 953 0.070% 99.957% ( 110, 170 ] 1151 0.085% 100.042% ( 170, 250 ] 232 0.017% 100.059% ( 250, 380 ] 308 0.023% 100.082% ( 380, 580 ] 379 0.028% 100.110% ( 580, 870 ] 340 0.025% 100.135% ( 870, 1300 ] 294 0.022% 100.157% ( 1300, 1900 ] 201 0.015% 100.171% ( 1900, 2900 ] 282 0.021% 100.192% ( 2900, 4400 ] 573 0.042% 100.234% ( 4400, 6600 ] 224 0.017% 100.251% ( 6600, 9900 ] 83 0.006% 100.257% ( 9900, 14000 ] 7 0.001% 100.257% ( 14000, 22000 ] 2 0.000% 100.258% ** Level 2 read latency histogram (micros): Count: 31983 Average: 6.2402 StdDev: 21.75 Min: 1 Median: 4.4931 Max: 1681 Percentiles: P50: 4.49 P75: 5.75 P99: 14.72 P99.9: 356.46 P99.99: 841.25 ------------------------------------------------------ [ 0, 1 ] 4 0.013% 0.013% ( 1, 2 ] 55 0.172% 0.184% ( 2, 3 ] 177 0.553% 0.738% ( 3, 4 ] 12606 39.415% 40.153% ######## ( 4, 6 ] 12773 39.937% 80.089% ######## ( 6, 10 ] 5436 16.997% 97.086% ### ( 10, 15 ] 649 2.029% 99.115% ( 15, 22 ] 194 0.607% 99.722% ( 22, 34 ] 20 0.063% 99.784% ( 34, 51 ] 2 0.006% 99.791% ( 76, 110 ] 1 0.003% 99.794% ( 110, 170 ] 4 0.013% 99.806% ( 170, 250 ] 12 0.038% 99.844% ( 250, 380 ] 22 0.069% 99.912% ( 380, 580 ] 23 0.072% 99.984% ( 580, 870 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1300, 1900 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 477814 Average: 15.4519 StdDev: 199.71 Min: 0 Median: 2.7592 Max: 19331 Percentiles: P50: 2.76 P75: 4.42 P99: 14.83 P99.9: 1361.05 P99.99: 2735.11 ------------------------------------------------------ [ 0, 1 ] 5768 1.207% 1.207% ( 1, 2 ] 96405 20.176% 21.383% #### ( 2, 3 ] 180103 37.693% 59.077% ######## ( 3, 4 ] 57625 12.060% 71.137% ## ( 4, 6 ] 88580 18.539% 89.675% #### ( 6, 10 ] 39165 8.197% 97.872% ## ( 10, 15 ] 5585 1.169% 99.041% ( 15, 22 ] 1034 0.216% 99.257% ( 22, 34 ] 151 0.032% 99.289% ( 34, 51 ] 37 0.008% 99.297% ( 51, 76 ] 9 0.002% 99.298% ( 76, 110 ] 22 0.005% 99.303% ( 110, 170 ] 171 0.036% 99.339% ( 170, 250 ] 257 0.054% 99.393% ( 250, 380 ] 445 0.093% 99.486% ( 380, 580 ] 636 0.133% 99.619% ( 580, 870 ] 723 0.151% 99.770% ( 870, 1300 ] 593 0.124% 99.894% ( 1300, 1900 ] 277 0.058% 99.952% ( 1900, 2900 ] 217 0.045% 99.998% ( 2900, 4400 ] 425 0.089% 100.087% ( 4400, 6600 ] 156 0.033% 100.119% ( 6600, 9900 ] 44 0.009% 100.129% ( 9900, 14000 ] 17 0.004% 100.132% ( 14000, 22000 ] 4 0.001% 100.133% ** Level 4 read latency histogram (micros): Count: 61958 Average: 8.3187 StdDev: 110.47 Min: 1 Median: 2.6762 Max: 5674 Percentiles: P50: 2.68 P75: 4.18 P99: 12.96 P99.9: 1352.10 P99.99: 4088.25 ------------------------------------------------------ [ 0, 1 ] 353 0.570% 0.570% ( 1, 2 ] 14963 24.150% 24.720% ##### ( 2, 3 ] 23163 37.385% 62.105% ####### ( 3, 4 ] 6993 11.287% 73.392% ## ( 4, 6 ] 10788 17.412% 90.803% ### ( 6, 10 ] 4737 7.646% 98.449% ## ( 10, 15 ] 576 0.930% 99.379% ( 15, 22 ] 86 0.139% 99.517% ( 22, 34 ] 14 0.023% 99.540% ( 34, 51 ] 7 0.011% 99.551% ( 51, 76 ] 1 0.002% 99.553% ( 76, 110 ] 18 0.029% 99.582% ( 110, 170 ] 43 0.069% 99.651% ( 170, 250 ] 62 0.100% 99.751% ( 250, 380 ] 27 0.044% 99.795% ( 380, 580 ] 28 0.045% 99.840% ( 580, 870 ] 21 0.034% 99.874% ( 870, 1300 ] 15 0.024% 99.898% ( 1300, 1900 ] 12 0.019% 99.918% ( 1900, 2900 ] 25 0.040% 99.958% ( 2900, 4400 ] 25 0.040% 99.998% ( 4400, 6600 ] 8 0.013% 100.011% ** Level 5 read latency histogram (micros): Count: 200 Average: 1717.5200 StdDev: 2001.10 Min: 87 Median: 848.5185 Max: 14782 Percentiles: P50: 848.52 P75: 2540.00 P99: 8800.00 P99.9: 14782.00 P99.99: 14782.00 ------------------------------------------------------ ( 76, 110 ] 14 7.000% 7.000% # ( 110, 170 ] 15 7.500% 14.500% ## ( 170, 250 ] 12 6.000% 20.500% # ( 250, 380 ] 16 8.000% 28.500% ## ( 380, 580 ] 18 9.000% 37.500% ## ( 580, 870 ] 27 13.500% 51.000% ### ( 870, 1300 ] 14 7.000% 58.000% # ( 1300, 1900 ] 18 9.000% 67.000% ## ( 1900, 2900 ] 25 12.500% 79.500% ### ( 2900, 4400 ] 19 9.500% 89.000% ## ( 4400, 6600 ] 18 9.000% 98.000% ## ( 6600, 9900 ] 3 1.500% 99.500% ( 14000, 22000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 59.3 total, 7.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 132.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.752 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 134.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.329 H:M:S, 31.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 7.280 micros/op 137358 ops/sec 60.004 seconds 8241999 operations; 133.1 MB/s Microseconds per write: Count: 8241999 Average: 7.2802 StdDev: 441.71 Min: 1 Median: 2.6472 Max: 860712 Percentiles: P50: 2.65 P75: 3.90 P99: 9.94 P99.9: 1242.76 P99.99: 2795.21 ------------------------------------------------------ [ 0, 1 ] 181469 2.202% 2.202% ( 1, 2 ] 1845067 22.386% 24.588% #### ( 2, 3 ] 3236281 39.266% 63.854% ######## ( 3, 4 ] 1017636 12.347% 76.201% ## ( 4, 6 ] 1547831 18.780% 94.980% #### ( 6, 10 ] 336429 4.082% 99.062% # ( 10, 15 ] 41242 0.500% 99.563% ( 15, 22 ] 6632 0.080% 99.643% ( 22, 34 ] 2286 0.028% 99.671% ( 34, 51 ] 319 0.004% 99.675% ( 51, 76 ] 49 0.001% 99.675% ( 76, 110 ] 771 0.009% 99.685% ( 110, 170 ] 6747 0.082% 99.767% ( 170, 250 ] 625 0.008% 99.774% ( 250, 380 ] 204 0.002% 99.777% ( 380, 580 ] 31 0.000% 99.777% ( 580, 870 ] 25 0.000% 99.777% ( 870, 1300 ] 11666 0.142% 99.919% ( 1300, 1900 ] 28 0.000% 99.919% ( 1900, 2900 ] 6520 0.079% 99.998% ( 2900, 4400 ] 113 0.001% 100.000% ( 4400, 6600 ] 8 0.000% 100.000% ( 6600, 9900 ] 10 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 147541 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8241999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 8505742968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 446 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28751771 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 23821841938 rocksdb.compact.write.bytes COUNT : 23671078573 rocksdb.flush.write.bytes COUNT : 8389633785 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 53 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 153 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8321689600 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2981888 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23906209700 rocksdb.non.last.level.read.count COUNT : 5771721 rocksdb.block.checksum.compute.count COUNT : 5770882 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.923489 P95 : 5.606258 P99 : 9.342975 P100 : 860706.000000 COUNT : 8241999 SUM : 54405305 rocksdb.compaction.times.micros P50 : 1537500.000000 P95 : 3985000.000000 P99 : 25410000.000000 P100 : 25489748.000000 COUNT : 69 SUM : 141307718 rocksdb.compaction.times.cpu_micros P50 : 1190555.555556 P95 : 3670000.000000 P99 : 23937765.000000 P100 : 23937765.000000 COUNT : 69 SUM : 118322158 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 780.928571 P95 : 1890.000000 P99 : 8086.000000 P100 : 8086.000000 COUNT : 121 SUM : 128294 rocksdb.compaction.outfile.sync.micros P50 : 1182.421875 P95 : 14933.333333 P99 : 43285.000000 P100 : 76189.000000 COUNT : 279 SUM : 1168039 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 166.146789 P95 : 2480.000000 P99 : 6438.666667 P100 : 6752.000000 COUNT : 222 SUM : 117453 rocksdb.table.open.io.micros P50 : 1582.352941 P95 : 11557.083333 P99 : 17540.000000 P100 : 21859.000000 COUNT : 446 SUM : 1204940 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.062950 P95 : 9.847113 P99 : 14.941721 P100 : 19340.000000 COUNT : 5769608 SUM : 48699457 rocksdb.read.block.get.micros P50 : 469.230769 P95 : 4247.692308 P99 : 6463.741935 P100 : 14955.000000 COUNT : 892 SUM : 947524 rocksdb.write.raw.block.micros P50 : 0.550262 P95 : 1.601746 P99 : 3.709499 P100 : 37320.000000 COUNT : 7779472 SUM : 21688932 rocksdb.numfiles.in.singlecompaction P50 : 3.296053 P95 : 4.100000 P99 : 14.525000 P100 : 24.000000 COUNT : 119 SUM : 454 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559877 P95 : 1225.957575 P99 : 2639.202709 P100 : 860486.000000 COUNT : 170440 SUM : 28761991 rocksdb.sst.read.micros P50 : 2.240715 P95 : 6.504564 P99 : 11.138201 P100 : 19331.000000 COUNT : 5771898 SUM : 33325990 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8241999 SUM : 8505742968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217450.980392 P95 : 526722.222222 P99 : 994300.000000 P100 : 1145514.000000 COUNT : 121 SUM : 31500364 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 266 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0