[2024-12-04 22:02:43.059715] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-04 22:02:43.059975] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2352118 ] Set seed to 1733346163053093 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-04 22:02:43.175199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-04 22:02:43.382421] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-04 22:02:43.382471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2352118' to capture a snapshot of events at runtime. [2024-12-04 22:02:43.382481] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2352118 for offline analysis/debug. [2024-12-04 22:02:43.382529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Dec 4 22:02:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/04-22:02:54 ... thread 0: (1000000,1000000) ops and (361546.5,361546.5) ops/second in (2.765896,2.765896) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.98 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.9 2.31 2.07 12 0.193 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.05 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 18/0 929.06 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 226.0 226.1 0.55 0.49 1 0.553 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/9 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 0.4 1.3 74.4 317.4 3.37 3.05 14 0.241 254K 46 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.2 1.3 74.4 317.4 3.37 3.05 14 0.241 254K 46 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 237.4 237.4 1.06 0.98 2 0.528 254K 46 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.9 2.31 2.07 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 359.39 MB/s write, 0.25 GB read, 84.29 MB/s read, 3.4 seconds Interval compaction: 1.04 GB write, 386.61 MB/s write, 0.25 GB read, 90.67 MB/s read, 3.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 116139 Average: 2.0084 StdDev: 22.41 Min: 1 Median: 1.2855 Max: 3751 Percentiles: P50: 1.29 P75: 1.70 P99: 4.56 P99.9: 9.85 P99.99: 144.83 ------------------------------------------------------ [ 0, 1 ] 38103 32.808% 32.808% ####### ( 1, 2 ] 69946 60.226% 93.034% ############ ( 2, 3 ] 4672 4.023% 97.057% # ( 3, 4 ] 1976 1.701% 98.758% ( 4, 6 ] 1011 0.871% 99.629% ( 6, 10 ] 329 0.283% 99.912% ( 10, 15 ] 64 0.055% 99.967% ( 15, 22 ] 16 0.014% 99.981% ( 22, 34 ] 2 0.002% 99.983% ( 34, 51 ] 2 0.002% 99.985% ( 51, 76 ] 2 0.002% 99.986% ( 110, 170 ] 11 0.009% 99.996% ( 250, 380 ] 1 0.001% 99.997% ( 380, 580 ] 3 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ( 1300, 1900 ] 2 0.002% 100.003% ( 1900, 2900 ] 2 0.002% 100.004% ( 2900, 4400 ] 3 0.003% 100.007% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1468.7250 StdDev: 2029.53 Min: 0 Median: 250.0000 Max: 9066 Percentiles: P50: 250.00 P75: 2483.33 P99: 9020.00 P99.9: 9066.00 P99.99: 9066.00 ------------------------------------------------------ [ 0, 1 ] 24 30.000% 30.000% ###### ( 1, 2 ] 8 10.000% 40.000% ## ( 2, 3 ] 2 2.500% 42.500% # ( 3, 4 ] 1 1.250% 43.750% ( 4, 6 ] 3 3.750% 47.500% # ( 76, 110 ] 1 1.250% 48.750% ( 170, 250 ] 1 1.250% 50.000% ( 250, 380 ] 3 3.750% 53.750% # ( 580, 870 ] 2 2.500% 56.250% # ( 870, 1300 ] 6 7.500% 63.750% ## ( 1300, 1900 ] 2 2.500% 66.250% # ( 1900, 2900 ] 12 15.000% 81.250% ### ( 2900, 4400 ] 7 8.750% 90.000% ## ( 4400, 6600 ] 5 6.250% 96.250% # ( 6600, 9900 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3386.2333 StdDev: 2038.74 Min: 933 Median: 2650.0000 Max: 8283 Percentiles: P50: 2650.00 P75: 4250.00 P99: 8283.00 P99.9: 8283.00 P99.99: 8283.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 2 6.667% 20.000% # ( 1900, 2900 ] 12 40.000% 60.000% ######## ( 2900, 4400 ] 5 16.667% 76.667% ### ( 4400, 6600 ] 3 10.000% 86.667% ## ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 330.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.182 H:M:S, 6.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 355.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.182 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/04-22:02:57 ... thread 0: (1000000,2000000) ops and (331215.2,345716.9) ops/second in (3.019185,5.785081) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 107.0 0.9 0.0 0.9 2.6 1.8 0.0 1.5 103.3 317.1 8.54 7.91 29 0.294 895K 1006 0.0 0.0 L1 1/0 2.66 MB 0.3 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.0 244.7 1.29 1.25 1 1.286 319K 380 0.0 0.0 L2 2/0 55.42 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 47/0 995.08 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 184.7 184.6 2.68 2.22 2 1.339 502K 322 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/4 97.92 GB 0.0 1.8 0.7 1.1 3.6 2.5 0.8 2.0 139.7 280.1 13.01 11.86 33 0.394 1845K 1754 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.1 3.6 2.5 0.7 2.0 139.7 280.1 13.01 11.86 33 0.394 1845K 1754 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.1 1.8 0.7 0.0 0.0 230.7 230.5 7.88 7.29 7 1.125 1845K 1754 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.1 5.13 4.57 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.56 GB write, 607.55 MB/s write, 1.78 GB read, 303.16 MB/s read, 13.0 seconds Interval compaction: 3.56 GB write, 629.55 MB/s write, 1.78 GB read, 314.14 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 380634 Average: 2.1064 StdDev: 15.82 Min: 1 Median: 1.4048 Max: 3751 Percentiles: P50: 1.40 P75: 1.80 P99: 5.56 P99.9: 10.61 P99.99: 20.72 ------------------------------------------------------ [ 0, 1 ] 92687 24.351% 24.351% ##### ( 1, 2 ] 241173 63.361% 87.712% ############# ( 2, 3 ] 27314 7.176% 94.887% # ( 3, 4 ] 10218 2.684% 97.572% # ( 4, 6 ] 6991 1.837% 99.409% ( 6, 10 ] 1829 0.481% 99.889% ( 10, 15 ] 349 0.092% 99.981% ( 15, 22 ] 44 0.012% 99.992% ( 22, 34 ] 9 0.002% 99.995% ( 34, 51 ] 4 0.001% 99.996% ( 51, 76 ] 3 0.001% 99.997% ( 110, 170 ] 15 0.004% 100.001% ( 170, 250 ] 8 0.002% 100.003% ( 250, 380 ] 3 0.001% 100.003% ( 380, 580 ] 6 0.002% 100.005% ( 580, 870 ] 9 0.002% 100.007% ( 870, 1300 ] 5 0.001% 100.009% ( 1300, 1900 ] 5 0.001% 100.010% ( 1900, 2900 ] 2 0.001% 100.011% ( 2900, 4400 ] 5 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 65398 Average: 2.3977 StdDev: 6.71 Min: 1 Median: 1.6236 Max: 991 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 12.46 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 6132 9.376% 9.376% ## ( 1, 2 ] 42600 65.140% 74.516% ############# ( 2, 3 ] 10991 16.806% 91.322% ### ( 3, 4 ] 2521 3.855% 95.177% # ( 4, 6 ] 2555 3.907% 99.084% # ( 6, 10 ] 483 0.739% 99.823% ( 10, 15 ] 103 0.157% 99.980% ( 15, 22 ] 4 0.006% 99.986% ( 22, 34 ] 1 0.002% 99.988% ( 34, 51 ] 1 0.002% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28895 Average: 6.4477 StdDev: 131.79 Min: 0 Median: 1.6030 Max: 9066 Percentiles: P50: 1.60 P75: 1.99 P99: 7.13 P99.9: 1331.50 P99.99: 6721.55 ------------------------------------------------------ [ 0, 1 ] 3164 10.950% 10.950% ## ( 1, 2 ] 18712 64.759% 75.709% ############# ( 2, 3 ] 4467 15.459% 91.168% ### ( 3, 4 ] 1162 4.021% 95.189% # ( 4, 6 ] 1040 3.599% 98.789% # ( 6, 10 ] 217 0.751% 99.540% ( 10, 15 ] 64 0.221% 99.761% ( 15, 22 ] 12 0.042% 99.803% ( 22, 34 ] 7 0.024% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 4 0.014% 99.868% ( 580, 870 ] 3 0.010% 99.879% ( 870, 1300 ] 6 0.021% 99.900% ( 1300, 1900 ] 2 0.007% 99.907% ( 1900, 2900 ] 12 0.042% 99.948% ( 2900, 4400 ] 7 0.024% 99.972% ( 4400, 6600 ] 5 0.017% 99.990% ( 6600, 9900 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3386.2333 StdDev: 2038.74 Min: 933 Median: 2650.0000 Max: 8283 Percentiles: P50: 2650.00 P75: 4250.00 P99: 8283.00 P99.9: 8283.00 P99.99: 8283.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 2 6.667% 20.000% # ( 1900, 2900 ] 12 40.000% 60.000% ######## ( 2900, 4400 ] 5 16.667% 76.667% ### ( 4400, 6600 ] 3 10.000% 86.667% ## ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 328.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.535 H:M:S, 8.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.353 H:M:S, 11.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/04-22:03:00 ... thread 0: (1000000,3000000) ops and (333063.6,341393.6) ops/second in (3.002430,8.787511) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.34 GB 207.7 2.0 0.0 2.0 4.7 2.8 0.0 1.7 128.9 310.0 15.64 14.63 47 0.333 2046K 2275 0.0 0.0 L1 1/0 2.66 MB 0.3 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.0 244.7 1.29 1.25 1 1.286 319K 380 0.0 0.0 L2 2/0 55.42 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 47/0 995.08 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 184.7 184.6 2.68 2.22 2 1.339 502K 322 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 98.90 GB 0.0 2.9 0.7 2.2 5.6 3.4 0.8 2.0 146.8 287.6 20.11 18.58 51 0.394 2997K 3023 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.7 2.2 5.6 3.4 0.7 2.0 146.8 287.6 20.11 18.58 51 0.394 2997K 3023 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.7 2.2 2.9 0.7 0.0 0.0 241.8 241.5 12.21 11.54 11 1.110 2997K 3023 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.0 7.90 7.04 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.65 GB write, 642.71 MB/s write, 2.88 GB read, 328.02 MB/s read, 20.1 seconds Interval compaction: 5.65 GB write, 658.04 MB/s write, 2.88 GB read, 335.85 MB/s read, 20.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 642773 Average: 2.0510 StdDev: 13.35 Min: 1 Median: 1.3909 Max: 3751 Percentiles: P50: 1.39 P75: 1.78 P99: 5.30 P99.9: 9.97 P99.99: 19.48 ------------------------------------------------------ [ 0, 1 ] 160245 24.930% 24.930% ##### ( 1, 2 ] 412275 64.140% 89.070% ############# ( 2, 3 ] 41932 6.524% 95.594% # ( 3, 4 ] 15697 2.442% 98.036% ( 4, 6 ] 9543 1.485% 99.521% ( 6, 10 ] 2457 0.382% 99.903% ( 10, 15 ] 523 0.081% 99.984% ( 15, 22 ] 59 0.009% 99.993% ( 22, 34 ] 9 0.001% 99.995% ( 34, 51 ] 6 0.001% 99.996% ( 51, 76 ] 3 0.000% 99.996% ( 110, 170 ] 22 0.003% 100.000% ( 170, 250 ] 13 0.002% 100.002% ( 250, 380 ] 7 0.001% 100.003% ( 380, 580 ] 12 0.002% 100.005% ( 580, 870 ] 13 0.002% 100.007% ( 870, 1300 ] 11 0.002% 100.008% ( 1300, 1900 ] 9 0.001% 100.010% ( 1900, 2900 ] 2 0.000% 100.010% ( 2900, 4400 ] 5 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 65398 Average: 2.3977 StdDev: 6.71 Min: 1 Median: 1.6236 Max: 991 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 12.46 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 6132 9.376% 9.376% ## ( 1, 2 ] 42600 65.140% 74.516% ############# ( 2, 3 ] 10991 16.806% 91.322% ### ( 3, 4 ] 2521 3.855% 95.177% # ( 4, 6 ] 2555 3.907% 99.084% # ( 6, 10 ] 483 0.739% 99.823% ( 10, 15 ] 103 0.157% 99.980% ( 15, 22 ] 4 0.006% 99.986% ( 22, 34 ] 1 0.002% 99.988% ( 34, 51 ] 1 0.002% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28895 Average: 6.4477 StdDev: 131.79 Min: 0 Median: 1.6030 Max: 9066 Percentiles: P50: 1.60 P75: 1.99 P99: 7.13 P99.9: 1331.50 P99.99: 6721.55 ------------------------------------------------------ [ 0, 1 ] 3164 10.950% 10.950% ## ( 1, 2 ] 18712 64.759% 75.709% ############# ( 2, 3 ] 4467 15.459% 91.168% ### ( 3, 4 ] 1162 4.021% 95.189% # ( 4, 6 ] 1040 3.599% 98.789% # ( 6, 10 ] 217 0.751% 99.540% ( 10, 15 ] 64 0.221% 99.761% ( 15, 22 ] 12 0.042% 99.803% ( 22, 34 ] 7 0.024% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 4 0.014% 99.868% ( 580, 870 ] 3 0.010% 99.879% ( 870, 1300 ] 6 0.021% 99.900% ( 1300, 1900 ] 2 0.007% 99.907% ( 1900, 2900 ] 12 0.042% 99.948% ( 2900, 4400 ] 7 0.024% 99.972% ( 4400, 6600 ] 5 0.017% 99.990% ( 6600, 9900 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3386.2333 StdDev: 2038.74 Min: 933 Median: 2650.0000 Max: 8283 Percentiles: P50: 2650.00 P75: 4250.00 P99: 8283.00 P99.9: 8283.00 P99.99: 8283.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 2 6.667% 20.000% # ( 1900, 2900 ] 12 40.000% 60.000% ######## ( 2900, 4400 ] 5 16.667% 76.667% ### ( 4400, 6600 ] 3 10.000% 86.667% ## ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.907 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/04-22:03:03 ... thread 0: (1000000,4000000) ops and (333297.7,339333.0) ops/second in (3.000321,11.787832) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.32 GB 314.6 2.8 0.0 2.8 6.6 3.7 0.0 1.8 133.1 309.3 21.78 20.41 64 0.340 2942K 3260 0.0 0.0 L1 1/0 2.66 MB 0.3 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.0 244.7 1.29 1.25 1 1.286 319K 380 0.0 0.0 L2 2/0 55.42 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 47/0 995.08 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 184.7 184.6 2.68 2.22 2 1.339 502K 322 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 99.89 GB 0.0 3.7 0.7 3.1 7.5 4.4 0.8 2.0 146.1 292.3 26.25 24.36 68 0.386 3892K 4008 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.7 3.1 7.5 4.4 0.7 2.0 146.1 292.3 26.25 24.36 68 0.386 3892K 4008 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.7 3.1 3.7 0.7 0.0 0.0 246.7 246.4 15.54 14.80 14 1.110 3892K 4008 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 358.8 10.71 9.56 54 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.49 GB write, 639.42 MB/s write, 3.74 GB read, 319.50 MB/s read, 26.2 seconds Interval compaction: 7.49 GB write, 650.79 MB/s write, 3.74 GB read, 325.18 MB/s read, 26.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 900037 Average: 2.0367 StdDev: 13.31 Min: 1 Median: 1.3840 Max: 3751 Percentiles: P50: 1.38 P75: 1.77 P99: 5.21 P99.9: 9.96 P99.99: 18.73 ------------------------------------------------------ [ 0, 1 ] 227496 25.276% 25.276% ##### ( 1, 2 ] 579539 64.391% 89.667% ############# ( 2, 3 ] 55753 6.195% 95.861% # ( 3, 4 ] 20850 2.317% 98.178% ( 4, 6 ] 12198 1.355% 99.533% ( 6, 10 ] 3336 0.371% 99.904% ( 10, 15 ] 736 0.082% 99.986% ( 15, 22 ] 77 0.009% 99.994% ( 22, 34 ] 14 0.002% 99.996% ( 34, 51 ] 7 0.001% 99.997% ( 51, 76 ] 5 0.001% 99.997% ( 110, 170 ] 27 0.003% 100.000% ( 170, 250 ] 18 0.002% 100.002% ( 250, 380 ] 11 0.001% 100.003% ( 380, 580 ] 17 0.002% 100.005% ( 580, 870 ] 17 0.002% 100.007% ( 870, 1300 ] 16 0.002% 100.009% ( 1300, 1900 ] 11 0.001% 100.010% ( 1900, 2900 ] 5 0.001% 100.011% ( 2900, 4400 ] 6 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 65398 Average: 2.3977 StdDev: 6.71 Min: 1 Median: 1.6236 Max: 991 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 12.46 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 6132 9.376% 9.376% ## ( 1, 2 ] 42600 65.140% 74.516% ############# ( 2, 3 ] 10991 16.806% 91.322% ### ( 3, 4 ] 2521 3.855% 95.177% # ( 4, 6 ] 2555 3.907% 99.084% # ( 6, 10 ] 483 0.739% 99.823% ( 10, 15 ] 103 0.157% 99.980% ( 15, 22 ] 4 0.006% 99.986% ( 22, 34 ] 1 0.002% 99.988% ( 34, 51 ] 1 0.002% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28895 Average: 6.4477 StdDev: 131.79 Min: 0 Median: 1.6030 Max: 9066 Percentiles: P50: 1.60 P75: 1.99 P99: 7.13 P99.9: 1331.50 P99.99: 6721.55 ------------------------------------------------------ [ 0, 1 ] 3164 10.950% 10.950% ## ( 1, 2 ] 18712 64.759% 75.709% ############# ( 2, 3 ] 4467 15.459% 91.168% ### ( 3, 4 ] 1162 4.021% 95.189% # ( 4, 6 ] 1040 3.599% 98.789% # ( 6, 10 ] 217 0.751% 99.540% ( 10, 15 ] 64 0.221% 99.761% ( 15, 22 ] 12 0.042% 99.803% ( 22, 34 ] 7 0.024% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 4 0.014% 99.868% ( 580, 870 ] 3 0.010% 99.879% ( 870, 1300 ] 6 0.021% 99.900% ( 1300, 1900 ] 2 0.007% 99.907% ( 1900, 2900 ] 12 0.042% 99.948% ( 2900, 4400 ] 7 0.024% 99.972% ( 4400, 6600 ] 5 0.017% 99.990% ( 6600, 9900 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3386.2333 StdDev: 2038.74 Min: 933 Median: 2650.0000 Max: 8283 Percentiles: P50: 2650.00 P75: 4250.00 P99: 8283.00 P99.9: 8283.00 P99.99: 8283.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 2 6.667% 20.000% # ( 1900, 2900 ] 12 40.000% 60.000% ######## ( 2900, 4400 ] 5 16.667% 76.667% ### ( 4400, 6600 ] 3 10.000% 86.667% ## ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.286 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/04-22:03:15 ... thread 0: (1000000,5000000) ops and (85594.2,213030.0) ops/second in (11.683041,23.470873) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/19 4.24 GB 0.0 3.8 0.0 3.8 8.5 4.7 0.0 1.8 138.3 307.6 28.25 26.53 82 0.344 3965K 4227 0.0 0.0 L1 1/1 2.66 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.0 244.7 1.29 1.25 1 1.286 319K 380 0.0 0.0 L2 2/0 55.42 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 47/0 995.08 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 184.7 184.6 2.68 2.22 2 1.339 502K 322 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/20 100.81 GB 0.0 4.7 0.7 4.0 9.4 5.4 0.8 2.0 148.0 294.2 32.72 30.48 86 0.380 4916K 4975 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.7 4.0 9.4 5.4 0.7 2.0 148.0 294.2 32.72 30.48 86 0.380 4916K 4975 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.7 4.0 4.7 0.7 0.0 0.0 250.0 249.7 19.37 18.57 18 1.076 4916K 4975 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 358.7 13.35 11.91 68 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.40 GB write, 406.40 MB/s write, 4.73 GB read, 204.45 MB/s read, 32.7 seconds Interval compaction: 9.40 GB write, 410.02 MB/s write, 4.73 GB read, 206.27 MB/s read, 32.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 16, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1815803 Average: 2.0632 StdDev: 11.53 Min: 1 Median: 1.3797 Max: 3751 Percentiles: P50: 1.38 P75: 1.76 P99: 5.42 P99.9: 12.22 P99.99: 155.12 ------------------------------------------------------ [ 0, 1 ] 456509 25.141% 25.141% ##### ( 1, 2 ] 1188850 65.472% 90.613% ############# ( 2, 3 ] 99457 5.477% 96.091% # ( 3, 4 ] 38098 2.098% 98.189% ( 4, 6 ] 20783 1.145% 99.333% ( 6, 10 ] 9638 0.531% 99.864% ( 10, 15 ] 1471 0.081% 99.945% ( 15, 22 ] 238 0.013% 99.958% ( 22, 34 ] 24 0.001% 99.960% ( 34, 51 ] 8 0.000% 99.960% ( 51, 76 ] 6 0.000% 99.960% ( 76, 110 ] 282 0.016% 99.976% ( 110, 170 ] 345 0.019% 99.995% ( 170, 250 ] 88 0.005% 100.000% ( 250, 380 ] 56 0.003% 100.003% ( 380, 580 ] 62 0.003% 100.006% ( 580, 870 ] 42 0.002% 100.008% ( 870, 1300 ] 26 0.001% 100.010% ( 1300, 1900 ] 13 0.001% 100.011% ( 1900, 2900 ] 7 0.000% 100.011% ( 2900, 4400 ] 8 0.000% 100.011% ** Level 1 read latency histogram (micros): Count: 65399 Average: 2.3995 StdDev: 6.72 Min: 1 Median: 1.6237 Max: 991 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 12.50 P99.99: 123.80 ------------------------------------------------------ [ 0, 1 ] 6132 9.376% 9.376% ## ( 1, 2 ] 42600 65.139% 74.515% ############# ( 2, 3 ] 10991 16.806% 91.321% ### ( 3, 4 ] 2521 3.855% 95.176% # ( 4, 6 ] 2555 3.907% 99.083% # ( 6, 10 ] 483 0.739% 99.821% ( 10, 15 ] 103 0.157% 99.979% ( 15, 22 ] 4 0.006% 99.985% ( 22, 34 ] 1 0.002% 99.986% ( 34, 51 ] 1 0.002% 99.988% ( 51, 76 ] 1 0.002% 99.989% ( 110, 170 ] 2 0.003% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28895 Average: 6.4477 StdDev: 131.79 Min: 0 Median: 1.6030 Max: 9066 Percentiles: P50: 1.60 P75: 1.99 P99: 7.13 P99.9: 1331.50 P99.99: 6721.55 ------------------------------------------------------ [ 0, 1 ] 3164 10.950% 10.950% ## ( 1, 2 ] 18712 64.759% 75.709% ############# ( 2, 3 ] 4467 15.459% 91.168% ### ( 3, 4 ] 1162 4.021% 95.189% # ( 4, 6 ] 1040 3.599% 98.789% # ( 6, 10 ] 217 0.751% 99.540% ( 10, 15 ] 64 0.221% 99.761% ( 15, 22 ] 12 0.042% 99.803% ( 22, 34 ] 7 0.024% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 4 0.014% 99.868% ( 580, 870 ] 3 0.010% 99.879% ( 870, 1300 ] 6 0.021% 99.900% ( 1300, 1900 ] 2 0.007% 99.907% ( 1900, 2900 ] 12 0.042% 99.948% ( 2900, 4400 ] 7 0.024% 99.972% ( 4400, 6600 ] 5 0.017% 99.990% ( 6600, 9900 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3386.2333 StdDev: 2038.74 Min: 933 Median: 2650.0000 Max: 8283 Percentiles: P50: 2650.00 P75: 4250.00 P99: 8283.00 P99.9: 8283.00 P99.99: 8283.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 2 6.667% 20.000% # ( 1900, 2900 ] 12 40.000% 60.000% ######## ( 2900, 4400 ] 5 16.667% 76.667% ### ( 4400, 6600 ] 3 10.000% 86.667% ## ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 23.7 total, 11.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 207.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.969 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 84.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.684 H:M:S, 74.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/04-22:03:23 ... thread 0: (1000000,6000000) ops and (128612.6,192023.6) ops/second in (7.775288,31.246161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.78 GB 18.9 4.9 0.0 4.9 10.5 5.6 0.0 1.9 135.4 289.2 37.22 33.36 97 0.384 5116K 7461 0.0 0.0 L1 8/8 831.37 MB 0.0 3.7 3.6 0.1 3.6 3.6 0.2 1.0 225.8 222.4 16.74 15.68 2 8.368 3837K 56K 0.0 0.0 L2 1/0 1.05 MB 0.0 0.1 0.1 0.1 0.1 0.1 2.9 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 14/0 948.13 MB 0.9 1.9 1.4 0.5 1.9 1.4 1.6 1.3 146.4 146.2 13.31 9.01 11 1.210 1867K 572 0.0 0.0 L4 163/0 9.68 GB 1.0 1.6 1.4 0.2 1.6 1.4 1.4 1.1 132.6 132.2 12.40 7.68 18 0.689 1649K 4381 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/16 101.66 GB 0.0 12.2 6.5 5.7 17.8 12.1 8.7 3.2 156.4 227.0 80.17 66.21 129 0.621 12M 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 6.5 5.7 17.8 12.1 8.6 3.2 156.4 227.0 80.17 66.21 129 0.621 12M 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 6.5 5.7 12.2 6.5 0.0 0.0 199.8 198.6 62.75 51.78 48 1.307 12M 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 329.0 17.42 14.43 81 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.5 total, 31.2 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.77 GB write, 578.45 MB/s write, 12.24 GB read, 398.53 MB/s read, 80.2 seconds Interval compaction: 17.77 GB write, 582.33 MB/s write, 12.24 GB read, 401.21 MB/s read, 80.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 44, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2448841 Average: 2.6068 StdDev: 22.52 Min: 0 Median: 1.4298 Max: 7918 Percentiles: P50: 1.43 P75: 1.81 P99: 6.95 P99.9: 147.32 P99.99: 408.73 ------------------------------------------------------ [ 0, 1 ] 540900 22.088% 22.088% #### ( 1, 2 ] 1590407 64.945% 87.033% ############# ( 2, 3 ] 176277 7.198% 94.232% # ( 3, 4 ] 66023 2.696% 96.928% # ( 4, 6 ] 46144 1.884% 98.812% ( 6, 10 ] 19418 0.793% 99.605% ( 10, 15 ] 3033 0.124% 99.729% ( 15, 22 ] 423 0.017% 99.746% ( 22, 34 ] 31 0.001% 99.747% ( 34, 51 ] 11 0.000% 99.748% ( 51, 76 ] 18 0.001% 99.749% ( 76, 110 ] 1939 0.079% 99.828% ( 110, 170 ] 2846 0.116% 99.944% ( 170, 250 ] 687 0.028% 99.972% ( 250, 380 ] 394 0.016% 99.988% ( 380, 580 ] 328 0.013% 100.002% ( 580, 870 ] 149 0.006% 100.008% ( 870, 1300 ] 52 0.002% 100.010% ( 1300, 1900 ] 33 0.001% 100.011% ( 1900, 2900 ] 29 0.001% 100.012% ( 2900, 4400 ] 33 0.001% 100.014% ( 4400, 6600 ] 8 0.000% 100.014% ( 6600, 9900 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 535259 Average: 5.5143 StdDev: 88.10 Min: 1 Median: 1.9586 Max: 10046 Percentiles: P50: 1.96 P75: 2.94 P99: 9.16 P99.9: 14.72 P99.99: 31.70 ------------------------------------------------------ [ 0, 1 ] 13110 2.449% 2.449% ( 1, 2 ] 265512 49.604% 52.054% ########## ( 2, 3 ] 130107 24.307% 76.361% ##### ( 3, 4 ] 53525 10.000% 86.361% ## ( 4, 6 ] 59115 11.044% 97.405% ## ( 6, 10 ] 10808 2.019% 99.424% ( 10, 15 ] 2698 0.504% 99.928% ( 15, 22 ] 303 0.057% 99.985% ( 22, 34 ] 34 0.006% 99.991% ( 34, 51 ] 27 0.005% 99.996% ( 51, 76 ] 10 0.002% 99.998% ( 76, 110 ] 28 0.005% 100.003% ( 110, 170 ] 93 0.017% 100.021% ( 170, 250 ] 89 0.017% 100.037% ( 250, 380 ] 117 0.022% 100.059% ( 380, 580 ] 159 0.030% 100.089% ( 580, 870 ] 121 0.023% 100.112% ( 870, 1300 ] 92 0.017% 100.129% ( 1300, 1900 ] 71 0.013% 100.142% ( 1900, 2900 ] 93 0.017% 100.159% ( 2900, 4400 ] 120 0.022% 100.182% ( 4400, 6600 ] 40 0.007% 100.189% ( 6600, 9900 ] 9 0.002% 100.191% ( 9900, 14000 ] 1 0.000% 100.191% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 335150 Average: 13.2489 StdDev: 152.48 Min: 0 Median: 1.9637 Max: 9995 Percentiles: P50: 1.96 P75: 2.98 P99: 14.53 P99.9: 1207.57 P99.99: 1820.88 ------------------------------------------------------ [ 0, 1 ] 8706 2.598% 2.598% # ( 1, 2 ] 164854 49.188% 51.786% ########## ( 2, 3 ] 79224 23.638% 75.424% ##### ( 3, 4 ] 35336 10.543% 85.967% ## ( 4, 6 ] 36085 10.767% 96.734% ## ( 6, 10 ] 6039 1.802% 98.536% ( 10, 15 ] 1714 0.511% 99.048% ( 15, 22 ] 214 0.064% 99.111% ( 22, 34 ] 22 0.007% 99.118% ( 34, 51 ] 3 0.001% 99.119% ( 51, 76 ] 6 0.002% 99.121% ( 76, 110 ] 55 0.016% 99.137% ( 110, 170 ] 268 0.080% 99.217% ( 170, 250 ] 320 0.095% 99.313% ( 250, 380 ] 454 0.135% 99.448% ( 380, 580 ] 571 0.170% 99.618% ( 580, 870 ] 600 0.179% 99.797% ( 870, 1300 ] 438 0.131% 99.928% ( 1300, 1900 ] 239 0.071% 99.999% ( 1900, 2900 ] 234 0.070% 100.069% ( 2900, 4400 ] 208 0.062% 100.131% ( 4400, 6600 ] 53 0.016% 100.147% ( 6600, 9900 ] 14 0.004% 100.151% ( 9900, 14000 ] 1 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 8055 Average: 22.3728 StdDev: 271.53 Min: 1 Median: 2.0413 Max: 8283 Percentiles: P50: 2.04 P75: 2.99 P99: 188.17 P99.9: 4389.69 P99.99: 8283.00 ------------------------------------------------------ [ 0, 1 ] 115 1.428% 1.428% ( 1, 2 ] 3825 47.486% 48.914% ######### ( 2, 3 ] 2118 26.294% 75.208% ##### ( 3, 4 ] 806 10.006% 85.214% ## ( 4, 6 ] 936 11.620% 96.834% ## ( 6, 10 ] 123 1.527% 98.361% ( 10, 15 ] 33 0.410% 98.771% ( 15, 22 ] 5 0.062% 98.833% ( 22, 34 ] 2 0.025% 98.858% ( 76, 110 ] 1 0.012% 98.870% ( 110, 170 ] 5 0.062% 98.932% ( 170, 250 ] 24 0.298% 99.230% ( 250, 380 ] 1 0.012% 99.243% ( 380, 580 ] 7 0.087% 99.330% ( 580, 870 ] 5 0.062% 99.392% ( 870, 1300 ] 8 0.099% 99.491% ( 1300, 1900 ] 9 0.112% 99.603% ( 1900, 2900 ] 16 0.199% 99.801% ( 2900, 4400 ] 8 0.099% 99.901% ( 4400, 6600 ] 4 0.050% 99.950% ( 6600, 9900 ] 4 0.050% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1407.2313 StdDev: 1489.40 Min: 100 Median: 683.5714 Max: 6587 Percentiles: P50: 683.57 P75: 2400.00 P99: 6097.14 P99.9: 6549.71 P99.99: 6587.00 ------------------------------------------------------ ( 76, 110 ] 4 2.500% 2.500% # ( 110, 170 ] 23 14.375% 16.875% ### ( 170, 250 ] 14 8.750% 25.625% ## ( 250, 380 ] 16 10.000% 35.625% ## ( 380, 580 ] 18 11.250% 46.875% ## ( 580, 870 ] 14 8.750% 55.625% ## ( 870, 1300 ] 10 6.250% 61.875% # ( 1300, 1900 ] 12 7.500% 69.375% ## ( 1900, 2900 ] 18 11.250% 80.625% ## ( 2900, 4400 ] 24 15.000% 95.625% ### ( 4400, 6600 ] 7 4.375% 100.000% # ** DB Stats ** Uptime(secs): 31.5 total, 7.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 187.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.732 H:M:S, 46.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.763 H:M:S, 61.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/04-22:03:26 ... thread 0: (1000000,7000000) ops and (304839.8,202742.4) ops/second in (3.280412,34.526573) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.82 GB 138.5 5.8 0.0 5.8 12.4 6.6 0.0 1.9 135.3 290.6 43.76 39.49 114 0.384 6011K 8505 0.0 0.0 L1 8/8 831.37 MB 0.0 3.7 3.6 0.1 3.6 3.6 0.2 1.0 225.8 222.4 16.74 15.68 2 8.368 3837K 56K 0.0 0.0 L2 1/0 1.05 MB 0.0 0.1 0.1 0.1 0.1 0.1 2.9 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 14/0 948.13 MB 0.9 1.9 1.4 0.5 1.9 1.4 1.6 1.3 146.4 146.2 13.31 9.01 11 1.210 1867K 572 0.0 0.0 L4 163/0 9.68 GB 1.0 1.6 1.4 0.2 1.6 1.4 1.4 1.1 132.6 132.2 12.40 7.68 18 0.689 1649K 4381 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/16 102.71 GB 0.0 13.1 6.5 6.6 19.7 13.1 8.7 3.0 154.8 232.4 86.70 72.33 146 0.594 13M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 6.5 6.6 19.7 13.1 8.6 3.0 154.8 232.4 86.70 72.33 146 0.594 13M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 6.5 6.6 13.0 6.5 0.0 0.0 202.9 201.7 66.15 55.11 51 1.297 13M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 331.0 20.56 17.23 95 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.7 total, 34.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.68 GB write, 580.01 MB/s write, 13.10 GB read, 386.29 MB/s read, 86.7 seconds Interval compaction: 19.68 GB write, 583.53 MB/s write, 13.10 GB read, 388.63 MB/s read, 86.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 47, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2808103 Average: 2.5744 StdDev: 21.57 Min: 0 Median: 1.4456 Max: 7918 Percentiles: P50: 1.45 P75: 1.83 P99: 6.84 P99.9: 137.79 P99.99: 341.73 ------------------------------------------------------ [ 0, 1 ] 585943 20.866% 20.866% #### ( 1, 2 ] 1836083 65.385% 86.251% ############# ( 2, 3 ] 218486 7.781% 94.032% ## ( 3, 4 ] 79215 2.821% 96.853% # ( 4, 6 ] 55530 1.977% 98.830% ( 6, 10 ] 22736 0.810% 99.640% ( 10, 15 ] 3489 0.124% 99.764% ( 15, 22 ] 450 0.016% 99.780% ( 22, 34 ] 36 0.001% 99.782% ( 34, 51 ] 13 0.000% 99.782% ( 51, 76 ] 23 0.001% 99.783% ( 76, 110 ] 1963 0.070% 99.853% ( 110, 170 ] 2871 0.102% 99.955% ( 170, 250 ] 699 0.025% 99.980% ( 250, 380 ] 407 0.014% 99.994% ( 380, 580 ] 337 0.012% 100.006% ( 580, 870 ] 163 0.006% 100.012% ( 870, 1300 ] 56 0.002% 100.014% ( 1300, 1900 ] 35 0.001% 100.015% ( 1900, 2900 ] 33 0.001% 100.017% ( 2900, 4400 ] 35 0.001% 100.018% ( 4400, 6600 ] 8 0.000% 100.018% ( 6600, 9900 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 589715 Average: 5.2731 StdDev: 84.13 Min: 1 Median: 1.9034 Max: 10046 Percentiles: P50: 1.90 P75: 2.87 P99: 9.14 P99.9: 15.03 P99.99: 133.27 ------------------------------------------------------ [ 0, 1 ] 21394 3.628% 3.628% # ( 1, 2 ] 302714 51.332% 54.960% ########## ( 2, 3 ] 135416 22.963% 77.923% ##### ( 3, 4 ] 54954 9.319% 87.242% ## ( 4, 6 ] 60148 10.200% 97.441% ## ( 6, 10 ] 11713 1.986% 99.428% ( 10, 15 ] 2785 0.472% 99.900% ( 15, 22 ] 310 0.053% 99.952% ( 22, 34 ] 34 0.006% 99.958% ( 34, 51 ] 27 0.005% 99.963% ( 51, 76 ] 11 0.002% 99.965% ( 76, 110 ] 74 0.013% 99.977% ( 110, 170 ] 196 0.033% 100.010% ( 170, 250 ] 113 0.019% 100.030% ( 250, 380 ] 128 0.022% 100.051% ( 380, 580 ] 166 0.028% 100.079% ( 580, 870 ] 125 0.021% 100.101% ( 870, 1300 ] 92 0.016% 100.116% ( 1300, 1900 ] 74 0.013% 100.129% ( 1900, 2900 ] 94 0.016% 100.145% ( 2900, 4400 ] 120 0.020% 100.165% ( 4400, 6600 ] 40 0.007% 100.172% ( 6600, 9900 ] 9 0.002% 100.173% ( 9900, 14000 ] 1 0.000% 100.173% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 335150 Average: 13.2489 StdDev: 152.48 Min: 0 Median: 1.9637 Max: 9995 Percentiles: P50: 1.96 P75: 2.98 P99: 14.53 P99.9: 1207.57 P99.99: 1820.88 ------------------------------------------------------ [ 0, 1 ] 8706 2.598% 2.598% # ( 1, 2 ] 164854 49.188% 51.786% ########## ( 2, 3 ] 79224 23.638% 75.424% ##### ( 3, 4 ] 35336 10.543% 85.967% ## ( 4, 6 ] 36085 10.767% 96.734% ## ( 6, 10 ] 6039 1.802% 98.536% ( 10, 15 ] 1714 0.511% 99.048% ( 15, 22 ] 214 0.064% 99.111% ( 22, 34 ] 22 0.007% 99.118% ( 34, 51 ] 3 0.001% 99.119% ( 51, 76 ] 6 0.002% 99.121% ( 76, 110 ] 55 0.016% 99.137% ( 110, 170 ] 268 0.080% 99.217% ( 170, 250 ] 320 0.095% 99.313% ( 250, 380 ] 454 0.135% 99.448% ( 380, 580 ] 571 0.170% 99.618% ( 580, 870 ] 600 0.179% 99.797% ( 870, 1300 ] 438 0.131% 99.928% ( 1300, 1900 ] 239 0.071% 99.999% ( 1900, 2900 ] 234 0.070% 100.069% ( 2900, 4400 ] 208 0.062% 100.131% ( 4400, 6600 ] 53 0.016% 100.147% ( 6600, 9900 ] 14 0.004% 100.151% ( 9900, 14000 ] 1 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 8055 Average: 22.3728 StdDev: 271.53 Min: 1 Median: 2.0413 Max: 8283 Percentiles: P50: 2.04 P75: 2.99 P99: 188.17 P99.9: 4389.69 P99.99: 8283.00 ------------------------------------------------------ [ 0, 1 ] 115 1.428% 1.428% ( 1, 2 ] 3825 47.486% 48.914% ######### ( 2, 3 ] 2118 26.294% 75.208% ##### ( 3, 4 ] 806 10.006% 85.214% ## ( 4, 6 ] 936 11.620% 96.834% ## ( 6, 10 ] 123 1.527% 98.361% ( 10, 15 ] 33 0.410% 98.771% ( 15, 22 ] 5 0.062% 98.833% ( 22, 34 ] 2 0.025% 98.858% ( 76, 110 ] 1 0.012% 98.870% ( 110, 170 ] 5 0.062% 98.932% ( 170, 250 ] 24 0.298% 99.230% ( 250, 380 ] 1 0.012% 99.243% ( 380, 580 ] 7 0.087% 99.330% ( 580, 870 ] 5 0.062% 99.392% ( 870, 1300 ] 8 0.099% 99.491% ( 1300, 1900 ] 9 0.112% 99.603% ( 1900, 2900 ] 16 0.199% 99.801% ( 2900, 4400 ] 8 0.099% 99.901% ( 4400, 6600 ] 4 0.050% 99.950% ( 6600, 9900 ] 4 0.050% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1407.2313 StdDev: 1489.40 Min: 100 Median: 683.5714 Max: 6587 Percentiles: P50: 683.57 P75: 2400.00 P99: 6097.14 P99.9: 6549.71 P99.99: 6587.00 ------------------------------------------------------ ( 76, 110 ] 4 2.500% 2.500% # ( 110, 170 ] 23 14.375% 16.875% ### ( 170, 250 ] 14 8.750% 25.625% ## ( 250, 380 ] 16 10.000% 35.625% ## ( 380, 580 ] 18 11.250% 46.875% ## ( 580, 870 ] 14 8.750% 55.625% ## ( 870, 1300 ] 10 6.250% 61.875% # ( 1300, 1900 ] 12 7.500% 69.375% ## ( 1900, 2900 ] 18 11.250% 80.625% ## ( 2900, 4400 ] 24 15.000% 95.625% ### ( 4400, 6600 ] 7 4.375% 100.000% # ** DB Stats ** Uptime(secs): 34.7 total, 3.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 198.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.370 H:M:S, 44.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 300.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.638 H:M:S, 19.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/04-22:03:29 ... thread 0: (1000000,8000000) ops and (304121.1,211557.7) ops/second in (3.288164,37.814737) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.75 GB 232.8 6.9 0.0 6.9 14.4 7.6 0.0 1.9 138.6 290.6 50.91 46.25 132 0.386 7163K 9752 0.0 0.0 L1 8/8 831.37 MB 0.0 3.7 3.6 0.1 3.6 3.6 0.2 1.0 225.8 222.4 16.74 15.68 2 8.368 3837K 56K 0.0 0.0 L2 1/0 1.05 MB 0.0 0.1 0.1 0.1 0.1 0.1 2.9 2.0 249.9 249.8 0.50 0.48 1 0.504 127K 46 0.0 0.0 L3 14/0 948.13 MB 0.9 1.9 1.4 0.5 1.9 1.4 1.6 1.3 146.4 146.2 13.31 9.01 11 1.210 1867K 572 0.0 0.0 L4 163/0 9.68 GB 1.0 1.6 1.4 0.2 1.6 1.4 1.4 1.1 132.6 132.2 12.40 7.68 18 0.689 1649K 4381 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/16 103.63 GB 0.0 14.2 6.5 7.7 21.7 14.0 8.7 2.9 155.0 236.8 93.86 79.09 164 0.572 14M 71K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 6.5 7.7 21.7 14.0 8.6 2.9 155.0 236.8 93.86 79.09 164 0.572 14M 71K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 6.5 7.7 14.1 6.5 0.0 0.0 206.2 205.2 70.57 59.43 55 1.283 14M 71K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 332.7 23.29 19.66 109 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.0 total, 37.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.70 GB write, 584.49 MB/s write, 14.21 GB read, 382.71 MB/s read, 93.9 seconds Interval compaction: 21.70 GB write, 587.73 MB/s write, 14.21 GB read, 384.83 MB/s read, 93.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 49, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3123287 Average: 2.5545 StdDev: 20.88 Min: 0 Median: 1.4566 Max: 7918 Percentiles: P50: 1.46 P75: 1.84 P99: 6.68 P99.9: 131.68 P99.99: 321.71 ------------------------------------------------------ [ 0, 1 ] 624460 19.994% 19.994% #### ( 1, 2 ] 2052718 65.723% 85.717% ############# ( 2, 3 ] 255500 8.180% 93.897% ## ( 3, 4 ] 90995 2.913% 96.811% # ( 4, 6 ] 64141 2.054% 98.864% ( 6, 10 ] 24921 0.798% 99.662% ( 10, 15 ] 3850 0.123% 99.785% ( 15, 22 ] 474 0.015% 99.801% ( 22, 34 ] 39 0.001% 99.802% ( 34, 51 ] 15 0.000% 99.802% ( 51, 76 ] 25 0.001% 99.803% ( 76, 110 ] 1978 0.063% 99.866% ( 110, 170 ] 2903 0.093% 99.959% ( 170, 250 ] 725 0.023% 99.983% ( 250, 380 ] 420 0.013% 99.996% ( 380, 580 ] 349 0.011% 100.007% ( 580, 870 ] 174 0.006% 100.013% ( 870, 1300 ] 67 0.002% 100.015% ( 1300, 1900 ] 38 0.001% 100.016% ( 1900, 2900 ] 35 0.001% 100.017% ( 2900, 4400 ] 36 0.001% 100.018% ( 4400, 6600 ] 8 0.000% 100.019% ( 6600, 9900 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 727296 Average: 4.7818 StdDev: 75.96 Min: 1 Median: 1.8293 Max: 10046 Percentiles: P50: 1.83 P75: 2.74 P99: 9.05 P99.9: 18.07 P99.99: 155.48 ------------------------------------------------------ [ 0, 1 ] 33763 4.642% 4.642% # ( 1, 2 ] 397790 54.694% 59.337% ########### ( 2, 3 ] 154143 21.194% 80.531% #### ( 3, 4 ] 59611 8.196% 88.727% ## ( 4, 6 ] 63910 8.787% 97.514% ## ( 6, 10 ] 14155 1.946% 99.460% ( 10, 15 ] 3053 0.420% 99.880% ( 15, 22 ] 328 0.045% 99.925% ( 22, 34 ] 36 0.005% 99.930% ( 34, 51 ] 27 0.004% 99.934% ( 51, 76 ] 12 0.002% 99.936% ( 76, 110 ] 202 0.028% 99.963% ( 110, 170 ] 255 0.035% 99.998% ( 170, 250 ] 139 0.019% 100.018% ( 250, 380 ] 152 0.021% 100.038% ( 380, 580 ] 182 0.025% 100.064% ( 580, 870 ] 129 0.018% 100.081% ( 870, 1300 ] 92 0.013% 100.094% ( 1300, 1900 ] 75 0.010% 100.104% ( 1900, 2900 ] 95 0.013% 100.117% ( 2900, 4400 ] 120 0.016% 100.134% ( 4400, 6600 ] 40 0.005% 100.139% ( 6600, 9900 ] 9 0.001% 100.141% ( 9900, 14000 ] 1 0.000% 100.141% ** Level 2 read latency histogram (micros): Count: 31728 Average: 1.9897 StdDev: 23.94 Min: 1 Median: 1.1965 Max: 2927 Percentiles: P50: 1.20 P75: 1.63 P99: 3.58 P99.9: 9.90 P99.99: 819.89 ------------------------------------------------------ [ 0, 1 ] 12279 38.701% 38.701% ######## ( 1, 2 ] 18243 57.498% 96.199% ########### ( 2, 3 ] 735 2.317% 98.516% ( 3, 4 ] 266 0.838% 99.354% ( 4, 6 ] 105 0.331% 99.685% ( 6, 10 ] 70 0.221% 99.905% ( 10, 15 ] 16 0.050% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 51, 76 ] 1 0.003% 99.965% ( 110, 170 ] 3 0.009% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 1 0.003% 99.981% ( 380, 580 ] 2 0.006% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 335150 Average: 13.2489 StdDev: 152.48 Min: 0 Median: 1.9637 Max: 9995 Percentiles: P50: 1.96 P75: 2.98 P99: 14.53 P99.9: 1207.57 P99.99: 1820.88 ------------------------------------------------------ [ 0, 1 ] 8706 2.598% 2.598% # ( 1, 2 ] 164854 49.188% 51.786% ########## ( 2, 3 ] 79224 23.638% 75.424% ##### ( 3, 4 ] 35336 10.543% 85.967% ## ( 4, 6 ] 36085 10.767% 96.734% ## ( 6, 10 ] 6039 1.802% 98.536% ( 10, 15 ] 1714 0.511% 99.048% ( 15, 22 ] 214 0.064% 99.111% ( 22, 34 ] 22 0.007% 99.118% ( 34, 51 ] 3 0.001% 99.119% ( 51, 76 ] 6 0.002% 99.121% ( 76, 110 ] 55 0.016% 99.137% ( 110, 170 ] 268 0.080% 99.217% ( 170, 250 ] 320 0.095% 99.313% ( 250, 380 ] 454 0.135% 99.448% ( 380, 580 ] 571 0.170% 99.618% ( 580, 870 ] 600 0.179% 99.797% ( 870, 1300 ] 438 0.131% 99.928% ( 1300, 1900 ] 239 0.071% 99.999% ( 1900, 2900 ] 234 0.070% 100.069% ( 2900, 4400 ] 208 0.062% 100.131% ( 4400, 6600 ] 53 0.016% 100.147% ( 6600, 9900 ] 14 0.004% 100.151% ( 9900, 14000 ] 1 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 8055 Average: 22.3728 StdDev: 271.53 Min: 1 Median: 2.0413 Max: 8283 Percentiles: P50: 2.04 P75: 2.99 P99: 188.17 P99.9: 4389.69 P99.99: 8283.00 ------------------------------------------------------ [ 0, 1 ] 115 1.428% 1.428% ( 1, 2 ] 3825 47.486% 48.914% ######### ( 2, 3 ] 2118 26.294% 75.208% ##### ( 3, 4 ] 806 10.006% 85.214% ## ( 4, 6 ] 936 11.620% 96.834% ## ( 6, 10 ] 123 1.527% 98.361% ( 10, 15 ] 33 0.410% 98.771% ( 15, 22 ] 5 0.062% 98.833% ( 22, 34 ] 2 0.025% 98.858% ( 76, 110 ] 1 0.012% 98.870% ( 110, 170 ] 5 0.062% 98.932% ( 170, 250 ] 24 0.298% 99.230% ( 250, 380 ] 1 0.012% 99.243% ( 380, 580 ] 7 0.087% 99.330% ( 580, 870 ] 5 0.062% 99.392% ( 870, 1300 ] 8 0.099% 99.491% ( 1300, 1900 ] 9 0.112% 99.603% ( 1900, 2900 ] 16 0.199% 99.801% ( 2900, 4400 ] 8 0.099% 99.901% ( 4400, 6600 ] 4 0.050% 99.950% ( 6600, 9900 ] 4 0.050% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1407.2313 StdDev: 1489.40 Min: 100 Median: 683.5714 Max: 6587 Percentiles: P50: 683.57 P75: 2400.00 P99: 6097.14 P99.9: 6549.71 P99.99: 6587.00 ------------------------------------------------------ ( 76, 110 ] 4 2.500% 2.500% # ( 110, 170 ] 23 14.375% 16.875% ### ( 170, 250 ] 14 8.750% 25.625% ## ( 250, 380 ] 16 10.000% 35.625% ## ( 380, 580 ] 18 11.250% 46.875% ## ( 580, 870 ] 14 8.750% 55.625% ## ( 870, 1300 ] 10 6.250% 61.875% # ( 1300, 1900 ] 12 7.500% 69.375% ## ( 1900, 2900 ] 18 11.250% 80.625% ## ( 2900, 4400 ] 24 15.000% 95.625% ### ( 4400, 6600 ] 7 4.375% 100.000% # ** DB Stats ** Uptime(secs): 38.0 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 207.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.000 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.630 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.863 micros/op 145700 ops/sec 60.199 seconds 8770999 operations; 141.2 MB/s Microseconds per write: Count: 8770999 Average: 6.8631 StdDev: 378.16 Min: 1 Median: 1.7455 Max: 621009 Percentiles: P50: 1.75 P75: 2.78 P99: 9.63 P99.9: 1244.90 P99.99: 2772.42 ------------------------------------------------------ [ 0, 1 ] 1098826 12.528% 12.528% ### ( 1, 2 ] 4408727 50.265% 62.793% ########## ( 2, 3 ] 1375210 15.679% 78.472% ### ( 3, 4 ] 1220964 13.920% 92.392% ### ( 4, 6 ] 477072 5.439% 97.831% # ( 6, 10 ] 112886 1.287% 99.119% ( 10, 15 ] 35007 0.399% 99.518% ( 15, 22 ] 8241 0.094% 99.612% ( 22, 34 ] 1254 0.014% 99.626% ( 34, 51 ] 250 0.003% 99.629% ( 51, 76 ] 47 0.001% 99.629% ( 76, 110 ] 6324 0.072% 99.701% ( 110, 170 ] 2170 0.025% 99.726% ( 170, 250 ] 264 0.003% 99.729% ( 250, 380 ] 143 0.002% 99.731% ( 380, 580 ] 19 0.000% 99.731% ( 580, 870 ] 12 0.000% 99.731% ( 870, 1300 ] 16989 0.194% 99.925% ( 1300, 1900 ] 27 0.000% 99.925% ( 1900, 2900 ] 6522 0.074% 99.999% ( 2900, 4400 ] 19 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 180268 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8770999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9051670968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 404 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35830438 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 22984047584 rocksdb.compact.write.bytes COUNT : 22821478893 rocksdb.flush.write.bytes COUNT : 9049873722 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 227 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8976896000 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3481600 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23062436234 rocksdb.non.last.level.read.count COUNT : 5573378 rocksdb.block.checksum.compute.count COUNT : 5572613 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.390541 P95 : 3.933057 P99 : 8.380886 P100 : 621007.000000 COUNT : 8770999 SUM : 55960287 rocksdb.compaction.times.micros P50 : 1035666.666667 P95 : 2970000.000000 P99 : 15451147.000000 P100 : 15451147.000000 COUNT : 59 SUM : 83432305 rocksdb.compaction.times.cpu_micros P50 : 881250.000000 P95 : 2970000.000000 P99 : 14432074.000000 P100 : 14432074.000000 COUNT : 59 SUM : 71507685 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.197183 P95 : 1257.000000 P99 : 6116.000000 P100 : 14834.000000 COUNT : 122 SUM : 102464 rocksdb.compaction.outfile.sync.micros P50 : 941.666667 P95 : 44050.000000 P99 : 105240.000000 P100 : 211356.000000 COUNT : 268 SUM : 1815105 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.707317 P95 : 921.600000 P99 : 3590.000000 P100 : 4465.000000 COUNT : 208 SUM : 49253 rocksdb.table.open.io.micros P50 : 1439.285714 P95 : 9636.000000 P99 : 19306.666667 P100 : 19975.000000 COUNT : 404 SUM : 1006726 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.526685 P95 : 6.954445 P99 : 11.259406 P100 : 10050.000000 COUNT : 5571588 SUM : 31724063 rocksdb.read.block.get.micros P50 : 476.103896 P95 : 4148.000000 P99 : 6937.333333 P100 : 9126.000000 COUNT : 808 SUM : 807987 rocksdb.write.raw.block.micros P50 : 0.512634 P95 : 0.974005 P99 : 2.793391 P100 : 12755.000000 COUNT : 7718945 SUM : 15231142 rocksdb.numfiles.in.singlecompaction P50 : 3.250000 P95 : 4.900000 P99 : 21.860000 P100 : 38.000000 COUNT : 102 SUM : 397 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566850 P95 : 1212.101453 P99 : 2595.849839 P100 : 620817.000000 COUNT : 200293 SUM : 35849559 rocksdb.sst.read.micros P50 : 1.492481 P95 : 3.967226 P99 : 8.571074 P100 : 10046.000000 COUNT : 5573737 SUM : 20611714 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8770999 SUM : 9051670968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209518.072289 P95 : 361800.000000 P99 : 683100.000000 P100 : 717219.000000 COUNT : 122 SUM : 25820005 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 249 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0