[2024-07-22 23:00:05.143751] Starting SPDK v24.09-pre git sha1 f7b31b2b9 / DPDK 22.11.4 initialization... [2024-07-22 23:00:05.144151] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2243247 ] Set seed to 1721682005136429 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-22 23:00:05.386969] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-22 23:00:05.440876] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-22 23:00:05.440936] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2243247' to capture a snapshot of events at runtime. [2024-07-22 23:00:05.440960] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-22 23:00:05.440981] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-22 23:00:05.440996] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2243247 for offline analysis/debug. [2024-07-22 23:00:05.441131] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 22 23:00:10 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/22-23:00:18 ... thread 0: (1000000,1000000) ops and (121004.3,121004.3) ops/second in (8.264168,8.264168) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 567.01 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 258.6 3.65 3.31 15 0.244 0 0 0.0 0.0 L1 3/3 251.76 MB 0.0 0.4 0.2 0.1 0.4 0.2 0.1 1.5 100.7 100.6 3.75 3.64 2 1.877 383K 233 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 10/0 804.22 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1284/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1424/13 97.06 GB 0.0 0.5 0.3 0.2 1.4 1.2 0.3 1.5 58.0 166.7 8.69 8.19 18 0.483 511K 281 0.0 0.0 Int 0/0 0.00 KB 0.0 0.5 0.3 0.2 1.4 1.2 0.2 1.5 58.0 166.7 8.69 8.19 18 0.483 511K 281 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 0.0 100.1 100.0 5.04 4.88 3 1.679 511K 281 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 258.6 3.65 3.31 15 0.244 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.3 interval Flush(GB): cumulative 0.923, interval 0.923 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.41 GB write, 165.20 MB/s write, 0.49 GB read, 57.47 MB/s read, 8.7 seconds Interval compaction: 1.41 GB write, 175.19 MB/s write, 0.49 GB read, 60.95 MB/s read, 8.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 124366 Average: 4.5785 StdDev: 23.44 Min: 1 Median: 3.6142 Max: 6942 Percentiles: P50: 3.61 P75: 3.97 P99: 11.96 P99.9: 27.49 P99.99: 340.73 ------------------------------------------------------ [ 0, 1 ] 64 0.051% 0.051% ( 1, 2 ] 1937 1.557% 1.609% ( 2, 3 ] 6529 5.250% 6.859% # ( 3, 4 ] 87359 70.243% 77.102% ############## ( 4, 6 ] 22742 18.286% 95.389% #### ( 6, 10 ] 4026 3.237% 98.626% # ( 10, 15 ] 1192 0.958% 99.584% ( 15, 22 ] 327 0.263% 99.847% ( 22, 34 ] 150 0.121% 99.968% ( 34, 51 ] 13 0.010% 99.978% ( 51, 76 ] 3 0.002% 99.981% ( 76, 110 ] 1 0.001% 99.982% ( 110, 170 ] 1 0.001% 99.982% ( 250, 380 ] 18 0.014% 99.997% ( 380, 580 ] 3 0.002% 99.999% ( 580, 870 ] 3 0.002% 100.002% ( 870, 1300 ] 1 0.001% 100.002% ( 1300, 1900 ] 2 0.002% 100.004% ( 2900, 4400 ] 1 0.001% 100.005% ( 6600, 9900 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 51292 Average: 4.6309 StdDev: 11.53 Min: 2 Median: 3.6744 Max: 1260 Percentiles: P50: 3.67 P75: 4.23 P99: 11.55 P99.9: 27.23 P99.99: 706.27 ------------------------------------------------------ ( 1, 2 ] 2 0.004% 0.004% ( 2, 3 ] 1845 3.597% 3.601% # ( 3, 4 ] 35289 68.800% 72.401% ############## ( 4, 6 ] 11566 22.549% 94.950% ##### ( 6, 10 ] 1934 3.771% 98.721% # ( 10, 15 ] 462 0.901% 99.622% ( 15, 22 ] 110 0.214% 99.836% ( 22, 34 ] 75 0.146% 99.982% ( 34, 51 ] 1 0.002% 99.984% ( 51, 76 ] 1 0.002% 99.986% ( 170, 250 ] 1 0.002% 99.988% ( 580, 870 ] 2 0.004% 99.992% ( 870, 1300 ] 4 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 29445 Average: 3.2294 StdDev: 31.80 Min: 1 Median: 1.8767 Max: 3523 Percentiles: P50: 1.88 P75: 2.57 P99: 9.12 P99.9: 14.81 P99.99: 1232.30 ------------------------------------------------------ [ 0, 1 ] 526 1.786% 1.786% ( 1, 2 ] 16194 54.997% 56.784% ########### ( 2, 3 ] 9394 31.904% 88.687% ###### ( 3, 4 ] 1083 3.678% 92.365% # ( 4, 6 ] 1409 4.785% 97.151% # ( 6, 10 ] 701 2.381% 99.531% ( 10, 15 ] 115 0.391% 99.922% ( 15, 22 ] 9 0.031% 99.952% ( 22, 34 ] 2 0.007% 99.959% ( 34, 51 ] 1 0.003% 99.963% ( 51, 76 ] 1 0.003% 99.966% ( 250, 380 ] 3 0.010% 99.976% ( 580, 870 ] 1 0.003% 99.980% ( 870, 1300 ] 6 0.020% 100.000% ( 2900, 4400 ] 2 0.007% 100.007% ** Level 3 read latency histogram (micros): Count: 40 Average: 1970.4500 StdDev: 1383.28 Min: 590 Median: 1269.2857 Max: 5506 Percentiles: P50: 1269.29 P75: 2900.00 P99: 5506.00 P99.9: 5506.00 P99.99: 5506.00 ------------------------------------------------------ ( 580, 870 ] 7 17.500% 17.500% #### ( 870, 1300 ] 14 35.000% 52.500% ####### ( 1300, 1900 ] 4 10.000% 62.500% ## ( 1900, 2900 ] 5 12.500% 75.000% ### ( 2900, 4400 ] 6 15.000% 90.000% ### ( 4400, 6600 ] 4 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 2486.0667 StdDev: 1329.96 Min: 470 Median: 2400.0000 Max: 4959 Percentiles: P50: 2400.00 P75: 3556.25 P99: 4959.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ ( 380, 580 ] 1 3.333% 3.333% # ( 580, 870 ] 1 3.333% 6.667% # ( 870, 1300 ] 6 20.000% 26.667% #### ( 1300, 1900 ] 3 10.000% 36.667% ## ( 1900, 2900 ] 8 26.667% 63.333% ##### ( 2900, 4400 ] 8 26.667% 90.000% ##### ( 4400, 6600 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 8.8 total, 8.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 112.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 0 2024/07/22-23:00:26 ... thread 0: (1000000,2000000) ops and (119663.6,120330.2) ops/second in (8.356761,16.620929) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 1.17 GB 6.3 0.7 0.0 0.7 2.6 1.8 0.0 1.4 70.4 246.3 10.74 9.94 33 0.325 767K 684 0.0 0.0 L1 2/2 50.36 MB 0.0 0.9 0.6 0.4 0.9 0.6 0.1 1.7 97.3 97.1 9.71 9.42 3 3.237 959K 1492 0.0 0.0 L2 2/2 129.85 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.6 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 74/27 1.28 GB 0.5 0.6 0.5 0.1 0.6 0.5 0.1 1.2 152.2 152.1 4.10 3.59 2 2.048 633K 527 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1284/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1488/40 97.98 GB 0.0 2.4 1.1 1.3 4.2 3.0 0.8 2.3 94.9 167.9 25.83 24.19 39 0.662 2488K 2751 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 1.1 1.3 4.2 3.0 0.7 2.3 94.9 167.9 25.83 24.19 39 0.662 2488K 2751 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 1.1 1.3 2.4 1.1 0.0 0.0 130.8 130.7 18.73 17.83 9 2.081 2488K 2751 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 266.3 7.10 6.37 30 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.1 total, 16.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.24 GB write, 253.27 MB/s write, 2.39 GB read, 143.08 MB/s read, 25.8 seconds Interval compaction: 4.24 GB write, 260.89 MB/s write, 2.39 GB read, 147.38 MB/s read, 25.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 527463 Average: 3.7022 StdDev: 14.65 Min: 1 Median: 2.8573 Max: 6942 Percentiles: P50: 2.86 P75: 3.80 P99: 9.83 P99.9: 18.52 P99.99: 27.16 ------------------------------------------------------ [ 0, 1 ] 2760 0.523% 0.523% ( 1, 2 ] 144103 27.320% 27.843% ##### ( 2, 3 ] 136326 25.846% 53.689% ##### ( 3, 4 ] 139693 26.484% 80.173% ##### ( 4, 6 ] 79257 15.026% 95.199% ### ( 6, 10 ] 20964 3.974% 99.173% # ( 10, 15 ] 3487 0.661% 99.834% ( 15, 22 ] 696 0.132% 99.966% ( 22, 34 ] 298 0.056% 100.023% ( 34, 51 ] 23 0.004% 100.027% ( 51, 76 ] 6 0.001% 100.028% ( 76, 110 ] 2 0.000% 100.029% ( 110, 170 ] 1 0.000% 100.029% ( 170, 250 ] 1 0.000% 100.029% ( 250, 380 ] 35 0.007% 100.036% ( 380, 580 ] 6 0.001% 100.037% ( 580, 870 ] 4 0.001% 100.038% ( 870, 1300 ] 10 0.002% 100.040% ( 1300, 1900 ] 3 0.001% 100.040% ( 1900, 2900 ] 2 0.000% 100.041% ( 2900, 4400 ] 3 0.001% 100.041% ( 6600, 9900 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 217287 Average: 3.9914 StdDev: 8.81 Min: 1 Median: 3.1983 Max: 1303 Percentiles: P50: 3.20 P75: 3.95 P99: 9.87 P99.9: 20.63 P99.99: 47.33 ------------------------------------------------------ [ 0, 1 ] 103 0.047% 0.047% ( 1, 2 ] 28084 12.925% 12.972% ### ( 2, 3 ] 66055 30.400% 43.372% ###### ( 3, 4 ] 72636 33.429% 76.801% ####### ( 4, 6 ] 38222 17.591% 94.391% #### ( 6, 10 ] 10351 4.764% 99.155% # ( 10, 15 ] 1387 0.638% 99.793% ( 15, 22 ] 288 0.133% 99.926% ( 22, 34 ] 133 0.061% 99.987% ( 34, 51 ] 8 0.004% 99.991% ( 51, 76 ] 2 0.001% 99.992% ( 76, 110 ] 1 0.000% 99.992% ( 170, 250 ] 1 0.000% 99.993% ( 250, 380 ] 1 0.000% 99.993% ( 380, 580 ] 1 0.000% 99.994% ( 580, 870 ] 3 0.001% 99.995% ( 870, 1300 ] 10 0.005% 100.000% ( 1300, 1900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31869 Average: 3.2591 StdDev: 30.58 Min: 1 Median: 1.9285 Max: 3523 Percentiles: P50: 1.93 P75: 2.64 P99: 9.25 P99.9: 14.97 P99.99: 1214.94 ------------------------------------------------------ [ 0, 1 ] 526 1.651% 1.651% ( 1, 2 ] 16595 52.073% 53.723% ########## ( 2, 3 ] 10621 33.327% 87.050% ####### ( 3, 4 ] 1459 4.578% 91.628% # ( 4, 6 ] 1675 5.256% 96.884% # ( 6, 10 ] 831 2.608% 99.492% # ( 10, 15 ] 131 0.411% 99.903% ( 15, 22 ] 14 0.044% 99.947% ( 22, 34 ] 2 0.006% 99.953% ( 34, 51 ] 1 0.003% 99.956% ( 51, 76 ] 2 0.006% 99.962% ( 250, 380 ] 3 0.009% 99.972% ( 580, 870 ] 1 0.003% 99.975% ( 870, 1300 ] 6 0.019% 99.994% ( 2900, 4400 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 149491 Average: 6.3057 StdDev: 40.82 Min: 1 Median: 4.4259 Max: 5506 Percentiles: P50: 4.43 P75: 5.65 P99: 20.20 P99.9: 147.89 P99.99: 305.35 ------------------------------------------------------ [ 0, 1 ] 40 0.027% 0.027% ( 1, 2 ] 8894 5.950% 5.976% # ( 2, 3 ] 18678 12.494% 18.471% ## ( 3, 4 ] 34171 22.858% 41.329% ##### ( 4, 6 ] 60875 40.722% 82.050% ######## ( 6, 10 ] 20271 13.560% 95.610% ### ( 10, 15 ] 3557 2.379% 97.990% ( 15, 22 ] 2033 1.360% 99.350% ( 22, 34 ] 480 0.321% 99.671% ( 34, 51 ] 55 0.037% 99.708% ( 51, 76 ] 33 0.022% 99.730% ( 76, 110 ] 109 0.073% 99.803% ( 110, 170 ] 232 0.155% 99.958% ( 170, 250 ] 35 0.023% 99.981% ( 250, 380 ] 33 0.022% 100.003% ( 380, 580 ] 13 0.009% 100.012% ( 580, 870 ] 16 0.011% 100.023% ( 870, 1300 ] 14 0.009% 100.032% ( 1300, 1900 ] 4 0.003% 100.035% ( 1900, 2900 ] 5 0.003% 100.038% ( 2900, 4400 ] 6 0.004% 100.042% ( 4400, 6600 ] 4 0.003% 100.045% ** Level 4 read latency histogram (micros): Count: 30 Average: 2486.0667 StdDev: 1329.96 Min: 470 Median: 2400.0000 Max: 4959 Percentiles: P50: 2400.00 P75: 3556.25 P99: 4959.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ ( 380, 580 ] 1 3.333% 3.333% # ( 580, 870 ] 1 3.333% 6.667% # ( 870, 1300 ] 6 20.000% 26.667% #### ( 1300, 1900 ] 3 10.000% 36.667% ## ( 1900, 2900 ] 8 26.667% 63.333% ##### ( 2900, 4400 ] 8 26.667% 90.000% ##### ( 4400, 6600 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 17.1 total, 8.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 114.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/22-23:00:35 ... thread 0: (1000000,3000000) ops and (119783.9,120147.5) ops/second in (8.348370,24.969299) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 629.77 MB 37.8 1.5 0.0 1.5 4.3 2.8 0.0 1.5 71.6 208.6 21.13 19.75 52 0.406 1535K 1422 0.0 0.0 L1 3/0 245.64 MB 24.6 2.6 2.1 0.5 2.6 2.1 0.1 1.3 139.2 138.8 19.38 18.83 5 3.877 2739K 7525 0.0 0.0 L2 5/3 572.72 MB 2.6 0.1 0.1 0.1 0.1 0.1 1.9 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 16/5 878.10 MB 0.3 1.7 0.7 1.0 1.7 0.7 0.8 2.4 141.7 141.5 12.05 11.15 5 2.409 1697K 1954 0.0 0.0 L4 166/0 9.51 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.2 1.0 159.7 159.7 0.94 0.83 1 0.942 130K 0 0.0 0.0 L5 1300/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1497/12 98.96 GB 0.0 6.0 3.0 3.1 8.9 5.8 5.4 3.1 113.0 165.7 54.79 51.81 64 0.856 6230K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 3.0 3.1 8.9 5.8 5.3 3.1 113.0 165.7 54.79 51.81 64 0.856 6230K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 3.0 3.1 6.0 3.0 0.0 0.0 146.5 146.3 42.26 40.46 18 2.348 6230K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 231.4 12.53 11.35 46 0.272 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.5 total, 25.0 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.87 GB write, 356.41 MB/s write, 6.05 GB read, 243.10 MB/s read, 54.8 seconds Interval compaction: 8.87 GB write, 363.55 MB/s write, 6.05 GB read, 247.96 MB/s read, 54.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1008773 Average: 3.4281 StdDev: 11.90 Min: 1 Median: 2.4955 Max: 6942 Percentiles: P50: 2.50 P75: 3.52 P99: 9.57 P99.9: 15.33 P99.99: 21.75 ------------------------------------------------------ [ 0, 1 ] 5151 0.511% 0.511% ( 1, 2 ] 341342 33.837% 34.348% ####### ( 2, 3 ] 318664 31.589% 65.937% ###### ( 3, 4 ] 175742 17.421% 83.359% ### ( 4, 6 ] 125619 12.453% 95.811% ## ( 6, 10 ] 36005 3.569% 99.380% # ( 10, 15 ] 5196 0.515% 99.896% ( 15, 22 ] 991 0.098% 99.994% ( 22, 34 ] 363 0.036% 100.030% ( 34, 51 ] 30 0.003% 100.033% ( 51, 76 ] 8 0.001% 100.034% ( 76, 110 ] 4 0.000% 100.034% ( 110, 170 ] 1 0.000% 100.034% ( 170, 250 ] 1 0.000% 100.034% ( 250, 380 ] 46 0.005% 100.039% ( 380, 580 ] 22 0.002% 100.041% ( 580, 870 ] 9 0.001% 100.042% ( 870, 1300 ] 12 0.001% 100.043% ( 1300, 1900 ] 5 0.000% 100.043% ( 1900, 2900 ] 4 0.000% 100.044% ( 2900, 4400 ] 3 0.000% 100.044% ( 6600, 9900 ] 1 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 384760 Average: 3.8899 StdDev: 9.35 Min: 1 Median: 2.8910 Max: 1787 Percentiles: P50: 2.89 P75: 3.93 P99: 9.89 P99.9: 15.27 P99.99: 19.65 ------------------------------------------------------ [ 0, 1 ] 587 0.153% 0.153% ( 1, 2 ] 75204 19.546% 19.698% #### ( 2, 3 ] 130855 34.010% 53.708% ####### ( 3, 4 ] 87780 22.814% 76.522% ##### ( 4, 6 ] 65035 16.903% 93.425% ### ( 6, 10 ] 22048 5.730% 99.155% # ( 10, 15 ] 2846 0.740% 99.895% ( 15, 22 ] 553 0.144% 100.038% ( 22, 34 ] 164 0.043% 100.081% ( 34, 51 ] 8 0.002% 100.083% ( 51, 76 ] 3 0.001% 100.084% ( 76, 110 ] 2 0.001% 100.084% ( 170, 250 ] 6 0.002% 100.086% ( 250, 380 ] 8 0.002% 100.088% ( 380, 580 ] 7 0.002% 100.090% ( 580, 870 ] 22 0.006% 100.096% ( 870, 1300 ] 12 0.003% 100.099% ( 1300, 1900 ] 2 0.001% 100.099% ** Level 2 read latency histogram (micros): Count: 60262 Average: 3.5653 StdDev: 24.41 Min: 1 Median: 2.1330 Max: 3523 Percentiles: P50: 2.13 P75: 2.76 P99: 9.64 P99.9: 152.88 P99.99: 1052.68 ------------------------------------------------------ [ 0, 1 ] 584 0.969% 0.969% ( 1, 2 ] 26335 43.701% 44.670% ######### ( 2, 3 ] 24146 40.068% 84.738% ######## ( 3, 4 ] 3062 5.081% 89.819% # ( 4, 6 ] 3991 6.623% 96.442% # ( 6, 10 ] 1695 2.813% 99.255% # ( 10, 15 ] 279 0.463% 99.718% ( 15, 22 ] 24 0.040% 99.758% ( 22, 34 ] 3 0.005% 99.763% ( 34, 51 ] 1 0.002% 99.764% ( 51, 76 ] 2 0.003% 99.768% ( 76, 110 ] 34 0.056% 99.824% ( 110, 170 ] 64 0.106% 99.930% ( 170, 250 ] 11 0.018% 99.949% ( 250, 380 ] 12 0.020% 99.968% ( 380, 580 ] 8 0.013% 99.982% ( 580, 870 ] 2 0.003% 99.985% ( 870, 1300 ] 7 0.012% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 262801 Average: 5.0958 StdDev: 31.67 Min: 1 Median: 3.3498 Max: 5506 Percentiles: P50: 3.35 P75: 5.07 P99: 17.29 P99.9: 138.10 P99.99: 336.03 ------------------------------------------------------ [ 0, 1 ] 454 0.173% 0.173% ( 1, 2 ] 51182 19.476% 19.648% #### ( 2, 3 ] 65277 24.839% 44.487% ##### ( 3, 4 ] 41411 15.758% 60.245% ### ( 4, 6 ] 72162 27.459% 87.704% ##### ( 6, 10 ] 24712 9.403% 97.107% ## ( 10, 15 ] 4264 1.623% 98.729% ( 15, 22 ] 2173 0.827% 99.556% ( 22, 34 ] 514 0.196% 99.752% ( 34, 51 ] 59 0.022% 99.774% ( 51, 76 ] 34 0.013% 99.787% ( 76, 110 ] 159 0.061% 99.848% ( 110, 170 ] 293 0.111% 99.959% ( 170, 250 ] 43 0.016% 99.976% ( 250, 380 ] 57 0.022% 99.997% ( 380, 580 ] 20 0.008% 100.005% ( 580, 870 ] 23 0.009% 100.014% ( 870, 1300 ] 16 0.006% 100.020% ( 1300, 1900 ] 5 0.002% 100.022% ( 1900, 2900 ] 5 0.002% 100.024% ( 2900, 4400 ] 6 0.002% 100.026% ( 4400, 6600 ] 4 0.002% 100.027% ** Level 4 read latency histogram (micros): Count: 100 Average: 766.6600 StdDev: 1343.24 Min: 1 Median: 12.5000 Max: 4959 Percentiles: P50: 12.50 P75: 1085.00 P99: 4959.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ [ 0, 1 ] 23 23.000% 23.000% ##### ( 1, 2 ] 14 14.000% 37.000% ### ( 2, 3 ] 4 4.000% 41.000% # ( 3, 4 ] 1 1.000% 42.000% ( 6, 10 ] 6 6.000% 48.000% # ( 10, 15 ] 4 4.000% 52.000% # ( 15, 22 ] 1 1.000% 53.000% ( 34, 51 ] 6 6.000% 59.000% # ( 51, 76 ] 8 8.000% 67.000% ## ( 170, 250 ] 2 2.000% 69.000% ( 380, 580 ] 1 1.000% 70.000% ( 580, 870 ] 2 2.000% 72.000% ( 870, 1300 ] 6 6.000% 78.000% # ( 1300, 1900 ] 3 3.000% 81.000% # ( 1900, 2900 ] 8 8.000% 89.000% ## ( 2900, 4400 ] 8 8.000% 97.000% ## ( 4400, 6600 ] 3 3.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 786.1250 StdDev: 994.41 Min: 92 Median: 215.7143 Max: 4795 Percentiles: P50: 215.71 P75: 1214.00 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 22 27.500% 45.000% ###### ( 170, 250 ] 7 8.750% 53.750% ## ( 250, 380 ] 1 1.250% 55.000% ( 380, 580 ] 7 8.750% 63.750% ## ( 580, 870 ] 5 6.250% 70.000% # ( 870, 1300 ] 5 6.250% 76.250% # ( 1300, 1900 ] 6 7.500% 83.750% ## ( 1900, 2900 ] 8 10.000% 93.750% ## ( 2900, 4400 ] 4 5.000% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 25.5 total, 8.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 115.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 0 2024/07/22-23:00:43 ... thread 0: (1000000,4000000) ops and (121470.5,120475.6) ops/second in (8.232452,33.201751) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/5 1.54 GB 88.1 2.5 0.0 2.5 6.2 3.8 0.0 1.7 80.3 202.6 31.39 29.23 71 0.442 2558K 2376 0.0 0.0 L1 3/3 245.64 MB 0.0 2.6 2.1 0.5 2.6 2.1 0.1 1.3 139.2 138.8 19.38 18.83 5 3.877 2739K 7525 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.9 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 27/0 963.23 MB 1.0 3.3 1.3 2.0 3.3 1.2 0.8 2.6 146.5 146.2 22.83 21.52 10 2.283 3361K 7152 0.0 0.0 L4 174/0 9.68 GB 1.0 0.8 0.6 0.2 0.8 0.6 1.2 1.3 105.8 105.4 7.33 5.47 9 0.815 743K 2326 0.0 0.0 L5 1304/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1518/8 99.87 GB 0.0 9.2 4.0 5.2 13.0 7.7 5.7 3.5 115.1 161.6 82.22 76.29 96 0.856 9530K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.2 4.0 5.2 13.0 7.7 5.6 3.5 115.1 161.6 82.22 76.29 96 0.856 9530K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.2 4.0 5.2 9.2 4.0 0.0 0.0 143.9 143.6 65.77 61.66 35 1.879 9530K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 233.7 16.45 14.64 61 0.270 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.7 total, 33.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.98 GB write, 394.19 MB/s write, 9.24 GB read, 280.78 MB/s read, 82.2 seconds Interval compaction: 12.98 GB write, 400.12 MB/s write, 9.24 GB read, 285.01 MB/s read, 82.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1388939 Average: 3.7265 StdDev: 13.77 Min: 1 Median: 2.6819 Max: 6942 Percentiles: P50: 2.68 P75: 3.95 P99: 9.99 P99.9: 18.92 P99.99: 28.02 ------------------------------------------------------ [ 0, 1 ] 6017 0.433% 0.433% ( 1, 2 ] 416094 29.958% 30.391% ###### ( 2, 3 ] 399419 28.757% 59.148% ###### ( 3, 4 ] 230745 16.613% 75.761% ### ( 4, 6 ] 252816 18.202% 93.963% #### ( 6, 10 ] 70057 5.044% 99.007% # ( 10, 15 ] 11301 0.814% 99.821% ( 15, 22 ] 1970 0.142% 99.963% ( 22, 34 ] 762 0.055% 100.017% ( 34, 51 ] 60 0.004% 100.022% ( 51, 76 ] 11 0.001% 100.023% ( 76, 110 ] 57 0.004% 100.027% ( 110, 170 ] 42 0.003% 100.030% ( 170, 250 ] 14 0.001% 100.031% ( 250, 380 ] 81 0.006% 100.037% ( 380, 580 ] 34 0.002% 100.039% ( 580, 870 ] 15 0.001% 100.040% ( 870, 1300 ] 14 0.001% 100.041% ( 1300, 1900 ] 8 0.001% 100.042% ( 1900, 2900 ] 7 0.001% 100.042% ( 2900, 4400 ] 7 0.001% 100.043% ( 4400, 6600 ] 1 0.000% 100.043% ( 6600, 9900 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 677390 Average: 3.7504 StdDev: 7.71 Min: 1 Median: 2.7093 Max: 1787 Percentiles: P50: 2.71 P75: 3.84 P99: 9.86 P99.9: 14.94 P99.99: 19.54 ------------------------------------------------------ [ 0, 1 ] 1360 0.201% 0.201% ( 1, 2 ] 158632 23.418% 23.619% ##### ( 2, 3 ] 251954 37.195% 60.814% ####### ( 3, 4 ] 114757 16.941% 77.755% ### ( 4, 6 ] 107429 15.859% 93.614% ### ( 6, 10 ] 37814 5.582% 99.196% # ( 10, 15 ] 4827 0.713% 99.909% ( 15, 22 ] 848 0.125% 100.034% ( 22, 34 ] 255 0.038% 100.072% ( 34, 51 ] 17 0.003% 100.074% ( 51, 76 ] 4 0.001% 100.075% ( 76, 110 ] 89 0.013% 100.088% ( 110, 170 ] 48 0.007% 100.095% ( 170, 250 ] 19 0.003% 100.098% ( 250, 380 ] 18 0.003% 100.101% ( 380, 580 ] 14 0.002% 100.103% ( 580, 870 ] 24 0.004% 100.106% ( 870, 1300 ] 12 0.002% 100.108% ( 1300, 1900 ] 2 0.000% 100.108% ** Level 2 read latency histogram (micros): Count: 60262 Average: 3.5653 StdDev: 24.41 Min: 1 Median: 2.1330 Max: 3523 Percentiles: P50: 2.13 P75: 2.76 P99: 9.64 P99.9: 152.88 P99.99: 1052.68 ------------------------------------------------------ [ 0, 1 ] 584 0.969% 0.969% ( 1, 2 ] 26335 43.701% 44.670% ######### ( 2, 3 ] 24146 40.068% 84.738% ######## ( 3, 4 ] 3062 5.081% 89.819% # ( 4, 6 ] 3991 6.623% 96.442% # ( 6, 10 ] 1695 2.813% 99.255% # ( 10, 15 ] 279 0.463% 99.718% ( 15, 22 ] 24 0.040% 99.758% ( 22, 34 ] 3 0.005% 99.763% ( 34, 51 ] 1 0.002% 99.764% ( 51, 76 ] 2 0.003% 99.768% ( 76, 110 ] 34 0.056% 99.824% ( 110, 170 ] 64 0.106% 99.930% ( 170, 250 ] 11 0.018% 99.949% ( 250, 380 ] 12 0.020% 99.968% ( 380, 580 ] 8 0.013% 99.982% ( 580, 870 ] 2 0.003% 99.985% ( 870, 1300 ] 7 0.012% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 495273 Average: 5.5656 StdDev: 50.41 Min: 1 Median: 3.0711 Max: 7895 Percentiles: P50: 3.07 P75: 4.92 P99: 14.57 P99.9: 99.69 P99.99: 154.62 ------------------------------------------------------ [ 0, 1 ] 672 0.136% 0.136% ( 1, 2 ] 80450 16.244% 16.379% ### ( 2, 3 ] 161150 32.538% 48.917% ####### ( 3, 4 ] 75500 15.244% 64.161% ### ( 4, 6 ] 117086 23.641% 87.802% ##### ( 6, 10 ] 48203 9.733% 97.534% ## ( 10, 15 ] 7936 1.602% 99.137% ( 15, 22 ] 2835 0.572% 99.709% ( 22, 34 ] 683 0.138% 99.847% ( 34, 51 ] 74 0.015% 99.862% ( 51, 76 ] 41 0.008% 99.870% ( 76, 110 ] 212 0.043% 99.913% ( 110, 170 ] 513 0.104% 100.017% ( 170, 250 ] 270 0.055% 100.071% ( 250, 380 ] 206 0.042% 100.113% ( 380, 580 ] 133 0.027% 100.140% ( 580, 870 ] 57 0.012% 100.151% ( 870, 1300 ] 28 0.006% 100.157% ( 1300, 1900 ] 12 0.002% 100.159% ( 1900, 2900 ] 13 0.003% 100.162% ( 2900, 4400 ] 51 0.010% 100.172% ( 4400, 6600 ] 10 0.002% 100.174% ( 6600, 9900 ] 1 0.000% 100.174% ** Level 4 read latency histogram (micros): Count: 11030 Average: 11.9399 StdDev: 152.62 Min: 1 Median: 2.8141 Max: 4959 Percentiles: P50: 2.81 P75: 4.47 P99: 17.04 P99.9: 3061.67 P99.99: 4959.00 ------------------------------------------------------ [ 0, 1 ] 52 0.471% 0.471% ( 1, 2 ] 2436 22.085% 22.557% #### ( 2, 3 ] 3718 33.708% 56.265% ####### ( 3, 4 ] 1543 13.989% 70.254% ### ( 4, 6 ] 2222 20.145% 90.399% #### ( 6, 10 ] 810 7.344% 97.743% # ( 10, 15 ] 132 1.197% 98.939% ( 15, 22 ] 23 0.209% 99.148% ( 22, 34 ] 13 0.118% 99.266% ( 34, 51 ] 9 0.082% 99.347% ( 51, 76 ] 10 0.091% 99.438% ( 76, 110 ] 1 0.009% 99.447% ( 110, 170 ] 6 0.054% 99.501% ( 170, 250 ] 5 0.045% 99.547% ( 250, 380 ] 14 0.127% 99.674% ( 380, 580 ] 3 0.027% 99.701% ( 580, 870 ] 4 0.036% 99.737% ( 870, 1300 ] 6 0.054% 99.791% ( 1300, 1900 ] 3 0.027% 99.819% ( 1900, 2900 ] 8 0.073% 99.891% ( 2900, 4400 ] 9 0.082% 99.973% ( 4400, 6600 ] 3 0.027% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 783.2000 StdDev: 999.65 Min: 89 Median: 213.6364 Max: 4795 Percentiles: P50: 213.64 P75: 1228.33 P99: 4400.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 18 18.000% 18.000% #### ( 110, 170 ] 26 26.000% 44.000% ##### ( 170, 250 ] 11 11.000% 55.000% ## ( 250, 380 ] 1 1.000% 56.000% ( 380, 580 ] 8 8.000% 64.000% ## ( 580, 870 ] 6 6.000% 70.000% # ( 870, 1300 ] 6 6.000% 76.000% # ( 1300, 1900 ] 8 8.000% 84.000% ## ( 1900, 2900 ] 9 9.000% 93.000% ## ( 2900, 4400 ] 6 6.000% 99.000% # ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 33.7 total, 8.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 116.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/22-23:00:51 ... thread 0: (1000000,5000000) ops and (119879.0,120355.8) ops/second in (8.341745,41.543496) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 1.84 GB 69.2 3.0 0.0 3.0 7.7 4.7 0.0 1.6 77.0 200.5 39.26 36.63 89 0.441 3070K 2848 0.0 0.0 L1 8/8 934.66 MB 0.0 3.6 2.8 0.8 3.5 2.8 0.1 1.3 132.7 132.2 27.41 26.42 6 4.568 3691K 10K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.9 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 27/0 963.23 MB 1.0 3.3 1.3 2.0 3.3 1.2 0.8 2.6 146.5 146.2 22.83 21.52 10 2.283 3361K 7152 0.0 0.0 L4 174/0 9.68 GB 1.0 0.8 0.6 0.2 0.8 0.6 1.2 1.3 105.8 105.4 7.33 5.47 9 0.815 743K 2326 0.0 0.0 L5 1304/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1528/18 100.85 GB 0.0 10.7 4.7 6.0 15.4 9.4 5.7 3.2 111.2 160.4 98.11 91.29 115 0.853 10M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.7 4.7 6.0 15.4 9.4 5.6 3.2 111.2 160.4 98.11 91.29 115 0.853 10M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.7 4.7 6.0 10.6 4.6 0.0 0.0 141.1 140.8 77.31 72.69 38 2.034 10M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 233.2 20.80 18.60 77 0.270 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.0 total, 41.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.36 GB write, 374.16 MB/s write, 10.65 GB read, 259.37 MB/s read, 98.1 seconds Interval compaction: 15.36 GB write, 378.66 MB/s write, 10.65 GB read, 262.49 MB/s read, 98.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1780238 Average: 3.6618 StdDev: 13.41 Min: 1 Median: 2.6286 Max: 6942 Percentiles: P50: 2.63 P75: 3.91 P99: 9.91 P99.9: 18.27 P99.99: 26.62 ------------------------------------------------------ [ 0, 1 ] 7568 0.425% 0.425% ( 1, 2 ] 571041 32.077% 32.502% ###### ( 2, 3 ] 495565 27.837% 60.339% ###### ( 3, 4 ] 286406 16.088% 76.427% ### ( 4, 6 ] 321044 18.034% 94.461% #### ( 6, 10 ] 82766 4.649% 99.110% # ( 10, 15 ] 12970 0.729% 99.838% ( 15, 22 ] 2357 0.132% 99.971% ( 22, 34 ] 896 0.050% 100.021% ( 34, 51 ] 68 0.004% 100.025% ( 51, 76 ] 14 0.001% 100.026% ( 76, 110 ] 71 0.004% 100.030% ( 110, 170 ] 58 0.003% 100.033% ( 170, 250 ] 16 0.001% 100.034% ( 250, 380 ] 98 0.006% 100.039% ( 380, 580 ] 44 0.002% 100.042% ( 580, 870 ] 20 0.001% 100.043% ( 870, 1300 ] 17 0.001% 100.044% ( 1300, 1900 ] 10 0.001% 100.044% ( 1900, 2900 ] 11 0.001% 100.045% ( 2900, 4400 ] 8 0.000% 100.045% ( 4400, 6600 ] 1 0.000% 100.046% ( 6600, 9900 ] 1 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 840864 Average: 3.5464 StdDev: 7.97 Min: 1 Median: 2.5379 Max: 1787 Percentiles: P50: 2.54 P75: 3.57 P99: 9.72 P99.9: 14.85 P99.99: 19.91 ------------------------------------------------------ [ 0, 1 ] 2597 0.309% 0.309% ( 1, 2 ] 252557 30.035% 30.344% ###### ( 2, 3 ] 307261 36.541% 66.885% ####### ( 3, 4 ] 120376 14.316% 81.201% ### ( 4, 6 ] 112980 13.436% 94.637% ### ( 6, 10 ] 39400 4.686% 99.323% # ( 10, 15 ] 5004 0.595% 99.918% ( 15, 22 ] 862 0.103% 100.021% ( 22, 34 ] 257 0.031% 100.051% ( 34, 51 ] 18 0.002% 100.053% ( 51, 76 ] 5 0.001% 100.054% ( 76, 110 ] 89 0.011% 100.064% ( 110, 170 ] 75 0.009% 100.073% ( 170, 250 ] 23 0.003% 100.076% ( 250, 380 ] 24 0.003% 100.079% ( 380, 580 ] 17 0.002% 100.081% ( 580, 870 ] 32 0.004% 100.085% ( 870, 1300 ] 16 0.002% 100.087% ( 1300, 1900 ] 3 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 60262 Average: 3.5653 StdDev: 24.41 Min: 1 Median: 2.1330 Max: 3523 Percentiles: P50: 2.13 P75: 2.76 P99: 9.64 P99.9: 152.88 P99.99: 1052.68 ------------------------------------------------------ [ 0, 1 ] 584 0.969% 0.969% ( 1, 2 ] 26335 43.701% 44.670% ######### ( 2, 3 ] 24146 40.068% 84.738% ######## ( 3, 4 ] 3062 5.081% 89.819% # ( 4, 6 ] 3991 6.623% 96.442% # ( 6, 10 ] 1695 2.813% 99.255% # ( 10, 15 ] 279 0.463% 99.718% ( 15, 22 ] 24 0.040% 99.758% ( 22, 34 ] 3 0.005% 99.763% ( 34, 51 ] 1 0.002% 99.764% ( 51, 76 ] 2 0.003% 99.768% ( 76, 110 ] 34 0.056% 99.824% ( 110, 170 ] 64 0.106% 99.930% ( 170, 250 ] 11 0.018% 99.949% ( 250, 380 ] 12 0.020% 99.968% ( 380, 580 ] 8 0.013% 99.982% ( 580, 870 ] 2 0.003% 99.985% ( 870, 1300 ] 7 0.012% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 495273 Average: 5.5656 StdDev: 50.41 Min: 1 Median: 3.0711 Max: 7895 Percentiles: P50: 3.07 P75: 4.92 P99: 14.57 P99.9: 99.69 P99.99: 154.62 ------------------------------------------------------ [ 0, 1 ] 672 0.136% 0.136% ( 1, 2 ] 80450 16.244% 16.379% ### ( 2, 3 ] 161150 32.538% 48.917% ####### ( 3, 4 ] 75500 15.244% 64.161% ### ( 4, 6 ] 117086 23.641% 87.802% ##### ( 6, 10 ] 48203 9.733% 97.534% ## ( 10, 15 ] 7936 1.602% 99.137% ( 15, 22 ] 2835 0.572% 99.709% ( 22, 34 ] 683 0.138% 99.847% ( 34, 51 ] 74 0.015% 99.862% ( 51, 76 ] 41 0.008% 99.870% ( 76, 110 ] 212 0.043% 99.913% ( 110, 170 ] 513 0.104% 100.017% ( 170, 250 ] 270 0.055% 100.071% ( 250, 380 ] 206 0.042% 100.113% ( 380, 580 ] 133 0.027% 100.140% ( 580, 870 ] 57 0.012% 100.151% ( 870, 1300 ] 28 0.006% 100.157% ( 1300, 1900 ] 12 0.002% 100.159% ( 1900, 2900 ] 13 0.003% 100.162% ( 2900, 4400 ] 51 0.010% 100.172% ( 4400, 6600 ] 10 0.002% 100.174% ( 6600, 9900 ] 1 0.000% 100.174% ** Level 4 read latency histogram (micros): Count: 11030 Average: 11.9399 StdDev: 152.62 Min: 1 Median: 2.8141 Max: 4959 Percentiles: P50: 2.81 P75: 4.47 P99: 17.04 P99.9: 3061.67 P99.99: 4959.00 ------------------------------------------------------ [ 0, 1 ] 52 0.471% 0.471% ( 1, 2 ] 2436 22.085% 22.557% #### ( 2, 3 ] 3718 33.708% 56.265% ####### ( 3, 4 ] 1543 13.989% 70.254% ### ( 4, 6 ] 2222 20.145% 90.399% #### ( 6, 10 ] 810 7.344% 97.743% # ( 10, 15 ] 132 1.197% 98.939% ( 15, 22 ] 23 0.209% 99.148% ( 22, 34 ] 13 0.118% 99.266% ( 34, 51 ] 9 0.082% 99.347% ( 51, 76 ] 10 0.091% 99.438% ( 76, 110 ] 1 0.009% 99.447% ( 110, 170 ] 6 0.054% 99.501% ( 170, 250 ] 5 0.045% 99.547% ( 250, 380 ] 14 0.127% 99.674% ( 380, 580 ] 3 0.027% 99.701% ( 580, 870 ] 4 0.036% 99.737% ( 870, 1300 ] 6 0.054% 99.791% ( 1300, 1900 ] 3 0.027% 99.819% ( 1900, 2900 ] 8 0.073% 99.891% ( 2900, 4400 ] 9 0.082% 99.973% ( 4400, 6600 ] 3 0.027% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 783.2000 StdDev: 999.65 Min: 89 Median: 213.6364 Max: 4795 Percentiles: P50: 213.64 P75: 1228.33 P99: 4400.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 18 18.000% 18.000% #### ( 110, 170 ] 26 26.000% 44.000% ##### ( 170, 250 ] 11 11.000% 55.000% ## ( 250, 380 ] 1 1.000% 56.000% ( 380, 580 ] 8 8.000% 64.000% ## ( 580, 870 ] 6 6.000% 70.000% # ( 870, 1300 ] 6 6.000% 76.000% # ( 1300, 1900 ] 8 8.000% 84.000% ## ( 1900, 2900 ] 9 9.000% 93.000% ## ( 2900, 4400 ] 6 6.000% 99.000% # ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 42.0 total, 8.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 117.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/22-23:01:00 ... thread 0: (1000000,6000000) ops and (118021.3,119960.3) ops/second in (8.473050,50.016546) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.84 GB 44.1 4.0 0.0 4.0 9.7 5.7 0.0 1.7 77.9 189.4 52.54 47.40 108 0.487 4157K 3959 0.0 0.0 L1 16/16 985.21 MB 0.0 5.4 3.7 1.7 5.4 3.7 0.1 1.5 145.2 144.5 37.99 36.63 7 5.427 5599K 23K 0.0 0.0 L2 1/0 51.80 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.8 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 26/0 978.84 MB 1.0 4.4 1.8 2.5 4.3 1.8 1.1 2.4 119.9 119.5 37.20 29.80 21 1.771 4495K 16K 0.0 0.0 L4 177/0 9.47 GB 1.0 1.7 1.4 0.3 1.7 1.4 1.2 1.2 91.4 90.9 19.22 12.90 25 0.769 1728K 7647 0.0 0.0 L5 1316/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1547/24 101.75 GB 0.0 15.6 6.9 8.6 21.2 12.6 7.8 3.7 107.6 146.8 148.23 127.96 162 0.915 16M 51K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.6 6.9 8.6 21.2 12.6 7.7 3.7 107.6 146.8 148.23 127.96 162 0.915 16M 51K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.6 6.9 8.6 15.5 6.9 0.0 0.0 131.5 131.0 121.34 105.17 70 1.733 16M 51K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 217.9 26.89 22.80 92 0.292 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.5 total, 50.0 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.25 GB write, 430.69 MB/s write, 15.58 GB read, 315.77 MB/s read, 148.2 seconds Interval compaction: 21.25 GB write, 435.00 MB/s write, 15.58 GB read, 318.92 MB/s read, 148.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2133313 Average: 3.7547 StdDev: 20.72 Min: 1 Median: 2.6298 Max: 7113 Percentiles: P50: 2.63 P75: 3.91 P99: 9.93 P99.9: 18.82 P99.99: 27.83 ------------------------------------------------------ [ 0, 1 ] 8819 0.413% 0.413% ( 1, 2 ] 681583 31.950% 32.363% ###### ( 2, 3 ] 597463 28.006% 60.369% ###### ( 3, 4 ] 342320 16.046% 76.416% ### ( 4, 6 ] 381101 17.864% 94.280% #### ( 6, 10 ] 102400 4.800% 99.080% # ( 10, 15 ] 15797 0.740% 99.820% ( 15, 22 ] 3112 0.146% 99.966% ( 22, 34 ] 1041 0.049% 100.015% ( 34, 51 ] 90 0.004% 100.019% ( 51, 76 ] 15 0.001% 100.020% ( 76, 110 ] 74 0.003% 100.024% ( 110, 170 ] 85 0.004% 100.028% ( 170, 250 ] 43 0.002% 100.030% ( 250, 380 ] 137 0.006% 100.036% ( 380, 580 ] 67 0.003% 100.039% ( 580, 870 ] 40 0.002% 100.041% ( 870, 1300 ] 35 0.002% 100.043% ( 1300, 1900 ] 12 0.001% 100.043% ( 1900, 2900 ] 24 0.001% 100.044% ( 2900, 4400 ] 37 0.002% 100.046% ( 4400, 6600 ] 1 0.000% 100.046% ( 6600, 9900 ] 2 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 1063227 Average: 4.5192 StdDev: 65.30 Min: 1 Median: 2.5707 Max: 15069 Percentiles: P50: 2.57 P75: 3.71 P99: 10.07 P99.9: 17.70 P99.99: 21.96 ------------------------------------------------------ [ 0, 1 ] 3085 0.290% 0.290% ( 1, 2 ] 308963 29.059% 29.349% ###### ( 2, 3 ] 384717 36.184% 65.533% ####### ( 3, 4 ] 141433 13.302% 78.835% ### ( 4, 6 ] 153038 14.394% 93.229% ### ( 6, 10 ] 61233 5.759% 98.988% # ( 10, 15 ] 9087 0.855% 99.843% ( 15, 22 ] 1574 0.148% 99.991% ( 22, 34 ] 389 0.037% 100.027% ( 34, 51 ] 37 0.003% 100.031% ( 51, 76 ] 16 0.002% 100.032% ( 76, 110 ] 98 0.009% 100.042% ( 110, 170 ] 127 0.012% 100.054% ( 170, 250 ] 104 0.010% 100.063% ( 250, 380 ] 80 0.008% 100.071% ( 380, 580 ] 87 0.008% 100.079% ( 580, 870 ] 65 0.006% 100.085% ( 870, 1300 ] 37 0.003% 100.089% ( 1300, 1900 ] 14 0.001% 100.090% ( 1900, 2900 ] 14 0.001% 100.091% ( 2900, 4400 ] 119 0.011% 100.103% ( 4400, 6600 ] 20 0.002% 100.104% ( 6600, 9900 ] 15 0.001% 100.106% ( 9900, 14000 ] 6 0.001% 100.106% ( 14000, 22000 ] 2 0.000% 100.107% ** Level 2 read latency histogram (micros): Count: 60262 Average: 3.5653 StdDev: 24.41 Min: 1 Median: 2.1330 Max: 3523 Percentiles: P50: 2.13 P75: 2.76 P99: 9.64 P99.9: 152.88 P99.99: 1052.68 ------------------------------------------------------ [ 0, 1 ] 584 0.969% 0.969% ( 1, 2 ] 26335 43.701% 44.670% ######### ( 2, 3 ] 24146 40.068% 84.738% ######## ( 3, 4 ] 3062 5.081% 89.819% # ( 4, 6 ] 3991 6.623% 96.442% # ( 6, 10 ] 1695 2.813% 99.255% # ( 10, 15 ] 279 0.463% 99.718% ( 15, 22 ] 24 0.040% 99.758% ( 22, 34 ] 3 0.005% 99.763% ( 34, 51 ] 1 0.002% 99.764% ( 51, 76 ] 2 0.003% 99.768% ( 76, 110 ] 34 0.056% 99.824% ( 110, 170 ] 64 0.106% 99.930% ( 170, 250 ] 11 0.018% 99.949% ( 250, 380 ] 12 0.020% 99.968% ( 380, 580 ] 8 0.013% 99.982% ( 580, 870 ] 2 0.003% 99.985% ( 870, 1300 ] 7 0.012% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 879630 Average: 8.1571 StdDev: 205.68 Min: 1 Median: 3.2996 Max: 157246 Percentiles: P50: 3.30 P75: 5.19 P99: 14.48 P99.9: 45.14 P99.99: 138.93 ------------------------------------------------------ [ 0, 1 ] 777 0.088% 0.088% ( 1, 2 ] 112959 12.842% 12.930% ### ( 2, 3 ] 287812 32.720% 45.650% ####### ( 3, 4 ] 127735 14.521% 60.171% ### ( 4, 6 ] 219541 24.958% 85.129% ##### ( 6, 10 ] 105294 11.970% 97.100% ## ( 10, 15 ] 18668 2.122% 99.222% ( 15, 22 ] 4868 0.553% 99.775% ( 22, 34 ] 1021 0.116% 99.891% ( 34, 51 ] 115 0.013% 99.905% ( 51, 76 ] 47 0.005% 99.910% ( 76, 110 ] 299 0.034% 99.944% ( 110, 170 ] 842 0.096% 100.040% ( 170, 250 ] 554 0.063% 100.103% ( 250, 380 ] 473 0.054% 100.156% ( 380, 580 ] 419 0.048% 100.204% ( 580, 870 ] 255 0.029% 100.233% ( 870, 1300 ] 147 0.017% 100.250% ( 1300, 1900 ] 69 0.008% 100.257% ( 1900, 2900 ] 96 0.011% 100.268% ( 2900, 4400 ] 276 0.031% 100.300% ( 4400, 6600 ] 72 0.008% 100.308% ( 6600, 9900 ] 28 0.003% 100.311% ( 9900, 14000 ] 7 0.001% 100.312% ( 22000, 33000 ] 2 0.000% 100.312% ( 33000, 50000 ] 1 0.000% 100.312% ( 110000, 170000 ] 1 0.000% 100.312% ** Level 4 read latency histogram (micros): Count: 11185 Average: 14.6439 StdDev: 182.25 Min: 1 Median: 2.8181 Max: 8811 Percentiles: P50: 2.82 P75: 4.49 P99: 38.87 P99.9: 3420.23 P99.99: 6513.10 ------------------------------------------------------ [ 0, 1 ] 55 0.492% 0.492% ( 1, 2 ] 2473 22.110% 22.602% #### ( 2, 3 ] 3746 33.491% 56.093% ####### ( 3, 4 ] 1561 13.956% 70.049% ### ( 4, 6 ] 2241 20.036% 90.085% #### ( 6, 10 ] 815 7.287% 97.371% # ( 10, 15 ] 135 1.207% 98.578% ( 15, 22 ] 26 0.232% 98.811% ( 22, 34 ] 18 0.161% 98.972% ( 34, 51 ] 11 0.098% 99.070% ( 51, 76 ] 10 0.089% 99.160% ( 76, 110 ] 1 0.009% 99.169% ( 110, 170 ] 6 0.054% 99.222% ( 170, 250 ] 5 0.045% 99.267% ( 250, 380 ] 27 0.241% 99.508% ( 380, 580 ] 11 0.098% 99.607% ( 580, 870 ] 7 0.063% 99.669% ( 870, 1300 ] 10 0.089% 99.759% ( 1300, 1900 ] 4 0.036% 99.794% ( 1900, 2900 ] 8 0.072% 99.866% ( 2900, 4400 ] 11 0.098% 99.964% ( 4400, 6600 ] 3 0.027% 99.991% ( 6600, 9900 ] 1 0.009% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 876.3062 StdDev: 1099.66 Min: 89 Median: 250.0000 Max: 4795 Percentiles: P50: 250.00 P75: 1350.00 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 21 13.125% 13.125% ### ( 110, 170 ] 43 26.875% 40.000% ##### ( 170, 250 ] 16 10.000% 50.000% ## ( 250, 380 ] 5 3.125% 53.125% # ( 380, 580 ] 14 8.750% 61.875% ## ( 580, 870 ] 11 6.875% 68.750% # ( 870, 1300 ] 9 5.625% 74.375% # ( 1300, 1900 ] 12 7.500% 81.875% ## ( 1900, 2900 ] 13 8.125% 90.000% ## ( 2900, 4400 ] 14 8.750% 98.750% ## ( 4400, 6600 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 50.5 total, 8.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 116.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.269 H:M:S, 0.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.269 H:M:S, 3.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/22-23:01:08 ... thread 0: (1000000,7000000) ops and (120493.1,120036.1) ops/second in (8.299227,58.315773) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.83 GB 144.7 5.0 0.0 5.0 11.6 6.6 0.0 1.7 80.9 188.7 63.07 57.43 127 0.497 5181K 4932 0.0 0.0 L1 16/16 985.21 MB 0.0 5.4 3.7 1.7 5.4 3.7 0.1 1.5 145.2 144.5 37.99 36.63 7 5.427 5599K 23K 0.0 0.0 L2 1/0 51.80 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.8 2.0 98.2 98.2 1.28 1.24 1 1.283 127K 48 0.0 0.0 L3 26/0 978.84 MB 1.0 4.4 1.8 2.5 4.3 1.8 1.1 2.4 119.9 119.5 37.20 29.80 21 1.771 4495K 16K 0.0 0.0 L4 177/0 9.47 GB 1.0 1.7 1.4 0.3 1.7 1.4 1.2 1.2 91.4 90.9 19.22 12.90 25 0.769 1728K 7647 0.0 0.0 L5 1316/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1551/24 102.73 GB 0.0 16.6 6.9 9.6 23.2 13.5 7.8 3.5 106.8 149.3 158.76 138.00 181 0.877 17M 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.6 6.9 9.6 23.2 13.5 7.7 3.5 106.8 149.3 158.76 138.00 181 0.877 17M 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.6 6.9 9.6 16.5 6.9 0.0 0.0 134.2 133.8 126.40 110.13 74 1.708 17M 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 210.2 32.36 27.86 107 0.302 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.8 total, 58.3 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.16 GB write, 403.11 MB/s write, 16.56 GB read, 288.35 MB/s read, 158.8 seconds Interval compaction: 23.16 GB write, 406.56 MB/s write, 16.56 GB read, 290.82 MB/s read, 158.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2534713 Average: 3.7476 StdDev: 19.59 Min: 1 Median: 2.6401 Max: 7113 Percentiles: P50: 2.64 P75: 3.90 P99: 9.92 P99.9: 19.39 P99.99: 28.19 ------------------------------------------------------ [ 0, 1 ] 10824 0.427% 0.427% ( 1, 2 ] 809616 31.941% 32.368% ###### ( 2, 3 ] 698167 27.544% 59.912% ###### ( 3, 4 ] 425795 16.799% 76.711% ### ( 4, 6 ] 449986 17.753% 94.464% #### ( 6, 10 ] 117287 4.627% 99.091% # ( 10, 15 ] 17789 0.702% 99.793% ( 15, 22 ] 4332 0.171% 99.964% ( 22, 34 ] 1286 0.051% 100.015% ( 34, 51 ] 109 0.004% 100.019% ( 51, 76 ] 17 0.001% 100.020% ( 76, 110 ] 99 0.004% 100.023% ( 110, 170 ] 189 0.007% 100.031% ( 170, 250 ] 82 0.003% 100.034% ( 250, 380 ] 156 0.006% 100.040% ( 380, 580 ] 96 0.004% 100.044% ( 580, 870 ] 44 0.002% 100.046% ( 870, 1300 ] 41 0.002% 100.047% ( 1300, 1900 ] 14 0.001% 100.048% ( 1900, 2900 ] 26 0.001% 100.049% ( 2900, 4400 ] 38 0.001% 100.050% ( 4400, 6600 ] 1 0.000% 100.051% ( 6600, 9900 ] 2 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 1119731 Average: 4.5770 StdDev: 63.70 Min: 1 Median: 2.6347 Max: 15069 Percentiles: P50: 2.63 P75: 3.82 P99: 10.63 P99.9: 19.93 P99.99: 32.01 ------------------------------------------------------ [ 0, 1 ] 3114 0.278% 0.278% ( 1, 2 ] 311643 27.832% 28.110% ###### ( 2, 3 ] 386169 34.488% 62.598% ####### ( 3, 4 ] 169370 15.126% 77.724% ### ( 4, 6 ] 171924 15.354% 93.078% ### ( 6, 10 ] 65080 5.812% 98.890% # ( 10, 15 ] 9844 0.879% 99.769% ( 15, 22 ] 2083 0.186% 99.955% ( 22, 34 ] 470 0.042% 99.997% ( 34, 51 ] 43 0.004% 100.001% ( 51, 76 ] 16 0.001% 100.002% ( 76, 110 ] 204 0.018% 100.020% ( 110, 170 ] 286 0.026% 100.046% ( 170, 250 ] 131 0.012% 100.058% ( 250, 380 ] 91 0.008% 100.066% ( 380, 580 ] 100 0.009% 100.075% ( 580, 870 ] 69 0.006% 100.081% ( 870, 1300 ] 37 0.003% 100.084% ( 1300, 1900 ] 14 0.001% 100.085% ( 1900, 2900 ] 14 0.001% 100.087% ( 2900, 4400 ] 119 0.011% 100.097% ( 4400, 6600 ] 20 0.002% 100.099% ( 6600, 9900 ] 15 0.001% 100.100% ( 9900, 14000 ] 6 0.001% 100.101% ( 14000, 22000 ] 2 0.000% 100.101% ** Level 2 read latency histogram (micros): Count: 60262 Average: 3.5653 StdDev: 24.41 Min: 1 Median: 2.1330 Max: 3523 Percentiles: P50: 2.13 P75: 2.76 P99: 9.64 P99.9: 152.88 P99.99: 1052.68 ------------------------------------------------------ [ 0, 1 ] 584 0.969% 0.969% ( 1, 2 ] 26335 43.701% 44.670% ######### ( 2, 3 ] 24146 40.068% 84.738% ######## ( 3, 4 ] 3062 5.081% 89.819% # ( 4, 6 ] 3991 6.623% 96.442% # ( 6, 10 ] 1695 2.813% 99.255% # ( 10, 15 ] 279 0.463% 99.718% ( 15, 22 ] 24 0.040% 99.758% ( 22, 34 ] 3 0.005% 99.763% ( 34, 51 ] 1 0.002% 99.764% ( 51, 76 ] 2 0.003% 99.768% ( 76, 110 ] 34 0.056% 99.824% ( 110, 170 ] 64 0.106% 99.930% ( 170, 250 ] 11 0.018% 99.949% ( 250, 380 ] 12 0.020% 99.968% ( 380, 580 ] 8 0.013% 99.982% ( 580, 870 ] 2 0.003% 99.985% ( 870, 1300 ] 7 0.012% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 879630 Average: 8.1571 StdDev: 205.68 Min: 1 Median: 3.2996 Max: 157246 Percentiles: P50: 3.30 P75: 5.19 P99: 14.48 P99.9: 45.14 P99.99: 138.93 ------------------------------------------------------ [ 0, 1 ] 777 0.088% 0.088% ( 1, 2 ] 112959 12.842% 12.930% ### ( 2, 3 ] 287812 32.720% 45.650% ####### ( 3, 4 ] 127735 14.521% 60.171% ### ( 4, 6 ] 219541 24.958% 85.129% ##### ( 6, 10 ] 105294 11.970% 97.100% ## ( 10, 15 ] 18668 2.122% 99.222% ( 15, 22 ] 4868 0.553% 99.775% ( 22, 34 ] 1021 0.116% 99.891% ( 34, 51 ] 115 0.013% 99.905% ( 51, 76 ] 47 0.005% 99.910% ( 76, 110 ] 299 0.034% 99.944% ( 110, 170 ] 842 0.096% 100.040% ( 170, 250 ] 554 0.063% 100.103% ( 250, 380 ] 473 0.054% 100.156% ( 380, 580 ] 419 0.048% 100.204% ( 580, 870 ] 255 0.029% 100.233% ( 870, 1300 ] 147 0.017% 100.250% ( 1300, 1900 ] 69 0.008% 100.257% ( 1900, 2900 ] 96 0.011% 100.268% ( 2900, 4400 ] 276 0.031% 100.300% ( 4400, 6600 ] 72 0.008% 100.308% ( 6600, 9900 ] 28 0.003% 100.311% ( 9900, 14000 ] 7 0.001% 100.312% ( 22000, 33000 ] 2 0.000% 100.312% ( 33000, 50000 ] 1 0.000% 100.312% ( 110000, 170000 ] 1 0.000% 100.312% ** Level 4 read latency histogram (micros): Count: 11185 Average: 14.6439 StdDev: 182.25 Min: 1 Median: 2.8181 Max: 8811 Percentiles: P50: 2.82 P75: 4.49 P99: 38.87 P99.9: 3420.23 P99.99: 6513.10 ------------------------------------------------------ [ 0, 1 ] 55 0.492% 0.492% ( 1, 2 ] 2473 22.110% 22.602% #### ( 2, 3 ] 3746 33.491% 56.093% ####### ( 3, 4 ] 1561 13.956% 70.049% ### ( 4, 6 ] 2241 20.036% 90.085% #### ( 6, 10 ] 815 7.287% 97.371% # ( 10, 15 ] 135 1.207% 98.578% ( 15, 22 ] 26 0.232% 98.811% ( 22, 34 ] 18 0.161% 98.972% ( 34, 51 ] 11 0.098% 99.070% ( 51, 76 ] 10 0.089% 99.160% ( 76, 110 ] 1 0.009% 99.169% ( 110, 170 ] 6 0.054% 99.222% ( 170, 250 ] 5 0.045% 99.267% ( 250, 380 ] 27 0.241% 99.508% ( 380, 580 ] 11 0.098% 99.607% ( 580, 870 ] 7 0.063% 99.669% ( 870, 1300 ] 10 0.089% 99.759% ( 1300, 1900 ] 4 0.036% 99.794% ( 1900, 2900 ] 8 0.072% 99.866% ( 2900, 4400 ] 11 0.098% 99.964% ( 4400, 6600 ] 3 0.027% 99.991% ( 6600, 9900 ] 1 0.009% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 876.3062 StdDev: 1099.66 Min: 89 Median: 250.0000 Max: 4795 Percentiles: P50: 250.00 P75: 1350.00 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 21 13.125% 13.125% ### ( 110, 170 ] 43 26.875% 40.000% ##### ( 170, 250 ] 16 10.000% 50.000% ## ( 250, 380 ] 5 3.125% 53.125% # ( 380, 580 ] 14 8.750% 61.875% ## ( 580, 870 ] 11 6.875% 68.750% # ( 870, 1300 ] 9 5.625% 74.375% # ( 1300, 1900 ] 12 7.500% 81.875% ## ( 1900, 2900 ] 13 8.125% 90.000% ## ( 2900, 4400 ] 14 8.750% 98.750% ## ( 4400, 6600 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 58.8 total, 8.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 117.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.269 H:M:S, 0.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 118.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 8.329 micros/op 120058 ops/sec 60.004 seconds 7203999 operations; 116.3 MB/s Microseconds per write: Count: 7203999 Average: 8.3293 StdDev: 77.33 Min: 1 Median: 5.8131 Max: 161665 Percentiles: P50: 5.81 P75: 9.90 P99: 21.39 P99.9: 252.58 P99.99: 458.20 ------------------------------------------------------ [ 0, 1 ] 321 0.004% 0.004% ( 1, 2 ] 42975 0.597% 0.601% ( 2, 3 ] 93937 1.304% 1.905% ( 3, 4 ] 165813 2.302% 4.207% ( 4, 6 ] 3638945 50.513% 54.719% ########## ( 6, 10 ] 1497134 20.782% 75.501% #### ( 10, 15 ] 1468214 20.381% 95.882% #### ( 15, 22 ] 246076 3.416% 99.298% # ( 22, 34 ] 36531 0.507% 99.805% ( 34, 51 ] 5402 0.075% 99.880% ( 51, 76 ] 729 0.010% 99.890% ( 76, 110 ] 233 0.003% 99.893% ( 110, 170 ] 79 0.001% 99.894% ( 170, 250 ] 280 0.004% 99.898% ( 250, 380 ] 6357 0.088% 99.986% ( 380, 580 ] 646 0.009% 99.995% ( 580, 870 ] 108 0.001% 99.997% ( 870, 1300 ] 17 0.000% 99.997% ( 1300, 1900 ] 12 0.000% 99.997% ( 1900, 2900 ] 28 0.000% 99.998% ( 2900, 4400 ] 144 0.002% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 66259 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 7203999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7434526968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 460 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 268577 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19531643749 rocksdb.compact.write.bytes COUNT : 19469055090 rocksdb.flush.write.bytes COUNT : 7332811259 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 217 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7273272320 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2477056 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19600124700 rocksdb.non.last.level.read.count COUNT : 4733687 rocksdb.block.checksum.compute.count COUNT : 4732809 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 4.757668 P95 : 13.609663 P99 : 19.440425 P100 : 161662.000000 COUNT : 7203999 SUM : 49423896 rocksdb.compaction.times.micros P50 : 1355555.555556 P95 : 5565000.000000 P99 : 10584700.000000 P100 : 10584700.000000 COUNT : 74 SUM : 126399045 rocksdb.compaction.times.cpu_micros P50 : 847391.304348 P95 : 5565000.000000 P99 : 10200768.000000 P100 : 10200768.000000 COUNT : 74 SUM : 110131558 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 727.164179 P95 : 1287.352941 P99 : 8085.000000 P100 : 9041.000000 COUNT : 110 SUM : 97818 rocksdb.compaction.outfile.sync.micros P50 : 910.566038 P95 : 6002.857143 P99 : 17786.666667 P100 : 20478.000000 COUNT : 316 SUM : 512346 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 148.877551 P95 : 670.625000 P99 : 4175.000000 P100 : 6222.000000 COUNT : 215 SUM : 62461 rocksdb.table.open.io.micros P50 : 1225.000000 P95 : 6600.000000 P99 : 13180.000000 P100 : 25910.000000 COUNT : 460 SUM : 929950 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.599819 P95 : 11.945340 P99 : 18.937973 P100 : 157258.000000 COUNT : 4731618 SUM : 38079262 rocksdb.read.block.get.micros P50 : 426.979866 P95 : 3191.666667 P99 : 5625.714286 P100 : 25047.000000 COUNT : 920 SUM : 724716 rocksdb.write.raw.block.micros P50 : 0.707282 P95 : 2.004850 P99 : 7.891239 P100 : 32027.000000 COUNT : 6505594 SUM : 20786456 rocksdb.numfiles.in.singlecompaction P50 : 3.075472 P95 : 8.100000 P99 : 20.740000 P100 : 24.000000 COUNT : 118 SUM : 430 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 110000.000000 P95 : 161267.000000 P99 : 161267.000000 P100 : 161267.000000 COUNT : 2 SUM : 268577 rocksdb.sst.read.micros P50 : 2.712721 P95 : 7.697409 P99 : 12.159627 P100 : 157246.000000 COUNT : 4734088 SUM : 22753484 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 7203999 SUM : 7434526968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 250000.000000 P95 : 541500.000000 P99 : 698919.000000 P100 : 698919.000000 COUNT : 110 SUM : 33440334 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 274 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0