[2024-07-21 08:13:23.463795] Starting SPDK v24.09-pre git sha1 89fd17309 / DPDK 22.11.4 initialization... [2024-07-21 08:13:23.463941] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid434055 ] Set seed to 1721542403460439 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-21 08:13:23.549515] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-21 08:13:23.589497] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-21 08:13:23.589545] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 434055' to capture a snapshot of events at runtime. [2024-07-21 08:13:23.589557] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-21 08:13:23.589567] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-21 08:13:23.589575] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid434055 for offline analysis/debug. [2024-07-21 08:13:23.589658] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 21 08:13:27 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/21-08:13:30 ... thread 0: (1000000,1000000) ops and (338168.5,338168.5) ops/second in (2.957106,2.957106) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.97 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 341.1 2.59 2.32 12 0.215 0 0 0.0 0.0 L1 4/0 251.75 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.7 248.5 1.01 0.98 1 1.013 255K 240 0.0 0.0 L2 1/0 1.91 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 21/0 1.15 GB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 229.7 229.8 0.81 0.74 1 0.814 189K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/4 97.00 GB 0.0 0.6 0.6 0.1 1.5 1.4 0.4 1.7 121.6 292.3 5.16 4.75 15 0.344 637K 335 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.6 0.1 1.5 1.4 0.2 1.7 121.6 292.3 5.16 4.75 15 0.344 637K 335 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.6 0.1 0.6 0.6 0.0 0.0 243.5 243.4 2.58 2.44 3 0.859 637K 335 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 341.1 2.59 2.32 12 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.47 GB write, 483.94 MB/s write, 0.61 GB read, 201.31 MB/s read, 5.2 seconds Interval compaction: 1.47 GB write, 510.25 MB/s write, 0.61 GB read, 212.25 MB/s read, 5.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 140627 Average: 1.9729 StdDev: 17.75 Min: 1 Median: 1.3021 Max: 3386 Percentiles: P50: 1.30 P75: 1.72 P99: 5.00 P99.9: 9.96 P99.99: 142.91 ------------------------------------------------------ [ 0, 1 ] 44885 31.918% 31.918% ###### ( 1, 2 ] 84179 59.860% 91.778% ############ ( 2, 3 ] 6798 4.834% 96.612% # ( 3, 4 ] 2618 1.862% 98.473% ( 4, 6 ] 1492 1.061% 99.534% ( 6, 10 ] 523 0.372% 99.906% ( 10, 15 ] 95 0.068% 99.974% ( 15, 22 ] 16 0.011% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 2 0.001% 99.987% ( 51, 76 ] 2 0.001% 99.989% ( 110, 170 ] 9 0.006% 99.995% ( 170, 250 ] 2 0.001% 99.996% ( 250, 380 ] 3 0.002% 99.999% ( 380, 580 ] 4 0.003% 100.001% ( 870, 1300 ] 1 0.001% 100.002% ( 1900, 2900 ] 2 0.001% 100.004% ( 2900, 4400 ] 3 0.002% 100.006% ** Level 1 read latency histogram (micros): Count: 20 Average: 250.6000 StdDev: 575.59 Min: 1 Median: 1.8000 Max: 2368 Percentiles: P50: 1.80 P75: 170.00 P99: 2368.00 P99.9: 2368.00 P99.99: 2368.00 ------------------------------------------------------ [ 0, 1 ] 6 30.000% 30.000% ###### ( 1, 2 ] 5 25.000% 55.000% ##### ( 2, 3 ] 2 10.000% 65.000% ## ( 3, 4 ] 1 5.000% 70.000% # ( 110, 170 ] 1 5.000% 75.000% # ( 170, 250 ] 1 5.000% 80.000% # ( 250, 380 ] 1 5.000% 85.000% # ( 380, 580 ] 1 5.000% 90.000% # ( 1300, 1900 ] 1 5.000% 95.000% # ( 1900, 2900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 47480 Average: 2.2578 StdDev: 19.07 Min: 1 Median: 1.4809 Max: 3044 Percentiles: P50: 1.48 P75: 1.85 P99: 5.55 P99.9: 10.22 P99.99: 430.40 ------------------------------------------------------ [ 0, 1 ] 8081 17.020% 17.020% ### ( 1, 2 ] 32563 68.583% 85.602% ############## ( 2, 3 ] 4212 8.871% 94.473% ## ( 3, 4 ] 1480 3.117% 97.591% # ( 4, 6 ] 863 1.818% 99.408% ( 6, 10 ] 232 0.489% 99.897% ( 10, 15 ] 34 0.072% 99.968% ( 15, 22 ] 5 0.011% 99.979% ( 22, 34 ] 1 0.002% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 250, 380 ] 3 0.006% 99.989% ( 380, 580 ] 1 0.002% 99.992% ( 580, 870 ] 2 0.004% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 100 Average: 894.9900 StdDev: 1163.26 Min: 1 Median: 315.0000 Max: 4440 Percentiles: P50: 315.00 P75: 1572.73 P99: 4400.00 P99.9: 4440.00 P99.99: 4440.00 ------------------------------------------------------ [ 0, 1 ] 21 21.000% 21.000% #### ( 1, 2 ] 14 14.000% 35.000% ### ( 4, 6 ] 1 1.000% 36.000% ( 6, 10 ] 5 5.000% 41.000% # ( 15, 22 ] 1 1.000% 42.000% ( 51, 76 ] 2 2.000% 44.000% ( 76, 110 ] 1 1.000% 45.000% ( 110, 170 ] 3 3.000% 48.000% # ( 170, 250 ] 1 1.000% 49.000% ( 250, 380 ] 2 2.000% 51.000% ( 380, 580 ] 5 5.000% 56.000% # ( 580, 870 ] 8 8.000% 64.000% ## ( 870, 1300 ] 6 6.000% 70.000% # ( 1300, 1900 ] 11 11.000% 81.000% ## ( 1900, 2900 ] 9 9.000% 90.000% ## ( 2900, 4400 ] 9 9.000% 99.000% ## ( 4400, 6600 ] 1 1.000% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 1852.8500 StdDev: 1229.09 Min: 418 Median: 1500.0000 Max: 4738 Percentiles: P50: 1500.00 P75: 2900.00 P99: 4738.00 P99.9: 4738.00 P99.99: 4738.00 ------------------------------------------------------ ( 380, 580 ] 1 5.000% 5.000% # ( 580, 870 ] 6 30.000% 35.000% ###### ( 870, 1300 ] 2 10.000% 45.000% ## ( 1300, 1900 ] 3 15.000% 60.000% ### ( 1900, 2900 ] 3 15.000% 75.000% ### ( 2900, 4400 ] 4 20.000% 95.000% #### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.412 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/21-08:13:33 ... thread 0: (1000000,2000000) ops and (335478.2,336817.9) ops/second in (2.980820,5.937926) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 1.35 GB 6.3 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.3 326.2 7.34 6.73 27 0.272 575K 633 0.0 0.0 L1 1/1 2.57 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.7 248.5 1.01 0.98 1 1.013 255K 240 0.0 0.0 L2 2/1 79.25 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 17/8 868.73 MB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 229.7 229.8 0.81 0.74 1 0.814 189K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.8 132.8 1.27 0.87 1 1.267 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/22 97.92 GB 0.0 1.3 0.7 0.6 3.1 2.5 1.4 1.7 121.9 285.2 11.18 10.04 31 0.361 1384K 968 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.1 2.5 1.3 1.7 121.9 285.2 11.18 10.04 31 0.361 1384K 968 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 228.4 228.2 5.97 5.39 6 0.995 1384K 968 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.4 5.21 4.64 25 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.11 GB write, 522.78 MB/s write, 1.33 GB read, 223.46 MB/s read, 11.2 seconds Interval compaction: 3.11 GB write, 536.94 MB/s write, 1.33 GB read, 229.51 MB/s read, 11.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 349056 Average: 2.1533 StdDev: 14.91 Min: 1 Median: 1.4411 Max: 3386 Percentiles: P50: 1.44 P75: 1.83 P99: 5.52 P99.9: 9.94 P99.99: 18.41 ------------------------------------------------------ [ 0, 1 ] 76165 21.820% 21.820% #### ( 1, 2 ] 222991 63.884% 85.704% ############# ( 2, 3 ] 29918 8.571% 94.275% ## ( 3, 4 ] 11531 3.303% 97.579% # ( 4, 6 ] 6511 1.865% 99.444% ( 6, 10 ] 1618 0.464% 99.908% ( 10, 15 ] 274 0.078% 99.986% ( 15, 22 ] 33 0.009% 99.996% ( 22, 34 ] 2 0.001% 99.996% ( 34, 51 ] 3 0.001% 99.997% ( 51, 76 ] 8 0.002% 99.999% ( 110, 170 ] 15 0.004% 100.004% ( 170, 250 ] 6 0.002% 100.005% ( 250, 380 ] 7 0.002% 100.007% ( 380, 580 ] 5 0.001% 100.009% ( 580, 870 ] 5 0.001% 100.010% ( 870, 1300 ] 5 0.001% 100.012% ( 1300, 1900 ] 3 0.001% 100.013% ( 1900, 2900 ] 4 0.001% 100.014% ( 2900, 4400 ] 4 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 21 Average: 238.9048 StdDev: 564.15 Min: 1 Median: 1.9000 Max: 2368 Percentiles: P50: 1.90 P75: 155.00 P99: 2368.00 P99.9: 2368.00 P99.99: 2368.00 ------------------------------------------------------ [ 0, 1 ] 6 28.571% 28.571% ###### ( 1, 2 ] 5 23.810% 52.381% ##### ( 2, 3 ] 2 9.524% 61.905% ## ( 3, 4 ] 1 4.762% 66.667% # ( 4, 6 ] 1 4.762% 71.429% # ( 110, 170 ] 1 4.762% 76.190% # ( 170, 250 ] 1 4.762% 80.952% # ( 250, 380 ] 1 4.762% 85.714% # ( 380, 580 ] 1 4.762% 90.476% # ( 1300, 1900 ] 1 4.762% 95.238% # ( 1900, 2900 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 54756 Average: 2.5660 StdDev: 24.02 Min: 1 Median: 1.5018 Max: 3233 Percentiles: P50: 1.50 P75: 1.87 P99: 5.92 P99.9: 113.11 P99.99: 727.36 ------------------------------------------------------ [ 0, 1 ] 8636 15.772% 15.772% ### ( 1, 2 ] 37353 68.217% 83.989% ############## ( 2, 3 ] 5313 9.703% 93.692% ## ( 3, 4 ] 1861 3.399% 97.091% # ( 4, 6 ] 1090 1.991% 99.081% ( 6, 10 ] 372 0.679% 99.761% ( 10, 15 ] 52 0.095% 99.856% ( 15, 22 ] 6 0.011% 99.867% ( 22, 34 ] 1 0.002% 99.869% ( 76, 110 ] 17 0.031% 99.900% ( 110, 170 ] 24 0.044% 99.943% ( 170, 250 ] 8 0.015% 99.958% ( 250, 380 ] 12 0.022% 99.980% ( 380, 580 ] 5 0.009% 99.989% ( 580, 870 ] 3 0.005% 99.995% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 186660 Average: 3.3429 StdDev: 36.37 Min: 1 Median: 1.6183 Max: 4440 Percentiles: P50: 1.62 P75: 2.08 P99: 8.63 P99.9: 159.43 P99.99: 455.44 ------------------------------------------------------ [ 0, 1 ] 21526 11.532% 11.532% ## ( 1, 2 ] 116128 62.214% 73.746% ############ ( 2, 3 ] 30916 16.563% 90.309% ### ( 3, 4 ] 7865 4.214% 94.522% # ( 4, 6 ] 6454 3.458% 97.980% # ( 6, 10 ] 2899 1.553% 99.533% ( 10, 15 ] 309 0.166% 99.698% ( 15, 22 ] 79 0.042% 99.741% ( 22, 34 ] 22 0.012% 99.752% ( 34, 51 ] 3 0.002% 99.754% ( 51, 76 ] 4 0.002% 99.756% ( 76, 110 ] 125 0.067% 99.823% ( 110, 170 ] 174 0.093% 99.916% ( 170, 250 ] 71 0.038% 99.954% ( 250, 380 ] 52 0.028% 99.982% ( 380, 580 ] 38 0.020% 100.003% ( 580, 870 ] 19 0.010% 100.013% ( 870, 1300 ] 14 0.008% 100.020% ( 1300, 1900 ] 11 0.006% 100.026% ( 1900, 2900 ] 9 0.005% 100.031% ( 2900, 4400 ] 9 0.005% 100.036% ( 4400, 6600 ] 1 0.001% 100.036% ** Level 4 read latency histogram (micros): Count: 305 Average: 128.2131 StdDev: 555.43 Min: 0 Median: 1.6227 Max: 4738 Percentiles: P50: 1.62 P75: 5.93 P99: 3631.25 P99.9: 4738.00 P99.99: 4738.00 ------------------------------------------------------ [ 0, 1 ] 84 27.541% 27.541% ###### ( 1, 2 ] 110 36.066% 63.607% ####### ( 2, 3 ] 24 7.869% 71.475% ## ( 3, 4 ] 4 1.311% 72.787% ( 4, 6 ] 7 2.295% 75.082% ( 6, 10 ] 39 12.787% 87.869% ### ( 10, 15 ] 10 3.279% 91.148% # ( 51, 76 ] 1 0.328% 91.475% ( 110, 170 ] 3 0.984% 92.459% ( 170, 250 ] 2 0.656% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 6 1.967% 95.738% ( 870, 1300 ] 2 0.656% 96.393% ( 1300, 1900 ] 3 0.984% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 4 1.311% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 667.3500 StdDev: 867.68 Min: 79 Median: 293.3333 Max: 3517 Percentiles: P50: 293.33 P75: 1013.33 P99: 3517.00 P99.9: 3517.00 P99.99: 3517.00 ------------------------------------------------------ ( 76, 110 ] 8 40.000% 40.000% ######## ( 170, 250 ] 1 5.000% 45.000% # ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.806 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/21-08:13:36 ... thread 0: (1000000,3000000) ops and (334408.2,336010.9) ops/second in (2.990357,8.928283) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.34 GB 107.0 1.4 0.0 1.4 4.2 2.8 0.0 1.5 107.2 316.9 13.51 12.55 44 0.307 1471K 1601 0.0 0.0 L1 1/1 2.57 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.7 248.5 1.01 0.98 1 1.013 255K 240 0.0 0.0 L2 1/0 77.33 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 15/0 869.32 MB 0.9 0.8 0.2 0.7 0.8 0.2 0.3 4.6 228.5 228.2 3.79 3.54 2 1.897 880K 1344 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.8 132.8 1.27 0.87 1 1.267 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/13 98.90 GB 0.0 2.9 0.7 2.1 5.6 3.5 1.4 2.0 143.8 283.0 20.34 18.65 49 0.415 2970K 3280 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.7 2.1 5.6 3.5 1.3 2.0 143.8 283.0 20.34 18.65 49 0.415 2970K 3280 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.7 2.1 2.9 0.7 0.0 0.0 238.2 237.9 12.28 11.47 10 1.228 2970K 3280 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.9 8.06 7.18 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.62 GB write, 633.25 MB/s write, 2.86 GB read, 321.78 MB/s read, 20.3 seconds Interval compaction: 5.62 GB write, 644.65 MB/s write, 2.86 GB read, 327.57 MB/s read, 20.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 770517 Average: 2.2039 StdDev: 11.50 Min: 1 Median: 1.5009 Max: 3386 Percentiles: P50: 1.50 P75: 1.88 P99: 5.56 P99.9: 9.96 P99.99: 14.44 ------------------------------------------------------ [ 0, 1 ] 128263 16.646% 16.646% ### ( 1, 2 ] 513037 66.583% 83.230% ############# ( 2, 3 ] 81490 10.576% 93.806% ## ( 3, 4 ] 27619 3.584% 97.390% # ( 4, 6 ] 15911 2.065% 99.455% ( 6, 10 ] 3461 0.449% 99.904% ( 10, 15 ] 744 0.097% 100.001% ( 15, 22 ] 64 0.008% 100.009% ( 22, 34 ] 5 0.001% 100.010% ( 34, 51 ] 4 0.001% 100.011% ( 51, 76 ] 11 0.001% 100.012% ( 110, 170 ] 42 0.005% 100.017% ( 170, 250 ] 19 0.002% 100.020% ( 250, 380 ] 15 0.002% 100.022% ( 380, 580 ] 8 0.001% 100.023% ( 580, 870 ] 15 0.002% 100.025% ( 870, 1300 ] 10 0.001% 100.026% ( 1300, 1900 ] 4 0.001% 100.027% ( 1900, 2900 ] 4 0.001% 100.027% ( 2900, 4400 ] 5 0.001% 100.028% ** Level 1 read latency histogram (micros): Count: 21 Average: 238.9048 StdDev: 564.15 Min: 1 Median: 1.9000 Max: 2368 Percentiles: P50: 1.90 P75: 155.00 P99: 2368.00 P99.9: 2368.00 P99.99: 2368.00 ------------------------------------------------------ [ 0, 1 ] 6 28.571% 28.571% ###### ( 1, 2 ] 5 23.810% 52.381% ##### ( 2, 3 ] 2 9.524% 61.905% ## ( 3, 4 ] 1 4.762% 66.667% # ( 4, 6 ] 1 4.762% 71.429% # ( 110, 170 ] 1 4.762% 76.190% # ( 170, 250 ] 1 4.762% 80.952% # ( 250, 380 ] 1 4.762% 85.714% # ( 380, 580 ] 1 4.762% 90.476% # ( 1300, 1900 ] 1 4.762% 95.238% # ( 1900, 2900 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 186690 Average: 3.3950 StdDev: 37.28 Min: 1 Median: 1.6183 Max: 4440 Percentiles: P50: 1.62 P75: 2.08 P99: 8.64 P99.9: 163.25 P99.99: 493.17 ------------------------------------------------------ [ 0, 1 ] 21534 11.535% 11.535% ## ( 1, 2 ] 116137 62.208% 73.743% ############ ( 2, 3 ] 30917 16.561% 90.304% ### ( 3, 4 ] 7865 4.213% 94.517% # ( 4, 6 ] 6454 3.457% 97.974% # ( 6, 10 ] 2899 1.553% 99.526% ( 10, 15 ] 309 0.166% 99.692% ( 15, 22 ] 79 0.042% 99.734% ( 22, 34 ] 22 0.012% 99.746% ( 34, 51 ] 3 0.002% 99.748% ( 51, 76 ] 4 0.002% 99.750% ( 76, 110 ] 125 0.067% 99.817% ( 110, 170 ] 175 0.094% 99.911% ( 170, 250 ] 71 0.038% 99.949% ( 250, 380 ] 53 0.028% 99.977% ( 380, 580 ] 43 0.023% 100.000% ( 580, 870 ] 19 0.010% 100.010% ( 870, 1300 ] 16 0.009% 100.019% ( 1300, 1900 ] 13 0.007% 100.026% ( 1900, 2900 ] 10 0.005% 100.031% ( 2900, 4400 ] 9 0.005% 100.036% ( 4400, 6600 ] 1 0.001% 100.036% ** Level 4 read latency histogram (micros): Count: 305 Average: 128.2131 StdDev: 555.43 Min: 0 Median: 1.6227 Max: 4738 Percentiles: P50: 1.62 P75: 5.93 P99: 3631.25 P99.9: 4738.00 P99.99: 4738.00 ------------------------------------------------------ [ 0, 1 ] 84 27.541% 27.541% ###### ( 1, 2 ] 110 36.066% 63.607% ####### ( 2, 3 ] 24 7.869% 71.475% ## ( 3, 4 ] 4 1.311% 72.787% ( 4, 6 ] 7 2.295% 75.082% ( 6, 10 ] 39 12.787% 87.869% ### ( 10, 15 ] 10 3.279% 91.148% # ( 51, 76 ] 1 0.328% 91.475% ( 110, 170 ] 3 0.984% 92.459% ( 170, 250 ] 2 0.656% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 6 1.967% 95.738% ( 870, 1300 ] 2 0.656% 96.393% ( 1300, 1900 ] 3 0.984% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 4 1.311% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 667.3500 StdDev: 867.68 Min: 79 Median: 293.3333 Max: 3517 Percentiles: P50: 293.33 P75: 1013.33 P99: 3517.00 P99.9: 3517.00 P99.99: 3517.00 ------------------------------------------------------ ( 76, 110 ] 8 40.000% 40.000% ######## ( 170, 250 ] 1 5.000% 45.000% # ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.196 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.390 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/21-08:13:39 ... thread 0: (1000000,4000000) ops and (329455.1,334347.6) ops/second in (3.035315,11.963598) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.27 GB 31.5 2.2 0.0 2.2 5.9 3.7 0.0 1.6 117.3 312.7 19.33 18.00 60 0.322 2302K 2497 0.0 0.0 L1 6/6 493.40 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 232.4 231.5 5.43 5.24 2 2.715 1281K 4574 0.0 0.0 L2 4/4 511.94 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.8 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 15/1 946.60 MB 0.8 0.9 0.3 0.7 0.9 0.3 0.3 3.6 216.2 215.9 4.45 4.03 3 1.485 978K 1395 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.8 132.8 1.27 0.87 1 1.267 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/23 99.82 GB 0.0 4.7 1.8 3.0 8.4 5.5 1.9 2.3 155.3 276.0 31.23 28.85 67 0.466 4924K 8561 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 1.8 3.0 8.4 5.5 1.8 2.3 155.3 276.0 31.23 28.85 67 0.466 4924K 8561 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 1.8 3.0 4.7 1.8 0.0 0.0 236.7 236.3 20.49 19.28 15 1.366 4924K 8561 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.8 10.74 9.56 52 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.42 GB write, 710.95 MB/s write, 4.74 GB read, 399.97 MB/s read, 31.2 seconds Interval compaction: 8.42 GB write, 720.50 MB/s write, 4.74 GB read, 405.35 MB/s read, 31.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1077223 Average: 2.2717 StdDev: 11.29 Min: 1 Median: 1.5262 Max: 3386 Percentiles: P50: 1.53 P75: 1.90 P99: 5.67 P99.9: 10.82 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 159536 14.810% 14.810% ### ( 1, 2 ] 720453 66.881% 81.691% ############# ( 2, 3 ] 122692 11.390% 93.080% ## ( 3, 4 ] 42457 3.941% 97.022% # ( 4, 6 ] 25519 2.369% 99.390% ( 6, 10 ] 5297 0.492% 99.882% ( 10, 15 ] 1180 0.110% 99.992% ( 15, 22 ] 96 0.009% 100.001% ( 22, 34 ] 9 0.001% 100.001% ( 34, 51 ] 5 0.000% 100.002% ( 51, 76 ] 12 0.001% 100.003% ( 76, 110 ] 14 0.001% 100.004% ( 110, 170 ] 102 0.009% 100.014% ( 170, 250 ] 58 0.005% 100.019% ( 250, 380 ] 28 0.003% 100.022% ( 380, 580 ] 18 0.002% 100.023% ( 580, 870 ] 31 0.003% 100.026% ( 870, 1300 ] 16 0.001% 100.028% ( 1300, 1900 ] 5 0.000% 100.028% ( 1900, 2900 ] 6 0.001% 100.029% ( 2900, 4400 ] 5 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 177829 Average: 2.9733 StdDev: 16.73 Min: 1 Median: 1.6743 Max: 2368 Percentiles: P50: 1.67 P75: 2.23 P99: 8.22 P99.9: 140.11 P99.99: 502.68 ------------------------------------------------------ [ 0, 1 ] 11983 6.738% 6.738% # ( 1, 2 ] 114099 64.162% 70.901% ############# ( 2, 3 ] 31888 17.932% 88.833% #### ( 3, 4 ] 9233 5.192% 94.025% # ( 4, 6 ] 7694 4.327% 98.351% # ( 6, 10 ] 2085 1.172% 99.524% ( 10, 15 ] 512 0.288% 99.812% ( 15, 22 ] 54 0.030% 99.842% ( 22, 34 ] 3 0.002% 99.844% ( 34, 51 ] 3 0.002% 99.845% ( 51, 76 ] 4 0.002% 99.848% ( 76, 110 ] 47 0.026% 99.874% ( 110, 170 ] 94 0.053% 99.927% ( 170, 250 ] 50 0.028% 99.955% ( 250, 380 ] 35 0.020% 99.975% ( 380, 580 ] 46 0.026% 100.001% ( 580, 870 ] 21 0.012% 100.012% ( 870, 1300 ] 10 0.006% 100.018% ( 1300, 1900 ] 3 0.002% 100.020% ( 1900, 2900 ] 1 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 191484 Average: 3.9350 StdDev: 40.36 Min: 1 Median: 1.6266 Max: 4440 Percentiles: P50: 1.63 P75: 2.12 P99: 9.27 P99.9: 289.97 P99.99: 638.38 ------------------------------------------------------ [ 0, 1 ] 21666 11.315% 11.315% ## ( 1, 2 ] 118215 61.736% 73.051% ############ ( 2, 3 ] 32249 16.842% 89.893% ### ( 3, 4 ] 8248 4.307% 94.200% # ( 4, 6 ] 6739 3.519% 97.719% # ( 6, 10 ] 3002 1.568% 99.287% ( 10, 15 ] 335 0.175% 99.462% ( 15, 22 ] 83 0.043% 99.505% ( 22, 34 ] 22 0.011% 99.517% ( 34, 51 ] 3 0.002% 99.518% ( 51, 76 ] 5 0.003% 99.521% ( 76, 110 ] 246 0.128% 99.650% ( 110, 170 ] 299 0.156% 99.806% ( 170, 250 ] 151 0.079% 99.885% ( 250, 380 ] 96 0.050% 99.935% ( 380, 580 ] 98 0.051% 99.986% ( 580, 870 ] 39 0.020% 100.006% ( 870, 1300 ] 21 0.011% 100.017% ( 1300, 1900 ] 13 0.007% 100.024% ( 1900, 2900 ] 11 0.006% 100.030% ( 2900, 4400 ] 10 0.005% 100.035% ( 4400, 6600 ] 1 0.001% 100.036% ** Level 4 read latency histogram (micros): Count: 305 Average: 128.2131 StdDev: 555.43 Min: 0 Median: 1.6227 Max: 4738 Percentiles: P50: 1.62 P75: 5.93 P99: 3631.25 P99.9: 4738.00 P99.99: 4738.00 ------------------------------------------------------ [ 0, 1 ] 84 27.541% 27.541% ###### ( 1, 2 ] 110 36.066% 63.607% ####### ( 2, 3 ] 24 7.869% 71.475% ## ( 3, 4 ] 4 1.311% 72.787% ( 4, 6 ] 7 2.295% 75.082% ( 6, 10 ] 39 12.787% 87.869% ### ( 10, 15 ] 10 3.279% 91.148% # ( 51, 76 ] 1 0.328% 91.475% ( 110, 170 ] 3 0.984% 92.459% ( 170, 250 ] 2 0.656% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 6 1.967% 95.738% ( 870, 1300 ] 2 0.656% 96.393% ( 1300, 1900 ] 3 0.984% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 4 1.311% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 667.3500 StdDev: 867.68 Min: 79 Median: 293.3333 Max: 3517 Percentiles: P50: 293.33 P75: 1013.33 P99: 3517.00 P99.9: 3517.00 P99.99: 3517.00 ------------------------------------------------------ ( 76, 110 ] 8 40.000% 40.000% ######## ( 170, 250 ] 1 5.000% 45.000% # ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.599 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/21-08:13:42 ... thread 0: (1000000,5000000) ops and (318799.2,331117.7) ops/second in (3.136771,15.100369) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.26 GB 138.5 3.1 0.0 3.1 7.7 4.7 0.0 1.7 123.5 311.1 25.51 23.81 77 0.331 3198K 3486 0.0 0.0 L1 6/6 493.40 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 232.4 231.5 5.43 5.24 2 2.715 1281K 4574 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.8 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 21/0 942.13 MB 0.9 1.6 0.8 0.8 1.6 0.8 0.3 2.1 217.4 217.1 7.38 6.80 4 1.844 1628K 2658 0.0 0.0 L4 169/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 132.8 132.8 1.27 0.87 1 1.267 170K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/18 100.80 GB 0.0 6.2 2.3 3.9 10.9 6.9 3.1 2.3 158.0 276.4 40.33 37.44 85 0.474 6470K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 2.3 3.9 10.9 6.9 3.0 2.3 158.0 276.4 40.33 37.44 85 0.474 6470K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 2.3 3.9 6.2 2.3 0.0 0.0 238.2 237.7 26.76 25.35 19 1.408 6470K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.7 13.57 12.09 66 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.89 GB write, 730.48 MB/s write, 6.22 GB read, 417.53 MB/s read, 40.3 seconds Interval compaction: 10.89 GB write, 738.26 MB/s write, 6.22 GB read, 421.98 MB/s read, 40.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 20, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1494686 Average: 2.2865 StdDev: 11.23 Min: 1 Median: 1.5290 Max: 3538 Percentiles: P50: 1.53 P75: 1.90 P99: 5.68 P99.9: 10.97 P99.99: 17.36 ------------------------------------------------------ [ 0, 1 ] 212856 14.241% 14.241% ### ( 1, 2 ] 1010306 67.593% 81.834% ############## ( 2, 3 ] 169984 11.373% 93.207% ## ( 3, 4 ] 57677 3.859% 97.065% # ( 4, 6 ] 34330 2.297% 99.362% ( 6, 10 ] 7726 0.517% 99.879% ( 10, 15 ] 1610 0.108% 99.987% ( 15, 22 ] 141 0.009% 99.996% ( 22, 34 ] 11 0.001% 99.997% ( 34, 51 ] 8 0.001% 99.998% ( 51, 76 ] 16 0.001% 99.999% ( 76, 110 ] 80 0.005% 100.004% ( 110, 170 ] 156 0.010% 100.014% ( 170, 250 ] 86 0.006% 100.020% ( 250, 380 ] 52 0.003% 100.024% ( 380, 580 ] 41 0.003% 100.026% ( 580, 870 ] 46 0.003% 100.029% ( 870, 1300 ] 21 0.001% 100.031% ( 1300, 1900 ] 8 0.001% 100.031% ( 1900, 2900 ] 6 0.000% 100.032% ( 2900, 4400 ] 7 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 210069 Average: 2.9319 StdDev: 15.92 Min: 1 Median: 1.6612 Max: 2368 Percentiles: P50: 1.66 P75: 2.17 P99: 8.25 P99.9: 145.61 P99.99: 503.05 ------------------------------------------------------ [ 0, 1 ] 14905 7.095% 7.095% # ( 1, 2 ] 136320 64.893% 71.988% ############# ( 2, 3 ] 36367 17.312% 89.300% ### ( 3, 4 ] 10437 4.968% 94.269% # ( 4, 6 ] 8480 4.037% 98.305% # ( 6, 10 ] 2594 1.235% 99.540% ( 10, 15 ] 562 0.268% 99.808% ( 15, 22 ] 56 0.027% 99.834% ( 22, 34 ] 4 0.002% 99.836% ( 34, 51 ] 4 0.002% 99.838% ( 51, 76 ] 4 0.002% 99.840% ( 76, 110 ] 47 0.022% 99.862% ( 110, 170 ] 133 0.063% 99.926% ( 170, 250 ] 64 0.030% 99.956% ( 250, 380 ] 39 0.019% 99.975% ( 380, 580 ] 52 0.025% 100.000% ( 580, 870 ] 22 0.010% 100.010% ( 870, 1300 ] 10 0.005% 100.015% ( 1300, 1900 ] 3 0.001% 100.016% ( 1900, 2900 ] 1 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 191539 Average: 3.9758 StdDev: 40.63 Min: 1 Median: 1.6266 Max: 4440 Percentiles: P50: 1.63 P75: 2.12 P99: 9.30 P99.9: 302.60 P99.99: 666.64 ------------------------------------------------------ [ 0, 1 ] 21684 11.321% 11.321% ## ( 1, 2 ] 118229 61.726% 73.047% ############ ( 2, 3 ] 32250 16.837% 89.884% ### ( 3, 4 ] 8248 4.306% 94.190% # ( 4, 6 ] 6739 3.518% 97.709% # ( 6, 10 ] 3002 1.567% 99.276% ( 10, 15 ] 335 0.175% 99.451% ( 15, 22 ] 83 0.043% 99.494% ( 22, 34 ] 22 0.011% 99.506% ( 34, 51 ] 3 0.002% 99.507% ( 51, 76 ] 5 0.003% 99.510% ( 76, 110 ] 246 0.128% 99.638% ( 110, 170 ] 300 0.157% 99.795% ( 170, 250 ] 161 0.084% 99.879% ( 250, 380 ] 100 0.052% 99.931% ( 380, 580 ] 100 0.052% 99.983% ( 580, 870 ] 43 0.022% 100.006% ( 870, 1300 ] 22 0.011% 100.017% ( 1300, 1900 ] 13 0.007% 100.024% ( 1900, 2900 ] 11 0.006% 100.030% ( 2900, 4400 ] 10 0.005% 100.035% ( 4400, 6600 ] 1 0.001% 100.036% ** Level 4 read latency histogram (micros): Count: 305 Average: 128.2131 StdDev: 555.43 Min: 0 Median: 1.6227 Max: 4738 Percentiles: P50: 1.62 P75: 5.93 P99: 3631.25 P99.9: 4738.00 P99.99: 4738.00 ------------------------------------------------------ [ 0, 1 ] 84 27.541% 27.541% ###### ( 1, 2 ] 110 36.066% 63.607% ####### ( 2, 3 ] 24 7.869% 71.475% ## ( 3, 4 ] 4 1.311% 72.787% ( 4, 6 ] 7 2.295% 75.082% ( 6, 10 ] 39 12.787% 87.869% ### ( 10, 15 ] 10 3.279% 91.148% # ( 51, 76 ] 1 0.328% 91.475% ( 110, 170 ] 3 0.984% 92.459% ( 170, 250 ] 2 0.656% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 6 1.967% 95.738% ( 870, 1300 ] 2 0.656% 96.393% ( 1300, 1900 ] 3 0.984% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 4 1.311% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 791.6500 StdDev: 947.71 Min: 79 Median: 332.7273 Max: 3517 Percentiles: P50: 332.73 P75: 1128.00 P99: 3517.00 P99.9: 3517.00 P99.99: 3517.00 ------------------------------------------------------ ( 76, 110 ] 14 23.333% 23.333% ##### ( 110, 170 ] 6 10.000% 33.333% ## ( 170, 250 ] 3 5.000% 38.333% # ( 250, 380 ] 11 18.333% 56.667% #### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 2 3.333% 81.667% # ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 15.3 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.054 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.455 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/21-08:13:47 ... thread 0: (1000000,6000000) ops and (198265.1,297853.7) ops/second in (5.043751,20.144120) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.58 GB 182.5 4.4 0.0 4.4 10.0 5.7 0.0 1.8 134.6 308.8 33.24 31.13 98 0.339 4541K 4831 0.0 0.0 L1 11/0 1.28 GB 131.0 3.4 2.9 0.5 3.3 2.9 0.2 1.2 229.2 227.5 15.07 14.53 3 5.023 3507K 25K 0.0 0.0 L2 8/3 860.91 MB 5.2 0.2 0.1 0.1 0.2 0.1 1.6 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 21/6 942.13 MB 0.6 1.6 0.8 0.8 1.6 0.8 0.3 2.1 217.4 217.1 7.38 6.80 4 1.844 1628K 2658 0.0 0.0 L4 169/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 132.8 132.8 1.27 0.87 1 1.267 170K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/13 101.76 GB 0.0 9.7 3.9 5.7 15.3 9.6 3.9 2.7 171.4 271.2 57.70 54.05 107 0.539 10M 33K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.7 3.9 5.7 15.3 9.6 3.8 2.7 171.4 271.2 57.70 54.05 107 0.539 10M 33K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.7 3.9 5.7 9.6 3.9 0.0 0.0 239.6 238.8 41.27 39.43 25 1.651 10M 33K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.6 16.44 14.62 82 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.3 total, 20.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.28 GB write, 770.69 MB/s write, 9.66 GB read, 486.94 MB/s read, 57.7 seconds Interval compaction: 15.28 GB write, 776.84 MB/s write, 9.66 GB read, 490.83 MB/s read, 57.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 20, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1971179 Average: 2.2655 StdDev: 10.85 Min: 1 Median: 1.5178 Max: 3538 Percentiles: P50: 1.52 P75: 1.89 P99: 5.68 P99.9: 11.21 P99.99: 18.80 ------------------------------------------------------ [ 0, 1 ] 292491 14.838% 14.838% ### ( 1, 2 ] 1338435 67.900% 82.739% ############## ( 2, 3 ] 211888 10.749% 93.488% ## ( 3, 4 ] 73321 3.720% 97.208% # ( 4, 6 ] 41979 2.130% 99.337% ( 6, 10 ] 10557 0.536% 99.873% ( 10, 15 ] 2211 0.112% 99.985% ( 15, 22 ] 184 0.009% 99.994% ( 22, 34 ] 14 0.001% 99.995% ( 34, 51 ] 12 0.001% 99.996% ( 51, 76 ] 19 0.001% 99.997% ( 76, 110 ] 109 0.006% 100.002% ( 110, 170 ] 215 0.011% 100.013% ( 170, 250 ] 112 0.006% 100.019% ( 250, 380 ] 70 0.004% 100.022% ( 380, 580 ] 56 0.003% 100.025% ( 580, 870 ] 65 0.003% 100.028% ( 870, 1300 ] 25 0.001% 100.030% ( 1300, 1900 ] 9 0.000% 100.030% ( 1900, 2900 ] 7 0.000% 100.030% ( 2900, 4400 ] 8 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 339213 Average: 3.0320 StdDev: 19.06 Min: 1 Median: 1.6164 Max: 3120 Percentiles: P50: 1.62 P75: 2.00 P99: 8.43 P99.9: 181.55 P99.99: 555.42 ------------------------------------------------------ [ 0, 1 ] 32244 9.506% 9.506% ## ( 1, 2 ] 222857 65.698% 75.204% ############# ( 2, 3 ] 50349 14.843% 90.047% ### ( 3, 4 ] 15528 4.578% 94.624% # ( 4, 6 ] 12195 3.595% 98.219% # ( 6, 10 ] 4359 1.285% 99.504% ( 10, 15 ] 773 0.228% 99.732% ( 15, 22 ] 82 0.024% 99.756% ( 22, 34 ] 4 0.001% 99.758% ( 34, 51 ] 4 0.001% 99.759% ( 51, 76 ] 19 0.006% 99.764% ( 76, 110 ] 205 0.060% 99.825% ( 110, 170 ] 235 0.069% 99.894% ( 170, 250 ] 137 0.040% 99.935% ( 250, 380 ] 103 0.030% 99.965% ( 380, 580 ] 97 0.029% 99.994% ( 580, 870 ] 44 0.013% 100.006% ( 870, 1300 ] 19 0.006% 100.012% ( 1300, 1900 ] 9 0.003% 100.015% ( 1900, 2900 ] 2 0.001% 100.015% ( 2900, 4400 ] 1 0.000% 100.016% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 223299 Average: 4.0971 StdDev: 39.62 Min: 1 Median: 1.6476 Max: 4440 Percentiles: P50: 1.65 P75: 2.19 P99: 9.41 P99.9: 332.12 P99.99: 609.36 ------------------------------------------------------ [ 0, 1 ] 22733 10.181% 10.181% ## ( 1, 2 ] 137292 61.483% 71.664% ############ ( 2, 3 ] 38481 17.233% 88.897% ### ( 3, 4 ] 10620 4.756% 93.653% # ( 4, 6 ] 8787 3.935% 97.588% # ( 6, 10 ] 3700 1.657% 99.245% ( 10, 15 ] 440 0.197% 99.442% ( 15, 22 ] 110 0.049% 99.491% ( 22, 34 ] 24 0.011% 99.502% ( 34, 51 ] 3 0.001% 99.503% ( 51, 76 ] 6 0.003% 99.506% ( 76, 110 ] 249 0.112% 99.618% ( 110, 170 ] 333 0.149% 99.767% ( 170, 250 ] 209 0.094% 99.860% ( 250, 380 ] 142 0.064% 99.924% ( 380, 580 ] 143 0.064% 99.988% ( 580, 870 ] 56 0.025% 100.013% ( 870, 1300 ] 32 0.014% 100.027% ( 1300, 1900 ] 14 0.006% 100.034% ( 1900, 2900 ] 11 0.005% 100.039% ( 2900, 4400 ] 10 0.004% 100.043% ( 4400, 6600 ] 1 0.000% 100.043% ** Level 4 read latency histogram (micros): Count: 305 Average: 128.2131 StdDev: 555.43 Min: 0 Median: 1.6227 Max: 4738 Percentiles: P50: 1.62 P75: 5.93 P99: 3631.25 P99.9: 4738.00 P99.99: 4738.00 ------------------------------------------------------ [ 0, 1 ] 84 27.541% 27.541% ###### ( 1, 2 ] 110 36.066% 63.607% ####### ( 2, 3 ] 24 7.869% 71.475% ## ( 3, 4 ] 4 1.311% 72.787% ( 4, 6 ] 7 2.295% 75.082% ( 6, 10 ] 39 12.787% 87.869% ### ( 10, 15 ] 10 3.279% 91.148% # ( 51, 76 ] 1 0.328% 91.475% ( 110, 170 ] 3 0.984% 92.459% ( 170, 250 ] 2 0.656% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 6 1.967% 95.738% ( 870, 1300 ] 2 0.656% 96.393% ( 1300, 1900 ] 3 0.984% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 4 1.311% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 791.6500 StdDev: 947.71 Min: 79 Median: 332.7273 Max: 3517 Percentiles: P50: 332.73 P75: 1128.00 P99: 3517.00 P99.9: 3517.00 P99.99: 3517.00 ------------------------------------------------------ ( 76, 110 ] 14 23.333% 23.333% ##### ( 110, 170 ] 6 10.000% 33.333% ## ( 170, 250 ] 3 5.000% 38.333% # ( 250, 380 ] 11 18.333% 56.667% #### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 2 3.333% 81.667% # ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 20.3 total, 5.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 290.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.380 H:M:S, 21.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.326 H:M:S, 46.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/21-08:13:51 ... thread 0: (1000000,7000000) ops and (277439.8,294755.4) ops/second in (3.604386,23.748506) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/16 3.50 GB 0.0 5.7 0.0 5.7 12.3 6.6 0.0 1.9 138.8 298.2 42.22 39.08 114 0.370 5947K 7950 0.0 0.0 L1 11/11 1.28 GB 0.0 3.4 2.9 0.5 3.3 2.9 0.2 1.2 229.2 227.5 15.07 14.53 3 5.023 3507K 25K 0.0 0.0 L2 1/0 87.89 MB 0.9 0.2 0.1 0.1 0.2 0.1 1.6 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 30/5 1.18 GB 1.0 3.2 1.5 1.7 3.2 1.5 0.3 2.1 206.9 206.1 15.96 14.37 11 1.451 3355K 12K 0.0 0.0 L4 176/5 9.70 GB 1.0 0.6 0.6 0.0 0.6 0.6 0.8 1.0 133.8 133.7 4.93 3.15 11 0.448 666K 806 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/37 102.67 GB 0.0 13.1 5.1 8.0 19.7 11.7 4.3 3.0 170.6 255.4 78.92 71.85 140 0.564 13M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 5.1 8.0 19.7 11.7 4.2 3.0 170.6 255.4 78.92 71.85 140 0.564 13M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 5.1 8.0 13.1 5.1 0.0 0.0 227.0 226.2 59.30 54.74 45 1.318 13M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.5 19.62 17.11 95 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.9 total, 23.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.68 GB write, 843.00 MB/s write, 13.15 GB read, 563.10 MB/s read, 78.9 seconds Interval compaction: 19.68 GB write, 848.71 MB/s write, 13.15 GB read, 566.91 MB/s read, 78.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 34, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2324799 Average: 2.3925 StdDev: 14.95 Min: 1 Median: 1.5511 Max: 8018 Percentiles: P50: 1.55 P75: 1.93 P99: 5.85 P99.9: 12.20 P99.99: 99.82 ------------------------------------------------------ [ 0, 1 ] 309431 13.310% 13.310% ### ( 1, 2 ] 1547754 66.576% 79.886% ############# ( 2, 3 ] 277175 11.923% 91.808% ## ( 3, 4 ] 104893 4.512% 96.320% # ( 4, 6 ] 67406 2.899% 99.220% # ( 6, 10 ] 14527 0.625% 99.845% ( 10, 15 ] 2926 0.126% 99.970% ( 15, 22 ] 257 0.011% 99.982% ( 22, 34 ] 18 0.001% 99.982% ( 34, 51 ] 13 0.001% 99.983% ( 51, 76 ] 20 0.001% 99.984% ( 76, 110 ] 212 0.009% 99.993% ( 110, 170 ] 375 0.016% 100.009% ( 170, 250 ] 163 0.007% 100.016% ( 250, 380 ] 129 0.006% 100.022% ( 380, 580 ] 102 0.004% 100.026% ( 580, 870 ] 93 0.004% 100.030% ( 870, 1300 ] 36 0.002% 100.031% ( 1300, 1900 ] 12 0.001% 100.032% ( 1900, 2900 ] 11 0.000% 100.032% ( 2900, 4400 ] 12 0.001% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ( 6600, 9900 ] 2 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 504388 Average: 3.3387 StdDev: 31.89 Min: 1 Median: 1.6784 Max: 8014 Percentiles: P50: 1.68 P75: 2.29 P99: 8.75 P99.9: 171.12 P99.99: 540.23 ------------------------------------------------------ [ 0, 1 ] 38266 7.587% 7.587% ## ( 1, 2 ] 315348 62.521% 70.108% ############# ( 2, 3 ] 84866 16.826% 86.933% ### ( 3, 4 ] 30182 5.984% 92.917% # ( 4, 6 ] 25018 4.960% 97.877% # ( 6, 10 ] 8239 1.633% 99.510% ( 10, 15 ] 1286 0.255% 99.765% ( 15, 22 ] 148 0.029% 99.795% ( 22, 34 ] 7 0.001% 99.796% ( 34, 51 ] 4 0.001% 99.797% ( 51, 76 ] 19 0.004% 99.801% ( 76, 110 ] 223 0.044% 99.845% ( 110, 170 ] 275 0.055% 99.899% ( 170, 250 ] 187 0.037% 99.937% ( 250, 380 ] 159 0.032% 99.968% ( 380, 580 ] 138 0.027% 99.995% ( 580, 870 ] 84 0.017% 100.012% ( 870, 1300 ] 42 0.008% 100.020% ( 1300, 1900 ] 14 0.003% 100.023% ( 1900, 2900 ] 17 0.003% 100.027% ( 2900, 4400 ] 8 0.002% 100.028% ( 4400, 6600 ] 2 0.000% 100.029% ( 6600, 9900 ] 1 0.000% 100.029% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 596483 Average: 3.8256 StdDev: 37.23 Min: 0 Median: 1.8035 Max: 4440 Percentiles: P50: 1.80 P75: 2.67 P99: 8.83 P99.9: 130.55 P99.99: 224.52 ------------------------------------------------------ [ 0, 1 ] 31575 5.294% 5.294% # ( 1, 2 ] 331867 55.637% 60.931% ########### ( 2, 3 ] 124681 20.903% 81.834% #### ( 3, 4 ] 50198 8.416% 90.249% ## ( 4, 6 ] 44832 7.516% 97.765% ## ( 6, 10 ] 10409 1.745% 99.510% ( 10, 15 ] 1540 0.258% 99.768% ( 15, 22 ] 241 0.040% 99.809% ( 22, 34 ] 32 0.005% 99.814% ( 34, 51 ] 8 0.001% 99.816% ( 51, 76 ] 12 0.002% 99.818% ( 76, 110 ] 325 0.054% 99.872% ( 110, 170 ] 489 0.082% 99.954% ( 170, 250 ] 316 0.053% 100.007% ( 250, 380 ] 234 0.039% 100.046% ( 380, 580 ] 231 0.039% 100.085% ( 580, 870 ] 108 0.018% 100.103% ( 870, 1300 ] 64 0.011% 100.114% ( 1300, 1900 ] 18 0.003% 100.117% ( 1900, 2900 ] 18 0.003% 100.120% ( 2900, 4400 ] 32 0.005% 100.125% ( 4400, 6600 ] 1 0.000% 100.125% ** Level 4 read latency histogram (micros): Count: 11368 Average: 67.4416 StdDev: 298.88 Min: 0 Median: 2.0522 Max: 6286 Percentiles: P50: 2.05 P75: 3.41 P99: 1259.72 P99.9: 3768.44 P99.99: 4336.84 ------------------------------------------------------ [ 0, 1 ] 350 3.079% 3.079% # ( 1, 2 ] 5206 45.795% 48.874% ######### ( 2, 3 ] 2451 21.561% 70.435% #### ( 3, 4 ] 1280 11.260% 81.694% ## ( 4, 6 ] 736 6.474% 88.169% # ( 6, 10 ] 292 2.569% 90.737% # ( 10, 15 ] 39 0.343% 91.080% ( 15, 22 ] 7 0.062% 91.142% ( 51, 76 ] 1 0.009% 91.151% ( 76, 110 ] 13 0.114% 91.265% ( 110, 170 ] 65 0.572% 91.837% ( 170, 250 ] 100 0.880% 92.716% ( 250, 380 ] 138 1.214% 93.930% ( 380, 580 ] 234 2.058% 95.989% ( 580, 870 ] 239 2.102% 98.091% ( 870, 1300 ] 114 1.003% 99.094% ( 1300, 1900 ] 42 0.369% 99.463% ( 1900, 2900 ] 34 0.299% 99.762% ( 2900, 4400 ] 27 0.238% 100.000% ( 4400, 6600 ] 4 0.035% 100.035% ** Level 5 read latency histogram (micros): Count: 80 Average: 890.4500 StdDev: 1002.51 Min: 79 Median: 380.0000 Max: 3556 Percentiles: P50: 380.00 P75: 1300.00 P99: 3556.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 7 8.750% 26.250% ## ( 170, 250 ] 5 6.250% 32.500% # ( 250, 380 ] 14 17.500% 50.000% #### ( 380, 580 ] 11 13.750% 63.750% ### ( 580, 870 ] 3 3.750% 67.500% # ( 870, 1300 ] 6 7.500% 75.000% ## ( 1300, 1900 ] 3 3.750% 78.750% # ( 1900, 2900 ] 11 13.750% 92.500% ### ( 2900, 4400 ] 6 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 23.9 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 288.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.164 H:M:S, 21.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 273.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.783 H:M:S, 21.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/21-08:14:15 ... thread 0: (1000000,8000000) ops and (41674.6,167560.5) ops/second in (23.995451,47.743957) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/1 1.23 GB 37.8 7.3 0.0 7.3 14.9 7.6 0.0 2.0 140.6 285.8 53.29 47.76 131 0.407 7610K 11K 0.0 0.0 L1 7/7 751.08 MB 0.0 7.9 6.1 1.8 7.8 6.0 0.2 1.3 220.9 217.6 36.66 34.23 4 9.164 8223K 119K 0.0 0.0 L2 22/20 2.73 GB 2.6 0.2 0.1 0.1 0.2 0.1 5.4 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 33/14 1.72 GB 1.0 4.4 2.3 2.2 4.4 2.2 0.6 2.0 175.8 174.9 25.88 20.11 17 1.522 4621K 24K 0.0 0.0 L4 174/0 9.60 GB 1.0 1.2 1.1 0.1 1.2 1.1 0.8 1.0 134.5 134.2 9.06 5.77 19 0.477 1219K 1349 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/42 103.55 GB 0.0 21.0 9.7 11.4 28.5 17.1 9.0 3.8 171.5 231.9 125.64 108.59 172 0.730 21M 157K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.0 9.7 11.4 28.5 17.1 8.8 3.8 171.5 231.9 125.64 108.59 172 0.730 21M 157K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.0 9.7 11.4 20.9 9.5 0.0 0.0 212.1 210.5 101.61 88.85 64 1.588 21M 157K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 322.6 24.02 19.73 108 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.9 total, 47.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.46 GB write, 608.29 MB/s write, 21.05 GB read, 449.85 MB/s read, 125.6 seconds Interval compaction: 28.46 GB write, 610.34 MB/s write, 21.05 GB read, 451.37 MB/s read, 125.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 43, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3600971 Average: 2.8822 StdDev: 25.53 Min: 1 Median: 1.4994 Max: 8425 Percentiles: P50: 1.50 P75: 1.88 P99: 6.92 P99.9: 154.12 P99.99: 360.70 ------------------------------------------------------ [ 0, 1 ] 633586 17.595% 17.595% #### ( 1, 2 ] 2336590 64.888% 82.483% ############# ( 2, 3 ] 356720 9.906% 92.389% ## ( 3, 4 ] 137397 3.816% 96.204% # ( 4, 6 ] 95165 2.643% 98.847% # ( 6, 10 ] 23931 0.665% 99.512% ( 10, 15 ] 4685 0.130% 99.642% ( 15, 22 ] 702 0.019% 99.661% ( 22, 34 ] 37 0.001% 99.662% ( 34, 51 ] 89 0.002% 99.665% ( 51, 76 ] 167 0.005% 99.669% ( 76, 110 ] 4566 0.127% 99.796% ( 110, 170 ] 5079 0.141% 99.937% ( 170, 250 ] 1208 0.034% 99.971% ( 250, 380 ] 809 0.022% 99.993% ( 380, 580 ] 600 0.017% 100.010% ( 580, 870 ] 282 0.008% 100.018% ( 870, 1300 ] 86 0.002% 100.020% ( 1300, 1900 ] 39 0.001% 100.021% ( 1900, 2900 ] 62 0.002% 100.023% ( 2900, 4400 ] 54 0.001% 100.025% ( 4400, 6600 ] 9 0.000% 100.025% ( 6600, 9900 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1364742 Average: 5.6234 StdDev: 86.81 Min: 1 Median: 1.6938 Max: 11080 Percentiles: P50: 1.69 P75: 2.46 P99: 9.33 P99.9: 250.08 P99.99: 731.57 ------------------------------------------------------ [ 0, 1 ] 147430 10.803% 10.803% ## ( 1, 2 ] 771046 56.498% 67.300% ########### ( 2, 3 ] 226117 16.568% 83.869% ### ( 3, 4 ] 96947 7.104% 90.973% # ( 4, 6 ] 89322 6.545% 97.517% # ( 6, 10 ] 24279 1.779% 99.296% ( 10, 15 ] 4735 0.347% 99.643% ( 15, 22 ] 683 0.050% 99.693% ( 22, 34 ] 34 0.002% 99.696% ( 34, 51 ] 14 0.001% 99.697% ( 51, 76 ] 77 0.006% 99.703% ( 76, 110 ] 1129 0.083% 99.785% ( 110, 170 ] 1152 0.084% 99.870% ( 170, 250 ] 413 0.030% 99.900% ( 250, 380 ] 430 0.032% 99.932% ( 380, 580 ] 521 0.038% 99.970% ( 580, 870 ] 531 0.039% 100.009% ( 870, 1300 ] 386 0.028% 100.037% ( 1300, 1900 ] 228 0.017% 100.054% ( 1900, 2900 ] 303 0.022% 100.076% ( 2900, 4400 ] 288 0.021% 100.097% ( 4400, 6600 ] 82 0.006% 100.103% ( 6600, 9900 ] 18 0.001% 100.104% ( 9900, 14000 ] 2 0.000% 100.104% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 901121 Average: 5.1478 StdDev: 70.36 Min: 0 Median: 1.8529 Max: 8450 Percentiles: P50: 1.85 P75: 2.78 P99: 9.13 P99.9: 200.65 P99.99: 457.65 ------------------------------------------------------ [ 0, 1 ] 36010 3.996% 3.996% # ( 1, 2 ] 486023 53.935% 57.932% ########### ( 2, 3 ] 196983 21.860% 79.791% #### ( 3, 4 ] 83697 9.288% 89.079% ## ( 4, 6 ] 76239 8.460% 97.540% ## ( 6, 10 ] 16807 1.865% 99.405% ( 10, 15 ] 2987 0.331% 99.736% ( 15, 22 ] 379 0.042% 99.778% ( 22, 34 ] 40 0.004% 99.783% ( 34, 51 ] 13 0.001% 99.784% ( 51, 76 ] 20 0.002% 99.787% ( 76, 110 ] 332 0.037% 99.823% ( 110, 170 ] 537 0.060% 99.883% ( 170, 250 ] 399 0.044% 99.927% ( 250, 380 ] 389 0.043% 99.970% ( 380, 580 ] 453 0.050% 100.021% ( 580, 870 ] 342 0.038% 100.059% ( 870, 1300 ] 211 0.023% 100.082% ( 1300, 1900 ] 109 0.012% 100.094% ( 1900, 2900 ] 118 0.013% 100.107% ( 2900, 4400 ] 144 0.016% 100.123% ( 4400, 6600 ] 27 0.003% 100.126% ( 6600, 9900 ] 7 0.001% 100.127% ** Level 4 read latency histogram (micros): Count: 15656 Average: 84.0006 StdDev: 408.76 Min: 0 Median: 1.9982 Max: 10649 Percentiles: P50: 2.00 P75: 3.36 P99: 2034.59 P99.9: 4385.53 P99.99: 6247.23 ------------------------------------------------------ [ 0, 1 ] 494 3.155% 3.155% # ( 1, 2 ] 7347 46.928% 50.083% ######### ( 2, 3 ] 3269 20.880% 70.963% #### ( 3, 4 ] 1752 11.191% 82.154% ## ( 4, 6 ] 982 6.272% 88.426% # ( 6, 10 ] 394 2.517% 90.943% # ( 10, 15 ] 61 0.390% 91.332% ( 15, 22 ] 9 0.057% 91.390% ( 51, 76 ] 1 0.006% 91.396% ( 76, 110 ] 14 0.089% 91.486% ( 110, 170 ] 80 0.511% 91.997% ( 170, 250 ] 118 0.754% 92.750% ( 250, 380 ] 155 0.990% 93.740% ( 380, 580 ] 282 1.801% 95.542% ( 580, 870 ] 292 1.865% 97.407% ( 870, 1300 ] 167 1.067% 98.473% ( 1300, 1900 ] 71 0.454% 98.927% ( 1900, 2900 ] 85 0.543% 99.470% ( 2900, 4400 ] 68 0.434% 99.904% ( 4400, 6600 ] 16 0.102% 100.006% ( 6600, 9900 ] 1 0.006% 100.013% ( 9900, 14000 ] 3 0.019% 100.032% ** Level 5 read latency histogram (micros): Count: 120 Average: 1045.2667 StdDev: 1213.66 Min: 79 Median: 472.3077 Max: 5690 Percentiles: P50: 472.31 P75: 1600.00 P99: 5280.00 P99.9: 5690.00 P99.99: 5690.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 14 11.667% 23.333% ## ( 170, 250 ] 7 5.833% 29.167% # ( 250, 380 ] 19 15.833% 45.000% ### ( 380, 580 ] 13 10.833% 55.833% ## ( 580, 870 ] 10 8.333% 64.167% ## ( 870, 1300 ] 10 8.333% 72.500% ## ( 1300, 1900 ] 6 5.000% 77.500% # ( 1900, 2900 ] 14 11.667% 89.167% ## ( 2900, 4400 ] 11 9.167% 98.333% ## ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 47.9 total, 24.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 164.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.191 H:M:S, 54.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 41.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:21.027 H:M:S, 87.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/21-08:14:20 ... thread 0: (1000000,9000000) ops and (186977.9,169516.5) ops/second in (5.348225,53.092182) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/5 2.21 GB 106.9 8.1 0.0 8.1 16.7 8.5 0.0 1.9 133.4 273.7 62.33 53.79 145 0.430 8441K 12K 0.0 0.0 L1 7/7 751.08 MB 0.0 7.9 6.1 1.8 7.8 6.0 0.2 1.3 220.9 217.6 36.66 34.23 4 9.164 8223K 119K 0.0 0.0 L2 11/10 1.38 GB 1.3 0.2 0.1 0.1 0.2 0.1 5.4 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 22/3 1.15 GB 0.9 6.7 3.6 3.1 6.6 3.6 0.6 1.8 163.5 162.6 41.79 30.62 23 1.817 6941K 37K 0.0 0.0 L4 173/6 9.84 GB 1.0 3.2 3.0 0.2 3.2 3.0 0.9 1.1 127.9 127.6 25.78 15.43 41 0.629 3287K 3204 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/31 104.51 GB 0.0 26.1 12.9 13.2 34.5 21.3 10.6 4.0 159.8 211.0 167.31 134.78 214 0.782 27M 173K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.1 12.9 13.2 34.5 21.3 10.5 4.0 159.8 211.0 167.31 134.78 214 0.782 27M 173K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.1 12.9 13.2 25.9 12.7 0.0 0.0 193.5 192.2 138.17 112.34 94 1.470 27M 173K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 300.5 29.14 22.45 120 0.243 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.3 total, 53.1 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.48 GB write, 663.04 MB/s write, 26.10 GB read, 501.95 MB/s read, 167.3 seconds Interval compaction: 34.48 GB write, 665.05 MB/s write, 26.10 GB read, 503.47 MB/s read, 167.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 65, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4029976 Average: 3.1913 StdDev: 38.74 Min: 1 Median: 1.5340 Max: 8425 Percentiles: P50: 1.53 P75: 1.93 P99: 7.56 P99.9: 156.72 P99.99: 473.20 ------------------------------------------------------ [ 0, 1 ] 644764 15.999% 15.999% ### ( 1, 2 ] 2565885 63.670% 79.669% ############# ( 2, 3 ] 450112 11.169% 90.838% ## ( 3, 4 ] 181037 4.492% 95.331% # ( 4, 6 ] 135109 3.353% 98.683% # ( 6, 10 ] 32782 0.813% 99.497% ( 10, 15 ] 6496 0.161% 99.658% ( 15, 22 ] 888 0.022% 99.680% ( 22, 34 ] 41 0.001% 99.681% ( 34, 51 ] 98 0.002% 99.683% ( 51, 76 ] 169 0.004% 99.687% ( 76, 110 ] 4581 0.114% 99.801% ( 110, 170 ] 5118 0.127% 99.928% ( 170, 250 ] 1259 0.031% 99.959% ( 250, 380 ] 899 0.022% 99.982% ( 380, 580 ] 721 0.018% 100.000% ( 580, 870 ] 404 0.010% 100.010% ( 870, 1300 ] 168 0.004% 100.014% ( 1300, 1900 ] 105 0.003% 100.016% ( 1900, 2900 ] 157 0.004% 100.020% ( 2900, 4400 ] 163 0.004% 100.024% ( 4400, 6600 ] 52 0.001% 100.026% ( 6600, 9900 ] 12 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1787793 Average: 6.3022 StdDev: 97.14 Min: 1 Median: 1.7505 Max: 11080 Percentiles: P50: 1.75 P75: 2.61 P99: 9.48 P99.9: 408.90 P99.99: 997.21 ------------------------------------------------------ [ 0, 1 ] 152469 8.528% 8.528% ## ( 1, 2 ] 987888 55.257% 63.786% ########### ( 2, 3 ] 327664 18.328% 82.114% #### ( 3, 4 ] 141587 7.920% 90.033% ## ( 4, 6 ] 129583 7.248% 97.281% # ( 6, 10 ] 35317 1.975% 99.257% ( 10, 15 ] 6851 0.383% 99.640% ( 15, 22 ] 921 0.052% 99.692% ( 22, 34 ] 50 0.003% 99.694% ( 34, 51 ] 20 0.001% 99.696% ( 51, 76 ] 80 0.004% 99.700% ( 76, 110 ] 1151 0.064% 99.764% ( 110, 170 ] 1215 0.068% 99.832% ( 170, 250 ] 518 0.029% 99.861% ( 250, 380 ] 585 0.033% 99.894% ( 380, 580 ] 742 0.042% 99.936% ( 580, 870 ] 805 0.045% 99.981% ( 870, 1300 ] 572 0.032% 100.013% ( 1300, 1900 ] 366 0.020% 100.033% ( 1900, 2900 ] 495 0.028% 100.061% ( 2900, 4400 ] 493 0.028% 100.088% ( 4400, 6600 ] 133 0.007% 100.096% ( 6600, 9900 ] 31 0.002% 100.097% ( 9900, 14000 ] 2 0.000% 100.098% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1568574 Average: 5.9617 StdDev: 90.01 Min: 0 Median: 1.9102 Max: 11204 Percentiles: P50: 1.91 P75: 2.88 P99: 9.17 P99.9: 170.56 P99.99: 482.63 ------------------------------------------------------ [ 0, 1 ] 42673 2.720% 2.720% # ( 1, 2 ] 814769 51.943% 54.664% ########## ( 2, 3 ] 363312 23.162% 77.826% ##### ( 3, 4 ] 160136 10.209% 88.035% ## ( 4, 6 ] 147759 9.420% 97.455% ## ( 6, 10 ] 30539 1.947% 99.402% ( 10, 15 ] 6035 0.385% 99.786% ( 15, 22 ] 733 0.047% 99.833% ( 22, 34 ] 52 0.003% 99.836% ( 34, 51 ] 29 0.002% 99.838% ( 51, 76 ] 21 0.001% 99.840% ( 76, 110 ] 344 0.022% 99.862% ( 110, 170 ] 600 0.038% 99.900% ( 170, 250 ] 491 0.031% 99.931% ( 250, 380 ] 568 0.036% 99.967% ( 380, 580 ] 694 0.044% 100.012% ( 580, 870 ] 633 0.040% 100.052% ( 870, 1300 ] 426 0.027% 100.079% ( 1300, 1900 ] 266 0.017% 100.096% ( 1900, 2900 ] 336 0.021% 100.117% ( 2900, 4400 ] 368 0.023% 100.141% ( 4400, 6600 ] 96 0.006% 100.147% ( 6600, 9900 ] 25 0.002% 100.149% ( 9900, 14000 ] 2 0.000% 100.149% ** Level 4 read latency histogram (micros): Count: 51362 Average: 76.2380 StdDev: 404.04 Min: 0 Median: 1.9997 Max: 10649 Percentiles: P50: 2.00 P75: 3.26 P99: 2170.38 P99.9: 4776.52 P99.99: 6272.06 ------------------------------------------------------ [ 0, 1 ] 1201 2.338% 2.338% ( 1, 2 ] 24488 47.677% 50.016% ########## ( 2, 3 ] 11370 22.137% 72.153% #### ( 3, 4 ] 5672 11.043% 83.196% ## ( 4, 6 ] 3893 7.580% 90.775% ## ( 6, 10 ] 1189 2.315% 93.090% ( 10, 15 ] 204 0.397% 93.487% ( 15, 22 ] 26 0.051% 93.538% ( 22, 34 ] 4 0.008% 93.546% ( 51, 76 ] 1 0.002% 93.548% ( 76, 110 ] 32 0.062% 93.610% ( 110, 170 ] 161 0.313% 93.924% ( 170, 250 ] 240 0.467% 94.391% ( 250, 380 ] 323 0.629% 95.020% ( 380, 580 ] 564 1.098% 96.118% ( 580, 870 ] 655 1.275% 97.393% ( 870, 1300 ] 480 0.935% 98.328% ( 1300, 1900 ] 274 0.533% 98.861% ( 1900, 2900 ] 264 0.514% 99.375% ( 2900, 4400 ] 258 0.502% 99.877% ( 4400, 6600 ] 68 0.132% 100.010% ( 6600, 9900 ] 2 0.004% 100.014% ( 9900, 14000 ] 3 0.006% 100.019% ** Level 5 read latency histogram (micros): Count: 220 Average: 1197.0955 StdDev: 1284.48 Min: 79 Median: 643.0435 Max: 5835 Percentiles: P50: 643.04 P75: 1853.85 P99: 5793.33 P99.9: 5835.00 P99.99: 5835.00 ------------------------------------------------------ ( 76, 110 ] 14 6.364% 6.364% # ( 110, 170 ] 21 9.545% 15.909% ## ( 170, 250 ] 13 5.909% 21.818% # ( 250, 380 ] 31 14.091% 35.909% ### ( 380, 580 ] 26 11.818% 47.727% ## ( 580, 870 ] 23 10.455% 58.182% ## ( 870, 1300 ] 25 11.364% 69.545% ## ( 1300, 1900 ] 13 5.909% 75.455% # ( 1900, 2900 ] 25 11.364% 86.818% ## ( 2900, 4400 ] 23 10.455% 97.273% ## ( 4400, 6600 ] 6 2.727% 100.000% # ** DB Stats ** Uptime(secs): 53.3 total, 5.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 166.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.555 H:M:S, 53.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 184.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.364 H:M:S, 44.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/07/21-08:14:24 ... thread 0: (1000000,10000000) ops and (246510.1,174981.8) ops/second in (4.056629,57.148811) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.27 GB 201.3 9.0 0.0 9.0 18.5 9.5 0.0 2.0 132.4 271.0 69.91 60.02 160 0.437 9401K 14K 0.0 0.0 L1 16/0 1.24 GB 127.0 9.5 7.0 2.5 9.4 6.9 0.2 1.3 205.8 203.1 47.27 41.66 5 9.455 9289K 119K 0.0 0.0 L2 1/0 67.21 MB 0.7 0.2 0.1 0.1 0.2 0.1 5.7 1.5 251.5 251.3 0.75 0.72 1 0.751 191K 95 0.0 0.0 L3 17/1 1.07 GB 1.0 8.3 5.1 3.3 8.3 5.0 0.8 1.6 162.0 161.2 52.77 38.51 26 2.030 7635K 39K 0.0 0.0 L4 170/4 9.54 GB 1.0 5.0 4.7 0.3 5.0 4.7 0.9 1.1 131.4 131.1 39.08 24.09 60 0.651 5104K 6233 0.0 0.0 L5 1108/0 91.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/9 105.42 GB 0.0 32.1 16.9 15.2 41.4 26.2 13.3 4.4 156.6 201.9 209.79 165.00 252 0.832 31M 179K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.1 16.9 15.2 41.4 26.2 13.2 4.4 156.6 201.9 209.79 165.00 252 0.832 31M 179K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.1 16.9 15.2 31.9 16.7 0.0 0.0 185.6 184.5 177.03 140.06 120 1.475 31M 179K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 296.2 32.75 24.94 132 0.248 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.3 total, 57.2 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 41.37 GB write, 739.17 MB/s write, 32.09 GB read, 573.32 MB/s read, 209.8 seconds Interval compaction: 41.37 GB write, 741.25 MB/s write, 32.09 GB read, 574.93 MB/s read, 209.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 77, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 77, interval: 100 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4277037 Average: 3.1613 StdDev: 37.83 Min: 1 Median: 1.5424 Max: 8425 Percentiles: P50: 1.54 P75: 1.94 P99: 7.51 P99.9: 154.19 P99.99: 469.31 ------------------------------------------------------ [ 0, 1 ] 664200 15.529% 15.529% ### ( 1, 2 ] 2718129 63.552% 79.081% ############# ( 2, 3 ] 490986 11.480% 90.561% ## ( 3, 4 ] 198174 4.633% 95.194% # ( 4, 6 ] 149545 3.496% 98.691% # ( 6, 10 ] 35010 0.819% 99.509% ( 10, 15 ] 7086 0.166% 99.675% ( 15, 22 ] 958 0.022% 99.697% ( 22, 34 ] 44 0.001% 99.698% ( 34, 51 ] 101 0.002% 99.701% ( 51, 76 ] 170 0.004% 99.705% ( 76, 110 ] 4581 0.107% 99.812% ( 110, 170 ] 5127 0.120% 99.932% ( 170, 250 ] 1266 0.030% 99.961% ( 250, 380 ] 909 0.021% 99.982% ( 380, 580 ] 724 0.017% 99.999% ( 580, 870 ] 410 0.010% 100.009% ( 870, 1300 ] 175 0.004% 100.013% ( 1300, 1900 ] 109 0.003% 100.016% ( 1900, 2900 ] 162 0.004% 100.019% ( 2900, 4400 ] 165 0.004% 100.023% ( 4400, 6600 ] 52 0.001% 100.024% ( 6600, 9900 ] 12 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1975152 Average: 6.2415 StdDev: 96.23 Min: 1 Median: 1.7551 Max: 11080 Percentiles: P50: 1.76 P75: 2.61 P99: 9.48 P99.9: 422.84 P99.99: 1053.64 ------------------------------------------------------ [ 0, 1 ] 158445 8.022% 8.022% ## ( 1, 2 ] 1098059 55.594% 63.616% ########### ( 2, 3 ] 366829 18.572% 82.188% #### ( 3, 4 ] 155738 7.885% 90.073% ## ( 4, 6 ] 141949 7.187% 97.259% # ( 6, 10 ] 39569 2.003% 99.263% ( 10, 15 ] 7512 0.380% 99.643% ( 15, 22 ] 980 0.050% 99.693% ( 22, 34 ] 56 0.003% 99.695% ( 34, 51 ] 21 0.001% 99.697% ( 51, 76 ] 82 0.004% 99.701% ( 76, 110 ] 1207 0.061% 99.762% ( 110, 170 ] 1294 0.066% 99.827% ( 170, 250 ] 596 0.030% 99.857% ( 250, 380 ] 664 0.034% 99.891% ( 380, 580 ] 821 0.042% 99.933% ( 580, 870 ] 866 0.044% 99.977% ( 870, 1300 ] 624 0.032% 100.008% ( 1300, 1900 ] 394 0.020% 100.028% ( 1900, 2900 ] 527 0.027% 100.055% ( 2900, 4400 ] 544 0.028% 100.082% ( 4400, 6600 ] 138 0.007% 100.089% ( 6600, 9900 ] 35 0.002% 100.091% ( 9900, 14000 ] 2 0.000% 100.091% ** Level 2 read latency histogram (micros): Count: 76211 Average: 2.5189 StdDev: 20.37 Min: 1 Median: 1.5356 Max: 3233 Percentiles: P50: 1.54 P75: 1.90 P99: 6.98 P99.9: 20.97 P99.99: 555.16 ------------------------------------------------------ [ 0, 1 ] 10238 13.434% 13.434% ### ( 1, 2 ] 52033 68.275% 81.709% ############## ( 2, 3 ] 8251 10.827% 92.535% ## ( 3, 4 ] 3002 3.939% 96.474% # ( 4, 6 ] 1733 2.274% 98.748% ( 6, 10 ] 782 1.026% 99.774% ( 10, 15 ] 83 0.109% 99.883% ( 15, 22 ] 15 0.020% 99.903% ( 22, 34 ] 1 0.001% 99.904% ( 76, 110 ] 17 0.022% 99.927% ( 110, 170 ] 24 0.031% 99.958% ( 170, 250 ] 8 0.010% 99.969% ( 250, 380 ] 12 0.016% 99.984% ( 380, 580 ] 5 0.007% 99.991% ( 580, 870 ] 3 0.004% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1996173 Average: 6.5937 StdDev: 100.72 Min: 0 Median: 1.9234 Max: 11204 Percentiles: P50: 1.92 P75: 2.90 P99: 9.30 P99.9: 184.20 P99.99: 472.50 ------------------------------------------------------ [ 0, 1 ] 47866 2.398% 2.398% ( 1, 2 ] 1029054 51.551% 53.949% ########## ( 2, 3 ] 469245 23.507% 77.456% ##### ( 3, 4 ] 205633 10.301% 87.758% ## ( 4, 6 ] 190915 9.564% 97.322% ## ( 6, 10 ] 40563 2.032% 99.354% ( 10, 15 ] 8449 0.423% 99.777% ( 15, 22 ] 1004 0.050% 99.827% ( 22, 34 ] 61 0.003% 99.831% ( 34, 51 ] 39 0.002% 99.832% ( 51, 76 ] 24 0.001% 99.834% ( 76, 110 ] 404 0.020% 99.854% ( 110, 170 ] 800 0.040% 99.894% ( 170, 250 ] 675 0.034% 99.928% ( 250, 380 ] 790 0.040% 99.967% ( 380, 580 ] 976 0.049% 100.016% ( 580, 870 ] 878 0.044% 100.060% ( 870, 1300 ] 579 0.029% 100.089% ( 1300, 1900 ] 354 0.018% 100.107% ( 1900, 2900 ] 533 0.027% 100.134% ( 2900, 4400 ] 614 0.031% 100.164% ( 4400, 6600 ] 162 0.008% 100.173% ( 6600, 9900 ] 39 0.002% 100.175% ( 9900, 14000 ] 4 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 105088 Average: 47.5523 StdDev: 306.18 Min: 0 Median: 1.8873 Max: 10649 Percentiles: P50: 1.89 P75: 2.90 P99: 1277.98 P99.9: 4206.16 P99.99: 6109.20 ------------------------------------------------------ [ 0, 1 ] 3544 3.372% 3.372% # ( 1, 2 ] 55221 52.547% 55.920% ########### ( 2, 3 ] 22241 21.164% 77.084% #### ( 3, 4 ] 9549 9.087% 86.171% ## ( 4, 6 ] 7045 6.704% 92.875% # ( 6, 10 ] 2375 2.260% 95.135% ( 10, 15 ] 383 0.364% 95.499% ( 15, 22 ] 53 0.050% 95.549% ( 22, 34 ] 9 0.009% 95.558% ( 34, 51 ] 1 0.001% 95.559% ( 51, 76 ] 1 0.001% 95.560% ( 76, 110 ] 112 0.107% 95.666% ( 110, 170 ] 331 0.315% 95.981% ( 170, 250 ] 408 0.388% 96.370% ( 250, 380 ] 465 0.442% 96.812% ( 380, 580 ] 762 0.725% 97.537% ( 580, 870 ] 891 0.848% 98.385% ( 870, 1300 ] 681 0.648% 99.033% ( 1300, 1900 ] 366 0.348% 99.381% ( 1900, 2900 ] 295 0.281% 99.662% ( 2900, 4400 ] 287 0.273% 99.935% ( 4400, 6600 ] 74 0.070% 100.006% ( 6600, 9900 ] 3 0.003% 100.009% ( 9900, 14000 ] 3 0.003% 100.011% ** Level 5 read latency histogram (micros): Count: 340 Average: 1114.7706 StdDev: 1202.43 Min: 77 Median: 575.2381 Max: 5835 Percentiles: P50: 575.24 P75: 1709.09 P99: 5353.33 P99.9: 5835.00 P99.99: 5835.00 ------------------------------------------------------ ( 76, 110 ] 21 6.176% 6.176% # ( 110, 170 ] 38 11.176% 17.353% ## ( 170, 250 ] 27 7.941% 25.294% ## ( 250, 380 ] 43 12.647% 37.941% ### ( 380, 580 ] 42 12.353% 50.294% ## ( 580, 870 ] 34 10.000% 60.294% ## ( 870, 1300 ] 35 10.294% 70.588% ## ( 1300, 1900 ] 22 6.471% 77.059% # ( 1900, 2900 ] 39 11.471% 88.529% ## ( 2900, 4400 ] 33 9.706% 98.235% ## ( 4400, 6600 ] 6 1.765% 100.000% ** DB Stats ** Uptime(secs): 57.3 total, 4.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 171.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.909 H:M:S, 52.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 242.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.354 H:M:S, 33.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.470 micros/op 182809 ops/sec 60.002 seconds 10968999 operations; 177.1 MB/s Microseconds per write: Count: 10968999 Average: 5.4702 StdDev: 578.65 Min: 0 Median: 1.7467 Max: 776355 Percentiles: P50: 1.75 P75: 2.70 P99: 6.44 P99.9: 1040.31 P99.99: 2770.86 ------------------------------------------------------ [ 0, 1 ] 1419298 12.939% 12.939% ### ( 1, 2 ] 5444576 49.636% 62.575% ########## ( 2, 3 ] 1949116 17.769% 80.345% #### ( 3, 4 ] 1507910 13.747% 94.092% ### ( 4, 6 ] 530783 4.839% 98.930% # ( 6, 10 ] 69734 0.636% 99.566% ( 10, 15 ] 15154 0.138% 99.704% ( 15, 22 ] 6099 0.056% 99.760% ( 22, 34 ] 1840 0.017% 99.777% ( 34, 51 ] 186 0.002% 99.778% ( 51, 76 ] 22 0.000% 99.779% ( 76, 110 ] 7588 0.069% 99.848% ( 110, 170 ] 3110 0.028% 99.876% ( 170, 250 ] 327 0.003% 99.879% ( 250, 380 ] 70 0.001% 99.880% ( 380, 580 ] 29 0.000% 99.880% ( 580, 870 ] 46 0.000% 99.880% ( 870, 1300 ] 5408 0.049% 99.930% ( 1300, 1900 ] 25 0.000% 99.930% ( 1900, 2900 ] 7557 0.069% 99.999% ( 2900, 4400 ] 74 0.001% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 4 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 5 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 201701 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10968999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11320006968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 671 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30285413 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36023130272 rocksdb.compact.write.bytes COUNT : 35809984641 rocksdb.flush.write.bytes COUNT : 11163375971 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 76 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 426 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11073673216 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4580352 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36134070331 rocksdb.non.last.level.read.count COUNT : 8725666 rocksdb.block.checksum.compute.count COUNT : 8724400 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.387234 P95 : 3.759733 P99 : 5.804474 P100 : 776354.000000 COUNT : 10968999 SUM : 54887555 rocksdb.compaction.times.micros P50 : 987500.000000 P95 : 4212500.000000 P99 : 12950000.000000 P100 : 21586722.000000 COUNT : 125 SUM : 182770076 rocksdb.compaction.times.cpu_micros P50 : 739166.666667 P95 : 3512500.000000 P99 : 9387500.000000 P100 : 19698236.000000 COUNT : 125 SUM : 145610900 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 722.803030 P95 : 4025.000000 P99 : 42350.000000 P100 : 65882.000000 COUNT : 145 SUM : 278018 rocksdb.compaction.outfile.sync.micros P50 : 1185.840708 P95 : 78500.000000 P99 : 127400.000000 P100 : 210820.000000 COUNT : 442 SUM : 5203154 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 114.200000 P95 : 1266.772727 P99 : 2922.500000 P100 : 4420.000000 COUNT : 297 SUM : 86800 rocksdb.table.open.io.micros P50 : 1557.547170 P95 : 6777.222222 P99 : 10561.125000 P100 : 13711.000000 COUNT : 671 SUM : 1452846 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.735708 P95 : 8.270377 P99 : 12.585382 P100 : 11210.000000 COUNT : 8722463 SUM : 63665396 rocksdb.read.block.get.micros P50 : 500.863309 P95 : 3416.071429 P99 : 4374.642857 P100 : 5979.000000 COUNT : 1342 SUM : 1204939 rocksdb.write.raw.block.micros P50 : 0.514210 P95 : 0.976999 P99 : 2.885802 P100 : 13569.000000 COUNT : 11392694 SUM : 25526176 rocksdb.numfiles.in.singlecompaction P50 : 2.805556 P95 : 5.725000 P99 : 13.225000 P100 : 23.000000 COUNT : 171 SUM : 574 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565669 P95 : 2161.613676 P99 : 2756.579753 P100 : 776173.000000 COUNT : 111809 SUM : 30292080 rocksdb.sst.read.micros P50 : 1.664510 P95 : 4.976054 P99 : 9.122899 P100 : 11204.000000 COUNT : 8725879 SUM : 45340263 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10968999 SUM : 11320006968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218080.808081 P95 : 540312.500000 P99 : 933941.000000 P100 : 933941.000000 COUNT : 145 SUM : 35342684 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 430 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0