[2024-12-13 05:28:28.857114] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 22.11.4 initialization... [2024-12-13 05:28:28.857397] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid183110 ] Set seed to 1734064108850373 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 05:28:29.001920] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 05:28:29.029282] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 05:28:29.029323] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 183110' to capture a snapshot of events at runtime. [2024-12-13 05:28:29.029334] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-13 05:28:29.029345] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-13 05:28:29.029353] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid183110 for offline analysis/debug. [2024-12-13 05:28:29.029898] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 05:28:33 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/13-05:28:36 ... thread 0: (1000000,1000000) ops and (357707.4,357707.4) ops/second in (2.795581,2.795581) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 378.00 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 349.1 2.35 2.12 12 0.196 0 0 0.0 0.0 L1 4/0 251.74 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.0 243.7 1.03 0.99 1 1.033 255K 255 0.0 0.0 L2 3/2 188.88 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 251.0 250.9 0.75 0.73 1 0.753 191K 88 0.0 0.0 L3 9/0 741.37 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/6 96.94 GB 0.0 0.4 0.4 0.1 1.2 1.2 0.5 1.5 106.7 304.8 4.13 3.84 14 0.295 447K 343 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.2 1.2 0.5 1.5 106.7 304.8 4.13 3.84 14 0.295 447K 343 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 246.9 246.7 1.79 1.72 2 0.893 447K 343 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 349.1 2.35 2.12 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 412.20 MB/s write, 0.43 GB read, 144.31 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 450.28 MB/s write, 0.43 GB read, 157.64 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 141016 Average: 2.0035 StdDev: 16.76 Min: 0 Median: 1.3068 Max: 3281 Percentiles: P50: 1.31 P75: 1.74 P99: 5.36 P99.9: 9.72 P99.99: 19.82 ------------------------------------------------------ [ 0, 1 ] 45552 32.303% 32.303% ###### ( 1, 2 ] 81354 57.691% 89.994% ############ ( 2, 3 ] 7768 5.509% 95.503% # ( 3, 4 ] 3401 2.412% 97.914% ( 4, 6 ] 2255 1.599% 99.514% ( 6, 10 ] 586 0.416% 99.929% ( 10, 15 ] 68 0.048% 99.977% ( 15, 22 ] 26 0.018% 99.996% ( 22, 34 ] 1 0.001% 99.996% ( 34, 51 ] 1 0.001% 99.997% ( 51, 76 ] 1 0.001% 99.998% ( 110, 170 ] 4 0.003% 100.001% ( 170, 250 ] 8 0.006% 100.006% ( 250, 380 ] 4 0.003% 100.009% ( 870, 1300 ] 2 0.001% 100.011% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 3 0.002% 100.013% ( 2900, 4400 ] 2 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 25 Average: 376.2800 StdDev: 709.14 Min: 1 Median: 3.5000 Max: 2655 Percentiles: P50: 3.50 P75: 496.67 P99: 2655.00 P99.9: 2655.00 P99.99: 2655.00 ------------------------------------------------------ [ 0, 1 ] 4 16.000% 16.000% ### ( 1, 2 ] 8 32.000% 48.000% ###### ( 3, 4 ] 1 4.000% 52.000% # ( 6, 10 ] 1 4.000% 56.000% # ( 110, 170 ] 1 4.000% 60.000% # ( 170, 250 ] 1 4.000% 64.000% # ( 250, 380 ] 1 4.000% 68.000% # ( 380, 580 ] 3 12.000% 80.000% ## ( 580, 870 ] 3 12.000% 92.000% ## ( 1900, 2900 ] 2 8.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 28941 Average: 2.3255 StdDev: 5.53 Min: 1 Median: 1.5646 Max: 773 Percentiles: P50: 1.56 P75: 1.93 P99: 5.98 P99.9: 11.21 P99.99: 256.88 ------------------------------------------------------ [ 0, 1 ] 3374 11.658% 11.658% ## ( 1, 2 ] 19654 67.911% 79.569% ############## ( 2, 3 ] 3222 11.133% 90.702% ## ( 3, 4 ] 1359 4.696% 95.398% # ( 4, 6 ] 1052 3.635% 99.033% # ( 6, 10 ] 246 0.850% 99.883% ( 10, 15 ] 25 0.086% 99.969% ( 15, 22 ] 4 0.014% 99.983% ( 34, 51 ] 1 0.003% 99.986% ( 51, 76 ] 1 0.003% 99.990% ( 170, 250 ] 1 0.003% 99.993% ( 250, 380 ] 2 0.007% 100.000% ( 580, 870 ] 1 0.003% 100.003% ** Level 3 read latency histogram (micros): Count: 40 Average: 1415.1750 StdDev: 1182.14 Min: 180 Median: 956.0000 Max: 4157 Percentiles: P50: 956.00 P75: 2328.57 P99: 4157.00 P99.9: 4157.00 P99.99: 4157.00 ------------------------------------------------------ ( 170, 250 ] 2 5.000% 5.000% # ( 250, 380 ] 6 15.000% 20.000% ### ( 380, 580 ] 8 20.000% 40.000% #### ( 580, 870 ] 3 7.500% 47.500% ## ( 870, 1300 ] 5 12.500% 60.000% ### ( 1300, 1900 ] 3 7.500% 67.500% ## ( 1900, 2900 ] 7 17.500% 85.000% #### ( 2900, 4400 ] 6 15.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 1565.7429 StdDev: 1089.68 Min: 103 Median: 1264.1667 Max: 4641 Percentiles: P50: 1264.17 P75: 2221.43 P99: 4641.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 7 20.000% 34.286% #### ( 870, 1300 ] 6 17.143% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 7 20.000% 88.571% #### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 322.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.224 H:M:S, 7.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.224 H:M:S, 8.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:28:39 ... thread 0: (1000000,2000000) ops and (329041.2,342776.0) ops/second in (3.039133,5.834714) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.35 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.5 318.0 8.32 7.72 29 0.287 831K 911 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.0 243.7 1.03 0.99 1 1.033 255K 255 0.0 0.0 L2 1/0 3.37 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 33/0 986.32 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 200.3 200.2 3.12 2.74 3 1.039 634K 511 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1233/10 97.92 GB 0.0 1.8 0.8 1.0 3.6 2.6 0.9 2.0 142.4 280.0 13.26 12.21 35 0.379 1917K 1768 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.6 0.9 2.0 142.4 280.0 13.26 12.21 35 0.379 1917K 1768 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 234.1 233.9 8.06 7.55 9 0.896 1917K 1768 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.7 5.19 4.66 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.63 GB write, 609.21 MB/s write, 1.84 GB read, 309.77 MB/s read, 13.3 seconds Interval compaction: 3.63 GB write, 636.19 MB/s write, 1.84 GB read, 323.48 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 385626 Average: 2.0794 StdDev: 14.17 Min: 0 Median: 1.3976 Max: 3352 Percentiles: P50: 1.40 P75: 1.80 P99: 5.46 P99.9: 9.74 P99.99: 17.21 ------------------------------------------------------ [ 0, 1 ] 97273 25.225% 25.225% ##### ( 1, 2 ] 240288 62.311% 87.536% ############ ( 2, 3 ] 27924 7.241% 94.777% # ( 3, 4 ] 11446 2.968% 97.745% # ( 4, 6 ] 6645 1.723% 99.468% ( 6, 10 ] 1780 0.462% 99.930% ( 10, 15 ] 216 0.056% 99.986% ( 15, 22 ] 49 0.013% 99.999% ( 22, 34 ] 4 0.001% 100.000% ( 34, 51 ] 4 0.001% 100.001% ( 51, 76 ] 1 0.000% 100.001% ( 110, 170 ] 7 0.002% 100.003% ( 170, 250 ] 17 0.004% 100.007% ( 250, 380 ] 11 0.003% 100.010% ( 380, 580 ] 3 0.001% 100.011% ( 580, 870 ] 6 0.002% 100.012% ( 870, 1300 ] 4 0.001% 100.013% ( 1300, 1900 ] 1 0.000% 100.014% ( 1900, 2900 ] 5 0.001% 100.015% ( 2900, 4400 ] 4 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 63922 Average: 2.4970 StdDev: 15.89 Min: 1 Median: 1.6264 Max: 2655 Percentiles: P50: 1.63 P75: 2.03 P99: 5.98 P99.9: 12.64 P99.99: 146.47 ------------------------------------------------------ [ 0, 1 ] 5596 8.754% 8.754% ## ( 1, 2 ] 42087 65.841% 74.596% ############# ( 2, 3 ] 10176 15.919% 90.515% ### ( 3, 4 ] 3223 5.042% 95.557% # ( 4, 6 ] 2220 3.473% 99.030% # ( 6, 10 ] 509 0.796% 99.826% ( 10, 15 ] 89 0.139% 99.966% ( 15, 22 ] 8 0.013% 99.978% ( 22, 34 ] 3 0.005% 99.983% ( 34, 51 ] 3 0.005% 99.987% ( 51, 76 ] 1 0.002% 99.989% ( 110, 170 ] 1 0.002% 99.991% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 3 0.005% 99.998% ( 580, 870 ] 3 0.005% 100.003% ( 1900, 2900 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47915 Average: 3.5878 StdDev: 53.64 Min: 0 Median: 1.6089 Max: 4157 Percentiles: P50: 1.61 P75: 1.99 P99: 6.84 P99.9: 77.45 P99.99: 2952.12 ------------------------------------------------------ [ 0, 1 ] 4699 9.807% 9.807% ## ( 1, 2 ] 31628 66.009% 75.816% ############# ( 2, 3 ] 7073 14.762% 90.577% ### ( 3, 4 ] 2324 4.850% 95.427% # ( 4, 6 ] 1638 3.419% 98.846% # ( 6, 10 ] 351 0.733% 99.578% ( 10, 15 ] 101 0.211% 99.789% ( 15, 22 ] 42 0.088% 99.877% ( 22, 34 ] 11 0.023% 99.900% ( 76, 110 ] 2 0.004% 99.904% ( 110, 170 ] 2 0.004% 99.908% ( 170, 250 ] 2 0.004% 99.912% ( 250, 380 ] 9 0.019% 99.931% ( 380, 580 ] 8 0.017% 99.948% ( 580, 870 ] 4 0.008% 99.956% ( 870, 1300 ] 6 0.013% 99.969% ( 1300, 1900 ] 3 0.006% 99.975% ( 1900, 2900 ] 7 0.015% 99.990% ( 2900, 4400 ] 6 0.013% 100.002% ** Level 4 read latency histogram (micros): Count: 35 Average: 1565.7429 StdDev: 1089.68 Min: 103 Median: 1264.1667 Max: 4641 Percentiles: P50: 1264.17 P75: 2221.43 P99: 4641.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 7 20.000% 34.286% #### ( 870, 1300 ] 6 17.143% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 7 20.000% 88.571% #### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.643 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:28:42 ... thread 0: (1000000,3000000) ops and (304250.0,328893.8) ops/second in (3.286771,9.121485) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.34 GB 107.0 1.7 0.0 1.7 4.4 2.8 0.0 1.6 117.4 312.9 14.49 13.54 45 0.322 1727K 1928 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.0 243.7 1.03 0.99 1 1.033 255K 255 0.0 0.0 L2 1/0 3.37 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 33/0 986.32 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 200.3 200.2 3.12 2.74 3 1.039 634K 511 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/10 98.90 GB 0.0 2.7 0.8 1.9 5.5 3.6 0.9 2.0 142.5 288.3 19.43 18.03 51 0.381 2812K 2785 0.0 0.0 Int 0/0 0.00 KB 0.0 2.7 0.8 1.9 5.5 3.6 0.9 2.0 142.5 288.3 19.43 18.03 51 0.381 2812K 2785 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.7 0.8 1.9 2.7 0.8 0.0 0.0 245.2 245.0 11.29 10.73 12 0.941 2812K 2785 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 348.3 8.14 7.30 39 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.47 GB write, 597.10 MB/s write, 2.71 GB read, 295.25 MB/s read, 19.4 seconds Interval compaction: 5.47 GB write, 614.02 MB/s write, 2.71 GB read, 303.61 MB/s read, 19.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 844060 Average: 2.1137 StdDev: 11.27 Min: 0 Median: 1.4596 Max: 3352 Percentiles: P50: 1.46 P75: 1.84 P99: 5.32 P99.9: 9.41 P99.99: 13.40 ------------------------------------------------------ [ 0, 1 ] 164361 19.473% 19.473% #### ( 1, 2 ] 560675 66.426% 85.899% ############# ( 2, 3 ] 74312 8.804% 94.703% ## ( 3, 4 ] 26888 3.186% 97.888% # ( 4, 6 ] 14267 1.690% 99.579% ( 6, 10 ] 3186 0.377% 99.956% ( 10, 15 ] 424 0.050% 100.006% ( 15, 22 ] 73 0.009% 100.015% ( 22, 34 ] 6 0.001% 100.016% ( 34, 51 ] 4 0.000% 100.016% ( 51, 76 ] 2 0.000% 100.016% ( 110, 170 ] 13 0.002% 100.018% ( 170, 250 ] 23 0.003% 100.021% ( 250, 380 ] 18 0.002% 100.023% ( 380, 580 ] 5 0.001% 100.023% ( 580, 870 ] 9 0.001% 100.024% ( 870, 1300 ] 7 0.001% 100.025% ( 1300, 1900 ] 4 0.000% 100.026% ( 1900, 2900 ] 6 0.001% 100.026% ( 2900, 4400 ] 5 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 63922 Average: 2.4970 StdDev: 15.89 Min: 1 Median: 1.6264 Max: 2655 Percentiles: P50: 1.63 P75: 2.03 P99: 5.98 P99.9: 12.64 P99.99: 146.47 ------------------------------------------------------ [ 0, 1 ] 5596 8.754% 8.754% ## ( 1, 2 ] 42087 65.841% 74.596% ############# ( 2, 3 ] 10176 15.919% 90.515% ### ( 3, 4 ] 3223 5.042% 95.557% # ( 4, 6 ] 2220 3.473% 99.030% # ( 6, 10 ] 509 0.796% 99.826% ( 10, 15 ] 89 0.139% 99.966% ( 15, 22 ] 8 0.013% 99.978% ( 22, 34 ] 3 0.005% 99.983% ( 34, 51 ] 3 0.005% 99.987% ( 51, 76 ] 1 0.002% 99.989% ( 110, 170 ] 1 0.002% 99.991% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 3 0.005% 99.998% ( 580, 870 ] 3 0.005% 100.003% ( 1900, 2900 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47915 Average: 3.5878 StdDev: 53.64 Min: 0 Median: 1.6089 Max: 4157 Percentiles: P50: 1.61 P75: 1.99 P99: 6.84 P99.9: 77.45 P99.99: 2952.12 ------------------------------------------------------ [ 0, 1 ] 4699 9.807% 9.807% ## ( 1, 2 ] 31628 66.009% 75.816% ############# ( 2, 3 ] 7073 14.762% 90.577% ### ( 3, 4 ] 2324 4.850% 95.427% # ( 4, 6 ] 1638 3.419% 98.846% # ( 6, 10 ] 351 0.733% 99.578% ( 10, 15 ] 101 0.211% 99.789% ( 15, 22 ] 42 0.088% 99.877% ( 22, 34 ] 11 0.023% 99.900% ( 76, 110 ] 2 0.004% 99.904% ( 110, 170 ] 2 0.004% 99.908% ( 170, 250 ] 2 0.004% 99.912% ( 250, 380 ] 9 0.019% 99.931% ( 380, 580 ] 8 0.017% 99.948% ( 580, 870 ] 4 0.008% 99.956% ( 870, 1300 ] 6 0.013% 99.969% ( 1300, 1900 ] 3 0.006% 99.975% ( 1900, 2900 ] 7 0.015% 99.990% ( 2900, 4400 ] 6 0.013% 100.002% ** Level 4 read latency histogram (micros): Count: 35 Average: 1565.7429 StdDev: 1089.68 Min: 103 Median: 1264.1667 Max: 4641 Percentiles: P50: 1264.17 P75: 2221.43 P99: 4641.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 7 20.000% 34.286% #### ( 870, 1300 ] 6 17.143% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 7 20.000% 88.571% #### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 9.4 total, 3.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 314.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.275 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.632 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:28:45 ... thread 0: (1000000,4000000) ops and (335506.9,330522.5) ops/second in (2.980565,12.102050) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.27 GB 0.0 2.5 0.0 2.5 6.2 3.7 0.0 1.7 123.0 310.4 20.49 19.14 62 0.330 2558K 2811 0.0 0.0 L1 9/9 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 238.5 237.6 5.54 5.39 2 2.771 1342K 4851 0.0 0.0 L2 1/0 3.37 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 33/0 986.32 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 200.3 200.2 3.12 2.74 3 1.039 634K 511 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/23 99.88 GB 0.0 4.5 1.8 2.7 8.3 5.6 0.9 2.2 155.6 283.7 29.94 28.03 69 0.434 4730K 8264 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.8 2.7 8.3 5.6 0.9 2.2 155.6 283.7 29.94 28.03 69 0.434 4730K 8264 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.8 2.7 4.5 1.8 0.0 0.0 245.6 245.1 18.97 18.19 16 1.186 4730K 8264 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 350.3 10.97 9.84 53 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.29 GB write, 687.02 MB/s write, 4.55 GB read, 376.87 MB/s read, 29.9 seconds Interval compaction: 8.29 GB write, 701.69 MB/s write, 4.55 GB read, 384.91 MB/s read, 29.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1061041 Average: 2.0896 StdDev: 11.97 Min: 0 Median: 1.4392 Max: 3615 Percentiles: P50: 1.44 P75: 1.82 P99: 5.23 P99.9: 9.41 P99.99: 13.70 ------------------------------------------------------ [ 0, 1 ] 224243 21.134% 21.134% #### ( 1, 2 ] 697284 65.717% 86.851% ############# ( 2, 3 ] 87052 8.204% 95.056% ## ( 3, 4 ] 31755 2.993% 98.048% # ( 4, 6 ] 16371 1.543% 99.591% ( 6, 10 ] 3840 0.362% 99.953% ( 10, 15 ] 529 0.050% 100.003% ( 15, 22 ] 90 0.008% 100.012% ( 22, 34 ] 8 0.001% 100.012% ( 34, 51 ] 6 0.001% 100.013% ( 51, 76 ] 4 0.000% 100.013% ( 76, 110 ] 1 0.000% 100.013% ( 110, 170 ] 18 0.002% 100.015% ( 170, 250 ] 30 0.003% 100.018% ( 250, 380 ] 25 0.002% 100.020% ( 380, 580 ] 7 0.001% 100.021% ( 580, 870 ] 15 0.001% 100.022% ( 870, 1300 ] 9 0.001% 100.023% ( 1300, 1900 ] 6 0.001% 100.024% ( 1900, 2900 ] 6 0.001% 100.024% ( 2900, 4400 ] 8 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 83493 Average: 2.5696 StdDev: 19.71 Min: 1 Median: 1.5453 Max: 2655 Percentiles: P50: 1.55 P75: 1.94 P99: 6.00 P99.9: 16.60 P99.99: 627.18 ------------------------------------------------------ [ 0, 1 ] 12683 15.190% 15.190% ### ( 1, 2 ] 53298 63.835% 79.026% ############# ( 2, 3 ] 10797 12.932% 91.957% ### ( 3, 4 ] 3499 4.191% 96.148% # ( 4, 6 ] 2383 2.854% 99.002% # ( 6, 10 ] 623 0.746% 99.748% ( 10, 15 ] 124 0.149% 99.897% ( 15, 22 ] 11 0.013% 99.910% ( 22, 34 ] 3 0.004% 99.914% ( 34, 51 ] 3 0.004% 99.917% ( 51, 76 ] 1 0.001% 99.919% ( 76, 110 ] 7 0.008% 99.927% ( 110, 170 ] 27 0.032% 99.959% ( 170, 250 ] 7 0.008% 99.968% ( 250, 380 ] 10 0.012% 99.980% ( 380, 580 ] 8 0.010% 99.989% ( 580, 870 ] 4 0.005% 99.994% ( 870, 1300 ] 5 0.006% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ( 1900, 2900 ] 3 0.004% 100.005% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47915 Average: 3.5878 StdDev: 53.64 Min: 0 Median: 1.6089 Max: 4157 Percentiles: P50: 1.61 P75: 1.99 P99: 6.84 P99.9: 77.45 P99.99: 2952.12 ------------------------------------------------------ [ 0, 1 ] 4699 9.807% 9.807% ## ( 1, 2 ] 31628 66.009% 75.816% ############# ( 2, 3 ] 7073 14.762% 90.577% ### ( 3, 4 ] 2324 4.850% 95.427% # ( 4, 6 ] 1638 3.419% 98.846% # ( 6, 10 ] 351 0.733% 99.578% ( 10, 15 ] 101 0.211% 99.789% ( 15, 22 ] 42 0.088% 99.877% ( 22, 34 ] 11 0.023% 99.900% ( 76, 110 ] 2 0.004% 99.904% ( 110, 170 ] 2 0.004% 99.908% ( 170, 250 ] 2 0.004% 99.912% ( 250, 380 ] 9 0.019% 99.931% ( 380, 580 ] 8 0.017% 99.948% ( 580, 870 ] 4 0.008% 99.956% ( 870, 1300 ] 6 0.013% 99.969% ( 1300, 1900 ] 3 0.006% 99.975% ( 1900, 2900 ] 7 0.015% 99.990% ( 2900, 4400 ] 6 0.013% 100.002% ** Level 4 read latency histogram (micros): Count: 35 Average: 1565.7429 StdDev: 1089.68 Min: 103 Median: 1264.1667 Max: 4641 Percentiles: P50: 1264.17 P75: 2221.43 P99: 4641.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 7 20.000% 34.286% #### ( 870, 1300 ] 6 17.143% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 7 20.000% 88.571% #### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 318.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.665 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.390 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:28:48 ... thread 0: (1000000,5000000) ops and (304486.2,324965.0) ops/second in (3.284221,15.386271) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.20 GB 94.4 3.3 0.0 3.3 8.0 4.7 0.0 1.7 128.6 309.4 26.46 24.77 78 0.339 3454K 3756 0.0 0.0 L1 9/9 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 238.5 237.6 5.54 5.39 2 2.771 1342K 4851 0.0 0.0 L2 1/0 3.37 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 33/0 986.32 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 200.3 200.2 3.12 2.74 3 1.039 634K 511 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/23 100.80 GB 0.0 5.4 1.8 3.6 10.1 6.5 0.9 2.2 154.3 287.4 35.91 33.66 85 0.422 5626K 9209 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.8 3.6 10.1 6.5 0.9 2.2 154.3 287.4 35.91 33.66 85 0.422 5626K 9209 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.8 3.6 5.4 1.8 0.0 0.0 248.6 248.2 22.29 21.45 19 1.173 5626K 9209 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.4 13.62 12.21 66 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.08 GB write, 659.51 MB/s write, 5.41 GB read, 354.13 MB/s read, 35.9 seconds Interval compaction: 10.08 GB write, 670.58 MB/s write, 5.41 GB read, 360.08 MB/s read, 35.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 17, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1447285 Average: 2.1172 StdDev: 11.71 Min: 0 Median: 1.4574 Max: 3824 Percentiles: P50: 1.46 P75: 1.83 P99: 5.28 P99.9: 9.39 P99.99: 13.20 ------------------------------------------------------ [ 0, 1 ] 282252 19.502% 19.502% #### ( 1, 2 ] 964991 66.676% 86.178% ############# ( 2, 3 ] 125601 8.678% 94.857% ## ( 3, 4 ] 45191 3.122% 97.979% # ( 4, 6 ] 23153 1.600% 99.579% ( 6, 10 ] 5488 0.379% 99.958% ( 10, 15 ] 728 0.050% 100.008% ( 15, 22 ] 108 0.007% 100.016% ( 22, 34 ] 11 0.001% 100.016% ( 34, 51 ] 8 0.001% 100.017% ( 51, 76 ] 4 0.000% 100.017% ( 76, 110 ] 11 0.001% 100.018% ( 110, 170 ] 41 0.003% 100.021% ( 170, 250 ] 45 0.003% 100.024% ( 250, 380 ] 36 0.002% 100.026% ( 380, 580 ] 14 0.001% 100.027% ( 580, 870 ] 20 0.001% 100.029% ( 870, 1300 ] 12 0.001% 100.030% ( 1300, 1900 ] 9 0.001% 100.030% ( 1900, 2900 ] 8 0.001% 100.031% ( 2900, 4400 ] 9 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 149151 Average: 2.5676 StdDev: 16.07 Min: 1 Median: 1.5500 Max: 2655 Percentiles: P50: 1.55 P75: 1.93 P99: 7.37 P99.9: 100.05 P99.99: 552.64 ------------------------------------------------------ [ 0, 1 ] 20174 13.526% 13.526% ### ( 1, 2 ] 98911 66.316% 79.842% ############# ( 2, 3 ] 18504 12.406% 92.248% ## ( 3, 4 ] 5781 3.876% 96.124% # ( 4, 6 ] 3727 2.499% 98.623% ( 6, 10 ] 1642 1.101% 99.724% ( 10, 15 ] 193 0.129% 99.853% ( 15, 22 ] 16 0.011% 99.864% ( 22, 34 ] 3 0.002% 99.866% ( 34, 51 ] 3 0.002% 99.868% ( 51, 76 ] 4 0.003% 99.871% ( 76, 110 ] 62 0.042% 99.912% ( 110, 170 ] 61 0.041% 99.953% ( 170, 250 ] 24 0.016% 99.969% ( 250, 380 ] 19 0.013% 99.982% ( 380, 580 ] 14 0.009% 99.991% ( 580, 870 ] 8 0.005% 99.997% ( 870, 1300 ] 5 0.003% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ( 1900, 2900 ] 3 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47915 Average: 3.5878 StdDev: 53.64 Min: 0 Median: 1.6089 Max: 4157 Percentiles: P50: 1.61 P75: 1.99 P99: 6.84 P99.9: 77.45 P99.99: 2952.12 ------------------------------------------------------ [ 0, 1 ] 4699 9.807% 9.807% ## ( 1, 2 ] 31628 66.009% 75.816% ############# ( 2, 3 ] 7073 14.762% 90.577% ### ( 3, 4 ] 2324 4.850% 95.427% # ( 4, 6 ] 1638 3.419% 98.846% # ( 6, 10 ] 351 0.733% 99.578% ( 10, 15 ] 101 0.211% 99.789% ( 15, 22 ] 42 0.088% 99.877% ( 22, 34 ] 11 0.023% 99.900% ( 76, 110 ] 2 0.004% 99.904% ( 110, 170 ] 2 0.004% 99.908% ( 170, 250 ] 2 0.004% 99.912% ( 250, 380 ] 9 0.019% 99.931% ( 380, 580 ] 8 0.017% 99.948% ( 580, 870 ] 4 0.008% 99.956% ( 870, 1300 ] 6 0.013% 99.969% ( 1300, 1900 ] 3 0.006% 99.975% ( 1900, 2900 ] 7 0.015% 99.990% ( 2900, 4400 ] 6 0.013% 100.002% ** Level 4 read latency histogram (micros): Count: 35 Average: 1565.7429 StdDev: 1089.68 Min: 103 Median: 1264.1667 Max: 4641 Percentiles: P50: 1264.17 P75: 2221.43 P99: 4641.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 7 20.000% 34.286% #### ( 870, 1300 ] 6 17.143% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 7 20.000% 88.571% #### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.295 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.630 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:28:58 ... thread 0: (1000000,6000000) ops and (106308.7,242005.4) ops/second in (9.406569,24.792840) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 2.27 GB 0.0 5.4 0.0 5.4 11.1 5.7 0.0 1.9 147.5 303.2 37.58 35.33 101 0.372 5628K 7590 0.0 0.0 L1 17/17 1.96 GB 0.0 4.3 3.3 1.0 4.3 3.2 0.2 1.3 230.8 228.4 19.07 18.43 3 6.357 4469K 45K 0.0 0.0 L2 1/0 3.37 MB 0.0 0.2 0.1 0.1 0.2 0.1 1.4 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 16/2 1.14 GB 0.9 0.6 0.4 0.2 0.6 0.4 1.1 1.4 200.3 200.2 3.12 2.74 3 1.039 634K 511 0.0 0.0 L4 165/11 10.24 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/37 101.81 GB 0.0 10.5 3.8 6.7 16.2 9.5 4.0 2.8 177.7 273.5 60.56 57.26 109 0.556 10M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 3.8 6.7 16.2 9.5 4.0 2.8 177.7 273.5 60.56 57.26 109 0.556 10M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 3.8 6.7 10.5 3.8 0.0 0.0 245.2 244.0 43.89 42.33 26 1.688 10M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.4 16.67 14.92 83 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.1 total, 24.8 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.18 GB write, 661.24 MB/s write, 10.51 GB read, 429.53 MB/s read, 60.6 seconds Interval compaction: 16.18 GB write, 668.13 MB/s write, 10.51 GB read, 434.01 MB/s read, 60.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 17, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2300684 Average: 2.2321 StdDev: 12.46 Min: 0 Median: 1.4558 Max: 3824 Percentiles: P50: 1.46 P75: 1.83 P99: 5.48 P99.9: 11.18 P99.99: 141.34 ------------------------------------------------------ [ 0, 1 ] 444863 19.336% 19.336% #### ( 1, 2 ] 1547786 67.275% 86.611% ############# ( 2, 3 ] 189270 8.227% 94.838% ## ( 3, 4 ] 68895 2.995% 97.832% # ( 4, 6 ] 36228 1.575% 99.407% ( 6, 10 ] 11051 0.480% 99.887% ( 10, 15 ] 1235 0.054% 99.941% ( 15, 22 ] 185 0.008% 99.949% ( 22, 34 ] 19 0.001% 99.950% ( 34, 51 ] 10 0.000% 99.950% ( 51, 76 ] 23 0.001% 99.951% ( 76, 110 ] 539 0.023% 99.975% ( 110, 170 ] 670 0.029% 100.004% ( 170, 250 ] 248 0.011% 100.015% ( 250, 380 ] 182 0.008% 100.023% ( 380, 580 ] 98 0.004% 100.027% ( 580, 870 ] 73 0.003% 100.030% ( 870, 1300 ] 29 0.001% 100.031% ( 1300, 1900 ] 14 0.001% 100.032% ( 1900, 2900 ] 12 0.001% 100.032% ( 2900, 4400 ] 11 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 334572 Average: 2.6134 StdDev: 16.59 Min: 1 Median: 1.5000 Max: 2655 Percentiles: P50: 1.50 P75: 1.87 P99: 7.51 P99.9: 137.13 P99.99: 755.43 ------------------------------------------------------ [ 0, 1 ] 55369 16.549% 16.549% ### ( 1, 2 ] 223851 66.907% 83.456% ############# ( 2, 3 ] 32852 9.819% 93.275% ## ( 3, 4 ] 10678 3.192% 96.467% # ( 4, 6 ] 7067 2.112% 98.579% ( 6, 10 ] 3722 1.112% 99.691% ( 10, 15 ] 251 0.075% 99.766% ( 15, 22 ] 34 0.010% 99.776% ( 22, 34 ] 4 0.001% 99.778% ( 34, 51 ] 5 0.001% 99.779% ( 51, 76 ] 38 0.011% 99.790% ( 76, 110 ] 257 0.077% 99.867% ( 110, 170 ] 242 0.072% 99.940% ( 170, 250 ] 64 0.019% 99.959% ( 250, 380 ] 42 0.013% 99.971% ( 380, 580 ] 45 0.013% 99.985% ( 580, 870 ] 29 0.009% 99.993% ( 870, 1300 ] 19 0.006% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ( 1900, 2900 ] 4 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 49099 Average: 4.3187 StdDev: 56.20 Min: 0 Median: 1.6211 Max: 4157 Percentiles: P50: 1.62 P75: 2.02 P99: 8.47 P99.9: 440.01 P99.99: 2786.26 ------------------------------------------------------ [ 0, 1 ] 4707 9.587% 9.587% ## ( 1, 2 ] 31946 65.064% 74.651% ############# ( 2, 3 ] 7402 15.076% 89.727% ### ( 3, 4 ] 2547 5.187% 94.914% # ( 4, 6 ] 1776 3.617% 98.532% # ( 6, 10 ] 374 0.762% 99.293% ( 10, 15 ] 111 0.226% 99.519% ( 15, 22 ] 49 0.100% 99.619% ( 22, 34 ] 13 0.026% 99.646% ( 76, 110 ] 5 0.010% 99.656% ( 110, 170 ] 45 0.092% 99.747% ( 170, 250 ] 34 0.069% 99.817% ( 250, 380 ] 35 0.071% 99.888% ( 380, 580 ] 23 0.047% 99.935% ( 580, 870 ] 10 0.020% 99.955% ( 870, 1300 ] 8 0.016% 99.971% ( 1300, 1900 ] 3 0.006% 99.978% ( 1900, 2900 ] 8 0.016% 99.994% ( 2900, 4400 ] 6 0.012% 100.006% ** Level 4 read latency histogram (micros): Count: 35 Average: 1565.7429 StdDev: 1089.68 Min: 103 Median: 1264.1667 Max: 4641 Percentiles: P50: 1264.17 P75: 2221.43 P99: 4641.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 7 20.000% 34.286% #### ( 870, 1300 ] 6 17.143% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 7 20.000% 88.571% #### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 23 Average: 684.9565 StdDev: 882.67 Min: 103 Median: 266.2500 Max: 3776 Percentiles: P50: 266.25 P75: 977.50 P99: 3776.00 P99.9: 3776.00 P99.99: 3776.00 ------------------------------------------------------ ( 76, 110 ] 2 8.696% 8.696% ## ( 110, 170 ] 5 21.739% 30.435% #### ( 170, 250 ] 4 17.391% 47.826% ### ( 250, 380 ] 4 17.391% 65.217% ### ( 380, 580 ] 2 8.696% 73.913% ## ( 870, 1300 ] 1 4.348% 78.261% # ( 1300, 1900 ] 2 8.696% 86.957% ## ( 1900, 2900 ] 2 8.696% 95.652% ## ( 2900, 4400 ] 1 4.348% 100.000% # ** DB Stats ** Uptime(secs): 25.1 total, 9.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 235.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.735 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 104.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.440 H:M:S, 68.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 0 2024/12/13-05:29:01 ... thread 0: (1000000,7000000) ops and (325354.8,251198.5) ops/second in (3.073568,27.866408) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.19 GB 69.2 6.0 0.0 6.0 12.6 6.6 0.0 1.9 144.2 304.5 42.38 39.81 116 0.365 6203K 8215 0.0 0.0 L1 17/17 1.96 GB 0.0 4.3 3.3 1.0 4.3 3.2 0.2 1.3 230.8 228.4 19.07 18.43 3 6.357 4469K 45K 0.0 0.0 L2 1/0 3.37 MB 0.0 0.2 0.1 0.1 0.2 0.1 1.4 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 14/0 944.96 MB 0.9 0.6 0.4 0.2 0.6 0.4 1.1 1.4 200.3 200.2 3.12 2.74 3 1.039 634K 511 0.0 0.0 L4 167/0 9.48 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.0 1.1 186.3 185.9 1.30 1.12 2 0.650 245K 580 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/28 102.73 GB 0.0 11.3 4.0 7.3 17.9 10.6 5.0 2.7 173.6 274.8 66.66 62.85 126 0.529 11M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 4.0 7.3 17.9 10.6 5.0 2.7 173.6 274.8 66.66 62.85 126 0.529 11M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 4.0 7.3 11.2 4.0 0.0 0.0 244.7 243.5 47.29 45.52 30 1.576 11M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 351.1 19.38 17.34 96 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.1 total, 27.9 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.89 GB write, 651.30 MB/s write, 11.30 GB read, 411.36 MB/s read, 66.7 seconds Interval compaction: 17.89 GB write, 657.34 MB/s write, 11.30 GB read, 415.18 MB/s read, 66.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 21, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2647759 Average: 2.2529 StdDev: 12.78 Min: 0 Median: 1.4657 Max: 3824 Percentiles: P50: 1.47 P75: 1.84 P99: 5.57 P99.9: 11.46 P99.99: 138.60 ------------------------------------------------------ [ 0, 1 ] 492677 18.607% 18.607% #### ( 1, 2 ] 1784860 67.410% 86.018% ############# ( 2, 3 ] 228153 8.617% 94.634% ## ( 3, 4 ] 81475 3.077% 97.711% # ( 4, 6 ] 43543 1.645% 99.356% ( 6, 10 ] 13907 0.525% 99.881% ( 10, 15 ] 1706 0.064% 99.946% ( 15, 22 ] 218 0.008% 99.954% ( 22, 34 ] 23 0.001% 99.955% ( 34, 51 ] 10 0.000% 99.955% ( 51, 76 ] 25 0.001% 99.956% ( 76, 110 ] 555 0.021% 99.977% ( 110, 170 ] 720 0.027% 100.004% ( 170, 250 ] 294 0.011% 100.015% ( 250, 380 ] 214 0.008% 100.023% ( 380, 580 ] 119 0.004% 100.028% ( 580, 870 ] 89 0.003% 100.031% ( 870, 1300 ] 36 0.001% 100.033% ( 1300, 1900 ] 17 0.001% 100.033% ( 1900, 2900 ] 14 0.001% 100.034% ( 2900, 4400 ] 13 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 367274 Average: 2.5929 StdDev: 15.83 Min: 1 Median: 1.5126 Max: 2655 Percentiles: P50: 1.51 P75: 1.89 P99: 7.39 P99.9: 129.02 P99.99: 722.73 ------------------------------------------------------ [ 0, 1 ] 57982 15.787% 15.787% ### ( 1, 2 ] 245130 66.743% 82.530% ############# ( 2, 3 ] 38202 10.401% 92.932% ## ( 3, 4 ] 12599 3.430% 96.362% # ( 4, 6 ] 8300 2.260% 98.622% ( 6, 10 ] 3993 1.087% 99.709% ( 10, 15 ] 281 0.077% 99.786% ( 15, 22 ] 37 0.010% 99.796% ( 22, 34 ] 6 0.002% 99.797% ( 34, 51 ] 5 0.001% 99.799% ( 51, 76 ] 38 0.010% 99.809% ( 76, 110 ] 257 0.070% 99.879% ( 110, 170 ] 242 0.066% 99.945% ( 170, 250 ] 64 0.017% 99.962% ( 250, 380 ] 42 0.011% 99.974% ( 380, 580 ] 45 0.012% 99.986% ( 580, 870 ] 29 0.008% 99.994% ( 870, 1300 ] 19 0.005% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ( 1900, 2900 ] 4 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 76694 Average: 4.1196 StdDev: 47.94 Min: 0 Median: 1.6396 Max: 4157 Percentiles: P50: 1.64 P75: 2.10 P99: 8.96 P99.9: 399.57 P99.99: 2316.32 ------------------------------------------------------ [ 0, 1 ] 6548 8.538% 8.538% ## ( 1, 2 ] 49719 64.828% 73.366% ############# ( 2, 3 ] 12414 16.186% 89.552% ### ( 3, 4 ] 3838 5.004% 94.556% # ( 4, 6 ] 2740 3.573% 98.129% # ( 6, 10 ] 902 1.176% 99.305% ( 10, 15 ] 156 0.203% 99.508% ( 15, 22 ] 51 0.066% 99.575% ( 22, 34 ] 13 0.017% 99.592% ( 51, 76 ] 1 0.001% 99.593% ( 76, 110 ] 31 0.040% 99.634% ( 110, 170 ] 81 0.106% 99.739% ( 170, 250 ] 64 0.083% 99.823% ( 250, 380 ] 55 0.072% 99.894% ( 380, 580 ] 44 0.057% 99.952% ( 580, 870 ] 14 0.018% 99.970% ( 870, 1300 ] 9 0.012% 99.982% ( 1300, 1900 ] 3 0.004% 99.986% ( 1900, 2900 ] 8 0.010% 99.996% ( 2900, 4400 ] 7 0.009% 100.005% ** Level 4 read latency histogram (micros): Count: 120 Average: 483.8583 StdDev: 917.83 Min: 0 Median: 5.0000 Max: 4641 Percentiles: P50: 5.00 P75: 652.50 P99: 4300.00 P99.9: 4641.00 P99.99: 4641.00 ------------------------------------------------------ [ 0, 1 ] 26 21.667% 21.667% #### ( 1, 2 ] 26 21.667% 43.333% #### ( 2, 3 ] 4 3.333% 46.667% # ( 3, 4 ] 2 1.667% 48.333% ( 4, 6 ] 4 3.333% 51.667% # ( 6, 10 ] 9 7.500% 59.167% ## ( 10, 15 ] 3 2.500% 61.667% # ( 15, 22 ] 3 2.500% 64.167% # ( 76, 110 ] 1 0.833% 65.000% ( 110, 170 ] 6 5.000% 70.000% # ( 170, 250 ] 1 0.833% 70.833% ( 380, 580 ] 3 2.500% 73.333% # ( 580, 870 ] 8 6.667% 80.000% # ( 870, 1300 ] 7 5.833% 85.833% # ( 1300, 1900 ] 6 5.000% 90.833% # ( 1900, 2900 ] 7 5.833% 96.667% # ( 2900, 4400 ] 3 2.500% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 879.2250 StdDev: 1063.96 Min: 87 Median: 380.0000 Max: 4074 Percentiles: P50: 380.00 P75: 1085.00 P99: 4074.00 P99.9: 4074.00 P99.99: 4074.00 ------------------------------------------------------ ( 76, 110 ] 9 11.250% 11.250% ## ( 110, 170 ] 14 17.500% 28.750% #### ( 170, 250 ] 8 10.000% 38.750% ## ( 250, 380 ] 9 11.250% 50.000% ## ( 380, 580 ] 6 7.500% 57.500% ## ( 580, 870 ] 12 15.000% 72.500% ### ( 870, 1300 ] 4 5.000% 77.500% # ( 1300, 1900 ] 5 6.250% 83.750% # ( 1900, 2900 ] 7 8.750% 92.500% ## ( 2900, 4400 ] 6 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 28.1 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 244.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.154 H:M:S, 32.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:29:22 ... thread 0: (1000000,8000000) ops and (47036.2,162844.5) ops/second in (21.260203,49.126611) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 1.91 GB 12.6 6.5 0.0 6.5 14.1 7.6 0.0 1.8 132.5 288.8 49.92 44.55 131 0.381 6715K 8689 0.0 0.0 L1 9/9 907.42 MB 0.0 8.5 5.5 3.0 8.4 5.4 0.2 1.5 227.2 224.2 38.45 36.45 4 9.611 8400K 45K 0.0 0.0 L2 1/0 97.48 MB 1.0 0.2 0.1 0.1 0.2 0.1 4.7 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 21/5 1.48 GB 1.0 1.9 1.0 0.9 1.9 1.0 3.7 1.9 138.4 137.1 14.34 8.97 9 1.593 2015K 18K 0.0 0.0 L4 164/13 9.73 GB 1.0 3.2 2.8 0.4 3.2 2.8 1.0 1.1 120.0 119.5 27.24 15.37 28 0.973 3299K 11K 0.0 0.0 L5 1088/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/40 103.61 GB 0.0 20.3 9.5 10.8 27.8 16.9 13.3 3.6 159.1 217.6 130.74 106.09 174 0.751 20M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.3 9.5 10.8 27.8 16.9 13.3 3.6 159.1 217.6 130.74 106.09 174 0.751 20M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.3 9.5 10.8 20.2 9.3 0.0 0.0 196.7 195.2 105.74 85.91 65 1.627 20M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 312.5 25.00 20.19 109 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.4 total, 49.1 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.78 GB write, 575.99 MB/s write, 20.31 GB read, 421.00 MB/s read, 130.7 seconds Interval compaction: 27.78 GB write, 579.02 MB/s write, 20.31 GB read, 423.21 MB/s read, 130.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 56, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3359650 Average: 2.6900 StdDev: 28.70 Min: 0 Median: 1.4667 Max: 8023 Percentiles: P50: 1.47 P75: 1.85 P99: 5.93 P99.9: 117.77 P99.99: 338.47 ------------------------------------------------------ [ 0, 1 ] 652513 19.422% 19.422% #### ( 1, 2 ] 2201209 65.519% 84.941% ############# ( 2, 3 ] 291631 8.680% 93.621% ## ( 3, 4 ] 111170 3.309% 96.930% # ( 4, 6 ] 72224 2.150% 99.080% ( 6, 10 ] 21001 0.625% 99.705% ( 10, 15 ] 2832 0.084% 99.790% ( 15, 22 ] 493 0.015% 99.804% ( 22, 34 ] 31 0.001% 99.805% ( 34, 51 ] 11 0.000% 99.805% ( 51, 76 ] 78 0.002% 99.808% ( 76, 110 ] 2797 0.083% 99.891% ( 110, 170 ] 2341 0.070% 99.961% ( 170, 250 ] 624 0.019% 99.979% ( 250, 380 ] 532 0.016% 99.995% ( 380, 580 ] 445 0.013% 100.008% ( 580, 870 ] 337 0.010% 100.018% ( 870, 1300 ] 139 0.004% 100.023% ( 1300, 1900 ] 64 0.002% 100.024% ( 1900, 2900 ] 57 0.002% 100.026% ( 2900, 4400 ] 64 0.002% 100.028% ( 4400, 6600 ] 19 0.001% 100.029% ( 6600, 9900 ] 6 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1681105 Average: 5.2381 StdDev: 91.16 Min: 1 Median: 1.6347 Max: 14289 Percentiles: P50: 1.63 P75: 2.34 P99: 8.95 P99.9: 127.20 P99.99: 274.94 ------------------------------------------------------ [ 0, 1 ] 255148 15.177% 15.177% ### ( 1, 2 ] 922303 54.863% 70.040% ########### ( 2, 3 ] 246319 14.652% 84.693% ### ( 3, 4 ] 110414 6.568% 91.260% # ( 4, 6 ] 108782 6.471% 97.731% # ( 6, 10 ] 28877 1.718% 99.449% ( 10, 15 ] 4677 0.278% 99.727% ( 15, 22 ] 817 0.049% 99.776% ( 22, 34 ] 53 0.003% 99.779% ( 34, 51 ] 16 0.001% 99.780% ( 51, 76 ] 152 0.009% 99.789% ( 76, 110 ] 1415 0.084% 99.873% ( 110, 170 ] 1573 0.094% 99.967% ( 170, 250 ] 318 0.019% 99.986% ( 250, 380 ] 380 0.023% 100.008% ( 380, 580 ] 470 0.028% 100.036% ( 580, 870 ] 500 0.030% 100.066% ( 870, 1300 ] 348 0.021% 100.087% ( 1300, 1900 ] 192 0.011% 100.098% ( 1900, 2900 ] 258 0.015% 100.113% ( 2900, 4400 ] 332 0.020% 100.133% ( 4400, 6600 ] 131 0.008% 100.141% ( 6600, 9900 ] 49 0.003% 100.144% ( 9900, 14000 ] 2 0.000% 100.144% ( 14000, 22000 ] 1 0.000% 100.144% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 415001 Average: 9.8430 StdDev: 125.39 Min: 0 Median: 1.9258 Max: 8182 Percentiles: P50: 1.93 P75: 2.94 P99: 9.73 P99.9: 860.70 P99.99: 1240.42 ------------------------------------------------------ [ 0, 1 ] 10667 2.570% 2.570% # ( 1, 2 ] 212608 51.231% 53.801% ########## ( 2, 3 ] 94017 22.655% 76.456% ##### ( 3, 4 ] 45732 11.020% 87.475% ## ( 4, 6 ] 41363 9.967% 97.442% ## ( 6, 10 ] 6933 1.671% 99.113% ( 10, 15 ] 1259 0.303% 99.416% ( 15, 22 ] 187 0.045% 99.461% ( 22, 34 ] 30 0.007% 99.469% ( 34, 51 ] 6 0.001% 99.470% ( 51, 76 ] 2 0.000% 99.471% ( 76, 110 ] 38 0.009% 99.480% ( 110, 170 ] 170 0.041% 99.521% ( 170, 250 ] 226 0.054% 99.575% ( 250, 380 ] 366 0.088% 99.663% ( 380, 580 ] 500 0.120% 99.784% ( 580, 870 ] 499 0.120% 99.904% ( 870, 1300 ] 415 0.100% 100.004% ( 1300, 1900 ] 217 0.052% 100.056% ( 1900, 2900 ] 149 0.036% 100.092% ( 2900, 4400 ] 184 0.044% 100.137% ( 4400, 6600 ] 45 0.011% 100.147% ( 6600, 9900 ] 13 0.003% 100.151% ** Level 4 read latency histogram (micros): Count: 77548 Average: 15.8422 StdDev: 166.24 Min: 0 Median: 2.0784 Max: 9451 Percentiles: P50: 2.08 P75: 3.15 P99: 255.63 P99.9: 2282.05 P99.99: 4006.53 ------------------------------------------------------ [ 0, 1 ] 855 1.103% 1.103% ( 1, 2 ] 36390 46.926% 48.028% ######### ( 2, 3 ] 19515 25.165% 73.193% ##### ( 3, 4 ] 9347 12.053% 85.247% ## ( 4, 6 ] 8575 11.058% 96.304% ## ( 6, 10 ] 1614 2.081% 98.386% ( 10, 15 ] 302 0.389% 98.775% ( 15, 22 ] 50 0.064% 98.839% ( 22, 34 ] 13 0.017% 98.856% ( 34, 51 ] 8 0.010% 98.867% ( 51, 76 ] 2 0.003% 98.869% ( 76, 110 ] 14 0.018% 98.887% ( 110, 170 ] 31 0.040% 98.927% ( 170, 250 ] 54 0.070% 98.997% ( 250, 380 ] 81 0.104% 99.101% ( 380, 580 ] 140 0.181% 99.282% ( 580, 870 ] 194 0.250% 99.532% ( 870, 1300 ] 161 0.208% 99.740% ( 1300, 1900 ] 101 0.130% 99.870% ( 1900, 2900 ] 64 0.083% 99.952% ( 2900, 4400 ] 41 0.053% 100.005% ( 4400, 6600 ] 18 0.023% 100.028% ( 6600, 9900 ] 3 0.004% 100.032% ** Level 5 read latency histogram (micros): Count: 220 Average: 1394.3318 StdDev: 1543.15 Min: 85 Median: 669.2308 Max: 7207 Percentiles: P50: 669.23 P75: 2311.76 P99: 7207.00 P99.9: 7207.00 P99.99: 7207.00 ------------------------------------------------------ ( 76, 110 ] 12 5.455% 5.455% # ( 110, 170 ] 21 9.545% 15.000% ## ( 170, 250 ] 17 7.727% 22.727% ## ( 250, 380 ] 26 11.818% 34.545% ## ( 380, 580 ] 26 11.818% 46.364% ## ( 580, 870 ] 26 11.818% 58.182% ## ( 870, 1300 ] 16 7.273% 65.455% # ( 1300, 1900 ] 14 6.364% 71.818% # ( 1900, 2900 ] 17 7.727% 79.545% ## ( 2900, 4400 ] 35 15.909% 95.455% ### ( 4400, 6600 ] 7 3.182% 98.636% # ( 6600, 9900 ] 3 1.364% 100.000% ** DB Stats ** Uptime(secs): 49.4 total, 21.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 159.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.930 H:M:S, 54.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 46.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.776 H:M:S, 83.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/13-05:29:25 ... thread 0: (1000000,9000000) ops and (322419.7,172320.8) ops/second in (3.101547,52.228158) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 2.83 GB 119.6 7.4 0.0 7.4 15.9 8.5 0.0 1.9 133.6 288.2 56.58 50.61 147 0.385 7675K 9994 0.0 0.0 L1 9/9 907.42 MB 0.0 8.5 5.5 3.0 8.4 5.4 0.2 1.5 227.2 224.2 38.45 36.45 4 9.611 8400K 45K 0.0 0.0 L2 1/0 97.48 MB 1.0 0.2 0.1 0.1 0.2 0.1 4.7 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 16/0 972.73 MB 1.0 1.9 1.0 0.9 1.9 1.0 3.7 1.9 138.4 137.1 14.34 8.97 9 1.593 2015K 18K 0.0 0.0 L4 160/0 9.65 GB 1.0 4.0 3.3 0.6 4.0 3.3 1.0 1.2 124.6 124.2 32.72 19.08 33 0.992 4120K 13K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/21 104.53 GB 0.0 22.0 10.0 12.0 30.4 18.4 13.9 3.6 157.8 218.0 142.88 115.86 195 0.733 22M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.0 10.0 12.0 30.4 18.4 13.9 3.6 157.8 218.0 142.88 115.86 195 0.733 22M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.0 10.0 12.0 21.9 9.8 0.0 0.0 195.8 194.5 115.14 93.27 73 1.577 22M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 315.7 27.74 22.59 122 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.5 total, 52.2 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.42 GB write, 593.39 MB/s write, 22.02 GB read, 429.60 MB/s read, 142.9 seconds Interval compaction: 30.42 GB write, 596.32 MB/s write, 22.02 GB read, 431.72 MB/s read, 142.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 60, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3703275 Average: 2.6882 StdDev: 27.80 Min: 0 Median: 1.4771 Max: 8023 Percentiles: P50: 1.48 P75: 1.86 P99: 5.96 P99.9: 113.87 P99.99: 324.15 ------------------------------------------------------ [ 0, 1 ] 693545 18.728% 18.728% #### ( 1, 2 ] 2427247 65.543% 84.271% ############# ( 2, 3 ] 337616 9.117% 93.388% ## ( 3, 4 ] 126714 3.422% 96.809% # ( 4, 6 ] 82750 2.235% 99.044% ( 6, 10 ] 24792 0.669% 99.713% ( 10, 15 ] 3219 0.087% 99.800% ( 15, 22 ] 537 0.015% 99.815% ( 22, 34 ] 33 0.001% 99.816% ( 34, 51 ] 12 0.000% 99.816% ( 51, 76 ] 81 0.002% 99.818% ( 76, 110 ] 2868 0.077% 99.896% ( 110, 170 ] 2458 0.066% 99.962% ( 170, 250 ] 696 0.019% 99.981% ( 250, 380 ] 592 0.016% 99.997% ( 380, 580 ] 507 0.014% 100.011% ( 580, 870 ] 373 0.010% 100.021% ( 870, 1300 ] 147 0.004% 100.025% ( 1300, 1900 ] 67 0.002% 100.026% ( 1900, 2900 ] 59 0.002% 100.028% ( 2900, 4400 ] 66 0.002% 100.030% ( 4400, 6600 ] 19 0.001% 100.030% ( 6600, 9900 ] 6 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 1736507 Average: 5.1612 StdDev: 89.77 Min: 1 Median: 1.6370 Max: 14289 Percentiles: P50: 1.64 P75: 2.34 P99: 8.94 P99.9: 126.62 P99.99: 276.93 ------------------------------------------------------ [ 0, 1 ] 258516 14.887% 14.887% ### ( 1, 2 ] 957207 55.123% 70.010% ########### ( 2, 3 ] 256771 14.787% 84.796% ### ( 3, 4 ] 113440 6.533% 91.329% # ( 4, 6 ] 111190 6.403% 97.732% # ( 6, 10 ] 29961 1.725% 99.457% ( 10, 15 ] 4756 0.274% 99.731% ( 15, 22 ] 827 0.048% 99.779% ( 22, 34 ] 53 0.003% 99.782% ( 34, 51 ] 16 0.001% 99.783% ( 51, 76 ] 154 0.009% 99.792% ( 76, 110 ] 1434 0.083% 99.874% ( 110, 170 ] 1608 0.093% 99.967% ( 170, 250 ] 321 0.018% 99.985% ( 250, 380 ] 383 0.022% 100.007% ( 380, 580 ] 475 0.027% 100.035% ( 580, 870 ] 502 0.029% 100.064% ( 870, 1300 ] 348 0.020% 100.084% ( 1300, 1900 ] 192 0.011% 100.095% ( 1900, 2900 ] 259 0.015% 100.110% ( 2900, 4400 ] 333 0.019% 100.129% ( 4400, 6600 ] 131 0.008% 100.136% ( 6600, 9900 ] 49 0.003% 100.139% ( 9900, 14000 ] 2 0.000% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 460526 Average: 9.2942 StdDev: 120.29 Min: 0 Median: 1.9199 Max: 8182 Percentiles: P50: 1.92 P75: 2.92 P99: 9.56 P99.9: 839.06 P99.99: 1235.90 ------------------------------------------------------ [ 0, 1 ] 11316 2.457% 2.457% ( 1, 2 ] 238014 51.683% 54.140% ########## ( 2, 3 ] 104403 22.670% 76.811% ##### ( 3, 4 ] 50207 10.902% 87.713% ## ( 4, 6 ] 45339 9.845% 97.558% ## ( 6, 10 ] 7463 1.621% 99.178% ( 10, 15 ] 1309 0.284% 99.463% ( 15, 22 ] 187 0.041% 99.503% ( 22, 34 ] 30 0.007% 99.510% ( 34, 51 ] 6 0.001% 99.511% ( 51, 76 ] 2 0.000% 99.511% ( 76, 110 ] 39 0.008% 99.520% ( 110, 170 ] 176 0.038% 99.558% ( 170, 250 ] 234 0.051% 99.609% ( 250, 380 ] 377 0.082% 99.691% ( 380, 580 ] 507 0.110% 99.801% ( 580, 870 ] 511 0.111% 99.912% ( 870, 1300 ] 423 0.092% 100.004% ( 1300, 1900 ] 220 0.048% 100.051% ( 1900, 2900 ] 159 0.035% 100.086% ( 2900, 4400 ] 187 0.041% 100.127% ( 4400, 6600 ] 46 0.010% 100.137% ( 6600, 9900 ] 13 0.003% 100.139% ** Level 4 read latency histogram (micros): Count: 98777 Average: 13.4336 StdDev: 148.86 Min: 0 Median: 1.9791 Max: 9451 Percentiles: P50: 1.98 P75: 2.97 P99: 49.55 P99.9: 1995.74 P99.99: 3950.78 ------------------------------------------------------ [ 0, 1 ] 1333 1.350% 1.350% ( 1, 2 ] 49082 49.690% 51.039% ########## ( 2, 3 ] 24324 24.625% 75.664% ##### ( 3, 4 ] 10830 10.964% 86.628% ## ( 4, 6 ] 9741 9.862% 96.490% ## ( 6, 10 ] 2065 2.091% 98.581% ( 10, 15 ] 340 0.344% 98.925% ( 15, 22 ] 53 0.054% 98.979% ( 22, 34 ] 13 0.013% 98.992% ( 34, 51 ] 9 0.009% 99.001% ( 51, 76 ] 2 0.002% 99.003% ( 76, 110 ] 25 0.025% 99.028% ( 110, 170 ] 55 0.056% 99.084% ( 170, 250 ] 81 0.082% 99.166% ( 250, 380 ] 94 0.095% 99.261% ( 380, 580 ] 155 0.157% 99.418% ( 580, 870 ] 202 0.205% 99.622% ( 870, 1300 ] 165 0.167% 99.789% ( 1300, 1900 ] 103 0.104% 99.894% ( 1900, 2900 ] 65 0.066% 99.960% ( 2900, 4400 ] 43 0.044% 100.003% ( 4400, 6600 ] 18 0.018% 100.021% ( 6600, 9900 ] 3 0.003% 100.024% ** Level 5 read latency histogram (micros): Count: 260 Average: 1355.9346 StdDev: 1510.72 Min: 77 Median: 655.1852 Max: 7207 Percentiles: P50: 655.19 P75: 2233.33 P99: 7040.00 P99.9: 7207.00 P99.99: 7207.00 ------------------------------------------------------ ( 76, 110 ] 19 7.308% 7.308% # ( 110, 170 ] 25 9.615% 16.923% ## ( 170, 250 ] 21 8.077% 25.000% ## ( 250, 380 ] 30 11.538% 36.538% ## ( 380, 580 ] 28 10.769% 47.308% ## ( 580, 870 ] 27 10.385% 57.692% ## ( 870, 1300 ] 22 8.462% 66.154% ## ( 1300, 1900 ] 16 6.154% 72.308% # ( 1900, 2900 ] 21 8.077% 80.385% ## ( 2900, 4400 ] 40 15.385% 95.769% ### ( 4400, 6600 ] 8 3.077% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 52.5 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 168.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.346 H:M:S, 52.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-05:29:31 ... thread 0: (1000000,10000000) ops and (171170.2,172205.1) ops/second in (5.842139,58.070297) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.46 GB 169.9 8.4 0.0 8.4 18.0 9.5 0.0 1.9 134.5 286.6 64.14 57.21 166 0.386 8762K 11K 0.0 0.0 L1 15/0 1.36 GB 139.2 10.8 6.9 3.9 10.6 6.7 0.2 1.5 217.0 214.3 50.82 46.52 5 10.164 9806K 45K 0.0 0.0 L2 2/1 134.05 MB 0.7 0.2 0.1 0.1 0.2 0.1 5.6 1.5 243.0 242.8 0.79 0.76 2 0.396 195K 91 0.0 0.0 L3 32/9 1.77 GB 1.0 3.0 1.4 1.6 3.0 1.4 4.2 2.1 140.6 139.3 22.12 14.30 16 1.382 3158K 28K 0.0 0.0 L4 160/11 9.65 GB 1.0 4.0 3.3 0.6 4.0 3.3 1.0 1.2 124.6 124.2 32.72 19.08 33 0.992 4120K 13K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/25 105.49 GB 0.0 26.4 11.8 14.6 35.8 21.1 15.2 3.7 158.5 214.6 170.59 137.87 222 0.768 26M 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.4 11.8 14.6 35.8 21.1 15.2 3.7 158.5 214.6 170.59 137.87 222 0.768 26M 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.4 11.8 14.6 26.2 11.6 0.0 0.0 194.1 192.7 139.33 112.65 85 1.639 26M 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 312.4 31.26 25.22 137 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.3 total, 58.1 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.75 GB write, 627.65 MB/s write, 26.40 GB read, 463.53 MB/s read, 170.6 seconds Interval compaction: 35.75 GB write, 630.44 MB/s write, 26.40 GB read, 465.59 MB/s read, 170.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 65, interval: 97 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4116375 Average: 2.6465 StdDev: 26.67 Min: 0 Median: 1.4830 Max: 8023 Percentiles: P50: 1.48 P75: 1.86 P99: 5.94 P99.9: 106.42 P99.99: 301.08 ------------------------------------------------------ [ 0, 1 ] 752530 18.281% 18.281% #### ( 1, 2 ] 2703420 65.675% 83.956% ############# ( 2, 3 ] 382120 9.283% 93.239% ## ( 3, 4 ] 145465 3.534% 96.773% # ( 4, 6 ] 94736 2.301% 99.074% ( 6, 10 ] 27144 0.659% 99.734% ( 10, 15 ] 3576 0.087% 99.821% ( 15, 22 ] 571 0.014% 99.834% ( 22, 34 ] 36 0.001% 99.835% ( 34, 51 ] 14 0.000% 99.836% ( 51, 76 ] 83 0.002% 99.838% ( 76, 110 ] 2868 0.070% 99.907% ( 110, 170 ] 2463 0.060% 99.967% ( 170, 250 ] 704 0.017% 99.984% ( 250, 380 ] 599 0.015% 99.999% ( 380, 580 ] 508 0.012% 100.011% ( 580, 870 ] 382 0.009% 100.021% ( 870, 1300 ] 150 0.004% 100.024% ( 1300, 1900 ] 69 0.002% 100.026% ( 1900, 2900 ] 61 0.001% 100.027% ( 2900, 4400 ] 68 0.002% 100.029% ( 4400, 6600 ] 20 0.000% 100.029% ( 6600, 9900 ] 6 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 2205188 Average: 5.2813 StdDev: 88.94 Min: 1 Median: 1.6656 Max: 14289 Percentiles: P50: 1.67 P75: 2.41 P99: 9.02 P99.9: 129.07 P99.99: 304.09 ------------------------------------------------------ [ 0, 1 ] 290097 13.155% 13.155% ### ( 1, 2 ] 1220611 55.352% 68.507% ########### ( 2, 3 ] 346771 15.725% 84.232% ### ( 3, 4 ] 148846 6.750% 90.982% # ( 4, 6 ] 146159 6.628% 97.610% # ( 6, 10 ] 40638 1.843% 99.453% ( 10, 15 ] 6337 0.287% 99.740% ( 15, 22 ] 1028 0.047% 99.787% ( 22, 34 ] 74 0.003% 99.790% ( 34, 51 ] 23 0.001% 99.791% ( 51, 76 ] 192 0.009% 99.800% ( 76, 110 ] 1618 0.073% 99.873% ( 110, 170 ] 1853 0.084% 99.957% ( 170, 250 ] 485 0.022% 99.979% ( 250, 380 ] 566 0.026% 100.005% ( 380, 580 ] 668 0.030% 100.035% ( 580, 870 ] 683 0.031% 100.066% ( 870, 1300 ] 461 0.021% 100.087% ( 1300, 1900 ] 260 0.012% 100.099% ( 1900, 2900 ] 366 0.017% 100.116% ( 2900, 4400 ] 454 0.021% 100.136% ( 4400, 6600 ] 158 0.007% 100.143% ( 6600, 9900 ] 51 0.002% 100.146% ( 9900, 14000 ] 2 0.000% 100.146% ( 14000, 22000 ] 1 0.000% 100.146% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.2637 StdDev: 4.34 Min: 1 Median: 1.5537 Max: 773 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.00 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 5804 12.100% 12.100% ## ( 1, 2 ] 32831 68.446% 80.547% ############## ( 2, 3 ] 5418 11.296% 91.842% ## ( 3, 4 ] 2050 4.274% 96.116% # ( 4, 6 ] 1471 3.067% 99.183% # ( 6, 10 ] 344 0.717% 99.900% ( 10, 15 ] 38 0.079% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 490478 Average: 9.6380 StdDev: 123.54 Min: 0 Median: 1.9266 Max: 8182 Percentiles: P50: 1.93 P75: 2.93 P99: 9.68 P99.9: 896.90 P99.99: 1299.05 ------------------------------------------------------ [ 0, 1 ] 11733 2.392% 2.392% ( 1, 2 ] 252005 51.379% 53.772% ########## ( 2, 3 ] 112219 22.880% 76.651% ##### ( 3, 4 ] 53444 10.896% 87.547% ## ( 4, 6 ] 48633 9.915% 97.463% ## ( 6, 10 ] 8202 1.672% 99.135% ( 10, 15 ] 1434 0.292% 99.427% ( 15, 22 ] 198 0.040% 99.468% ( 22, 34 ] 35 0.007% 99.475% ( 34, 51 ] 7 0.001% 99.476% ( 51, 76 ] 3 0.001% 99.477% ( 76, 110 ] 40 0.008% 99.485% ( 110, 170 ] 195 0.040% 99.525% ( 170, 250 ] 258 0.053% 99.578% ( 250, 380 ] 417 0.085% 99.663% ( 380, 580 ] 571 0.116% 99.779% ( 580, 870 ] 565 0.115% 99.894% ( 870, 1300 ] 472 0.096% 99.990% ( 1300, 1900 ] 233 0.048% 100.038% ( 1900, 2900 ] 184 0.038% 100.075% ( 2900, 4400 ] 214 0.044% 100.119% ( 4400, 6600 ] 53 0.011% 100.130% ( 6600, 9900 ] 13 0.003% 100.133% ** Level 4 read latency histogram (micros): Count: 111319 Average: 13.2783 StdDev: 143.89 Min: 0 Median: 1.9808 Max: 9451 Percentiles: P50: 1.98 P75: 2.98 P99: 105.66 P99.9: 1876.65 P99.99: 3802.38 ------------------------------------------------------ [ 0, 1 ] 1503 1.350% 1.350% ( 1, 2 ] 55217 49.602% 50.953% ########## ( 2, 3 ] 27266 24.494% 75.446% ##### ( 3, 4 ] 12198 10.958% 86.404% ## ( 4, 6 ] 11127 9.996% 96.400% ## ( 6, 10 ] 2401 2.157% 98.556% ( 10, 15 ] 389 0.349% 98.906% ( 15, 22 ] 59 0.053% 98.959% ( 22, 34 ] 13 0.012% 98.971% ( 34, 51 ] 9 0.008% 98.979% ( 51, 76 ] 2 0.002% 98.980% ( 76, 110 ] 25 0.022% 99.003% ( 110, 170 ] 59 0.053% 99.056% ( 170, 250 ] 93 0.084% 99.139% ( 250, 380 ] 114 0.102% 99.242% ( 380, 580 ] 182 0.163% 99.405% ( 580, 870 ] 242 0.217% 99.623% ( 870, 1300 ] 202 0.181% 99.804% ( 1300, 1900 ] 111 0.100% 99.904% ( 1900, 2900 ] 70 0.063% 99.967% ( 2900, 4400 ] 43 0.039% 100.005% ( 4400, 6600 ] 18 0.016% 100.022% ( 6600, 9900 ] 3 0.003% 100.024% ** Level 5 read latency histogram (micros): Count: 260 Average: 1355.9346 StdDev: 1510.72 Min: 77 Median: 655.1852 Max: 7207 Percentiles: P50: 655.19 P75: 2233.33 P99: 7040.00 P99.9: 7207.00 P99.99: 7207.00 ------------------------------------------------------ ( 76, 110 ] 19 7.308% 7.308% # ( 110, 170 ] 25 9.615% 16.923% ## ( 170, 250 ] 21 8.077% 25.000% ## ( 250, 380 ] 30 11.538% 36.538% ## ( 380, 580 ] 28 10.769% 47.308% ## ( 580, 870 ] 27 10.385% 57.692% ## ( 870, 1300 ] 22 8.462% 66.154% ## ( 1300, 1900 ] 16 6.154% 72.308% # ( 1900, 2900 ] 21 8.077% 80.385% ## ( 2900, 4400 ] 40 15.385% 95.769% ### ( 4400, 6600 ] 8 3.077% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 58.3 total, 5.8 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 168.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.349 H:M:S, 52.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 168.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.004 H:M:S, 51.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.697 micros/op 175530 ops/sec 60.001 seconds 10531999 operations; 170.1 MB/s Microseconds per write: Count: 10531999 Average: 5.6970 StdDev: 517.82 Min: 0 Median: 1.7383 Max: 887324 Percentiles: P50: 1.74 P75: 2.75 P99: 9.44 P99.9: 1109.15 P99.99: 2656.42 ------------------------------------------------------ [ 0, 1 ] 1412041 13.407% 13.407% ### ( 1, 2 ] 5219892 49.562% 62.969% ########## ( 2, 3 ] 1684387 15.993% 78.962% ### ( 3, 4 ] 1431023 13.587% 92.550% ### ( 4, 6 ] 566752 5.381% 97.931% # ( 6, 10 ] 130986 1.244% 99.175% ( 10, 15 ] 44658 0.424% 99.599% ( 15, 22 ] 10615 0.101% 99.700% ( 22, 34 ] 1962 0.019% 99.718% ( 34, 51 ] 263 0.002% 99.721% ( 51, 76 ] 40 0.000% 99.721% ( 76, 110 ] 7233 0.069% 99.790% ( 110, 170 ] 2957 0.028% 99.818% ( 170, 250 ] 331 0.003% 99.821% ( 250, 380 ] 210 0.002% 99.823% ( 380, 580 ] 38 0.000% 99.823% ( 580, 870 ] 23 0.000% 99.824% ( 870, 1300 ] 14485 0.138% 99.961% ( 1300, 1900 ] 40 0.000% 99.961% ( 1900, 2900 ] 3979 0.038% 99.999% ( 2900, 4400 ] 40 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 201305 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10531999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10869022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 586 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30725345 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30813658074 rocksdb.compact.write.bytes COUNT : 30600603995 rocksdb.flush.write.bytes COUNT : 10701292445 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 75 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 324 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10615055360 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4164608 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30920053512 rocksdb.non.last.level.read.count COUNT : 7464258 rocksdb.block.checksum.compute.count COUNT : 7463161 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.385866 P95 : 3.921923 P99 : 7.982178 P100 : 887312.000000 COUNT : 10531999 SUM : 55004539 rocksdb.compaction.times.micros P50 : 1081000.000000 P95 : 3775000.000000 P99 : 14400000.000000 P100 : 19373074.000000 COUNT : 95 SUM : 150858366 rocksdb.compaction.times.cpu_micros P50 : 888333.333333 P95 : 3775000.000000 P99 : 14400000.000000 P100 : 18021912.000000 COUNT : 95 SUM : 121491275 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.449438 P95 : 6270.000000 P99 : 87759.000000 P100 : 87759.000000 COUNT : 143 SUM : 409426 rocksdb.compaction.outfile.sync.micros P50 : 1133.450704 P95 : 168875.000000 P99 : 241850.000000 P100 : 283556.000000 COUNT : 363 SUM : 8593639 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.081395 P95 : 1643.333333 P99 : 4015.000000 P100 : 5409.000000 COUNT : 277 SUM : 91643 rocksdb.table.open.io.micros P50 : 1678.378378 P95 : 7997.000000 P99 : 12188.545455 P100 : 14937.000000 COUNT : 586 SUM : 1350301 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.624104 P95 : 7.676772 P99 : 10.771564 P100 : 14296.000000 COUNT : 7461845 SUM : 47366177 rocksdb.read.block.get.micros P50 : 528.571429 P95 : 3648.235294 P99 : 5124.307692 P100 : 7353.000000 COUNT : 1172 SUM : 1111766 rocksdb.write.raw.block.micros P50 : 0.514526 P95 : 0.977599 P99 : 2.976621 P100 : 18213.000000 COUNT : 10013969 SUM : 21664846 rocksdb.numfiles.in.singlecompaction P50 : 3.176136 P95 : 3.999432 P99 : 19.865000 P100 : 24.000000 COUNT : 161 SUM : 576 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569753 P95 : 1193.228637 P99 : 2523.771154 P100 : 887113.000000 COUNT : 152149 SUM : 30744363 rocksdb.sst.read.micros P50 : 1.585504 P95 : 4.558045 P99 : 8.260117 P100 : 14289.000000 COUNT : 7465013 SUM : 32229520 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10531999 SUM : 10869022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212800.000000 P95 : 515375.000000 P99 : 835060.000000 P100 : 1068303.000000 COUNT : 143 SUM : 32931549 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 354 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0