[2024-12-17 05:38:10.805982] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-17 05:38:10.806139] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2492746 ] Set seed to 1734410290802399 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-17 05:38:10.914062] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-17 05:38:10.937253] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-17 05:38:10.937299] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2492746' to capture a snapshot of events at runtime. [2024-12-17 05:38:10.937310] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-17 05:38:10.937320] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-17 05:38:10.937328] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2492746 for offline analysis/debug. [2024-12-17 05:38:10.937884] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 17 05:38:15 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/17-05:38:17 ... thread 0: (1000000,1000000) ops and (360577.7,360577.7) ops/second in (2.773327,2.773327) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 504.01 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.7 2.32 2.09 12 0.193 0 0 0.0 0.0 L1 1/0 1.90 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.9 246.7 1.02 0.99 1 1.020 255K 226 0.0 0.0 L2 3/2 298.60 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 16/9 755.44 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.8 199.8 0.31 0.27 1 0.313 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1176/17 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 103.0 301.1 4.13 3.80 15 0.276 432K 251 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 103.0 301.1 4.13 3.80 15 0.276 432K 251 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 234.1 234.0 1.82 1.71 3 0.606 432K 251 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.7 2.32 2.09 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 420.48 MB/s write, 0.42 GB read, 143.86 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 448.53 MB/s write, 0.42 GB read, 153.46 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 110375 Average: 1.8336 StdDev: 16.48 Min: 1 Median: 1.1409 Max: 3402 Percentiles: P50: 1.14 P75: 1.62 P99: 4.07 P99.9: 9.82 P99.99: 246.99 ------------------------------------------------------ [ 0, 1 ] 47112 42.684% 42.684% ######### ( 1, 2 ] 57317 51.929% 94.613% ########## ( 2, 3 ] 3400 3.080% 97.693% # ( 3, 4 ] 1417 1.284% 98.977% ( 4, 6 ] 772 0.699% 99.677% ( 6, 10 ] 260 0.236% 99.912% ( 10, 15 ] 58 0.053% 99.965% ( 15, 22 ] 12 0.011% 99.976% ( 22, 34 ] 5 0.005% 99.980% ( 51, 76 ] 2 0.002% 99.982% ( 110, 170 ] 10 0.009% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 3 0.003% 99.995% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 3 0.003% 100.002% ( 1900, 2900 ] 1 0.001% 100.003% ( 2900, 4400 ] 1 0.001% 100.004% ** Level 1 read latency histogram (micros): Count: 15360 Average: 2.9587 StdDev: 25.51 Min: 1 Median: 1.3099 Max: 1711 Percentiles: P50: 1.31 P75: 1.78 P99: 9.55 P99.9: 280.46 P99.99: 1439.20 ------------------------------------------------------ [ 0, 1 ] 5158 33.581% 33.581% ####### ( 1, 2 ] 8137 52.975% 86.556% ########### ( 2, 3 ] 1164 7.578% 94.134% ## ( 3, 4 ] 271 1.764% 95.898% ( 4, 6 ] 338 2.201% 98.099% ( 6, 10 ] 156 1.016% 99.115% ( 10, 15 ] 32 0.208% 99.323% ( 15, 22 ] 10 0.065% 99.388% ( 22, 34 ] 1 0.007% 99.395% ( 34, 51 ] 39 0.254% 99.648% ( 51, 76 ] 22 0.143% 99.792% ( 76, 110 ] 5 0.033% 99.824% ( 110, 170 ] 3 0.020% 99.844% ( 170, 250 ] 7 0.046% 99.889% ( 250, 380 ] 7 0.046% 99.935% ( 380, 580 ] 4 0.026% 99.961% ( 580, 870 ] 3 0.020% 99.980% ( 870, 1300 ] 1 0.007% 99.987% ( 1300, 1900 ] 2 0.013% 100.000% ** Level 2 read latency histogram (micros): Count: 15882 Average: 1.7549 StdDev: 3.78 Min: 0 Median: 1.1863 Max: 299 Percentiles: P50: 1.19 P75: 1.65 P99: 3.54 P99.9: 11.73 P99.99: 276.77 ------------------------------------------------------ [ 0, 1 ] 6333 39.875% 39.875% ######## ( 1, 2 ] 8632 54.351% 94.226% ########### ( 2, 3 ] 680 4.282% 98.508% # ( 3, 4 ] 145 0.913% 99.421% ( 4, 6 ] 44 0.277% 99.698% ( 6, 10 ] 29 0.183% 99.880% ( 10, 15 ] 9 0.057% 99.937% ( 15, 22 ] 3 0.019% 99.956% ( 34, 51 ] 2 0.013% 99.969% ( 51, 76 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 3990 Average: 22.8323 StdDev: 209.12 Min: 1 Median: 2.2227 Max: 4957 Percentiles: P50: 2.22 P75: 3.70 P99: 468.75 P99.9: 3402.50 P99.99: 4300.25 ------------------------------------------------------ [ 0, 1 ] 230 5.764% 5.764% # ( 1, 2 ] 1575 39.474% 45.238% ######## ( 2, 3 ] 853 21.378% 66.617% #### ( 3, 4 ] 475 11.905% 78.521% ## ( 4, 6 ] 453 11.353% 89.875% ## ( 6, 10 ] 230 5.764% 95.639% # ( 10, 15 ] 48 1.203% 96.842% ( 15, 22 ] 15 0.376% 97.218% ( 22, 34 ] 3 0.075% 97.293% ( 34, 51 ] 2 0.050% 97.343% ( 51, 76 ] 8 0.201% 97.544% ( 76, 110 ] 1 0.025% 97.569% ( 110, 170 ] 27 0.677% 98.246% ( 170, 250 ] 15 0.376% 98.622% ( 250, 380 ] 8 0.201% 98.822% ( 380, 580 ] 16 0.401% 99.223% ( 580, 870 ] 15 0.376% 99.599% ( 870, 1300 ] 2 0.050% 99.649% ( 1300, 1900 ] 2 0.050% 99.699% ( 1900, 2900 ] 6 0.150% 99.850% ( 2900, 4400 ] 6 0.150% 100.000% ( 4400, 6600 ] 2 0.050% 100.050% ** Level 4 read latency histogram (micros): Count: 35 Average: 1809.1714 StdDev: 1751.26 Min: 117 Median: 941.6667 Max: 5877 Percentiles: P50: 941.67 P75: 2993.75 P99: 5877.00 P99.9: 5877.00 P99.99: 5877.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 1 2.857% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 9 25.714% 48.571% ##### ( 870, 1300 ] 3 8.571% 57.143% ## ( 1300, 1900 ] 4 11.429% 68.571% ## ( 1900, 2900 ] 2 5.714% 74.286% # ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 332.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.201 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.201 H:M:S, 7.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/17-05:38:21 ... thread 0: (1000000,2000000) ops and (302705.5,329116.9) ops/second in (3.303541,6.076868) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.54 GB 12.6 0.9 0.0 0.9 2.8 1.8 0.0 1.5 104.2 312.6 9.06 8.40 29 0.313 959K 1270 0.0 0.0 L1 1/1 1.90 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.9 246.7 1.02 0.99 1 1.020 255K 226 0.0 0.0 L2 1/1 121.05 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 76/33 932.48 MB 0.8 1.0 0.2 0.7 1.0 0.2 0.0 4.1 205.0 204.9 4.82 4.14 3 1.608 1004K 553 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/45 97.98 GB 0.0 2.2 0.5 1.8 4.1 2.3 0.4 2.2 149.2 271.9 15.39 13.98 34 0.453 2332K 2074 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 0.5 1.8 4.1 2.3 0.4 2.2 149.2 271.9 15.39 13.98 34 0.453 2332K 2074 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 0.5 1.8 2.2 0.5 0.0 0.0 230.3 230.1 9.98 9.16 8 1.247 2332K 2074 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.8 5.42 4.82 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.09 GB write, 668.20 MB/s write, 2.24 GB read, 366.80 MB/s read, 15.4 seconds Interval compaction: 4.09 GB write, 688.55 MB/s write, 2.24 GB read, 377.97 MB/s read, 15.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 407587 Average: 2.2037 StdDev: 12.05 Min: 1 Median: 1.4793 Max: 3402 Percentiles: P50: 1.48 P75: 1.88 P99: 5.68 P99.9: 10.91 P99.99: 15.91 ------------------------------------------------------ [ 0, 1 ] 80988 19.870% 19.870% #### ( 1, 2 ] 256232 62.866% 82.736% ############# ( 2, 3 ] 41507 10.184% 92.919% ## ( 3, 4 ] 15946 3.912% 96.832% # ( 4, 6 ] 10509 2.578% 99.410% # ( 6, 10 ] 1918 0.471% 99.881% ( 10, 15 ] 441 0.108% 99.989% ( 15, 22 ] 48 0.012% 100.000% ( 22, 34 ] 7 0.002% 100.002% ( 34, 51 ] 1 0.000% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 110, 170 ] 12 0.003% 100.006% ( 170, 250 ] 9 0.002% 100.009% ( 250, 380 ] 9 0.002% 100.011% ( 380, 580 ] 6 0.001% 100.012% ( 580, 870 ] 5 0.001% 100.013% ( 870, 1300 ] 8 0.002% 100.015% ( 1300, 1900 ] 5 0.001% 100.017% ( 1900, 2900 ] 3 0.001% 100.017% ( 2900, 4400 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 57549 Average: 2.6282 StdDev: 13.22 Min: 1 Median: 1.6048 Max: 1711 Percentiles: P50: 1.60 P75: 2.09 P99: 7.59 P99.9: 49.89 P99.99: 603.69 ------------------------------------------------------ [ 0, 1 ] 7906 13.738% 13.738% ### ( 1, 2 ] 34502 59.952% 73.690% ############ ( 2, 3 ] 8602 14.947% 88.638% ### ( 3, 4 ] 2966 5.154% 93.791% # ( 4, 6 ] 2756 4.789% 98.580% # ( 6, 10 ] 606 1.053% 99.633% ( 10, 15 ] 98 0.170% 99.804% ( 15, 22 ] 17 0.030% 99.833% ( 22, 34 ] 2 0.003% 99.837% ( 34, 51 ] 39 0.068% 99.904% ( 51, 76 ] 23 0.040% 99.944% ( 76, 110 ] 5 0.009% 99.953% ( 110, 170 ] 3 0.005% 99.958% ( 170, 250 ] 7 0.012% 99.970% ( 250, 380 ] 7 0.012% 99.983% ( 380, 580 ] 4 0.007% 99.990% ( 580, 870 ] 3 0.005% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 28269 Average: 1.9518 StdDev: 2.91 Min: 0 Median: 1.3593 Max: 299 Percentiles: P50: 1.36 P75: 1.79 P99: 5.20 P99.9: 9.75 P99.99: 183.85 ------------------------------------------------------ [ 0, 1 ] 8173 28.912% 28.912% ###### ( 1, 2 ] 16591 58.690% 87.601% ############ ( 2, 3 ] 2200 7.782% 95.384% ## ( 3, 4 ] 762 2.696% 98.079% # ( 4, 6 ] 434 1.535% 99.614% ( 6, 10 ] 86 0.304% 99.919% ( 10, 15 ] 13 0.046% 99.965% ( 15, 22 ] 3 0.011% 99.975% ( 34, 51 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 193989 Average: 3.4017 StdDev: 33.65 Min: 1 Median: 1.6284 Max: 4957 Percentiles: P50: 1.63 P75: 2.19 P99: 9.33 P99.9: 196.35 P99.99: 692.69 ------------------------------------------------------ [ 0, 1 ] 24814 12.791% 12.791% ### ( 1, 2 ] 114858 59.209% 72.000% ############ ( 2, 3 ] 29947 15.437% 87.437% ### ( 3, 4 ] 10394 5.358% 92.795% # ( 4, 6 ] 8683 4.476% 97.271% # ( 6, 10 ] 4033 2.079% 99.350% ( 10, 15 ] 482 0.248% 99.599% ( 15, 22 ] 117 0.060% 99.659% ( 22, 34 ] 55 0.028% 99.688% ( 34, 51 ] 11 0.006% 99.693% ( 51, 76 ] 24 0.012% 99.706% ( 76, 110 ] 129 0.066% 99.772% ( 110, 170 ] 221 0.114% 99.886% ( 170, 250 ] 82 0.042% 99.928% ( 250, 380 ] 53 0.027% 99.956% ( 380, 580 ] 53 0.027% 99.983% ( 580, 870 ] 35 0.018% 100.001% ( 870, 1300 ] 12 0.006% 100.007% ( 1300, 1900 ] 2 0.001% 100.008% ( 1900, 2900 ] 7 0.004% 100.012% ( 2900, 4400 ] 6 0.003% 100.015% ( 4400, 6600 ] 2 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1809.1714 StdDev: 1751.26 Min: 117 Median: 941.6667 Max: 5877 Percentiles: P50: 941.67 P75: 2993.75 P99: 5877.00 P99.9: 5877.00 P99.99: 5877.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 1 2.857% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 9 25.714% 48.571% ##### ( 870, 1300 ] 3 8.571% 57.143% ## ( 1300, 1900 ] 4 11.429% 68.571% ## ( 1900, 2900 ] 2 5.714% 74.286% # ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 6.3 total, 3.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 314.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.839 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.638 H:M:S, 19.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/17-05:38:24 ... thread 0: (1000000,3000000) ops and (330837.1,329688.3) ops/second in (3.022636,9.099504) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.46 GB 107.0 1.7 0.0 1.7 4.5 2.8 0.0 1.6 118.6 309.0 14.87 13.85 45 0.331 1791K 2175 0.0 0.0 L1 1/1 1.90 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.9 246.7 1.02 0.99 1 1.020 255K 226 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 39/0 993.22 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 208.0 207.9 5.80 5.05 4 1.450 1199K 553 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1215/11 98.90 GB 0.0 3.3 0.6 2.7 6.0 3.4 0.5 2.2 150.3 278.0 22.18 20.35 51 0.435 3359K 2979 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 0.6 2.7 6.0 3.4 0.5 2.2 150.3 278.0 22.18 20.35 51 0.435 3359K 2979 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 0.6 2.7 3.3 0.6 0.0 0.0 236.7 236.5 14.08 13.15 12 1.173 3359K 2979 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.0 8.10 7.21 39 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.02 GB write, 663.88 MB/s write, 3.25 GB read, 358.95 MB/s read, 22.2 seconds Interval compaction: 6.02 GB write, 677.38 MB/s write, 3.25 GB read, 366.24 MB/s read, 22.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 799813 Average: 2.2241 StdDev: 10.77 Min: 1 Median: 1.5015 Max: 3438 Percentiles: P50: 1.50 P75: 1.88 P99: 5.65 P99.9: 10.63 P99.99: 14.76 ------------------------------------------------------ [ 0, 1 ] 137214 17.156% 17.156% ### ( 1, 2 ] 523809 65.491% 82.647% ############# ( 2, 3 ] 84424 10.555% 93.203% ## ( 3, 4 ] 31017 3.878% 97.081% # ( 4, 6 ] 18605 2.326% 99.407% ( 6, 10 ] 3834 0.479% 99.886% ( 10, 15 ] 872 0.109% 99.995% ( 15, 22 ] 67 0.008% 100.004% ( 22, 34 ] 9 0.001% 100.005% ( 34, 51 ] 3 0.000% 100.005% ( 51, 76 ] 9 0.001% 100.006% ( 76, 110 ] 24 0.003% 100.009% ( 110, 170 ] 40 0.005% 100.014% ( 170, 250 ] 28 0.004% 100.018% ( 250, 380 ] 22 0.003% 100.021% ( 380, 580 ] 18 0.002% 100.023% ( 580, 870 ] 12 0.002% 100.024% ( 870, 1300 ] 14 0.002% 100.026% ( 1300, 1900 ] 8 0.001% 100.027% ( 1900, 2900 ] 3 0.000% 100.027% ( 2900, 4400 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 75710 Average: 2.5744 StdDev: 11.54 Min: 1 Median: 1.6208 Max: 1711 Percentiles: P50: 1.62 P75: 2.11 P99: 7.10 P99.9: 41.97 P99.99: 501.45 ------------------------------------------------------ [ 0, 1 ] 8946 11.816% 11.816% ## ( 1, 2 ] 46566 61.506% 73.322% ############ ( 2, 3 ] 11787 15.569% 88.891% ### ( 3, 4 ] 4020 5.310% 94.200% # ( 4, 6 ] 3435 4.537% 98.737% # ( 6, 10 ] 724 0.956% 99.694% ( 10, 15 ] 117 0.155% 99.848% ( 15, 22 ] 19 0.025% 99.873% ( 22, 34 ] 2 0.003% 99.876% ( 34, 51 ] 39 0.052% 99.927% ( 51, 76 ] 23 0.030% 99.958% ( 76, 110 ] 5 0.007% 99.964% ( 110, 170 ] 3 0.004% 99.968% ( 170, 250 ] 7 0.009% 99.978% ( 250, 380 ] 7 0.009% 99.987% ( 380, 580 ] 4 0.005% 99.992% ( 580, 870 ] 3 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 28269 Average: 1.9518 StdDev: 2.91 Min: 0 Median: 1.3593 Max: 299 Percentiles: P50: 1.36 P75: 1.79 P99: 5.20 P99.9: 9.75 P99.99: 183.85 ------------------------------------------------------ [ 0, 1 ] 8173 28.912% 28.912% ###### ( 1, 2 ] 16591 58.690% 87.601% ############ ( 2, 3 ] 2200 7.782% 95.384% ## ( 3, 4 ] 762 2.696% 98.079% # ( 4, 6 ] 434 1.535% 99.614% ( 6, 10 ] 86 0.304% 99.919% ( 10, 15 ] 13 0.046% 99.965% ( 15, 22 ] 3 0.011% 99.975% ( 34, 51 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 214943 Average: 3.2893 StdDev: 32.02 Min: 1 Median: 1.6177 Max: 4957 Percentiles: P50: 1.62 P75: 2.13 P99: 9.19 P99.9: 179.69 P99.99: 680.74 ------------------------------------------------------ [ 0, 1 ] 27495 12.792% 12.792% ### ( 1, 2 ] 129477 60.238% 73.030% ############ ( 2, 3 ] 32184 14.973% 88.003% ### ( 3, 4 ] 11231 5.225% 93.228% # ( 4, 6 ] 9095 4.231% 97.459% # ( 6, 10 ] 4156 1.934% 99.393% ( 10, 15 ] 521 0.242% 99.635% ( 15, 22 ] 119 0.055% 99.691% ( 22, 34 ] 55 0.026% 99.716% ( 34, 51 ] 11 0.005% 99.721% ( 51, 76 ] 24 0.011% 99.732% ( 76, 110 ] 129 0.060% 99.793% ( 110, 170 ] 221 0.103% 99.895% ( 170, 250 ] 83 0.039% 99.934% ( 250, 380 ] 55 0.026% 99.960% ( 380, 580 ] 53 0.025% 99.984% ( 580, 870 ] 36 0.017% 100.001% ( 870, 1300 ] 12 0.006% 100.007% ( 1300, 1900 ] 2 0.001% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 6 0.003% 100.013% ( 4400, 6600 ] 2 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 1809.1714 StdDev: 1751.26 Min: 117 Median: 941.6667 Max: 5877 Percentiles: P50: 941.67 P75: 2993.75 P99: 5877.00 P99.9: 5877.00 P99.99: 5877.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 1 2.857% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 9 25.714% 48.571% ##### ( 870, 1300 ] 3 8.571% 57.143% ## ( 1300, 1900 ] 4 11.429% 68.571% ## ( 1900, 2900 ] 2 5.714% 74.286% # ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 9.3 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 317.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.245 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.406 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-05:38:27 ... thread 0: (1000000,4000000) ops and (331719.5,330193.8) ops/second in (3.014595,12.114099) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.27 GB 25.2 2.2 0.0 2.2 6.0 3.7 0.0 1.6 115.7 311.7 19.60 18.25 61 0.321 2302K 2661 0.0 0.0 L1 11/11 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 232.6 231.6 6.23 6.02 2 3.115 1471K 5881 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 39/0 993.22 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 208.0 207.9 5.80 5.05 4 1.450 1199K 553 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1227/25 99.88 GB 0.0 4.9 1.8 3.2 8.7 5.5 0.5 2.3 156.8 276.2 32.11 29.79 68 0.472 5087K 9120 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 1.8 3.2 8.7 5.5 0.5 2.3 156.8 276.2 32.11 29.79 68 0.472 5087K 9120 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 1.8 3.2 4.9 1.8 0.0 0.0 237.8 237.3 21.17 20.03 15 1.412 5087K 9120 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 351.3 10.94 9.76 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.66 GB write, 720.93 MB/s write, 4.92 GB read, 409.30 MB/s read, 32.1 seconds Interval compaction: 8.66 GB write, 731.95 MB/s write, 4.92 GB read, 415.56 MB/s read, 32.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1063798 Average: 2.2124 StdDev: 11.51 Min: 1 Median: 1.4815 Max: 4051 Percentiles: P50: 1.48 P75: 1.86 P99: 5.59 P99.9: 10.70 P99.99: 81.72 ------------------------------------------------------ [ 0, 1 ] 195415 18.370% 18.370% #### ( 1, 2 ] 698802 65.689% 84.059% ############# ( 2, 3 ] 104153 9.791% 93.850% ## ( 3, 4 ] 37569 3.532% 97.381% # ( 4, 6 ] 21675 2.038% 99.419% ( 6, 10 ] 4984 0.469% 99.887% ( 10, 15 ] 975 0.092% 99.979% ( 15, 22 ] 81 0.008% 99.986% ( 22, 34 ] 9 0.001% 99.987% ( 34, 51 ] 4 0.000% 99.988% ( 51, 76 ] 12 0.001% 99.989% ( 76, 110 ] 81 0.008% 99.996% ( 110, 170 ] 111 0.010% 100.007% ( 170, 250 ] 52 0.005% 100.012% ( 250, 380 ] 46 0.004% 100.016% ( 380, 580 ] 33 0.003% 100.019% ( 580, 870 ] 23 0.002% 100.021% ( 870, 1300 ] 17 0.002% 100.023% ( 1300, 1900 ] 9 0.001% 100.024% ( 1900, 2900 ] 3 0.000% 100.024% ( 2900, 4400 ] 4 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 108323 Average: 2.8083 StdDev: 17.76 Min: 0 Median: 1.5620 Max: 1717 Percentiles: P50: 1.56 P75: 1.96 P99: 7.73 P99.9: 160.40 P99.99: 880.30 ------------------------------------------------------ [ 0, 1 ] 16158 14.916% 14.916% ### ( 1, 2 ] 67626 62.430% 77.346% ############ ( 2, 3 ] 14251 13.156% 90.502% ### ( 3, 4 ] 4744 4.379% 94.882% # ( 4, 6 ] 3956 3.652% 98.534% # ( 6, 10 ] 1165 1.075% 99.610% ( 10, 15 ] 155 0.143% 99.753% ( 15, 22 ] 24 0.022% 99.775% ( 22, 34 ] 2 0.002% 99.777% ( 34, 51 ] 40 0.037% 99.814% ( 51, 76 ] 26 0.024% 99.838% ( 76, 110 ] 24 0.022% 99.860% ( 110, 170 ] 52 0.048% 99.908% ( 170, 250 ] 32 0.030% 99.937% ( 250, 380 ] 23 0.021% 99.958% ( 380, 580 ] 22 0.020% 99.979% ( 580, 870 ] 12 0.011% 99.990% ( 870, 1300 ] 7 0.006% 99.996% ( 1300, 1900 ] 4 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 28269 Average: 1.9518 StdDev: 2.91 Min: 0 Median: 1.3593 Max: 299 Percentiles: P50: 1.36 P75: 1.79 P99: 5.20 P99.9: 9.75 P99.99: 183.85 ------------------------------------------------------ [ 0, 1 ] 8173 28.912% 28.912% ###### ( 1, 2 ] 16591 58.690% 87.601% ############ ( 2, 3 ] 2200 7.782% 95.384% ## ( 3, 4 ] 762 2.696% 98.079% # ( 4, 6 ] 434 1.535% 99.614% ( 6, 10 ] 86 0.304% 99.919% ( 10, 15 ] 13 0.046% 99.965% ( 15, 22 ] 3 0.011% 99.975% ( 34, 51 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 214943 Average: 3.2893 StdDev: 32.02 Min: 1 Median: 1.6177 Max: 4957 Percentiles: P50: 1.62 P75: 2.13 P99: 9.19 P99.9: 179.69 P99.99: 680.74 ------------------------------------------------------ [ 0, 1 ] 27495 12.792% 12.792% ### ( 1, 2 ] 129477 60.238% 73.030% ############ ( 2, 3 ] 32184 14.973% 88.003% ### ( 3, 4 ] 11231 5.225% 93.228% # ( 4, 6 ] 9095 4.231% 97.459% # ( 6, 10 ] 4156 1.934% 99.393% ( 10, 15 ] 521 0.242% 99.635% ( 15, 22 ] 119 0.055% 99.691% ( 22, 34 ] 55 0.026% 99.716% ( 34, 51 ] 11 0.005% 99.721% ( 51, 76 ] 24 0.011% 99.732% ( 76, 110 ] 129 0.060% 99.793% ( 110, 170 ] 221 0.103% 99.895% ( 170, 250 ] 83 0.039% 99.934% ( 250, 380 ] 55 0.026% 99.960% ( 380, 580 ] 53 0.025% 99.984% ( 580, 870 ] 36 0.017% 100.001% ( 870, 1300 ] 12 0.006% 100.007% ( 1300, 1900 ] 2 0.001% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 6 0.003% 100.013% ( 4400, 6600 ] 2 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 1809.1714 StdDev: 1751.26 Min: 117 Median: 941.6667 Max: 5877 Percentiles: P50: 941.67 P75: 2993.75 P99: 5877.00 P99.9: 5877.00 P99.99: 5877.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 1 2.857% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 9 25.714% 48.571% ##### ( 870, 1300 ] 3 8.571% 57.143% ## ( 1300, 1900 ] 4 11.429% 68.571% ## ( 1900, 2900 ] 2 5.714% 74.286% # ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 12.3 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.674 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.429 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-05:38:30 ... thread 0: (1000000,5000000) ops and (299972.0,323671.9) ops/second in (3.333645,15.447744) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.20 GB 119.6 3.3 0.0 3.3 8.0 4.7 0.0 1.7 128.1 308.3 26.55 24.83 79 0.336 3454K 3857 0.0 0.0 L1 11/11 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 232.6 231.6 6.23 6.02 2 3.115 1471K 5881 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 39/0 993.22 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 208.0 207.9 5.80 5.05 4 1.450 1199K 553 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1229/25 100.80 GB 0.0 6.0 1.8 4.3 10.7 6.4 0.5 2.3 157.9 280.2 39.07 36.37 86 0.454 6238K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 1.8 4.3 10.7 6.4 0.5 2.3 157.9 280.2 39.07 36.37 86 0.454 6238K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 1.8 4.3 6.0 1.8 0.0 0.0 242.5 242.1 25.43 24.21 19 1.339 6238K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.2 13.63 12.16 67 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.69 GB write, 700.10 MB/s write, 6.02 GB read, 394.56 MB/s read, 39.1 seconds Interval compaction: 10.69 GB write, 708.49 MB/s write, 6.02 GB read, 399.29 MB/s read, 39.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 18, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1434479 Average: 2.2243 StdDev: 11.74 Min: 1 Median: 1.4872 Max: 4051 Percentiles: P50: 1.49 P75: 1.86 P99: 5.57 P99.9: 10.77 P99.99: 83.90 ------------------------------------------------------ [ 0, 1 ] 253642 17.682% 17.682% #### ( 1, 2 ] 951530 66.333% 84.015% ############# ( 2, 3 ] 142711 9.949% 93.963% ## ( 3, 4 ] 50265 3.504% 97.467% # ( 4, 6 ] 28004 1.952% 99.420% ( 6, 10 ] 6689 0.466% 99.886% ( 10, 15 ] 1332 0.093% 99.979% ( 15, 22 ] 104 0.007% 99.986% ( 22, 34 ] 13 0.001% 99.987% ( 34, 51 ] 7 0.000% 99.987% ( 51, 76 ] 18 0.001% 99.989% ( 76, 110 ] 97 0.007% 99.995% ( 110, 170 ] 177 0.012% 100.008% ( 170, 250 ] 81 0.006% 100.013% ( 250, 380 ] 63 0.004% 100.018% ( 380, 580 ] 46 0.003% 100.021% ( 580, 870 ] 31 0.002% 100.023% ( 870, 1300 ] 23 0.002% 100.025% ( 1300, 1900 ] 13 0.001% 100.026% ( 1900, 2900 ] 6 0.000% 100.026% ( 2900, 4400 ] 5 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 180658 Average: 2.7635 StdDev: 15.38 Min: 0 Median: 1.5610 Max: 1717 Percentiles: P50: 1.56 P75: 1.95 P99: 8.10 P99.9: 153.79 P99.99: 723.64 ------------------------------------------------------ [ 0, 1 ] 24469 13.544% 13.544% ### ( 1, 2 ] 117403 64.986% 78.531% ############# ( 2, 3 ] 23146 12.812% 91.343% ### ( 3, 4 ] 7132 3.948% 95.291% # ( 4, 6 ] 5488 3.038% 98.328% # ( 6, 10 ] 2310 1.279% 99.607% ( 10, 15 ] 246 0.136% 99.743% ( 15, 22 ] 28 0.015% 99.759% ( 22, 34 ] 2 0.001% 99.760% ( 34, 51 ] 40 0.022% 99.782% ( 51, 76 ] 29 0.016% 99.798% ( 76, 110 ] 88 0.049% 99.847% ( 110, 170 ] 132 0.073% 99.920% ( 170, 250 ] 45 0.025% 99.945% ( 250, 380 ] 36 0.020% 99.965% ( 380, 580 ] 39 0.022% 99.986% ( 580, 870 ] 14 0.008% 99.994% ( 870, 1300 ] 7 0.004% 99.998% ( 1300, 1900 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28269 Average: 1.9518 StdDev: 2.91 Min: 0 Median: 1.3593 Max: 299 Percentiles: P50: 1.36 P75: 1.79 P99: 5.20 P99.9: 9.75 P99.99: 183.85 ------------------------------------------------------ [ 0, 1 ] 8173 28.912% 28.912% ###### ( 1, 2 ] 16591 58.690% 87.601% ############ ( 2, 3 ] 2200 7.782% 95.384% ## ( 3, 4 ] 762 2.696% 98.079% # ( 4, 6 ] 434 1.535% 99.614% ( 6, 10 ] 86 0.304% 99.919% ( 10, 15 ] 13 0.046% 99.965% ( 15, 22 ] 3 0.011% 99.975% ( 34, 51 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 214943 Average: 3.2893 StdDev: 32.02 Min: 1 Median: 1.6177 Max: 4957 Percentiles: P50: 1.62 P75: 2.13 P99: 9.19 P99.9: 179.69 P99.99: 680.74 ------------------------------------------------------ [ 0, 1 ] 27495 12.792% 12.792% ### ( 1, 2 ] 129477 60.238% 73.030% ############ ( 2, 3 ] 32184 14.973% 88.003% ### ( 3, 4 ] 11231 5.225% 93.228% # ( 4, 6 ] 9095 4.231% 97.459% # ( 6, 10 ] 4156 1.934% 99.393% ( 10, 15 ] 521 0.242% 99.635% ( 15, 22 ] 119 0.055% 99.691% ( 22, 34 ] 55 0.026% 99.716% ( 34, 51 ] 11 0.005% 99.721% ( 51, 76 ] 24 0.011% 99.732% ( 76, 110 ] 129 0.060% 99.793% ( 110, 170 ] 221 0.103% 99.895% ( 170, 250 ] 83 0.039% 99.934% ( 250, 380 ] 55 0.026% 99.960% ( 380, 580 ] 53 0.025% 99.984% ( 580, 870 ] 36 0.017% 100.001% ( 870, 1300 ] 12 0.006% 100.007% ( 1300, 1900 ] 2 0.001% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 6 0.003% 100.013% ( 4400, 6600 ] 2 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 1809.1714 StdDev: 1751.26 Min: 117 Median: 941.6667 Max: 5877 Percentiles: P50: 941.67 P75: 2993.75 P99: 5877.00 P99.9: 5877.00 P99.99: 5877.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 1 2.857% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 9 25.714% 48.571% ##### ( 870, 1300 ] 3 8.571% 57.143% ## ( 1300, 1900 ] 4 11.429% 68.571% ## ( 1900, 2900 ] 2 5.714% 74.286% # ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 15.6 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.373 H:M:S, 15.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 295.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.699 H:M:S, 21.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-05:38:39 ... thread 0: (1000000,6000000) ops and (112485.6,246530.4) ops/second in (8.890028,24.337772) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 4.18 GB 219.8 5.4 0.0 5.4 11.0 5.7 0.0 1.9 146.6 301.4 37.38 35.07 100 0.374 5564K 9292 0.0 0.0 L1 11/11 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 232.6 231.6 6.23 6.02 2 3.115 1471K 5881 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 39/0 993.22 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 208.0 207.9 5.80 5.05 4 1.450 1199K 553 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1229/25 101.78 GB 0.0 8.1 1.8 6.3 13.7 7.4 0.5 2.4 165.3 281.1 49.90 46.61 107 0.466 8348K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.1 1.8 6.3 13.7 7.4 0.5 2.4 165.3 281.1 49.90 46.61 107 0.466 8348K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.1 1.8 6.3 8.0 1.8 0.0 0.0 247.5 247.0 33.32 31.84 24 1.388 8348K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.7 16.57 14.77 83 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.5 total, 24.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.70 GB write, 571.93 MB/s write, 8.05 GB read, 336.26 MB/s read, 49.9 seconds Interval compaction: 13.70 GB write, 576.27 MB/s write, 8.05 GB read, 338.82 MB/s read, 49.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 18, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2237182 Average: 2.3693 StdDev: 13.71 Min: 0 Median: 1.4749 Max: 4130 Percentiles: P50: 1.47 P75: 1.85 P99: 5.75 P99.9: 88.08 P99.99: 203.64 ------------------------------------------------------ [ 0, 1 ] 409777 18.317% 18.317% #### ( 1, 2 ] 1492425 66.710% 85.027% ############# ( 2, 3 ] 205358 9.179% 94.206% ## ( 3, 4 ] 73090 3.267% 97.473% # ( 4, 6 ] 39009 1.744% 99.217% ( 6, 10 ] 12615 0.564% 99.781% ( 10, 15 ] 2078 0.093% 99.874% ( 15, 22 ] 175 0.008% 99.881% ( 22, 34 ] 17 0.001% 99.882% ( 34, 51 ] 8 0.000% 99.882% ( 51, 76 ] 45 0.002% 99.884% ( 76, 110 ] 982 0.044% 99.928% ( 110, 170 ] 1239 0.055% 99.984% ( 170, 250 ] 336 0.015% 99.999% ( 250, 380 ] 209 0.009% 100.008% ( 380, 580 ] 178 0.008% 100.016% ( 580, 870 ] 83 0.004% 100.020% ( 870, 1300 ] 40 0.002% 100.022% ( 1300, 1900 ] 20 0.001% 100.022% ( 1900, 2900 ] 11 0.000% 100.023% ( 2900, 4400 ] 10 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 374412 Average: 2.6246 StdDev: 12.81 Min: 0 Median: 1.5193 Max: 1717 Percentiles: P50: 1.52 P75: 1.90 P99: 7.98 P99.9: 144.47 P99.99: 574.94 ------------------------------------------------------ [ 0, 1 ] 58241 15.555% 15.555% ### ( 1, 2 ] 248356 66.332% 81.888% ############# ( 2, 3 ] 39921 10.662% 92.550% ## ( 3, 4 ] 12783 3.414% 95.964% # ( 4, 6 ] 9056 2.419% 98.383% ( 6, 10 ] 4666 1.246% 99.629% ( 10, 15 ] 409 0.109% 99.738% ( 15, 22 ] 53 0.014% 99.752% ( 22, 34 ] 4 0.001% 99.753% ( 34, 51 ] 41 0.011% 99.764% ( 51, 76 ] 33 0.009% 99.773% ( 76, 110 ] 286 0.076% 99.850% ( 110, 170 ] 330 0.088% 99.938% ( 170, 250 ] 83 0.022% 99.960% ( 250, 380 ] 58 0.015% 99.975% ( 380, 580 ] 57 0.015% 99.991% ( 580, 870 ] 23 0.006% 99.997% ( 870, 1300 ] 9 0.002% 99.999% ( 1300, 1900 ] 4 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28269 Average: 1.9518 StdDev: 2.91 Min: 0 Median: 1.3593 Max: 299 Percentiles: P50: 1.36 P75: 1.79 P99: 5.20 P99.9: 9.75 P99.99: 183.85 ------------------------------------------------------ [ 0, 1 ] 8173 28.912% 28.912% ###### ( 1, 2 ] 16591 58.690% 87.601% ############ ( 2, 3 ] 2200 7.782% 95.384% ## ( 3, 4 ] 762 2.696% 98.079% # ( 4, 6 ] 434 1.535% 99.614% ( 6, 10 ] 86 0.304% 99.919% ( 10, 15 ] 13 0.046% 99.965% ( 15, 22 ] 3 0.011% 99.975% ( 34, 51 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 214943 Average: 3.2893 StdDev: 32.02 Min: 1 Median: 1.6177 Max: 4957 Percentiles: P50: 1.62 P75: 2.13 P99: 9.19 P99.9: 179.69 P99.99: 680.74 ------------------------------------------------------ [ 0, 1 ] 27495 12.792% 12.792% ### ( 1, 2 ] 129477 60.238% 73.030% ############ ( 2, 3 ] 32184 14.973% 88.003% ### ( 3, 4 ] 11231 5.225% 93.228% # ( 4, 6 ] 9095 4.231% 97.459% # ( 6, 10 ] 4156 1.934% 99.393% ( 10, 15 ] 521 0.242% 99.635% ( 15, 22 ] 119 0.055% 99.691% ( 22, 34 ] 55 0.026% 99.716% ( 34, 51 ] 11 0.005% 99.721% ( 51, 76 ] 24 0.011% 99.732% ( 76, 110 ] 129 0.060% 99.793% ( 110, 170 ] 221 0.103% 99.895% ( 170, 250 ] 83 0.039% 99.934% ( 250, 380 ] 55 0.026% 99.960% ( 380, 580 ] 53 0.025% 99.984% ( 580, 870 ] 36 0.017% 100.001% ( 870, 1300 ] 12 0.006% 100.007% ( 1300, 1900 ] 2 0.001% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 6 0.003% 100.013% ( 4400, 6600 ] 2 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 1809.1714 StdDev: 1751.26 Min: 117 Median: 941.6667 Max: 5877 Percentiles: P50: 941.67 P75: 2993.75 P99: 5877.00 P99.9: 5877.00 P99.99: 5877.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 1 2.857% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 9 25.714% 48.571% ##### ( 870, 1300 ] 3 8.571% 57.143% ## ( 1300, 1900 ] 4 11.429% 68.571% ## ( 1900, 2900 ] 2 5.714% 74.286% # ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 24.5 total, 8.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 240.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.366 H:M:S, 34.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.993 H:M:S, 67.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-05:39:05 ... thread 0: (1000000,7000000) ops and (38788.9,139669.4) ops/second in (25.780567,50.118339) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 440.75 MB 0.0 6.1 0.0 6.1 12.7 6.6 0.0 1.9 144.5 300.4 43.17 40.35 117 0.369 6331K 10K 0.0 0.0 L1 2/2 91.67 MB 0.0 9.3 6.0 3.3 9.1 5.9 0.1 1.5 218.8 215.5 43.43 40.19 4 10.858 7922K 43K 0.0 0.0 L2 13/7 1.46 GB 7.0 0.1 0.1 0.0 0.1 0.1 5.9 1.8 229.4 229.4 0.49 0.46 1 0.485 113K 25 0.0 0.0 L3 44/15 4.22 GB 3.2 1.4 0.6 0.8 1.4 0.6 3.9 2.5 198.4 198.2 7.38 6.30 9 0.820 1460K 1321 0.0 0.0 L4 176/4 9.82 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 132.7 132.7 0.98 0.64 1 0.984 122K 0 0.0 0.0 L5 1040/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/32 102.57 GB 0.0 17.0 6.8 10.2 23.5 13.2 11.4 3.6 182.8 251.8 95.44 87.93 132 0.723 15M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.0 6.8 10.2 23.5 13.2 11.4 3.6 182.8 251.8 95.44 87.93 132 0.723 15M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.0 6.8 10.2 16.9 6.6 0.0 0.0 229.4 227.4 76.05 70.75 35 2.173 15M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 347.6 19.39 17.18 97 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.3 total, 50.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.47 GB write, 477.71 MB/s write, 17.04 GB read, 346.78 MB/s read, 95.4 seconds Interval compaction: 23.47 GB write, 479.48 MB/s write, 17.04 GB read, 348.06 MB/s read, 95.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 20, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3181099 Average: 2.7866 StdDev: 22.31 Min: 0 Median: 1.4319 Max: 7704 Percentiles: P50: 1.43 P75: 1.82 P99: 6.13 P99.9: 157.21 P99.99: 439.97 ------------------------------------------------------ [ 0, 1 ] 697506 21.927% 21.927% #### ( 1, 2 ] 2067925 65.007% 86.933% ############# ( 2, 3 ] 239359 7.524% 94.458% ## ( 3, 4 ] 90751 2.853% 97.310% # ( 4, 6 ] 53263 1.674% 98.985% ( 6, 10 ] 15484 0.487% 99.472% ( 10, 15 ] 3079 0.097% 99.568% ( 15, 22 ] 487 0.015% 99.584% ( 22, 34 ] 21 0.001% 99.584% ( 34, 51 ] 10 0.000% 99.585% ( 51, 76 ] 129 0.004% 99.589% ( 76, 110 ] 5795 0.182% 99.771% ( 110, 170 ] 5222 0.164% 99.935% ( 170, 250 ] 910 0.029% 99.964% ( 250, 380 ] 651 0.020% 99.984% ( 380, 580 ] 630 0.020% 100.004% ( 580, 870 ] 258 0.008% 100.012% ( 870, 1300 ] 74 0.002% 100.014% ( 1300, 1900 ] 28 0.001% 100.015% ( 1900, 2900 ] 37 0.001% 100.016% ( 2900, 4400 ] 31 0.001% 100.017% ( 4400, 6600 ] 8 0.000% 100.018% ( 6600, 9900 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1052099 Average: 3.3738 StdDev: 41.87 Min: 0 Median: 1.4221 Max: 7973 Percentiles: P50: 1.42 P75: 1.86 P99: 8.75 P99.9: 165.02 P99.99: 694.07 ------------------------------------------------------ [ 0, 1 ] 270655 25.725% 25.725% ##### ( 1, 2 ] 605040 57.508% 83.233% ############ ( 2, 3 ] 85476 8.124% 91.357% ## ( 3, 4 ] 40888 3.886% 95.244% # ( 4, 6 ] 33588 3.192% 98.436% # ( 6, 10 ] 8615 0.819% 99.255% ( 10, 15 ] 1632 0.155% 99.410% ( 15, 22 ] 291 0.028% 99.438% ( 22, 34 ] 17 0.002% 99.440% ( 34, 51 ] 49 0.005% 99.444% ( 51, 76 ] 237 0.023% 99.467% ( 76, 110 ] 3023 0.287% 99.754% ( 110, 170 ] 1677 0.159% 99.913% ( 170, 250 ] 247 0.023% 99.937% ( 250, 380 ] 257 0.024% 99.961% ( 380, 580 ] 244 0.023% 99.985% ( 580, 870 ] 152 0.014% 99.999% ( 870, 1300 ] 102 0.010% 100.009% ( 1300, 1900 ] 33 0.003% 100.012% ( 1900, 2900 ] 31 0.003% 100.015% ( 2900, 4400 ] 48 0.005% 100.019% ( 4400, 6600 ] 16 0.002% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ** Level 2 read latency histogram (micros): Count: 28269 Average: 1.9518 StdDev: 2.91 Min: 0 Median: 1.3593 Max: 299 Percentiles: P50: 1.36 P75: 1.79 P99: 5.20 P99.9: 9.75 P99.99: 183.85 ------------------------------------------------------ [ 0, 1 ] 8173 28.912% 28.912% ###### ( 1, 2 ] 16591 58.690% 87.601% ############ ( 2, 3 ] 2200 7.782% 95.384% ## ( 3, 4 ] 762 2.696% 98.079% # ( 4, 6 ] 434 1.535% 99.614% ( 6, 10 ] 86 0.304% 99.919% ( 10, 15 ] 13 0.046% 99.965% ( 15, 22 ] 3 0.011% 99.975% ( 34, 51 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 260946 Average: 4.6786 StdDev: 58.61 Min: 1 Median: 1.6429 Max: 7408 Percentiles: P50: 1.64 P75: 2.22 P99: 9.64 P99.9: 526.10 P99.99: 1280.84 ------------------------------------------------------ [ 0, 1 ] 29719 11.389% 11.389% ## ( 1, 2 ] 156730 60.062% 71.451% ############ ( 2, 3 ] 41621 15.950% 87.401% ### ( 3, 4 ] 14152 5.423% 92.825% # ( 4, 6 ] 11468 4.395% 97.219% # ( 6, 10 ] 5103 1.956% 99.175% ( 10, 15 ] 669 0.256% 99.431% ( 15, 22 ] 140 0.054% 99.485% ( 22, 34 ] 57 0.022% 99.507% ( 34, 51 ] 12 0.005% 99.511% ( 51, 76 ] 25 0.010% 99.521% ( 76, 110 ] 162 0.062% 99.583% ( 110, 170 ] 289 0.111% 99.694% ( 170, 250 ] 176 0.067% 99.761% ( 250, 380 ] 206 0.079% 99.840% ( 380, 580 ] 215 0.082% 99.923% ( 580, 870 ] 132 0.051% 99.973% ( 870, 1300 ] 47 0.018% 99.991% ( 1300, 1900 ] 13 0.005% 99.996% ( 1900, 2900 ] 18 0.007% 100.003% ( 2900, 4400 ] 20 0.008% 100.011% ( 4400, 6600 ] 7 0.003% 100.013% ( 6600, 9900 ] 2 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 2526 Average: 68.2629 StdDev: 424.97 Min: 0 Median: 2.0019 Max: 7661 Percentiles: P50: 2.00 P75: 3.38 P99: 1508.80 P99.9: 6180.35 P99.99: 7661.00 ------------------------------------------------------ [ 0, 1 ] 103 4.078% 4.078% # ( 1, 2 ] 1159 45.883% 49.960% ######### ( 2, 3 ] 518 20.507% 70.467% #### ( 3, 4 ] 302 11.956% 82.423% ## ( 4, 6 ] 181 7.165% 89.588% # ( 6, 10 ] 60 2.375% 91.964% ( 10, 15 ] 22 0.871% 92.835% ( 15, 22 ] 9 0.356% 93.191% ( 22, 34 ] 1 0.040% 93.230% ( 110, 170 ] 14 0.554% 93.785% ( 170, 250 ] 24 0.950% 94.735% ( 250, 380 ] 29 1.148% 95.883% ( 380, 580 ] 27 1.069% 96.952% ( 580, 870 ] 37 1.465% 98.416% ( 870, 1300 ] 13 0.515% 98.931% ( 1300, 1900 ] 5 0.198% 99.129% ( 1900, 2900 ] 7 0.277% 99.406% ( 2900, 4400 ] 6 0.238% 99.644% ( 4400, 6600 ] 8 0.317% 99.960% ( 6600, 9900 ] 1 0.040% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1108.2750 StdDev: 1452.86 Min: 104 Median: 460.0000 Max: 6121 Percentiles: P50: 460.00 P75: 1300.00 P99: 6121.00 P99.9: 6121.00 P99.99: 6121.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 4 10.000% 12.500% ## ( 170, 250 ] 6 15.000% 27.500% ### ( 250, 380 ] 5 12.500% 40.000% ### ( 380, 580 ] 10 25.000% 65.000% ##### ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 1 2.500% 75.000% # ( 1300, 1900 ] 2 5.000% 80.000% # ( 1900, 2900 ] 3 7.500% 87.500% ## ( 2900, 4400 ] 3 7.500% 95.000% ## ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 50.3 total, 25.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 136.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.090 H:M:S, 61.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 38.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.723 H:M:S, 88.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/17-05:39:12 ... thread 0: (1000000,8000000) ops and (134874.2,139051.5) ops/second in (7.414316,57.532655) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 1007.34 MB 25.2 6.5 0.0 6.5 14.0 7.6 0.0 1.9 125.9 273.2 52.54 44.70 129 0.407 6715K 10K 0.0 0.0 L1 1/1 58.39 MB 0.0 9.8 6.4 3.4 9.7 6.3 0.1 1.5 210.5 207.5 47.68 42.67 5 9.536 8463K 44K 0.0 0.0 L2 4/2 341.04 MB 1.9 0.3 0.1 0.2 0.3 0.1 6.3 2.2 154.0 153.8 2.12 1.48 2 1.061 331K 593 0.0 0.0 L3 35/21 2.71 GB 0.9 4.6 2.0 2.6 4.6 2.0 4.1 2.2 140.9 139.9 33.45 21.26 23 1.454 4367K 30K 0.0 0.0 L4 172/12 9.92 GB 1.0 3.2 3.0 0.3 3.2 2.9 1.1 1.1 115.4 115.1 28.64 15.61 29 0.987 2801K 6542 0.0 0.0 L5 1076/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/41 103.51 GB 0.0 24.4 11.6 12.8 31.8 19.0 15.2 4.2 152.0 197.9 164.43 125.71 188 0.875 22M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.4 11.6 12.8 31.8 19.0 15.2 4.2 152.0 197.9 164.43 125.71 188 0.875 22M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.4 11.6 12.8 24.2 11.4 0.0 0.0 181.2 179.7 137.97 105.74 80 1.725 22M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 292.9 26.46 19.98 108 0.245 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.7 total, 57.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.78 GB write, 563.87 MB/s write, 24.41 GB read, 433.02 MB/s read, 164.4 seconds Interval compaction: 31.78 GB write, 565.69 MB/s write, 24.41 GB read, 434.41 MB/s read, 164.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 70, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 70, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3429422 Average: 3.0294 StdDev: 33.72 Min: 0 Median: 1.4599 Max: 7704 Percentiles: P50: 1.46 P75: 1.85 P99: 7.02 P99.9: 159.81 P99.99: 541.10 ------------------------------------------------------ [ 0, 1 ] 704316 20.537% 20.537% #### ( 1, 2 ] 2196824 64.058% 84.596% ############# ( 2, 3 ] 292425 8.527% 93.123% ## ( 3, 4 ] 116367 3.393% 96.516% # ( 4, 6 ] 79724 2.325% 98.840% ( 6, 10 ] 21404 0.624% 99.465% ( 10, 15 ] 4028 0.117% 99.582% ( 15, 22 ] 594 0.017% 99.599% ( 22, 34 ] 32 0.001% 99.600% ( 34, 51 ] 12 0.000% 99.601% ( 51, 76 ] 129 0.004% 99.604% ( 76, 110 ] 5796 0.169% 99.773% ( 110, 170 ] 5230 0.153% 99.926% ( 170, 250 ] 930 0.027% 99.953% ( 250, 380 ] 705 0.021% 99.974% ( 380, 580 ] 699 0.020% 99.994% ( 580, 870 ] 349 0.010% 100.004% ( 870, 1300 ] 142 0.004% 100.008% ( 1300, 1900 ] 61 0.002% 100.010% ( 1900, 2900 ] 94 0.003% 100.013% ( 2900, 4400 ] 108 0.003% 100.016% ( 4400, 6600 ] 31 0.001% 100.017% ( 6600, 9900 ] 5 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 2213122 Average: 6.1350 StdDev: 94.63 Min: 0 Median: 1.7011 Max: 10952 Percentiles: P50: 1.70 P75: 2.55 P99: 9.30 P99.9: 157.93 P99.99: 492.04 ------------------------------------------------------ [ 0, 1 ] 283985 12.832% 12.832% ### ( 1, 2 ] 1173215 53.012% 65.844% ########### ( 2, 3 ] 366220 16.548% 82.391% ### ( 3, 4 ] 172256 7.783% 90.175% ## ( 4, 6 ] 162341 7.335% 97.510% # ( 6, 10 ] 39937 1.805% 99.315% ( 10, 15 ] 7226 0.327% 99.641% ( 15, 22 ] 899 0.041% 99.682% ( 22, 34 ] 51 0.002% 99.684% ( 34, 51 ] 76 0.003% 99.688% ( 51, 76 ] 251 0.011% 99.699% ( 76, 110 ] 3047 0.138% 99.837% ( 110, 170 ] 1760 0.080% 99.916% ( 170, 250 ] 423 0.019% 99.935% ( 250, 380 ] 701 0.032% 99.967% ( 380, 580 ] 917 0.041% 100.008% ( 580, 870 ] 965 0.044% 100.052% ( 870, 1300 ] 763 0.034% 100.086% ( 1300, 1900 ] 439 0.020% 100.106% ( 1900, 2900 ] 497 0.022% 100.129% ( 2900, 4400 ] 630 0.028% 100.157% ( 4400, 6600 ] 158 0.007% 100.164% ( 6600, 9900 ] 31 0.001% 100.166% ( 9900, 14000 ] 1 0.000% 100.166% ** Level 2 read latency histogram (micros): Count: 48359 Average: 2.5681 StdDev: 20.18 Min: 0 Median: 1.5856 Max: 3244 Percentiles: P50: 1.59 P75: 2.13 P99: 6.21 P99.9: 13.31 P99.99: 748.79 ------------------------------------------------------ [ 0, 1 ] 8371 17.310% 17.310% ### ( 1, 2 ] 26996 55.824% 73.134% ########### ( 2, 3 ] 6885 14.237% 87.372% ### ( 3, 4 ] 2968 6.137% 93.509% # ( 4, 6 ] 2634 5.447% 98.956% # ( 6, 10 ] 403 0.833% 99.789% ( 10, 15 ] 81 0.167% 99.957% ( 15, 22 ] 4 0.008% 99.965% ( 34, 51 ] 2 0.004% 99.969% ( 51, 76 ] 1 0.002% 99.971% ( 110, 170 ] 3 0.006% 99.977% ( 170, 250 ] 3 0.006% 99.983% ( 250, 380 ] 2 0.004% 99.988% ( 580, 870 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 911885 Average: 9.5593 StdDev: 126.09 Min: 1 Median: 1.8763 Max: 11852 Percentiles: P50: 1.88 P75: 2.85 P99: 9.88 P99.9: 1019.06 P99.99: 1727.38 ------------------------------------------------------ [ 0, 1 ] 38006 4.168% 4.168% # ( 1, 2 ] 476943 52.303% 56.471% ########## ( 2, 3 ] 197808 21.692% 78.163% #### ( 3, 4 ] 88515 9.707% 87.870% ## ( 4, 6 ] 82436 9.040% 96.910% ## ( 6, 10 ] 19666 2.157% 99.067% ( 10, 15 ] 3580 0.393% 99.459% ( 15, 22 ] 452 0.050% 99.509% ( 22, 34 ] 74 0.008% 99.517% ( 34, 51 ] 19 0.002% 99.519% ( 51, 76 ] 30 0.003% 99.522% ( 76, 110 ] 170 0.019% 99.541% ( 110, 170 ] 339 0.037% 99.578% ( 170, 250 ] 339 0.037% 99.615% ( 250, 380 ] 564 0.062% 99.677% ( 380, 580 ] 843 0.092% 99.770% ( 580, 870 ] 928 0.102% 99.871% ( 870, 1300 ] 759 0.083% 99.955% ( 1300, 1900 ] 456 0.050% 100.005% ( 1900, 2900 ] 401 0.044% 100.049% ( 2900, 4400 ] 479 0.053% 100.101% ( 4400, 6600 ] 96 0.011% 100.112% ( 6600, 9900 ] 14 0.002% 100.113% ( 9900, 14000 ] 1 0.000% 100.113% ** Level 4 read latency histogram (micros): Count: 72400 Average: 33.9807 StdDev: 267.34 Min: 0 Median: 1.9895 Max: 10650 Percentiles: P50: 1.99 P75: 3.10 P99: 973.44 P99.9: 4040.79 P99.99: 6022.36 ------------------------------------------------------ [ 0, 1 ] 1099 1.518% 1.518% ( 1, 2 ] 35473 48.996% 50.514% ########## ( 2, 3 ] 16923 23.374% 73.888% ##### ( 3, 4 ] 8225 11.360% 85.249% ## ( 4, 6 ] 6912 9.547% 94.796% ## ( 6, 10 ] 1478 2.041% 96.837% ( 10, 15 ] 301 0.416% 97.253% ( 15, 22 ] 45 0.062% 97.315% ( 22, 34 ] 14 0.019% 97.334% ( 34, 51 ] 3 0.004% 97.338% ( 51, 76 ] 3 0.004% 97.343% ( 76, 110 ] 7 0.010% 97.352% ( 110, 170 ] 58 0.080% 97.432% ( 170, 250 ] 123 0.170% 97.602% ( 250, 380 ] 215 0.297% 97.899% ( 380, 580 ] 322 0.445% 98.344% ( 580, 870 ] 405 0.559% 98.903% ( 870, 1300 ] 291 0.402% 99.305% ( 1300, 1900 ] 167 0.231% 99.536% ( 1900, 2900 ] 148 0.204% 99.740% ( 2900, 4400 ] 152 0.210% 99.950% ( 4400, 6600 ] 39 0.054% 100.004% ( 6600, 9900 ] 5 0.007% 100.011% ( 9900, 14000 ] 1 0.001% 100.012% ** Level 5 read latency histogram (micros): Count: 220 Average: 1878.2318 StdDev: 1815.93 Min: 81 Median: 1047.0588 Max: 7699 Percentiles: P50: 1047.06 P75: 3284.62 P99: 7480.00 P99.9: 7699.00 P99.99: 7699.00 ------------------------------------------------------ ( 76, 110 ] 4 1.818% 1.818% ( 110, 170 ] 8 3.636% 5.455% # ( 170, 250 ] 14 6.364% 11.818% # ( 250, 380 ] 17 7.727% 19.545% ## ( 380, 580 ] 27 12.273% 31.818% ## ( 580, 870 ] 33 15.000% 46.818% ### ( 870, 1300 ] 17 7.727% 54.545% ## ( 1300, 1900 ] 22 10.000% 64.545% ## ( 1900, 2900 ] 13 5.909% 70.455% # ( 2900, 4400 ] 39 17.727% 88.182% #### ( 4400, 6600 ] 23 10.455% 98.636% ## ( 6600, 9900 ] 3 1.364% 100.000% ** DB Stats ** Uptime(secs): 57.7 total, 7.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 136.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:35.512 H:M:S, 61.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.422 H:M:S, 59.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 7.072 micros/op 141396 ops/sec 60.002 seconds 8483999 operations; 137.0 MB/s Microseconds per write: Count: 8483999 Average: 7.0723 StdDev: 662.43 Min: 0 Median: 1.7489 Max: 963388 Percentiles: P50: 1.75 P75: 2.77 P99: 8.58 P99.9: 1937.38 P99.99: 2812.92 ------------------------------------------------------ [ 0, 1 ] 1108069 13.061% 13.061% ### ( 1, 2 ] 4184908 49.327% 62.388% ########## ( 2, 3 ] 1389888 16.382% 78.770% ### ( 3, 4 ] 1191735 14.047% 92.817% ### ( 4, 6 ] 470176 5.542% 98.359% # ( 6, 10 ] 84323 0.994% 99.353% ( 10, 15 ] 20390 0.240% 99.593% ( 15, 22 ] 5564 0.066% 99.659% ( 22, 34 ] 1150 0.014% 99.672% ( 34, 51 ] 199 0.002% 99.675% ( 51, 76 ] 73 0.001% 99.676% ( 76, 110 ] 5770 0.068% 99.744% ( 110, 170 ] 2480 0.029% 99.773% ( 170, 250 ] 268 0.003% 99.776% ( 250, 380 ] 91 0.001% 99.777% ( 380, 580 ] 28 0.000% 99.777% ( 580, 870 ] 37 0.000% 99.778% ( 870, 1300 ] 10017 0.118% 99.896% ( 1300, 1900 ] 23 0.000% 99.896% ( 1900, 2900 ] 8721 0.103% 99.999% ( 2900, 4400 ] 53 0.001% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 5 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 208957 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8483999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 8755486968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 606 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36524426 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30469569330 rocksdb.compact.write.bytes COUNT : 30252642082 rocksdb.flush.write.bytes COUNT : 8587322480 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 301 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8518177792 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3390464 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30562292367 rocksdb.non.last.level.read.count COUNT : 7383172 rocksdb.block.checksum.compute.count COUNT : 7382027 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.407425 P95 : 3.895360 P99 : 6.969345 P100 : 963386.000000 COUNT : 8483999 SUM : 56109082 rocksdb.compaction.times.micros P50 : 1152400.000000 P95 : 4190000.000000 P99 : 22990000.000000 P100 : 23356894.000000 COUNT : 91 SUM : 158650037 rocksdb.compaction.times.cpu_micros P50 : 865483.870968 P95 : 3215000.000000 P99 : 14720000.000000 P100 : 21108178.000000 COUNT : 91 SUM : 119936666 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 702.254902 P95 : 16800.000000 P99 : 71750.000000 P100 : 496755.000000 COUNT : 113 SUM : 788019 rocksdb.compaction.outfile.sync.micros P50 : 1225.000000 P95 : 150714.285714 P99 : 330166.666667 P100 : 392038.000000 COUNT : 430 SUM : 10390339 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 119.090909 P95 : 2142.857143 P99 : 5529.333333 P100 : 8287.000000 COUNT : 246 SUM : 111316 rocksdb.table.open.io.micros P50 : 1568.085106 P95 : 10564.482759 P99 : 13991.517241 P100 : 20885.000000 COUNT : 606 SUM : 1549730 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.660150 P95 : 8.203700 P99 : 12.787336 P100 : 13844.000000 COUNT : 7380379 SUM : 55535297 rocksdb.read.block.get.micros P50 : 473.069307 P95 : 4274.683544 P99 : 6319.500000 P100 : 10340.000000 COUNT : 1212 SUM : 1248547 rocksdb.write.raw.block.micros P50 : 0.515707 P95 : 0.979843 P99 : 3.079999 P100 : 13640.000000 COUNT : 9425154 SUM : 21464227 rocksdb.numfiles.in.singlecompaction P50 : 3.132911 P95 : 5.580000 P99 : 26.680000 P100 : 39.000000 COUNT : 161 SUM : 617 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568785 P95 : 2009.705273 P99 : 2724.612019 P100 : 963194.000000 COUNT : 155242 SUM : 36536216 rocksdb.sst.read.micros P50 : 1.620163 P95 : 4.959918 P99 : 9.287519 P100 : 11852.000000 COUNT : 7383512 SUM : 40747951 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8483999 SUM : 8755486968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 216760.563380 P95 : 603833.333333 P99 : 1071933.333333 P100 : 1093927.000000 COUNT : 113 SUM : 28555800 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 394 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0