[2024-11-20 03:31:35.626990] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-20 03:31:35.627083] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3990431 ] Set seed to 1732069895624669 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 03:31:35.723160] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 03:31:35.761970] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 03:31:35.762017] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3990431' to capture a snapshot of events at runtime. [2024-11-20 03:31:35.762028] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 03:31:35.762054] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 03:31:35.762062] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3990431 for offline analysis/debug. [2024-11-20 03:31:35.762152] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 03:31:40 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-03:31:47 ... thread 0: (1000000,1000000) ops and (129375.0,129375.0) ops/second in (7.729466,7.729466) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 755.85 MB 31.5 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 120.8 7.30 2.54 10 0.730 0 0 0.0 0.0 L1 2/2 127.74 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.0 2.5 105.9 105.8 3.25 1.61 2 1.626 349K 139 0.0 0.0 L2 2/0 204.38 MB 2.0 0.2 0.1 0.1 0.2 0.1 0.0 2.7 133.9 133.8 1.53 0.93 1 1.527 207K 184 0.0 0.0 L3 42/11 3.36 GB 2.4 2.7 1.8 0.9 2.6 1.7 0.0 1.5 98.6 97.0 27.56 12.69 13 2.120 1483K 0 0.0 0.0 L4 200/17 12.71 GB 1.2 3.9 3.0 0.9 3.8 3.0 0.1 1.3 111.9 111.4 35.26 18.58 26 1.356 1949K 0 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1334/35 105.97 GB 0.0 7.0 5.0 2.1 7.8 5.8 0.1 9.1 96.3 107.2 74.89 36.35 52 1.440 3991K 323 0.0 0.0 Int 0/0 0.00 KB 0.0 7.0 5.0 2.1 7.8 5.8 0.1 9.1 96.3 107.2 74.89 36.35 52 1.440 3991K 323 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.0 5.0 2.1 7.0 4.9 0.0 0.0 106.7 105.8 67.59 33.81 42 1.609 3991K 323 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 120.8 7.30 2.54 10 0.730 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.84 GB write, 1012.33 MB/s write, 7.04 GB read, 908.99 MB/s read, 74.9 seconds Interval compaction: 7.84 GB write, 1038.65 MB/s write, 7.04 GB read, 932.61 MB/s read, 74.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 93534 Average: 17.1123 StdDev: 303.54 Min: 0 Median: 1.9271 Max: 67762 Percentiles: P50: 1.93 P75: 2.96 P99: 18.77 P99.9: 3352.74 P99.99: 6562.98 ------------------------------------------------------ [ 0, 1 ] 3369 3.602% 3.602% # ( 1, 2 ] 46811 50.047% 53.649% ########## ( 2, 3 ] 20863 22.305% 75.954% #### ( 3, 4 ] 9182 9.817% 85.771% ## ( 4, 6 ] 9316 9.960% 95.731% ## ( 6, 10 ] 2448 2.617% 98.348% # ( 10, 15 ] 566 0.605% 98.953% ( 15, 22 ] 81 0.087% 99.040% ( 22, 34 ] 9 0.010% 99.050% ( 34, 51 ] 6 0.006% 99.056% ( 51, 76 ] 4 0.004% 99.060% ( 76, 110 ] 5 0.005% 99.066% ( 110, 170 ] 13 0.014% 99.079% ( 170, 250 ] 26 0.028% 99.107% ( 250, 380 ] 78 0.083% 99.191% ( 380, 580 ] 121 0.129% 99.320% ( 580, 870 ] 159 0.170% 99.490% ( 870, 1300 ] 161 0.172% 99.662% ( 1300, 1900 ] 117 0.125% 99.787% ( 1900, 2900 ] 78 0.083% 99.871% ( 2900, 4400 ] 91 0.097% 99.968% ( 4400, 6600 ] 21 0.022% 99.990% ( 6600, 9900 ] 7 0.007% 99.998% ( 9900, 14000 ] 1 0.001% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ( 50000, 75000 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 89782 Average: 8.5806 StdDev: 128.13 Min: 1 Median: 1.9169 Max: 17624 Percentiles: P50: 1.92 P75: 2.93 P99: 9.84 P99.9: 1683.28 P99.99: 4721.14 ------------------------------------------------------ [ 0, 1 ] 2750 3.063% 3.063% # ( 1, 2 ] 45960 51.191% 54.254% ########## ( 2, 3 ] 20066 22.350% 76.603% #### ( 3, 4 ] 9440 10.514% 87.118% ## ( 4, 6 ] 8736 9.730% 96.848% ## ( 6, 10 ] 2014 2.243% 99.091% ( 10, 15 ] 397 0.442% 99.533% ( 15, 22 ] 53 0.059% 99.592% ( 22, 34 ] 6 0.007% 99.599% ( 34, 51 ] 2 0.002% 99.601% ( 51, 76 ] 4 0.004% 99.606% ( 170, 250 ] 9 0.010% 99.616% ( 250, 380 ] 9 0.010% 99.626% ( 380, 580 ] 42 0.047% 99.673% ( 580, 870 ] 86 0.096% 99.768% ( 870, 1300 ] 85 0.095% 99.863% ( 1300, 1900 ] 52 0.058% 99.921% ( 1900, 2900 ] 30 0.033% 99.954% ( 2900, 4400 ] 31 0.035% 99.989% ( 4400, 6600 ] 7 0.008% 99.997% ( 6600, 9900 ] 2 0.002% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 465256 Average: 13.3244 StdDev: 166.70 Min: 1 Median: 1.9817 Max: 11833 Percentiles: P50: 1.98 P75: 3.06 P99: 12.07 P99.9: 1220.18 P99.99: 1736.39 ------------------------------------------------------ [ 0, 1 ] 13819 2.970% 2.970% # ( 1, 2 ] 222893 47.908% 50.878% ########## ( 2, 3 ] 109460 23.527% 74.405% ##### ( 3, 4 ] 49628 10.667% 85.071% ## ( 4, 6 ] 48419 10.407% 95.478% ## ( 6, 10 ] 15061 3.237% 98.716% # ( 10, 15 ] 3198 0.687% 99.403% ( 15, 22 ] 457 0.098% 99.501% ( 22, 34 ] 101 0.022% 99.523% ( 34, 51 ] 41 0.009% 99.532% ( 51, 76 ] 32 0.007% 99.539% ( 76, 110 ] 22 0.005% 99.543% ( 110, 170 ] 46 0.010% 99.553% ( 170, 250 ] 111 0.024% 99.577% ( 250, 380 ] 203 0.044% 99.621% ( 380, 580 ] 338 0.073% 99.693% ( 580, 870 ] 500 0.107% 99.801% ( 870, 1300 ] 567 0.122% 99.923% ( 1300, 1900 ] 431 0.093% 100.015% ( 1900, 2900 ] 387 0.083% 100.098% ( 2900, 4400 ] 368 0.079% 100.178% ( 4400, 6600 ] 107 0.023% 100.201% ( 6600, 9900 ] 17 0.004% 100.204% ( 9900, 14000 ] 3 0.001% 100.205% ** Level 3 read latency histogram (micros): Count: 920883 Average: 12.4698 StdDev: 188.40 Min: 1 Median: 1.9939 Max: 45034 Percentiles: P50: 1.99 P75: 2.99 P99: 9.77 P99.9: 455.75 P99.99: 716.90 ------------------------------------------------------ [ 0, 1 ] 14652 1.591% 1.591% ( 1, 2 ] 448514 48.705% 50.296% ########## ( 2, 3 ] 229123 24.881% 75.177% ##### ( 3, 4 ] 101411 11.012% 86.189% ## ( 4, 6 ] 93889 10.196% 96.385% ## ( 6, 10 ] 25584 2.778% 99.163% # ( 10, 15 ] 5238 0.569% 99.732% ( 15, 22 ] 619 0.067% 99.799% ( 22, 34 ] 63 0.007% 99.806% ( 34, 51 ] 60 0.007% 99.812% ( 51, 76 ] 62 0.007% 99.819% ( 76, 110 ] 28 0.003% 99.822% ( 110, 170 ] 71 0.008% 99.830% ( 170, 250 ] 117 0.013% 99.842% ( 250, 380 ] 306 0.033% 99.876% ( 380, 580 ] 597 0.065% 99.940% ( 580, 870 ] 970 0.105% 100.046% ( 870, 1300 ] 1023 0.111% 100.157% ( 1300, 1900 ] 710 0.077% 100.234% ( 1900, 2900 ] 686 0.074% 100.308% ( 2900, 4400 ] 655 0.071% 100.380% ( 4400, 6600 ] 167 0.018% 100.398% ( 6600, 9900 ] 43 0.005% 100.402% ( 9900, 14000 ] 4 0.000% 100.403% ( 14000, 22000 ] 9 0.001% 100.404% ( 22000, 33000 ] 5 0.001% 100.404% ( 33000, 50000 ] 2 0.000% 100.405% ** Level 4 read latency histogram (micros): Count: 292079 Average: 30.4710 StdDev: 275.00 Min: 1 Median: 2.0307 Max: 28741 Percentiles: P50: 2.03 P75: 3.07 P99: 767.61 P99.9: 2498.14 P99.99: 2980.52 ------------------------------------------------------ [ 0, 1 ] 4547 1.557% 1.557% ( 1, 2 ] 139253 47.676% 49.233% ########## ( 2, 3 ] 72841 24.939% 74.172% ##### ( 3, 4 ] 32750 11.213% 85.385% ## ( 4, 6 ] 27890 9.549% 94.934% ## ( 6, 10 ] 8073 2.764% 97.698% # ( 10, 15 ] 1706 0.584% 98.282% ( 15, 22 ] 189 0.065% 98.346% ( 22, 34 ] 23 0.008% 98.354% ( 34, 51 ] 16 0.005% 98.360% ( 51, 76 ] 28 0.010% 98.369% ( 76, 110 ] 20 0.007% 98.376% ( 110, 170 ] 66 0.023% 98.399% ( 170, 250 ] 167 0.057% 98.456% ( 250, 380 ] 327 0.112% 98.568% ( 380, 580 ] 615 0.211% 98.778% ( 580, 870 ] 1002 0.343% 99.121% ( 870, 1300 ] 1140 0.390% 99.512% ( 1300, 1900 ] 788 0.270% 99.782% ( 1900, 2900 ] 580 0.199% 99.980% ( 2900, 4400 ] 555 0.190% 100.170% ( 4400, 6600 ] 152 0.052% 100.222% ( 6600, 9900 ] 28 0.010% 100.232% ( 14000, 22000 ] 3 0.001% 100.233% ( 22000, 33000 ] 2 0.001% 100.233% ** Level 5 read latency histogram (micros): Count: 13531 Average: 1661.7853 StdDev: 1621.18 Min: 82 Median: 1132.2518 Max: 48966 Percentiles: P50: 1132.25 P75: 2289.67 P99: 6566.64 P99.9: 12190.36 P99.99: 36665.77 ------------------------------------------------------ ( 76, 110 ] 13 0.096% 0.096% ( 110, 170 ] 120 0.887% 0.983% ( 170, 250 ] 288 2.128% 3.111% ( 250, 380 ] 764 5.646% 8.758% # ( 380, 580 ] 1595 11.788% 20.545% ## ( 580, 870 ] 2462 18.195% 38.741% #### ( 870, 1300 ] 2498 18.461% 57.202% #### ( 1300, 1900 ] 1814 13.406% 70.608% ### ( 1900, 2900 ] 1525 11.270% 81.879% ## ( 2900, 4400 ] 1712 12.652% 94.531% ### ( 4400, 6600 ] 614 4.538% 99.069% # ( 6600, 9900 ] 108 0.798% 99.867% ( 9900, 14000 ] 8 0.059% 99.926% ( 14000, 22000 ] 6 0.044% 99.970% ( 22000, 33000 ] 2 0.015% 99.985% ( 33000, 50000 ] 3 0.022% 100.007% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.810 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.810 H:M:S, 49.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-03:31:54 ... thread 0: (1000000,2000000) ops and (156276.9,141559.2) ops/second in (6.398898,14.128364) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.29 GB 25.2 0.4 0.0 0.4 2.2 1.8 0.0 1.2 23.4 136.3 16.18 6.81 22 0.735 383K 561 0.0 0.0 L1 1/1 56.23 MB 0.0 0.9 0.6 0.3 0.9 0.6 0.0 1.6 113.6 113.4 8.04 4.44 3 2.678 926K 1474 0.0 0.0 L2 3/3 333.13 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.7 133.9 133.8 1.53 0.93 1 1.527 207K 184 0.0 0.0 L3 27/13 1.62 GB 0.9 3.5 2.1 1.4 3.5 2.1 0.0 1.6 106.3 104.9 34.02 16.97 16 2.126 2041K 432 0.0 0.0 L4 172/0 9.76 GB 1.0 8.2 5.1 3.1 8.1 5.0 0.1 1.6 116.8 115.5 71.57 39.21 45 1.590 3057K 0 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/26 106.87 GB 0.0 13.2 7.9 5.3 14.8 9.5 5.6 8.3 102.6 115.4 131.33 68.35 87 1.510 6618K 2651 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 7.9 5.3 14.8 9.5 5.6 8.3 102.6 115.4 131.33 68.35 87 1.510 6618K 2651 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 7.9 5.3 13.0 7.7 0.0 0.0 114.3 113.1 117.91 63.15 66 1.786 6618K 2651 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 136.1 13.42 5.21 21 0.639 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.3 total, 14.1 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.80 GB write, 1057.60 MB/s write, 13.16 GB read, 940.01 MB/s read, 131.3 seconds Interval compaction: 14.80 GB write, 1072.64 MB/s write, 13.16 GB read, 953.38 MB/s read, 131.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 54, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 467294 Average: 11.2894 StdDev: 184.51 Min: 0 Median: 1.8752 Max: 67762 Percentiles: P50: 1.88 P75: 2.85 P99: 11.25 P99.9: 1810.35 P99.99: 3639.62 ------------------------------------------------------ [ 0, 1 ] 17809 3.811% 3.811% # ( 1, 2 ] 246622 52.777% 56.588% ########### ( 2, 3 ] 101340 21.687% 78.274% #### ( 3, 4 ] 43464 9.301% 87.575% ## ( 4, 6 ] 42034 8.995% 96.571% ## ( 6, 10 ] 10820 2.315% 98.886% ( 10, 15 ] 2135 0.457% 99.343% ( 15, 22 ] 216 0.046% 99.389% ( 22, 34 ] 19 0.004% 99.393% ( 34, 51 ] 19 0.004% 99.397% ( 51, 76 ] 45 0.010% 99.407% ( 76, 110 ] 15 0.003% 99.410% ( 110, 170 ] 40 0.009% 99.419% ( 170, 250 ] 107 0.023% 99.442% ( 250, 380 ] 244 0.052% 99.494% ( 380, 580 ] 453 0.097% 99.591% ( 580, 870 ] 599 0.128% 99.719% ( 870, 1300 ] 549 0.117% 99.837% ( 1300, 1900 ] 350 0.075% 99.911% ( 1900, 2900 ] 245 0.052% 99.964% ( 2900, 4400 ] 250 0.053% 100.017% ( 4400, 6600 ] 55 0.012% 100.029% ( 6600, 9900 ] 14 0.003% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 6 0.001% 100.034% ( 22000, 33000 ] 1 0.000% 100.034% ( 50000, 75000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 201757 Average: 8.9273 StdDev: 117.84 Min: 1 Median: 1.9643 Max: 17624 Percentiles: P50: 1.96 P75: 2.96 P99: 10.18 P99.9: 1432.82 P99.99: 3357.48 ------------------------------------------------------ [ 0, 1 ] 3997 1.981% 1.981% ( 1, 2 ] 100465 49.795% 51.776% ########## ( 2, 3 ] 48876 24.225% 76.001% ##### ( 3, 4 ] 21253 10.534% 86.535% ## ( 4, 6 ] 19828 9.828% 96.363% ## ( 6, 10 ] 5288 2.621% 98.984% # ( 10, 15 ] 922 0.457% 99.441% ( 15, 22 ] 102 0.051% 99.491% ( 22, 34 ] 8 0.004% 99.495% ( 34, 51 ] 13 0.006% 99.502% ( 51, 76 ] 25 0.012% 99.514% ( 76, 110 ] 4 0.002% 99.516% ( 110, 170 ] 19 0.009% 99.526% ( 170, 250 ] 43 0.021% 99.547% ( 250, 380 ] 73 0.036% 99.583% ( 380, 580 ] 163 0.081% 99.664% ( 580, 870 ] 248 0.123% 99.787% ( 870, 1300 ] 205 0.102% 99.888% ( 1300, 1900 ] 105 0.052% 99.941% ( 1900, 2900 ] 80 0.040% 99.980% ( 2900, 4400 ] 65 0.032% 100.012% ( 4400, 6600 ] 13 0.006% 100.019% ( 6600, 9900 ] 3 0.001% 100.020% ( 14000, 22000 ] 1 0.000% 100.021% ** Level 2 read latency histogram (micros): Count: 500292 Average: 13.2830 StdDev: 165.56 Min: 1 Median: 1.9899 Max: 11833 Percentiles: P50: 1.99 P75: 3.06 P99: 12.20 P99.9: 1256.17 P99.99: 1805.84 ------------------------------------------------------ [ 0, 1 ] 14058 2.810% 2.810% # ( 1, 2 ] 238485 47.669% 50.479% ########## ( 2, 3 ] 119316 23.849% 74.328% ##### ( 3, 4 ] 53460 10.686% 85.014% ## ( 4, 6 ] 52224 10.439% 95.453% ## ( 6, 10 ] 16247 3.248% 98.700% # ( 10, 15 ] 3412 0.682% 99.382% ( 15, 22 ] 485 0.097% 99.479% ( 22, 34 ] 104 0.021% 99.500% ( 34, 51 ] 46 0.009% 99.509% ( 51, 76 ] 38 0.008% 99.517% ( 76, 110 ] 22 0.004% 99.521% ( 110, 170 ] 48 0.010% 99.531% ( 170, 250 ] 114 0.023% 99.554% ( 250, 380 ] 221 0.044% 99.598% ( 380, 580 ] 383 0.077% 99.674% ( 580, 870 ] 571 0.114% 99.789% ( 870, 1300 ] 621 0.124% 99.913% ( 1300, 1900 ] 459 0.092% 100.004% ( 1900, 2900 ] 412 0.082% 100.087% ( 2900, 4400 ] 389 0.078% 100.165% ( 4400, 6600 ] 109 0.022% 100.186% ( 6600, 9900 ] 17 0.003% 100.190% ( 9900, 14000 ] 4 0.001% 100.190% ** Level 3 read latency histogram (micros): Count: 1660598 Average: 11.4880 StdDev: 176.11 Min: 1 Median: 1.9924 Max: 45034 Percentiles: P50: 1.99 P75: 2.99 P99: 9.78 P99.9: 524.51 P99.99: 780.06 ------------------------------------------------------ [ 0, 1 ] 24582 1.480% 1.480% ( 1, 2 ] 811849 48.889% 50.369% ########## ( 2, 3 ] 414950 24.988% 75.357% ##### ( 3, 4 ] 178484 10.748% 86.105% ## ( 4, 6 ] 168948 10.174% 96.279% ## ( 6, 10 ] 47846 2.881% 99.161% # ( 10, 15 ] 9085 0.547% 99.708% ( 15, 22 ] 1027 0.062% 99.770% ( 22, 34 ] 93 0.006% 99.775% ( 34, 51 ] 141 0.008% 99.784% ( 51, 76 ] 133 0.008% 99.792% ( 76, 110 ] 52 0.003% 99.795% ( 110, 170 ] 132 0.008% 99.803% ( 170, 250 ] 252 0.015% 99.818% ( 250, 380 ] 567 0.034% 99.852% ( 380, 580 ] 1105 0.067% 99.919% ( 580, 870 ] 1722 0.104% 100.022% ( 870, 1300 ] 1691 0.102% 100.124% ( 1300, 1900 ] 1093 0.066% 100.190% ( 1900, 2900 ] 1063 0.064% 100.254% ( 2900, 4400 ] 1029 0.062% 100.316% ( 4400, 6600 ] 269 0.016% 100.332% ( 6600, 9900 ] 67 0.004% 100.336% ( 9900, 14000 ] 7 0.000% 100.337% ( 14000, 22000 ] 14 0.001% 100.337% ( 22000, 33000 ] 8 0.000% 100.338% ( 33000, 50000 ] 3 0.000% 100.338% ** Level 4 read latency histogram (micros): Count: 800841 Average: 22.7340 StdDev: 257.81 Min: 1 Median: 1.9994 Max: 44889 Percentiles: P50: 2.00 P75: 3.02 P99: 399.07 P99.9: 1936.01 P99.99: 2566.59 ------------------------------------------------------ [ 0, 1 ] 12606 1.574% 1.574% ( 1, 2 ] 388058 48.456% 50.030% ########## ( 2, 3 ] 197999 24.724% 74.754% ##### ( 3, 4 ] 85690 10.700% 85.454% ## ( 4, 6 ] 78599 9.815% 95.269% ## ( 6, 10 ] 23362 2.917% 98.186% # ( 10, 15 ] 4484 0.560% 98.746% ( 15, 22 ] 499 0.062% 98.808% ( 22, 34 ] 50 0.006% 98.814% ( 34, 51 ] 41 0.005% 98.820% ( 51, 76 ] 78 0.010% 98.829% ( 76, 110 ] 41 0.005% 98.834% ( 110, 170 ] 128 0.016% 98.850% ( 170, 250 ] 356 0.044% 98.895% ( 250, 380 ] 706 0.088% 98.983% ( 380, 580 ] 1422 0.178% 99.161% ( 580, 870 ] 2192 0.274% 99.434% ( 870, 1300 ] 2255 0.282% 99.716% ( 1300, 1900 ] 1433 0.179% 99.895% ( 1900, 2900 ] 1143 0.143% 100.038% ( 2900, 4400 ] 1043 0.130% 100.168% ( 4400, 6600 ] 279 0.035% 100.203% ( 6600, 9900 ] 40 0.005% 100.208% ( 9900, 14000 ] 3 0.000% 100.208% ( 14000, 22000 ] 9 0.001% 100.209% ( 22000, 33000 ] 4 0.000% 100.210% ( 33000, 50000 ] 6 0.001% 100.210% ** Level 5 read latency histogram (micros): Count: 30411 Average: 1367.1856 StdDev: 1412.72 Min: 82 Median: 913.9212 Max: 48966 Percentiles: P50: 913.92 P75: 1689.90 P99: 6225.85 P99.9: 9788.88 P99.99: 30709.58 ------------------------------------------------------ ( 76, 110 ] 36 0.118% 0.118% ( 110, 170 ] 317 1.042% 1.161% ( 170, 250 ] 866 2.848% 4.008% # ( 250, 380 ] 2271 7.468% 11.476% # ( 380, 580 ] 4530 14.896% 26.372% ### ( 580, 870 ] 6580 21.637% 48.009% #### ( 870, 1300 ] 5928 19.493% 67.502% #### ( 1300, 1900 ] 3509 11.539% 79.040% ## ( 1900, 2900 ] 2641 8.684% 87.725% ## ( 2900, 4400 ] 2711 8.915% 96.639% ## ( 4400, 6600 ] 865 2.844% 99.484% # ( 6600, 9900 ] 131 0.431% 99.915% ( 9900, 14000 ] 12 0.039% 99.954% ( 14000, 22000 ] 7 0.023% 99.977% ( 22000, 33000 ] 5 0.016% 99.993% ( 33000, 50000 ] 5 0.016% 100.010% ** DB Stats ** Uptime(secs): 14.3 total, 6.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 137.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.414 H:M:S, 44.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.604 H:M:S, 40.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-03:31:58 ... thread 0: (1000000,3000000) ops and (244427.4,164658.2) ops/second in (4.091194,18.219558) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.54 GB 25.2 1.2 0.0 1.2 4.0 2.8 0.0 1.4 50.4 172.3 23.76 13.03 41 0.579 1215K 1428 0.0 0.0 L1 5/5 384.05 MB 0.0 1.7 1.3 0.4 1.7 1.3 0.0 1.3 133.8 133.5 12.89 8.24 4 3.222 1750K 3947 0.0 0.0 L2 3/2 296.08 MB 0.4 0.2 0.1 0.1 0.2 0.1 0.9 2.7 133.9 133.8 1.53 0.93 1 1.527 207K 184 0.0 0.0 L3 17/6 1.05 GB 0.6 5.0 2.6 2.4 4.9 2.5 0.0 1.9 120.4 119.2 42.18 23.60 20 2.109 3173K 2309 0.0 0.0 L4 176/0 9.47 GB 1.0 9.6 5.7 3.9 9.5 5.5 0.6 1.7 122.7 121.3 79.95 45.79 54 1.481 4249K 8592 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1370/23 107.83 GB 0.0 17.6 9.6 8.0 20.3 12.3 7.8 7.2 112.4 129.4 160.30 91.59 120 1.336 10M 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.6 9.6 8.0 20.3 12.3 7.8 7.2 112.4 129.4 160.30 91.59 120 1.336 10M 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.6 9.6 8.0 17.4 9.5 0.0 0.0 126.2 124.9 142.82 83.44 83 1.721 10M 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 165.7 17.49 8.14 37 0.473 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.4 total, 18.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.25 GB write, 1125.86 MB/s write, 17.59 GB read, 978.01 MB/s read, 160.3 seconds Interval compaction: 20.25 GB write, 1138.28 MB/s write, 17.59 GB read, 988.80 MB/s read, 160.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 60, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 784269 Average: 9.4180 StdDev: 149.14 Min: 0 Median: 1.8217 Max: 67762 Percentiles: P50: 1.82 P75: 2.73 P99: 10.29 P99.9: 1289.50 P99.99: 2826.23 ------------------------------------------------------ [ 0, 1 ] 37117 4.733% 4.733% # ( 1, 2 ] 432029 55.087% 59.820% ########### ( 2, 3 ] 162818 20.760% 80.580% #### ( 3, 4 ] 67682 8.630% 89.210% ## ( 4, 6 ] 61807 7.881% 97.091% ## ( 6, 10 ] 14819 1.890% 98.980% ( 10, 15 ] 2691 0.343% 99.323% ( 15, 22 ] 282 0.036% 99.359% ( 22, 34 ] 26 0.003% 99.363% ( 34, 51 ] 27 0.003% 99.366% ( 51, 76 ] 51 0.007% 99.373% ( 76, 110 ] 59 0.008% 99.380% ( 110, 170 ] 287 0.037% 99.417% ( 170, 250 ] 489 0.062% 99.479% ( 250, 380 ] 704 0.090% 99.569% ( 380, 580 ] 912 0.116% 99.685% ( 580, 870 ] 956 0.122% 99.807% ( 870, 1300 ] 748 0.095% 99.902% ( 1300, 1900 ] 406 0.052% 99.954% ( 1900, 2900 ] 304 0.039% 99.993% ( 2900, 4400 ] 281 0.036% 100.029% ( 4400, 6600 ] 60 0.008% 100.036% ( 6600, 9900 ] 14 0.002% 100.038% ( 9900, 14000 ] 1 0.000% 100.038% ( 14000, 22000 ] 6 0.001% 100.039% ( 22000, 33000 ] 1 0.000% 100.039% ( 50000, 75000 ] 1 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 324420 Average: 7.6038 StdDev: 98.56 Min: 1 Median: 1.9214 Max: 17624 Percentiles: P50: 1.92 P75: 2.88 P99: 9.88 P99.9: 1143.08 P99.99: 2708.33 ------------------------------------------------------ [ 0, 1 ] 6843 2.109% 2.109% ( 1, 2 ] 168619 51.976% 54.085% ########## ( 2, 3 ] 77416 23.863% 77.948% ##### ( 3, 4 ] 31946 9.847% 87.795% ## ( 4, 6 ] 28333 8.733% 96.528% ## ( 6, 10 ] 8257 2.545% 99.073% # ( 10, 15 ] 1229 0.379% 99.452% ( 15, 22 ] 156 0.048% 99.500% ( 22, 34 ] 9 0.003% 99.503% ( 34, 51 ] 18 0.006% 99.509% ( 51, 76 ] 30 0.009% 99.518% ( 76, 110 ] 15 0.005% 99.523% ( 110, 170 ] 92 0.028% 99.551% ( 170, 250 ] 156 0.048% 99.599% ( 250, 380 ] 203 0.063% 99.662% ( 380, 580 ] 281 0.087% 99.748% ( 580, 870 ] 330 0.102% 99.850% ( 870, 1300 ] 256 0.079% 99.929% ( 1300, 1900 ] 125 0.039% 99.967% ( 1900, 2900 ] 91 0.028% 99.995% ( 2900, 4400 ] 69 0.021% 100.017% ( 4400, 6600 ] 15 0.005% 100.021% ( 6600, 9900 ] 3 0.001% 100.022% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 2 read latency histogram (micros): Count: 517203 Average: 12.9469 StdDev: 162.85 Min: 1 Median: 1.9859 Max: 11833 Percentiles: P50: 1.99 P75: 3.04 P99: 12.01 P99.9: 1244.46 P99.99: 1803.63 ------------------------------------------------------ [ 0, 1 ] 14218 2.749% 2.749% # ( 1, 2 ] 247884 47.928% 50.677% ########## ( 2, 3 ] 123510 23.880% 74.557% ##### ( 3, 4 ] 54873 10.610% 85.167% ## ( 4, 6 ] 53457 10.336% 95.503% ## ( 6, 10 ] 16702 3.229% 98.732% # ( 10, 15 ] 3454 0.668% 99.400% ( 15, 22 ] 493 0.095% 99.495% ( 22, 34 ] 104 0.020% 99.515% ( 34, 51 ] 46 0.009% 99.524% ( 51, 76 ] 38 0.007% 99.531% ( 76, 110 ] 24 0.005% 99.536% ( 110, 170 ] 48 0.009% 99.545% ( 170, 250 ] 114 0.022% 99.567% ( 250, 380 ] 222 0.043% 99.610% ( 380, 580 ] 386 0.075% 99.685% ( 580, 870 ] 572 0.111% 99.795% ( 870, 1300 ] 621 0.120% 99.916% ( 1300, 1900 ] 459 0.089% 100.004% ( 1900, 2900 ] 412 0.080% 100.084% ( 2900, 4400 ] 389 0.075% 100.159% ( 4400, 6600 ] 109 0.021% 100.180% ( 6600, 9900 ] 17 0.003% 100.183% ( 9900, 14000 ] 4 0.001% 100.184% ** Level 3 read latency histogram (micros): Count: 2016096 Average: 10.3127 StdDev: 161.31 Min: 1 Median: 1.9696 Max: 45034 Percentiles: P50: 1.97 P75: 2.95 P99: 9.68 P99.9: 474.11 P99.99: 750.53 ------------------------------------------------------ [ 0, 1 ] 30757 1.526% 1.526% ( 1, 2 ] 1007968 49.996% 51.522% ########## ( 2, 3 ] 499857 24.793% 76.315% ##### ( 3, 4 ] 210298 10.431% 86.746% ## ( 4, 6 ] 196596 9.751% 96.497% ## ( 6, 10 ] 54823 2.719% 99.216% # ( 10, 15 ] 9963 0.494% 99.711% ( 15, 22 ] 1152 0.057% 99.768% ( 22, 34 ] 101 0.005% 99.773% ( 34, 51 ] 170 0.008% 99.781% ( 51, 76 ] 162 0.008% 99.789% ( 76, 110 ] 82 0.004% 99.793% ( 110, 170 ] 281 0.014% 99.807% ( 170, 250 ] 474 0.024% 99.831% ( 250, 380 ] 772 0.038% 99.869% ( 380, 580 ] 1328 0.066% 99.935% ( 580, 870 ] 1890 0.094% 100.029% ( 870, 1300 ] 1811 0.090% 100.118% ( 1300, 1900 ] 1137 0.056% 100.175% ( 1900, 2900 ] 1096 0.054% 100.229% ( 2900, 4400 ] 1048 0.052% 100.281% ( 4400, 6600 ] 274 0.014% 100.295% ( 6600, 9900 ] 67 0.003% 100.298% ( 9900, 14000 ] 7 0.000% 100.298% ( 14000, 22000 ] 14 0.001% 100.299% ( 22000, 33000 ] 8 0.000% 100.300% ( 33000, 50000 ] 3 0.000% 100.300% ** Level 4 read latency histogram (micros): Count: 1023624 Average: 21.1615 StdDev: 236.17 Min: 1 Median: 1.9874 Max: 44889 Percentiles: P50: 1.99 P75: 2.99 P99: 374.31 P99.9: 1779.61 P99.99: 2369.99 ------------------------------------------------------ [ 0, 1 ] 15678 1.532% 1.532% ( 1, 2 ] 502490 49.089% 50.621% ########## ( 2, 3 ] 251499 24.569% 75.190% ##### ( 3, 4 ] 106820 10.435% 85.626% ## ( 4, 6 ] 98080 9.582% 95.208% ## ( 6, 10 ] 29245 2.857% 98.065% # ( 10, 15 ] 5214 0.509% 98.574% ( 15, 22 ] 579 0.057% 98.630% ( 22, 34 ] 57 0.006% 98.636% ( 34, 51 ] 58 0.006% 98.642% ( 51, 76 ] 100 0.010% 98.651% ( 76, 110 ] 159 0.016% 98.667% ( 110, 170 ] 649 0.063% 98.730% ( 170, 250 ] 1224 0.120% 98.850% ( 250, 380 ] 1606 0.157% 99.007% ( 380, 580 ] 2372 0.232% 99.239% ( 580, 870 ] 2928 0.286% 99.525% ( 870, 1300 ] 2597 0.254% 99.778% ( 1300, 1900 ] 1558 0.152% 99.931% ( 1900, 2900 ] 1295 0.127% 100.057% ( 2900, 4400 ] 1129 0.110% 100.167% ( 4400, 6600 ] 289 0.028% 100.196% ( 6600, 9900 ] 45 0.004% 100.200% ( 9900, 14000 ] 3 0.000% 100.200% ( 14000, 22000 ] 9 0.001% 100.201% ( 22000, 33000 ] 4 0.000% 100.202% ( 33000, 50000 ] 6 0.001% 100.202% ** Level 5 read latency histogram (micros): Count: 51326 Average: 1040.7674 StdDev: 1216.18 Min: 78 Median: 675.2374 Max: 48966 Percentiles: P50: 675.24 P75: 1216.03 P99: 5725.28 P99.9: 9271.61 P99.99: 26108.28 ------------------------------------------------------ ( 76, 110 ] 470 0.916% 0.916% ( 110, 170 ] 2706 5.272% 6.188% # ( 170, 250 ] 4307 8.391% 14.579% ## ( 250, 380 ] 6171 12.023% 26.603% ## ( 380, 580 ] 8744 17.036% 43.639% ### ( 580, 870 ] 9942 19.370% 63.009% #### ( 870, 1300 ] 7648 14.901% 77.910% ### ( 1300, 1900 ] 4114 8.015% 85.925% ## ( 1900, 2900 ] 3189 6.213% 92.138% # ( 2900, 4400 ] 2985 5.816% 97.954% # ( 4400, 6600 ] 891 1.736% 99.690% ( 6600, 9900 ] 133 0.259% 99.949% ( 9900, 14000 ] 12 0.023% 99.973% ( 14000, 22000 ] 7 0.014% 99.986% ( 22000, 33000 ] 5 0.010% 99.996% ( 33000, 50000 ] 5 0.010% 100.006% ** DB Stats ** Uptime(secs): 18.4 total, 4.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 160.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.765 H:M:S, 36.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 240.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.351 H:M:S, 8.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-03:32:01 ... thread 0: (1000000,4000000) ops and (278468.5,183396.8) ops/second in (3.591070,21.810628) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.46 GB 119.6 2.2 0.0 2.2 5.8 3.7 0.0 1.6 71.0 192.6 31.07 19.50 59 0.527 2238K 2422 0.0 0.0 L1 5/5 384.05 MB 0.0 1.7 1.3 0.4 1.7 1.3 0.0 1.3 133.8 133.5 12.89 8.24 4 3.222 1750K 3947 0.0 0.0 L2 1/0 38.54 MB 0.4 0.2 0.1 0.1 0.2 0.1 0.9 2.7 133.9 133.8 1.53 0.93 1 1.527 207K 184 0.0 0.0 L3 16/0 906.99 MB 0.9 5.7 2.8 2.9 5.6 2.8 0.0 2.0 127.2 126.0 45.90 27.05 22 2.086 3941K 5059 0.0 0.0 L4 183/4 9.86 GB 1.0 10.9 6.0 4.9 10.8 5.9 0.6 1.8 128.0 126.4 87.34 52.08 59 1.480 5634K 30K 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/19 108.72 GB 0.0 20.6 10.2 10.4 24.1 13.7 7.8 6.5 118.3 138.3 178.72 107.80 145 1.233 13M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 10.2 10.4 24.1 13.7 7.8 6.5 118.3 138.3 178.72 107.80 145 1.233 13M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 10.2 10.4 20.5 10.0 0.0 0.0 133.9 132.6 157.95 97.10 94 1.680 13M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 182.0 20.77 10.71 51 0.407 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.0 total, 21.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.15 GB write, 1123.20 MB/s write, 20.65 GB read, 960.57 MB/s read, 178.7 seconds Interval compaction: 24.15 GB write, 1133.55 MB/s write, 20.65 GB read, 969.42 MB/s read, 178.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 60, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1102157 Average: 10.0511 StdDev: 137.74 Min: 0 Median: 1.7752 Max: 67762 Percentiles: P50: 1.78 P75: 2.63 P99: 116.43 P99.9: 1200.99 P99.99: 2466.71 ------------------------------------------------------ [ 0, 1 ] 67142 6.092% 6.092% # ( 1, 2 ] 624266 56.640% 62.732% ########### ( 2, 3 ] 215574 19.559% 82.292% #### ( 3, 4 ] 86462 7.845% 90.136% ## ( 4, 6 ] 75912 6.888% 97.024% # ( 6, 10 ] 17755 1.611% 98.635% ( 10, 15 ] 3092 0.281% 98.915% ( 15, 22 ] 331 0.030% 98.945% ( 22, 34 ] 36 0.003% 98.949% ( 34, 51 ] 31 0.003% 98.952% ( 51, 76 ] 59 0.005% 98.957% ( 76, 110 ] 306 0.028% 98.985% ( 110, 170 ] 1591 0.144% 99.129% ( 170, 250 ] 1972 0.179% 99.308% ( 250, 380 ] 1951 0.177% 99.485% ( 380, 580 ] 2085 0.189% 99.674% ( 580, 870 ] 1679 0.152% 99.826% ( 870, 1300 ] 1056 0.096% 99.922% ( 1300, 1900 ] 517 0.047% 99.969% ( 1900, 2900 ] 409 0.037% 100.006% ( 2900, 4400 ] 333 0.030% 100.036% ( 4400, 6600 ] 65 0.006% 100.042% ( 6600, 9900 ] 14 0.001% 100.044% ( 9900, 14000 ] 1 0.000% 100.044% ( 14000, 22000 ] 9 0.001% 100.045% ( 22000, 33000 ] 1 0.000% 100.045% ( 50000, 75000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 357634 Average: 7.5766 StdDev: 100.04 Min: 1 Median: 1.9134 Max: 17624 Percentiles: P50: 1.91 P75: 2.86 P99: 9.97 P99.9: 1116.29 P99.99: 2742.94 ------------------------------------------------------ [ 0, 1 ] 8083 2.260% 2.260% ( 1, 2 ] 186912 52.263% 54.524% ########## ( 2, 3 ] 84786 23.707% 78.231% ##### ( 3, 4 ] 34453 9.634% 87.865% ## ( 4, 6 ] 30708 8.586% 96.451% ## ( 6, 10 ] 9185 2.568% 99.019% # ( 10, 15 ] 1338 0.374% 99.394% ( 15, 22 ] 185 0.052% 99.445% ( 22, 34 ] 10 0.003% 99.448% ( 34, 51 ] 23 0.006% 99.454% ( 51, 76 ] 30 0.008% 99.463% ( 76, 110 ] 36 0.010% 99.473% ( 110, 170 ] 200 0.056% 99.529% ( 170, 250 ] 226 0.063% 99.592% ( 250, 380 ] 259 0.072% 99.664% ( 380, 580 ] 335 0.094% 99.758% ( 580, 870 ] 351 0.098% 99.856% ( 870, 1300 ] 273 0.076% 99.933% ( 1300, 1900 ] 126 0.035% 99.968% ( 1900, 2900 ] 94 0.026% 99.994% ( 2900, 4400 ] 74 0.021% 100.015% ( 4400, 6600 ] 15 0.004% 100.019% ( 6600, 9900 ] 3 0.001% 100.020% ( 14000, 22000 ] 2 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 517203 Average: 12.9469 StdDev: 162.85 Min: 1 Median: 1.9859 Max: 11833 Percentiles: P50: 1.99 P75: 3.04 P99: 12.01 P99.9: 1244.46 P99.99: 1803.63 ------------------------------------------------------ [ 0, 1 ] 14218 2.749% 2.749% # ( 1, 2 ] 247884 47.928% 50.677% ########## ( 2, 3 ] 123510 23.880% 74.557% ##### ( 3, 4 ] 54873 10.610% 85.167% ## ( 4, 6 ] 53457 10.336% 95.503% ## ( 6, 10 ] 16702 3.229% 98.732% # ( 10, 15 ] 3454 0.668% 99.400% ( 15, 22 ] 493 0.095% 99.495% ( 22, 34 ] 104 0.020% 99.515% ( 34, 51 ] 46 0.009% 99.524% ( 51, 76 ] 38 0.007% 99.531% ( 76, 110 ] 24 0.005% 99.536% ( 110, 170 ] 48 0.009% 99.545% ( 170, 250 ] 114 0.022% 99.567% ( 250, 380 ] 222 0.043% 99.610% ( 380, 580 ] 386 0.075% 99.685% ( 580, 870 ] 572 0.111% 99.795% ( 870, 1300 ] 621 0.120% 99.916% ( 1300, 1900 ] 459 0.089% 100.004% ( 1900, 2900 ] 412 0.080% 100.084% ( 2900, 4400 ] 389 0.075% 100.159% ( 4400, 6600 ] 109 0.021% 100.180% ( 6600, 9900 ] 17 0.003% 100.183% ( 9900, 14000 ] 4 0.001% 100.184% ** Level 3 read latency histogram (micros): Count: 2168765 Average: 9.8859 StdDev: 155.80 Min: 1 Median: 1.9566 Max: 45034 Percentiles: P50: 1.96 P75: 2.92 P99: 9.65 P99.9: 467.49 P99.99: 749.30 ------------------------------------------------------ [ 0, 1 ] 35298 1.628% 1.628% ( 1, 2 ] 1096629 50.565% 52.192% ########## ( 2, 3 ] 535308 24.683% 76.875% ##### ( 3, 4 ] 221695 10.222% 87.097% ## ( 4, 6 ] 206331 9.514% 96.611% ## ( 6, 10 ] 56818 2.620% 99.231% # ( 10, 15 ] 10228 0.472% 99.702% ( 15, 22 ] 1180 0.054% 99.757% ( 22, 34 ] 102 0.005% 99.761% ( 34, 51 ] 173 0.008% 99.769% ( 51, 76 ] 166 0.008% 99.777% ( 76, 110 ] 117 0.005% 99.782% ( 110, 170 ] 420 0.019% 99.802% ( 170, 250 ] 604 0.028% 99.830% ( 250, 380 ] 896 0.041% 99.871% ( 380, 580 ] 1443 0.067% 99.937% ( 580, 870 ] 1953 0.090% 100.027% ( 870, 1300 ] 1847 0.085% 100.113% ( 1300, 1900 ] 1139 0.053% 100.165% ( 1900, 2900 ] 1098 0.051% 100.216% ( 2900, 4400 ] 1052 0.049% 100.264% ( 4400, 6600 ] 274 0.013% 100.277% ( 6600, 9900 ] 67 0.003% 100.280% ( 9900, 14000 ] 7 0.000% 100.280% ( 14000, 22000 ] 14 0.001% 100.281% ( 22000, 33000 ] 8 0.000% 100.281% ( 33000, 50000 ] 3 0.000% 100.281% ** Level 4 read latency histogram (micros): Count: 1281813 Average: 19.3681 StdDev: 217.84 Min: 1 Median: 1.9716 Max: 44889 Percentiles: P50: 1.97 P75: 2.97 P99: 322.68 P99.9: 1563.58 P99.99: 2075.91 ------------------------------------------------------ [ 0, 1 ] 20409 1.592% 1.592% ( 1, 2 ] 638613 49.821% 51.413% ########## ( 2, 3 ] 313047 24.422% 75.835% ##### ( 3, 4 ] 129951 10.138% 85.974% ## ( 4, 6 ] 118582 9.251% 95.225% ## ( 6, 10 ] 35278 2.752% 97.977% # ( 10, 15 ] 5819 0.454% 98.431% ( 15, 22 ] 670 0.052% 98.483% ( 22, 34 ] 78 0.006% 98.489% ( 34, 51 ] 93 0.007% 98.496% ( 51, 76 ] 130 0.010% 98.507% ( 76, 110 ] 423 0.033% 98.540% ( 110, 170 ] 1913 0.149% 98.689% ( 170, 250 ] 2513 0.196% 98.885% ( 250, 380 ] 2640 0.206% 99.091% ( 380, 580 ] 3334 0.260% 99.351% ( 580, 870 ] 3495 0.273% 99.624% ( 870, 1300 ] 2828 0.221% 99.844% ( 1300, 1900 ] 1628 0.127% 99.971% ( 1900, 2900 ] 1369 0.107% 100.078% ( 2900, 4400 ] 1166 0.091% 100.169% ( 4400, 6600 ] 295 0.023% 100.192% ( 6600, 9900 ] 50 0.004% 100.196% ( 9900, 14000 ] 7 0.001% 100.196% ( 14000, 22000 ] 12 0.001% 100.197% ( 22000, 33000 ] 4 0.000% 100.198% ( 33000, 50000 ] 6 0.000% 100.198% ** Level 5 read latency histogram (micros): Count: 76241 Average: 826.8625 StdDev: 1077.97 Min: 76 Median: 499.5758 Max: 48966 Percentiles: P50: 499.58 P75: 946.33 P99: 5158.96 P99.9: 8770.32 P99.99: 19375.90 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 1754 2.301% 2.302% ( 110, 170 ] 8509 11.161% 13.463% ## ( 170, 250 ] 9753 12.792% 26.255% ### ( 250, 380 ] 10521 13.800% 40.055% ### ( 380, 580 ] 12684 16.637% 56.691% ### ( 580, 870 ] 12430 16.304% 72.995% ### ( 870, 1300 ] 8618 11.304% 84.298% ## ( 1300, 1900 ] 4355 5.712% 90.011% # ( 1900, 2900 ] 3414 4.478% 94.489% # ( 2900, 4400 ] 3127 4.101% 98.590% # ( 4400, 6600 ] 909 1.192% 99.782% ( 6600, 9900 ] 138 0.181% 99.963% ( 9900, 14000 ] 16 0.021% 99.984% ( 14000, 22000 ] 8 0.010% 99.995% ( 22000, 33000 ] 5 0.007% 100.001% ( 33000, 50000 ] 5 0.007% 100.008% ** DB Stats ** Uptime(secs): 22.0 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 178.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.765 H:M:S, 30.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-03:32:06 ... thread 0: (1000000,5000000) ops and (208013.6,187842.8) ops/second in (4.807377,26.618005) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 3.50 GB 251.8 3.4 0.0 3.4 8.1 4.7 0.0 1.7 88.3 211.7 39.26 27.15 81 0.485 3518K 3697 0.0 0.0 L1 5/5 384.05 MB 0.0 1.7 1.3 0.4 1.7 1.3 0.0 1.3 133.8 133.5 12.89 8.24 4 3.222 1750K 3947 0.0 0.0 L2 1/0 38.54 MB 0.4 0.2 0.1 0.1 0.2 0.1 0.9 2.7 133.9 133.8 1.53 0.93 1 1.527 207K 184 0.0 0.0 L3 16/0 906.99 MB 0.9 5.7 2.8 2.9 5.6 2.8 0.0 2.0 127.2 126.0 45.90 27.05 22 2.086 3941K 5059 0.0 0.0 L4 179/0 9.55 GB 1.0 10.9 6.0 4.9 10.8 5.9 0.6 1.8 128.0 126.4 87.34 52.08 59 1.480 5634K 30K 0.0 0.0 L5 1160/0 95.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1379/11 109.77 GB 0.0 21.9 10.2 11.6 26.4 14.8 8.1 5.6 119.9 144.7 186.91 115.45 167 1.119 15M 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.9 10.2 11.6 26.4 14.8 8.1 5.6 119.9 144.7 186.91 115.45 167 1.119 15M 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.9 10.2 11.6 21.7 10.0 0.0 0.0 137.7 136.4 162.74 101.80 99 1.644 15M 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 200.7 24.17 13.65 68 0.355 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.8 total, 26.6 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.42 GB write, 1008.74 MB/s write, 21.88 GB read, 835.38 MB/s read, 186.9 seconds Interval compaction: 26.42 GB write, 1016.35 MB/s write, 21.88 GB read, 841.69 MB/s read, 186.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 60, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1436724 Average: 12.0156 StdDev: 124.90 Min: 0 Median: 1.6956 Max: 67762 Percentiles: P50: 1.70 P75: 2.49 P99: 222.29 P99.9: 1009.88 P99.99: 1923.96 ------------------------------------------------------ [ 0, 1 ] 161794 11.261% 11.261% ## ( 1, 2 ] 800150 55.693% 66.954% ########### ( 2, 3 ] 237217 16.511% 83.465% ### ( 3, 4 ] 93494 6.507% 89.972% # ( 4, 6 ] 79987 5.567% 95.540% # ( 6, 10 ] 18675 1.300% 96.840% ( 10, 15 ] 3298 0.230% 97.069% ( 15, 22 ] 358 0.025% 97.094% ( 22, 34 ] 38 0.003% 97.097% ( 34, 51 ] 32 0.002% 97.099% ( 51, 76 ] 63 0.004% 97.103% ( 76, 110 ] 5260 0.366% 97.469% ( 110, 170 ] 16921 1.178% 98.647% ( 170, 250 ] 7756 0.540% 99.187% ( 250, 380 ] 3990 0.278% 99.465% ( 380, 580 ] 3750 0.261% 99.726% ( 580, 870 ] 2137 0.149% 99.874% ( 870, 1300 ] 1129 0.079% 99.953% ( 1300, 1900 ] 521 0.036% 99.989% ( 1900, 2900 ] 431 0.030% 100.019% ( 2900, 4400 ] 337 0.023% 100.043% ( 4400, 6600 ] 65 0.005% 100.047% ( 6600, 9900 ] 14 0.001% 100.048% ( 9900, 14000 ] 1 0.000% 100.048% ( 14000, 22000 ] 9 0.001% 100.049% ( 22000, 33000 ] 1 0.000% 100.049% ( 50000, 75000 ] 1 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 374665 Average: 7.7433 StdDev: 98.15 Min: 1 Median: 1.9409 Max: 17624 Percentiles: P50: 1.94 P75: 2.91 P99: 12.40 P99.9: 1090.23 P99.99: 2724.82 ------------------------------------------------------ [ 0, 1 ] 8214 2.192% 2.192% ( 1, 2 ] 190362 50.809% 53.001% ########## ( 2, 3 ] 90937 24.272% 77.272% ##### ( 3, 4 ] 36688 9.792% 87.065% ## ( 4, 6 ] 34148 9.114% 96.179% ## ( 6, 10 ] 9850 2.629% 98.808% # ( 10, 15 ] 1497 0.400% 99.208% ( 15, 22 ] 266 0.071% 99.279% ( 22, 34 ] 15 0.004% 99.283% ( 34, 51 ] 23 0.006% 99.289% ( 51, 76 ] 30 0.008% 99.297% ( 76, 110 ] 125 0.033% 99.330% ( 110, 170 ] 583 0.156% 99.486% ( 170, 250 ] 373 0.100% 99.585% ( 250, 380 ] 306 0.082% 99.667% ( 380, 580 ] 373 0.100% 99.766% ( 580, 870 ] 360 0.096% 99.863% ( 870, 1300 ] 274 0.073% 99.936% ( 1300, 1900 ] 126 0.034% 99.969% ( 1900, 2900 ] 94 0.025% 99.994% ( 2900, 4400 ] 74 0.020% 100.014% ( 4400, 6600 ] 15 0.004% 100.018% ( 6600, 9900 ] 3 0.001% 100.019% ( 14000, 22000 ] 2 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 517203 Average: 12.9469 StdDev: 162.85 Min: 1 Median: 1.9859 Max: 11833 Percentiles: P50: 1.99 P75: 3.04 P99: 12.01 P99.9: 1244.46 P99.99: 1803.63 ------------------------------------------------------ [ 0, 1 ] 14218 2.749% 2.749% # ( 1, 2 ] 247884 47.928% 50.677% ########## ( 2, 3 ] 123510 23.880% 74.557% ##### ( 3, 4 ] 54873 10.610% 85.167% ## ( 4, 6 ] 53457 10.336% 95.503% ## ( 6, 10 ] 16702 3.229% 98.732% # ( 10, 15 ] 3454 0.668% 99.400% ( 15, 22 ] 493 0.095% 99.495% ( 22, 34 ] 104 0.020% 99.515% ( 34, 51 ] 46 0.009% 99.524% ( 51, 76 ] 38 0.007% 99.531% ( 76, 110 ] 24 0.005% 99.536% ( 110, 170 ] 48 0.009% 99.545% ( 170, 250 ] 114 0.022% 99.567% ( 250, 380 ] 222 0.043% 99.610% ( 380, 580 ] 386 0.075% 99.685% ( 580, 870 ] 572 0.111% 99.795% ( 870, 1300 ] 621 0.120% 99.916% ( 1300, 1900 ] 459 0.089% 100.004% ( 1900, 2900 ] 412 0.080% 100.084% ( 2900, 4400 ] 389 0.075% 100.159% ( 4400, 6600 ] 109 0.021% 100.180% ( 6600, 9900 ] 17 0.003% 100.183% ( 9900, 14000 ] 4 0.001% 100.184% ** Level 3 read latency histogram (micros): Count: 2170529 Average: 10.0246 StdDev: 155.85 Min: 1 Median: 1.9574 Max: 45034 Percentiles: P50: 1.96 P75: 2.93 P99: 9.77 P99.9: 478.17 P99.99: 751.71 ------------------------------------------------------ [ 0, 1 ] 35298 1.626% 1.626% ( 1, 2 ] 1096633 50.524% 52.150% ########## ( 2, 3 ] 535323 24.663% 76.813% ##### ( 3, 4 ] 221698 10.214% 87.027% ## ( 4, 6 ] 206335 9.506% 96.533% ## ( 6, 10 ] 56819 2.618% 99.151% # ( 10, 15 ] 10228 0.471% 99.622% ( 15, 22 ] 1180 0.054% 99.677% ( 22, 34 ] 102 0.005% 99.682% ( 34, 51 ] 173 0.008% 99.689% ( 51, 76 ] 166 0.008% 99.697% ( 76, 110 ] 400 0.018% 99.716% ( 110, 170 ] 1336 0.062% 99.777% ( 170, 250 ] 904 0.042% 99.819% ( 250, 380 ] 1011 0.047% 99.865% ( 380, 580 ] 1533 0.071% 99.936% ( 580, 870 ] 1981 0.091% 100.027% ( 870, 1300 ] 1851 0.085% 100.113% ( 1300, 1900 ] 1139 0.052% 100.165% ( 1900, 2900 ] 1099 0.051% 100.216% ( 2900, 4400 ] 1052 0.048% 100.264% ( 4400, 6600 ] 274 0.013% 100.277% ( 6600, 9900 ] 67 0.003% 100.280% ( 9900, 14000 ] 7 0.000% 100.280% ( 14000, 22000 ] 14 0.001% 100.281% ( 22000, 33000 ] 8 0.000% 100.281% ( 33000, 50000 ] 3 0.000% 100.281% ** Level 4 read latency histogram (micros): Count: 1293613 Average: 20.7087 StdDev: 217.64 Min: 1 Median: 1.9807 Max: 44889 Percentiles: P50: 1.98 P75: 2.99 P99: 358.23 P99.9: 1561.28 P99.99: 2078.18 ------------------------------------------------------ [ 0, 1 ] 20410 1.578% 1.578% ( 1, 2 ] 638704 49.374% 50.951% ########## ( 2, 3 ] 313372 24.225% 75.176% ##### ( 3, 4 ] 130166 10.062% 85.238% ## ( 4, 6 ] 118879 9.190% 94.428% ## ( 6, 10 ] 35318 2.730% 97.158% # ( 10, 15 ] 5828 0.451% 97.609% ( 15, 22 ] 673 0.052% 97.661% ( 22, 34 ] 79 0.006% 97.667% ( 34, 51 ] 93 0.007% 97.674% ( 51, 76 ] 130 0.010% 97.684% ( 76, 110 ] 2136 0.165% 97.849% ( 110, 170 ] 7656 0.592% 98.441% ( 170, 250 ] 4429 0.342% 98.783% ( 250, 380 ] 3368 0.260% 99.044% ( 380, 580 ] 3890 0.301% 99.344% ( 580, 870 ] 3634 0.281% 99.625% ( 870, 1300 ] 2845 0.220% 99.845% ( 1300, 1900 ] 1629 0.126% 99.971% ( 1900, 2900 ] 1373 0.106% 100.077% ( 2900, 4400 ] 1168 0.090% 100.168% ( 4400, 6600 ] 295 0.023% 100.190% ( 6600, 9900 ] 50 0.004% 100.194% ( 9900, 14000 ] 7 0.001% 100.195% ( 14000, 22000 ] 12 0.001% 100.196% ( 22000, 33000 ] 4 0.000% 100.196% ( 33000, 50000 ] 6 0.000% 100.196% ** Level 5 read latency histogram (micros): Count: 138404 Average: 537.3006 StdDev: 866.28 Min: 74 Median: 232.0990 Max: 48966 Percentiles: P50: 232.10 P75: 573.45 P99: 4250.94 P99.9: 7207.67 P99.99: 12759.65 ------------------------------------------------------ ( 51, 76 ] 14 0.010% 0.010% ( 76, 110 ] 11883 8.586% 8.596% ## ( 110, 170 ] 40959 29.594% 38.190% ###### ( 170, 250 ] 21058 15.215% 53.405% ### ( 250, 380 ] 14462 10.449% 63.854% ## ( 380, 580 ] 15949 11.524% 75.377% ## ( 580, 870 ] 13313 9.619% 84.996% ## ( 870, 1300 ] 8755 6.326% 91.322% # ( 1300, 1900 ] 4373 3.160% 94.481% # ( 1900, 2900 ] 3435 2.482% 96.963% ( 2900, 4400 ] 3130 2.261% 99.225% ( 4400, 6600 ] 909 0.657% 99.882% ( 6600, 9900 ] 139 0.100% 99.982% ( 9900, 14000 ] 16 0.012% 99.993% ( 14000, 22000 ] 8 0.006% 99.999% ( 22000, 33000 ] 5 0.004% 100.003% ( 33000, 50000 ] 5 0.004% 100.007% ** DB Stats ** Uptime(secs): 26.8 total, 4.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 183.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.009 H:M:S, 29.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 204.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.244 H:M:S, 25.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-03:32:16 ... thread 0: (1000000,6000000) ops and (101519.6,164526.4) ops/second in (9.850315,36.468320) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.42 GB 319.9 5.7 0.0 5.7 11.3 5.6 0.0 2.0 113.9 227.6 50.86 38.19 100 0.509 5883K 15K 0.0 0.0 L1 5/5 384.05 MB 0.0 1.7 1.3 0.4 1.7 1.3 0.0 1.3 133.8 133.5 12.89 8.24 4 3.222 1750K 3947 0.0 0.0 L2 1/0 38.54 MB 0.4 0.2 0.1 0.1 0.2 0.1 0.9 2.7 133.9 133.8 1.53 0.93 1 1.527 207K 184 0.0 0.0 L3 16/0 906.99 MB 0.9 5.7 2.8 2.9 5.6 2.8 0.0 2.0 127.2 126.0 45.90 27.05 22 2.086 3941K 5059 0.0 0.0 L4 179/0 9.55 GB 1.0 10.9 6.0 4.9 10.8 5.9 0.6 1.8 128.0 126.4 87.34 52.08 59 1.480 5634K 30K 0.0 0.0 L5 1160/0 95.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1379/15 110.68 GB 0.0 24.2 10.2 13.9 29.6 15.7 8.1 5.2 124.6 152.7 198.51 126.48 186 1.067 17M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.2 10.2 13.9 29.6 15.7 8.1 5.2 124.6 152.7 198.51 126.48 186 1.067 17M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.2 10.2 13.9 23.9 10.0 0.0 0.0 144.3 143.0 171.44 110.32 103 1.664 17M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 214.1 27.07 16.16 83 0.326 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.7 total, 36.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.61 GB write, 826.75 MB/s write, 24.15 GB read, 674.51 MB/s read, 198.5 seconds Interval compaction: 29.61 GB write, 831.31 MB/s write, 24.15 GB read, 678.22 MB/s read, 198.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 60, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2138068 Average: 14.2275 StdDev: 108.86 Min: 0 Median: 1.5975 Max: 67762 Percentiles: P50: 1.60 P75: 2.26 P99: 238.95 P99.9: 805.98 P99.99: 1377.67 ------------------------------------------------------ [ 0, 1 ] 380731 17.807% 17.807% #### ( 1, 2 ] 1151962 53.879% 71.686% ########### ( 2, 3 ] 274767 12.851% 84.537% ### ( 3, 4 ] 107097 5.009% 89.546% # ( 4, 6 ] 87893 4.111% 93.657% # ( 6, 10 ] 20333 0.951% 94.608% ( 10, 15 ] 3777 0.177% 94.785% ( 15, 22 ] 433 0.020% 94.805% ( 22, 34 ] 41 0.002% 94.807% ( 34, 51 ] 33 0.002% 94.808% ( 51, 76 ] 94 0.004% 94.813% ( 76, 110 ] 18338 0.858% 95.670% ( 110, 170 ] 54560 2.552% 98.222% # ( 170, 250 ] 19294 0.902% 99.125% ( 250, 380 ] 7708 0.361% 99.485% ( 380, 580 ] 6638 0.310% 99.796% ( 580, 870 ] 2863 0.134% 99.930% ( 870, 1300 ] 1221 0.057% 99.987% ( 1300, 1900 ] 550 0.026% 100.012% ( 1900, 2900 ] 454 0.021% 100.034% ( 2900, 4400 ] 351 0.016% 100.050% ( 4400, 6600 ] 67 0.003% 100.053% ( 6600, 9900 ] 14 0.001% 100.054% ( 9900, 14000 ] 1 0.000% 100.054% ( 14000, 22000 ] 9 0.000% 100.054% ( 22000, 33000 ] 1 0.000% 100.054% ( 50000, 75000 ] 1 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 423946 Average: 7.8549 StdDev: 93.14 Min: 1 Median: 1.9635 Max: 17624 Percentiles: P50: 1.96 P75: 2.94 P99: 78.46 P99.9: 1018.09 P99.99: 2683.04 ------------------------------------------------------ [ 0, 1 ] 10030 2.366% 2.366% ( 1, 2 ] 209591 49.438% 51.804% ########## ( 2, 3 ] 104986 24.764% 76.568% ##### ( 3, 4 ] 41425 9.771% 86.339% ## ( 4, 6 ] 40117 9.463% 95.802% ## ( 6, 10 ] 11275 2.660% 98.462% # ( 10, 15 ] 1772 0.418% 98.880% ( 15, 22 ] 406 0.096% 98.975% ( 22, 34 ] 24 0.006% 98.981% ( 34, 51 ] 23 0.005% 98.986% ( 51, 76 ] 30 0.007% 98.994% ( 76, 110 ] 381 0.090% 99.083% ( 110, 170 ] 1506 0.355% 99.439% ( 170, 250 ] 662 0.156% 99.595% ( 250, 380 ] 397 0.094% 99.688% ( 380, 580 ] 427 0.101% 99.789% ( 580, 870 ] 375 0.088% 99.878% ( 870, 1300 ] 276 0.065% 99.943% ( 1300, 1900 ] 127 0.030% 99.973% ( 1900, 2900 ] 94 0.022% 99.995% ( 2900, 4400 ] 75 0.018% 100.013% ( 4400, 6600 ] 15 0.004% 100.016% ( 6600, 9900 ] 3 0.001% 100.017% ( 14000, 22000 ] 2 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 517203 Average: 12.9469 StdDev: 162.85 Min: 1 Median: 1.9859 Max: 11833 Percentiles: P50: 1.99 P75: 3.04 P99: 12.01 P99.9: 1244.46 P99.99: 1803.63 ------------------------------------------------------ [ 0, 1 ] 14218 2.749% 2.749% # ( 1, 2 ] 247884 47.928% 50.677% ########## ( 2, 3 ] 123510 23.880% 74.557% ##### ( 3, 4 ] 54873 10.610% 85.167% ## ( 4, 6 ] 53457 10.336% 95.503% ## ( 6, 10 ] 16702 3.229% 98.732% # ( 10, 15 ] 3454 0.668% 99.400% ( 15, 22 ] 493 0.095% 99.495% ( 22, 34 ] 104 0.020% 99.515% ( 34, 51 ] 46 0.009% 99.524% ( 51, 76 ] 38 0.007% 99.531% ( 76, 110 ] 24 0.005% 99.536% ( 110, 170 ] 48 0.009% 99.545% ( 170, 250 ] 114 0.022% 99.567% ( 250, 380 ] 222 0.043% 99.610% ( 380, 580 ] 386 0.075% 99.685% ( 580, 870 ] 572 0.111% 99.795% ( 870, 1300 ] 621 0.120% 99.916% ( 1300, 1900 ] 459 0.089% 100.004% ( 1900, 2900 ] 412 0.080% 100.084% ( 2900, 4400 ] 389 0.075% 100.159% ( 4400, 6600 ] 109 0.021% 100.180% ( 6600, 9900 ] 17 0.003% 100.183% ( 9900, 14000 ] 4 0.001% 100.184% ** Level 3 read latency histogram (micros): Count: 2174196 Average: 10.2938 StdDev: 155.91 Min: 1 Median: 1.9591 Max: 45034 Percentiles: P50: 1.96 P75: 2.93 P99: 10.17 P99.9: 491.05 P99.99: 754.94 ------------------------------------------------------ [ 0, 1 ] 35298 1.623% 1.623% ( 1, 2 ] 1096633 50.439% 52.062% ########## ( 2, 3 ] 535323 24.622% 76.684% ##### ( 3, 4 ] 221698 10.197% 86.880% ## ( 4, 6 ] 206335 9.490% 96.371% ## ( 6, 10 ] 56819 2.613% 98.984% # ( 10, 15 ] 10228 0.470% 99.454% ( 15, 22 ] 1180 0.054% 99.509% ( 22, 34 ] 102 0.005% 99.513% ( 34, 51 ] 173 0.008% 99.521% ( 51, 76 ] 166 0.008% 99.529% ( 76, 110 ] 983 0.045% 99.574% ( 110, 170 ] 3424 0.157% 99.732% ( 170, 250 ] 1556 0.072% 99.803% ( 250, 380 ] 1186 0.055% 99.858% ( 380, 580 ] 1653 0.076% 99.934% ( 580, 870 ] 2025 0.093% 100.027% ( 870, 1300 ] 1856 0.085% 100.112% ( 1300, 1900 ] 1139 0.052% 100.165% ( 1900, 2900 ] 1099 0.051% 100.215% ( 2900, 4400 ] 1052 0.048% 100.264% ( 4400, 6600 ] 274 0.013% 100.276% ( 6600, 9900 ] 67 0.003% 100.279% ( 9900, 14000 ] 7 0.000% 100.280% ( 14000, 22000 ] 14 0.001% 100.280% ( 22000, 33000 ] 8 0.000% 100.281% ( 33000, 50000 ] 3 0.000% 100.281% ** Level 4 read latency histogram (micros): Count: 1319226 Average: 23.5227 StdDev: 216.98 Min: 1 Median: 2.0014 Max: 44889 Percentiles: P50: 2.00 P75: 3.13 P99: 398.39 P99.9: 1554.75 P99.99: 2079.56 ------------------------------------------------------ [ 0, 1 ] 20410 1.547% 1.547% ( 1, 2 ] 638778 48.421% 49.968% ########## ( 2, 3 ] 313560 23.768% 73.736% ##### ( 3, 4 ] 130371 9.882% 83.619% ## ( 4, 6 ] 119169 9.033% 92.652% ## ( 6, 10 ] 35335 2.678% 95.330% # ( 10, 15 ] 5835 0.442% 95.773% ( 15, 22 ] 673 0.051% 95.824% ( 22, 34 ] 79 0.006% 95.830% ( 34, 51 ] 93 0.007% 95.837% ( 51, 76 ] 135 0.010% 95.847% ( 76, 110 ] 6414 0.486% 96.333% ( 110, 170 ] 21549 1.633% 97.967% ( 170, 250 ] 8484 0.643% 98.610% ( 250, 380 ] 4699 0.356% 98.966% ( 380, 580 ] 4891 0.371% 99.337% ( 580, 870 ] 3865 0.293% 99.630% ( 870, 1300 ] 2873 0.218% 99.847% ( 1300, 1900 ] 1634 0.124% 99.971% ( 1900, 2900 ] 1376 0.104% 100.076% ( 2900, 4400 ] 1169 0.089% 100.164% ( 4400, 6600 ] 296 0.022% 100.187% ( 6600, 9900 ] 50 0.004% 100.190% ( 9900, 14000 ] 7 0.001% 100.191% ( 14000, 22000 ] 12 0.001% 100.192% ( 22000, 33000 ] 4 0.000% 100.192% ( 33000, 50000 ] 6 0.000% 100.193% ** Level 5 read latency histogram (micros): Count: 269849 Average: 359.5449 StdDev: 651.35 Min: 73 Median: 163.1793 Max: 48966 Percentiles: P50: 163.18 P75: 316.51 P99: 3617.97 P99.9: 6317.51 P99.99: 9591.73 ------------------------------------------------------ ( 51, 76 ] 30 0.011% 0.011% ( 76, 110 ] 33876 12.554% 12.565% ### ( 110, 170 ] 113975 42.237% 54.801% ######## ( 170, 250 ] 43490 16.116% 70.918% ### ( 250, 380 ] 21530 7.979% 78.896% ## ( 380, 580 ] 21297 7.892% 86.789% ## ( 580, 870 ] 14665 5.435% 92.223% # ( 870, 1300 ] 8907 3.301% 95.524% # ( 1300, 1900 ] 4410 1.634% 97.158% ( 1900, 2900 ] 3469 1.286% 98.444% ( 2900, 4400 ] 3137 1.163% 99.606% ( 4400, 6600 ] 910 0.337% 99.943% ( 6600, 9900 ] 139 0.052% 99.995% ( 9900, 14000 ] 16 0.006% 100.001% ( 14000, 22000 ] 8 0.003% 100.004% ( 22000, 33000 ] 5 0.002% 100.006% ( 33000, 50000 ] 5 0.002% 100.007% ** DB Stats ** Uptime(secs): 36.7 total, 9.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 161.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.284 H:M:S, 39.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 99.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.274 H:M:S, 63.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 284.309 micros/op 14051 ops/sec 60.137 seconds 844996 operations; 13.6 MB/s (206999 of 206999 found) Microseconds per read: Count: 844996 Average: 284.3111 StdDev: 805.01 Min: 2 Median: 181.0564 Max: 97318 Percentiles: P50: 181.06 P75: 243.96 P99: 1957.13 P99.9: 12338.10 P99.99: 30526.88 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 26 0.003% 0.004% ( 3, 4 ] 33 0.004% 0.008% ( 4, 6 ] 100 0.012% 0.020% ( 6, 10 ] 392 0.046% 0.066% ( 10, 15 ] 2624 0.311% 0.376% ( 15, 22 ] 2250 0.266% 0.643% ( 22, 34 ] 8864 1.049% 1.692% ( 34, 51 ] 2011 0.238% 1.930% ( 51, 76 ] 231 0.027% 1.957% ( 76, 110 ] 18349 2.171% 4.129% ( 110, 170 ] 350482 41.477% 45.606% ######## ( 170, 250 ] 268659 31.794% 77.400% ###### ( 250, 380 ] 92518 10.949% 88.349% ## ( 380, 580 ] 46854 5.545% 93.894% # ( 580, 870 ] 25069 2.967% 96.861% # ( 870, 1300 ] 12534 1.483% 98.344% ( 1300, 1900 ] 5335 0.631% 98.975% ( 1900, 2900 ] 3659 0.433% 99.408% ( 2900, 4400 ] 2776 0.329% 99.737% ( 4400, 6600 ] 782 0.093% 99.829% ( 6600, 9900 ] 308 0.036% 99.866% ( 9900, 14000 ] 486 0.058% 99.923% ( 14000, 22000 ] 448 0.053% 99.976% ( 22000, 33000 ] 149 0.018% 99.994% ( 33000, 50000 ] 34 0.004% 99.998% ( 50000, 75000 ] 13 0.002% 100.000% ( 75000, 110000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12134335 rocksdb.bloom.filter.full.positive COUNT : 962749 rocksdb.bloom.filter.full.true.positive COUNT : 844556 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 440 rocksdb.memtable.miss COUNT : 844556 rocksdb.l0.hit COUNT : 30674 rocksdb.l1.hit COUNT : 7687 rocksdb.l2andup.hit COUNT : 806195 rocksdb.compaction.key.drop.new COUNT : 241411 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6339404 rocksdb.number.keys.read COUNT : 844996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6542264928 rocksdb.bytes.read COUNT : 844996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1760 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36265266 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29788580445 rocksdb.compact.write.bytes COUNT : 29536237880 rocksdb.flush.write.bytes COUNT : 6539723991 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 24 rocksdb.number.superversion_acquires COUNT : 1295 rocksdb.number.superversion_releases COUNT : 1254 rocksdb.number.superversion_cleanups COUNT : 320 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 381 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6486921216 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2459648 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33839221249 rocksdb.non.last.level.read.count COUNT : 8034739 rocksdb.block.checksum.compute.count COUNT : 8186695 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 179.339821 P95 : 686.610741 P99 : 1955.763870 P100 : 97316.000000 COUNT : 844996 SUM : 239439172 rocksdb.db.write.micros P50 : 1.569925 P95 : 4.250342 P99 : 8.022960 P100 : 976197.000000 COUNT : 6339404 SUM : 52179903 rocksdb.compaction.times.micros P50 : 1571212.121212 P95 : 3922000.000000 P99 : 6448666.666667 P100 : 24171506.000000 COUNT : 107 SUM : 201445783 rocksdb.compaction.times.cpu_micros P50 : 1008064.516129 P95 : 2562500.000000 P99 : 6346000.000000 P100 : 8868854.000000 COUNT : 107 SUM : 124949823 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1031.250000 P95 : 70833.333333 P99 : 214000.000000 P100 : 234127.000000 COUNT : 90 SUM : 1166109 rocksdb.compaction.outfile.sync.micros P50 : 12057.894737 P95 : 233111.111111 P99 : 508725.000000 P100 : 748794.000000 COUNT : 358 SUM : 18654524 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 229.047619 P95 : 3782.954545 P99 : 4385.681818 P100 : 9216.000000 COUNT : 221 SUM : 205762 rocksdb.table.open.io.micros P50 : 8115.094340 P95 : 19653.846154 P99 : 26308.333333 P100 : 68394.000000 COUNT : 1760 SUM : 14727993 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.957247 P95 : 9.776096 P99 : 165.516885 P100 : 45038.000000 COUNT : 7213362 SUM : 98121052 rocksdb.read.block.get.micros P50 : 144.499610 P95 : 560.604303 P99 : 1839.688975 P100 : 67810.000000 COUNT : 971568 SUM : 207689952 rocksdb.write.raw.block.micros P50 : 0.527730 P95 : 1.076991 P99 : 3.349496 P100 : 39751.000000 COUNT : 8737919 SUM : 25427121 rocksdb.numfiles.in.singlecompaction P50 : 3.068627 P95 : 6.200000 P99 : 13.250000 P100 : 21.000000 COUNT : 135 SUM : 501 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564023 P95 : 1232.396795 P99 : 2640.066875 P100 : 976033.000000 COUNT : 184581 SUM : 36277907 rocksdb.sst.read.micros P50 : 1.950809 P95 : 159.426047 P99 : 511.821940 P100 : 67762.000000 COUNT : 8034770 SUM : 286546188 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 844996 SUM : 844996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6339404 SUM : 6542264928 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 227142.857143 P95 : 831000.000000 P99 : 1227232.000000 P100 : 1227232.000000 COUNT : 90 SUM : 28466715 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 382 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0