[2024-12-13 09:25:36.391978] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-12-13 09:25:36.392141] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid344778 ] Set seed to 1734078336388356 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 09:25:36.517323] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 09:25:36.561792] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 09:25:36.561848] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 344778' to capture a snapshot of events at runtime. [2024-12-13 09:25:36.561861] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-13 09:25:36.561874] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-13 09:25:36.561885] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid344778 for offline analysis/debug. [2024-12-13 09:25:36.561988] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 09:25:38 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/13-09:25:45 ... thread 0: (1000000,1000000) ops and (132136.4,132136.4) ops/second in (7.567939,7.567939) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.42 GB 113.9 0.6 0.0 0.6 1.4 0.8 0.0 1.8 57.1 130.5 11.14 5.41 12 0.929 646K 767 0.0 0.0 L1 6/6 772.67 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 6/5 703.79 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 32/8 2.35 GB 1.8 3.0 2.0 1.0 3.0 2.0 0.0 1.5 100.7 100.1 30.99 17.24 15 2.066 1236K 1807 0.0 0.0 L4 176/9 11.25 GB 1.1 2.2 1.5 0.7 2.2 1.4 0.1 1.5 115.1 113.6 19.58 11.32 18 1.088 1157K 0 0.0 0.0 L5 1106/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1334/32 106.27 GB 0.0 5.9 3.5 2.4 6.6 4.2 0.1 8.3 97.4 109.9 61.72 33.98 45 1.371 3040K 2574 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 3.5 2.4 6.6 4.2 0.1 8.3 97.4 109.9 61.72 33.98 45 1.371 3040K 2574 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 3.5 2.4 5.8 3.4 0.0 0.0 109.3 108.4 55.02 31.46 35 1.572 3040K 2574 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 122.3 6.70 2.51 10 0.670 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.6 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.62 GB write, 875.78 MB/s write, 5.87 GB read, 776.36 MB/s read, 61.7 seconds Interval compaction: 6.62 GB write, 895.88 MB/s write, 5.87 GB read, 794.18 MB/s read, 61.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 172454 Average: 13.9525 StdDev: 282.52 Min: 1 Median: 1.9615 Max: 61122 Percentiles: P50: 1.96 P75: 2.97 P99: 14.50 P99.9: 2739.76 P99.99: 8568.48 ------------------------------------------------------ [ 0, 1 ] 5777 3.350% 3.350% # ( 1, 2 ] 83667 48.516% 51.865% ########## ( 2, 3 ] 41080 23.821% 75.686% ##### ( 3, 4 ] 17445 10.116% 85.802% ## ( 4, 6 ] 18310 10.617% 96.419% ## ( 6, 10 ] 3692 2.141% 98.560% ( 10, 15 ] 843 0.489% 99.049% ( 15, 22 ] 82 0.048% 99.097% ( 22, 34 ] 16 0.009% 99.106% ( 34, 51 ] 24 0.014% 99.120% ( 51, 76 ] 38 0.022% 99.142% ( 76, 110 ] 7 0.004% 99.146% ( 110, 170 ] 18 0.010% 99.156% ( 170, 250 ] 87 0.050% 99.207% ( 250, 380 ] 218 0.126% 99.333% ( 380, 580 ] 359 0.208% 99.541% ( 580, 870 ] 326 0.189% 99.730% ( 870, 1300 ] 170 0.099% 99.829% ( 1300, 1900 ] 74 0.043% 99.872% ( 1900, 2900 ] 59 0.034% 99.906% ( 2900, 4400 ] 119 0.069% 99.975% ( 4400, 6600 ] 19 0.011% 99.986% ( 6600, 9900 ] 13 0.008% 99.994% ( 9900, 14000 ] 2 0.001% 99.995% ( 14000, 22000 ] 8 0.005% 99.999% ( 22000, 33000 ] 3 0.002% 100.001% ( 33000, 50000 ] 1 0.001% 100.002% ( 50000, 75000 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 171252 Average: 15.8619 StdDev: 340.86 Min: 1 Median: 2.2578 Max: 53813 Percentiles: P50: 2.26 P75: 3.39 P99: 13.23 P99.9: 3572.99 P99.99: 18199.89 ------------------------------------------------------ [ 0, 1 ] 1763 1.029% 1.029% ( 1, 2 ] 71845 41.953% 42.982% ######## ( 2, 3 ] 46624 27.225% 70.208% ##### ( 3, 4 ] 21160 12.356% 82.564% ## ( 4, 6 ] 21745 12.698% 95.261% ### ( 6, 10 ] 5562 3.248% 98.509% # ( 10, 15 ] 1304 0.761% 99.271% ( 15, 22 ] 222 0.130% 99.400% ( 22, 34 ] 33 0.019% 99.420% ( 34, 51 ] 26 0.015% 99.435% ( 51, 76 ] 34 0.020% 99.455% ( 76, 110 ] 16 0.009% 99.464% ( 110, 170 ] 20 0.012% 99.476% ( 170, 250 ] 30 0.018% 99.493% ( 250, 380 ] 80 0.047% 99.540% ( 380, 580 ] 139 0.081% 99.621% ( 580, 870 ] 126 0.074% 99.695% ( 870, 1300 ] 109 0.064% 99.758% ( 1300, 1900 ] 62 0.036% 99.794% ( 1900, 2900 ] 114 0.067% 99.861% ( 2900, 4400 ] 151 0.088% 99.949% ( 4400, 6600 ] 42 0.025% 99.974% ( 6600, 9900 ] 15 0.009% 99.982% ( 9900, 14000 ] 6 0.004% 99.986% ( 14000, 22000 ] 15 0.009% 99.995% ( 22000, 33000 ] 7 0.004% 99.999% ( 33000, 50000 ] 2 0.001% 100.000% ( 50000, 75000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 456499 Average: 15.4981 StdDev: 330.38 Min: 1 Median: 2.2681 Max: 42088 Percentiles: P50: 2.27 P75: 3.42 P99: 12.58 P99.9: 1669.09 P99.99: 3280.89 ------------------------------------------------------ [ 0, 1 ] 5221 1.144% 1.144% ( 1, 2 ] 189892 41.597% 42.741% ######## ( 2, 3 ] 123595 27.075% 69.816% ##### ( 3, 4 ] 56770 12.436% 82.252% ## ( 4, 6 ] 59244 12.978% 95.230% ### ( 6, 10 ] 15255 3.342% 98.571% # ( 10, 15 ] 3801 0.833% 99.404% ( 15, 22 ] 607 0.133% 99.537% ( 22, 34 ] 126 0.028% 99.565% ( 34, 51 ] 101 0.022% 99.587% ( 51, 76 ] 93 0.020% 99.607% ( 76, 110 ] 31 0.007% 99.614% ( 110, 170 ] 65 0.014% 99.628% ( 170, 250 ] 67 0.015% 99.643% ( 250, 380 ] 161 0.035% 99.678% ( 380, 580 ] 296 0.065% 99.743% ( 580, 870 ] 356 0.078% 99.821% ( 870, 1300 ] 261 0.057% 99.878% ( 1300, 1900 ] 165 0.036% 99.914% ( 1900, 2900 ] 260 0.057% 99.971% ( 2900, 4400 ] 344 0.075% 100.046% ( 4400, 6600 ] 129 0.028% 100.075% ( 6600, 9900 ] 52 0.011% 100.086% ( 9900, 14000 ] 27 0.006% 100.092% ( 14000, 22000 ] 37 0.008% 100.100% ( 22000, 33000 ] 21 0.005% 100.105% ( 33000, 50000 ] 5 0.001% 100.106% ** Level 3 read latency histogram (micros): Count: 688912 Average: 11.1394 StdDev: 259.99 Min: 1 Median: 2.2031 Max: 63981 Percentiles: P50: 2.20 P75: 3.24 P99: 9.96 P99.9: 586.17 P99.99: 953.54 ------------------------------------------------------ [ 0, 1 ] 7001 1.016% 1.016% ( 1, 2 ] 298403 43.315% 44.331% ######### ( 2, 3 ] 192238 27.905% 72.236% ###### ( 3, 4 ] 80197 11.641% 83.877% ## ( 4, 6 ] 86921 12.617% 96.494% ### ( 6, 10 ] 17446 2.532% 99.027% # ( 10, 15 ] 3692 0.536% 99.562% ( 15, 22 ] 538 0.078% 99.641% ( 22, 34 ] 145 0.021% 99.662% ( 34, 51 ] 186 0.027% 99.689% ( 51, 76 ] 182 0.026% 99.715% ( 76, 110 ] 60 0.009% 99.724% ( 110, 170 ] 72 0.010% 99.734% ( 170, 250 ] 186 0.027% 99.761% ( 250, 380 ] 353 0.051% 99.812% ( 380, 580 ] 591 0.086% 99.898% ( 580, 870 ] 568 0.082% 99.981% ( 870, 1300 ] 330 0.048% 100.029% ( 1300, 1900 ] 182 0.026% 100.055% ( 1900, 2900 ] 254 0.037% 100.092% ( 2900, 4400 ] 368 0.053% 100.145% ( 4400, 6600 ] 94 0.014% 100.159% ( 6600, 9900 ] 51 0.007% 100.166% ( 9900, 14000 ] 16 0.002% 100.169% ( 14000, 22000 ] 23 0.003% 100.172% ( 22000, 33000 ] 14 0.002% 100.174% ( 33000, 50000 ] 5 0.001% 100.175% ( 50000, 75000 ] 2 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 244551 Average: 29.8777 StdDev: 467.94 Min: 1 Median: 2.1566 Max: 67800 Percentiles: P50: 2.16 P75: 3.25 P99: 572.90 P99.9: 3537.49 P99.99: 4771.41 ------------------------------------------------------ [ 0, 1 ] 3410 1.394% 1.394% ( 1, 2 ] 108816 44.496% 45.891% ######### ( 2, 3 ] 64198 26.251% 72.142% ##### ( 3, 4 ] 27665 11.313% 83.455% ## ( 4, 6 ] 27385 11.198% 94.653% ## ( 6, 10 ] 6948 2.841% 97.494% # ( 10, 15 ] 1215 0.497% 97.991% ( 15, 22 ] 174 0.071% 98.062% ( 22, 34 ] 33 0.013% 98.075% ( 34, 51 ] 70 0.029% 98.104% ( 51, 76 ] 60 0.025% 98.128% ( 76, 110 ] 17 0.007% 98.135% ( 110, 170 ] 80 0.033% 98.168% ( 170, 250 ] 277 0.113% 98.281% ( 250, 380 ] 657 0.269% 98.550% ( 380, 580 ] 1142 0.467% 99.017% ( 580, 870 ] 993 0.406% 99.423% ( 870, 1300 ] 555 0.227% 99.650% ( 1300, 1900 ] 237 0.097% 99.747% ( 1900, 2900 ] 225 0.092% 99.839% ( 2900, 4400 ] 354 0.145% 99.984% ( 4400, 6600 ] 98 0.040% 100.024% ( 6600, 9900 ] 33 0.013% 100.037% ( 9900, 14000 ] 16 0.007% 100.044% ( 14000, 22000 ] 30 0.012% 100.056% ( 22000, 33000 ] 16 0.007% 100.063% ( 33000, 50000 ] 8 0.003% 100.066% ( 50000, 75000 ] 2 0.001% 100.067% ** Level 5 read latency histogram (micros): Count: 17913 Average: 1162.0986 StdDev: 2544.97 Min: 86 Median: 600.4095 Max: 75616 Percentiles: P50: 600.41 P75: 1100.78 P99: 6593.71 P99.9: 44779.94 P99.99: 73351.46 ------------------------------------------------------ ( 76, 110 ] 35 0.195% 0.195% ( 110, 170 ] 245 1.368% 1.563% ( 170, 250 ] 1008 5.627% 7.190% # ( 250, 380 ] 2871 16.027% 23.218% ### ( 380, 580 ] 4544 25.367% 48.585% ##### ( 580, 870 ] 3602 20.108% 68.693% #### ( 870, 1300 ] 2105 11.751% 80.444% ## ( 1300, 1900 ] 993 5.543% 85.988% # ( 1900, 2900 ] 857 4.784% 90.772% # ( 2900, 4400 ] 1080 6.029% 96.801% # ( 4400, 6600 ] 395 2.205% 99.006% ( 6600, 9900 ] 95 0.530% 99.537% ( 9900, 14000 ] 12 0.067% 99.604% ( 14000, 22000 ] 20 0.112% 99.715% ( 22000, 33000 ] 22 0.123% 99.838% ( 33000, 50000 ] 16 0.089% 99.927% ( 50000, 75000 ] 12 0.067% 99.994% ( 75000, 110000 ] 1 0.006% 100.000% ** DB Stats ** Uptime(secs): 7.7 total, 7.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.148 H:M:S, 27.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.148 H:M:S, 28.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/13-09:25:53 ... thread 0: (1000000,2000000) ops and (132035.2,132085.7) ops/second in (7.573740,15.141679) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.40 GB 56.7 1.2 0.0 1.2 3.0 1.8 0.0 1.7 56.3 137.4 22.50 11.58 27 0.833 1285K 1528 0.0 0.0 L2 0/0 0.00 KB 0.0 0.8 0.8 0.1 0.8 0.8 0.0 1.1 98.0 97.6 8.50 4.57 1 8.500 784K 0 0.0 0.0 L3 14/2 1015.31 MB 0.9 3.8 2.6 1.1 3.7 2.6 0.8 1.4 100.8 100.2 38.17 21.26 17 2.245 1894K 1938 0.0 0.0 L4 184/17 10.91 GB 1.0 8.1 4.2 4.0 8.0 4.0 0.3 1.9 112.8 110.7 73.68 46.04 53 1.390 4134K 19K 0.0 0.0 L5 1142/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/30 107.13 GB 0.0 13.9 7.5 6.4 15.5 9.2 4.1 8.7 99.8 111.3 142.84 83.46 98 1.458 8098K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 7.5 6.4 15.5 9.2 4.1 8.7 99.8 111.3 142.84 83.46 98 1.458 8098K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 7.5 6.4 13.7 7.4 0.0 0.0 111.0 109.6 128.43 77.57 75 1.712 8098K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 126.7 14.41 5.88 23 0.627 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.53 GB write, 1038.28 MB/s write, 13.92 GB read, 930.56 MB/s read, 142.8 seconds Interval compaction: 15.53 GB write, 1050.20 MB/s write, 13.92 GB read, 941.23 MB/s read, 142.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 37, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 370729 Average: 30.0288 StdDev: 427.68 Min: 1 Median: 1.9691 Max: 61122 Percentiles: P50: 1.97 P75: 3.02 P99: 638.26 P99.9: 3750.13 P99.99: 13450.14 ------------------------------------------------------ [ 0, 1 ] 12533 3.381% 3.381% # ( 1, 2 ] 178346 48.107% 51.487% ########## ( 2, 3 ] 86276 23.272% 74.759% ##### ( 3, 4 ] 36105 9.739% 84.498% ## ( 4, 6 ] 37459 10.104% 94.603% ## ( 6, 10 ] 7185 1.938% 96.541% ( 10, 15 ] 1750 0.472% 97.013% ( 15, 22 ] 186 0.050% 97.063% ( 22, 34 ] 36 0.010% 97.073% ( 34, 51 ] 53 0.014% 97.087% ( 51, 76 ] 69 0.019% 97.105% ( 76, 110 ] 42 0.011% 97.117% ( 110, 170 ] 460 0.124% 97.241% ( 170, 250 ] 1385 0.374% 97.614% ( 250, 380 ] 1945 0.525% 98.139% ( 380, 580 ] 2769 0.747% 98.886% ( 580, 870 ] 2104 0.568% 99.454% ( 870, 1300 ] 788 0.213% 99.666% ( 1300, 1900 ] 278 0.075% 99.741% ( 1900, 2900 ] 345 0.093% 99.834% ( 2900, 4400 ] 431 0.116% 99.950% ( 4400, 6600 ] 106 0.029% 99.979% ( 6600, 9900 ] 34 0.009% 99.988% ( 9900, 14000 ] 8 0.002% 99.990% ( 14000, 22000 ] 30 0.008% 99.998% ( 22000, 33000 ] 30 0.008% 100.006% ( 33000, 50000 ] 9 0.002% 100.009% ( 50000, 75000 ] 1 0.000% 100.009% ** Level 1 read latency histogram (micros): Count: 196422 Average: 15.4684 StdDev: 340.73 Min: 1 Median: 2.2674 Max: 53813 Percentiles: P50: 2.27 P75: 3.39 P99: 13.04 P99.9: 3558.04 P99.99: 18178.90 ------------------------------------------------------ [ 0, 1 ] 1860 0.947% 0.947% ( 1, 2 ] 81849 41.670% 42.617% ######## ( 2, 3 ] 54240 27.614% 70.231% ###### ( 3, 4 ] 24155 12.298% 82.528% ## ( 4, 6 ] 25007 12.731% 95.260% ### ( 6, 10 ] 6414 3.265% 98.525% # ( 10, 15 ] 1533 0.780% 99.306% ( 15, 22 ] 252 0.128% 99.434% ( 22, 34 ] 34 0.017% 99.451% ( 34, 51 ] 30 0.015% 99.466% ( 51, 76 ] 35 0.018% 99.484% ( 76, 110 ] 16 0.008% 99.492% ( 110, 170 ] 20 0.010% 99.503% ( 170, 250 ] 35 0.018% 99.520% ( 250, 380 ] 93 0.047% 99.568% ( 380, 580 ] 150 0.076% 99.644% ( 580, 870 ] 135 0.069% 99.713% ( 870, 1300 ] 111 0.057% 99.769% ( 1300, 1900 ] 65 0.033% 99.802% ( 1900, 2900 ] 117 0.060% 99.862% ( 2900, 4400 ] 170 0.087% 99.949% ( 4400, 6600 ] 48 0.024% 99.973% ( 6600, 9900 ] 19 0.010% 99.983% ( 9900, 14000 ] 6 0.003% 99.986% ( 14000, 22000 ] 16 0.008% 99.994% ( 22000, 33000 ] 8 0.004% 99.998% ( 33000, 50000 ] 3 0.002% 99.999% ( 50000, 75000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 624276 Average: 14.9604 StdDev: 336.80 Min: 1 Median: 2.2577 Max: 42088 Percentiles: P50: 2.26 P75: 3.39 P99: 12.46 P99.9: 1656.27 P99.99: 3546.56 ------------------------------------------------------ [ 0, 1 ] 6991 1.120% 1.120% ( 1, 2 ] 261107 41.826% 42.945% ######## ( 2, 3 ] 170867 27.370% 70.316% ##### ( 3, 4 ] 75419 12.081% 82.397% ## ( 4, 6 ] 80402 12.879% 95.276% ### ( 6, 10 ] 20837 3.338% 98.614% # ( 10, 15 ] 4897 0.784% 99.398% ( 15, 22 ] 773 0.124% 99.522% ( 22, 34 ] 143 0.023% 99.545% ( 34, 51 ] 149 0.024% 99.569% ( 51, 76 ] 148 0.024% 99.593% ( 76, 110 ] 42 0.007% 99.599% ( 110, 170 ] 73 0.012% 99.611% ( 170, 250 ] 101 0.016% 99.627% ( 250, 380 ] 240 0.038% 99.666% ( 380, 580 ] 465 0.074% 99.740% ( 580, 870 ] 526 0.084% 99.824% ( 870, 1300 ] 350 0.056% 99.881% ( 1300, 1900 ] 205 0.033% 99.913% ( 1900, 2900 ] 304 0.049% 99.962% ( 2900, 4400 ] 405 0.065% 100.027% ( 4400, 6600 ] 147 0.024% 100.050% ( 6600, 9900 ] 64 0.010% 100.061% ( 9900, 14000 ] 37 0.006% 100.067% ( 14000, 22000 ] 53 0.008% 100.075% ( 22000, 33000 ] 34 0.005% 100.081% ( 33000, 50000 ] 8 0.001% 100.082% ** Level 3 read latency histogram (micros): Count: 1198225 Average: 12.3293 StdDev: 327.69 Min: 1 Median: 2.2017 Max: 86897 Percentiles: P50: 2.20 P75: 3.24 P99: 10.14 P99.9: 611.76 P99.99: 986.25 ------------------------------------------------------ [ 0, 1 ] 13344 1.114% 1.114% ( 1, 2 ] 518346 43.259% 44.373% ######### ( 2, 3 ] 334334 27.902% 72.276% ###### ( 3, 4 ] 136311 11.376% 83.652% ## ( 4, 6 ] 150982 12.600% 96.252% ### ( 6, 10 ] 32745 2.733% 98.985% # ( 10, 15 ] 6712 0.560% 99.545% ( 15, 22 ] 978 0.082% 99.627% ( 22, 34 ] 188 0.016% 99.642% ( 34, 51 ] 345 0.029% 99.671% ( 51, 76 ] 336 0.028% 99.699% ( 76, 110 ] 91 0.008% 99.707% ( 110, 170 ] 105 0.009% 99.716% ( 170, 250 ] 308 0.026% 99.741% ( 250, 380 ] 653 0.054% 99.796% ( 380, 580 ] 1135 0.095% 99.891% ( 580, 870 ] 1048 0.087% 99.978% ( 870, 1300 ] 537 0.045% 100.023% ( 1300, 1900 ] 259 0.022% 100.044% ( 1900, 2900 ] 396 0.033% 100.077% ( 2900, 4400 ] 538 0.045% 100.122% ( 4400, 6600 ] 151 0.013% 100.135% ( 6600, 9900 ] 85 0.007% 100.142% ( 9900, 14000 ] 46 0.004% 100.146% ( 14000, 22000 ] 79 0.007% 100.152% ( 22000, 33000 ] 58 0.005% 100.157% ( 33000, 50000 ] 12 0.001% 100.158% ( 50000, 75000 ] 4 0.000% 100.159% ( 75000, 110000 ] 1 0.000% 100.159% ** Level 4 read latency histogram (micros): Count: 1275116 Average: 18.7175 StdDev: 396.60 Min: 0 Median: 2.1687 Max: 67800 Percentiles: P50: 2.17 P75: 3.22 P99: 15.14 P99.9: 927.99 P99.99: 1436.94 ------------------------------------------------------ [ 0, 1 ] 15285 1.199% 1.199% ( 1, 2 ] 563711 44.209% 45.407% ######### ( 2, 3 ] 347187 27.228% 72.635% ##### ( 3, 4 ] 139788 10.963% 83.598% ## ( 4, 6 ] 149787 11.747% 95.345% ## ( 6, 10 ] 38718 3.036% 98.381% # ( 10, 15 ] 7867 0.617% 98.998% ( 15, 22 ] 1176 0.092% 99.091% ( 22, 34 ] 162 0.013% 99.103% ( 34, 51 ] 363 0.028% 99.132% ( 51, 76 ] 343 0.027% 99.159% ( 76, 110 ] 95 0.007% 99.166% ( 110, 170 ] 295 0.023% 99.189% ( 170, 250 ] 1035 0.081% 99.270% ( 250, 380 ] 2082 0.163% 99.434% ( 380, 580 ] 3200 0.251% 99.685% ( 580, 870 ] 2587 0.203% 99.887% ( 870, 1300 ] 1193 0.094% 99.981% ( 1300, 1900 ] 506 0.040% 100.021% ( 1900, 2900 ] 664 0.052% 100.073% ( 2900, 4400 ] 966 0.076% 100.149% ( 4400, 6600 ] 262 0.021% 100.169% ( 6600, 9900 ] 103 0.008% 100.177% ( 9900, 14000 ] 49 0.004% 100.181% ( 14000, 22000 ] 134 0.011% 100.192% ( 22000, 33000 ] 82 0.006% 100.198% ( 33000, 50000 ] 28 0.002% 100.200% ( 50000, 75000 ] 5 0.000% 100.201% ** Level 5 read latency histogram (micros): Count: 42394 Average: 1017.3827 StdDev: 2407.34 Min: 86 Median: 536.7016 Max: 75616 Percentiles: P50: 536.70 P75: 859.98 P99: 6468.61 P99.9: 39960.51 P99.99: 69938.44 ------------------------------------------------------ ( 76, 110 ] 100 0.236% 0.236% ( 110, 170 ] 1331 3.140% 3.375% # ( 170, 250 ] 3897 9.192% 12.568% ## ( 250, 380 ] 7194 16.969% 29.537% ### ( 380, 580 ] 11072 26.117% 55.654% ##### ( 580, 870 ] 8495 20.038% 75.692% #### ( 870, 1300 ] 4085 9.636% 85.328% ## ( 1300, 1900 ] 1607 3.791% 89.119% # ( 1900, 2900 ] 1556 3.670% 92.789% # ( 2900, 4400 ] 2020 4.765% 97.554% # ( 4400, 6600 ] 652 1.538% 99.092% ( 6600, 9900 ] 141 0.333% 99.424% ( 9900, 14000 ] 28 0.066% 99.490% ( 14000, 22000 ] 80 0.189% 99.679% ( 22000, 33000 ] 76 0.179% 99.858% ( 33000, 50000 ] 43 0.101% 99.960% ( 50000, 75000 ] 16 0.038% 99.998% ( 75000, 110000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 15.3 total, 7.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 128.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.526 H:M:S, 29.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.378 H:M:S, 31.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/13-09:25:57 ... thread 0: (1000000,3000000) ops and (257912.7,157737.3) ops/second in (3.877281,19.018960) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.39 GB 157.4 2.2 0.0 2.2 5.0 2.8 0.0 1.8 76.4 171.4 29.79 18.38 47 0.634 2309K 2495 0.0 0.0 L2 0/0 0.00 KB 0.0 0.8 0.8 0.1 0.8 0.8 0.0 1.1 98.0 97.6 8.50 4.57 1 8.500 784K 0 0.0 0.0 L3 12/0 890.36 MB 0.9 3.8 2.6 1.1 3.7 2.6 0.8 1.4 100.8 100.2 38.17 21.26 17 2.245 1894K 1938 0.0 0.0 L4 167/0 9.56 GB 1.0 9.6 4.3 5.3 9.3 4.0 0.3 2.2 116.7 113.5 84.11 52.88 55 1.529 4261K 19K 0.0 0.0 L5 1164/0 94.18 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1362/11 108.00 GB 0.0 16.4 7.7 8.7 18.9 10.1 5.4 6.8 104.5 120.2 160.56 97.09 120 1.338 9249K 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.4 7.7 8.7 18.9 10.1 5.4 6.8 104.5 120.2 160.56 97.09 120 1.338 9249K 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.4 7.7 8.7 16.1 7.4 0.0 0.0 117.3 115.2 142.94 88.37 81 1.765 9249K 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 160.9 17.62 8.72 39 0.452 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.2 total, 19.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.85 GB write, 1005.73 MB/s write, 16.38 GB read, 873.81 MB/s read, 160.6 seconds Interval compaction: 18.85 GB write, 1014.92 MB/s write, 16.38 GB read, 881.79 MB/s read, 160.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 37, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 669032 Average: 24.7485 StdDev: 320.95 Min: 0 Median: 1.7503 Max: 61122 Percentiles: P50: 1.75 P75: 2.71 P99: 440.09 P99.9: 2263.81 P99.99: 4216.73 ------------------------------------------------------ [ 0, 1 ] 74323 11.109% 11.109% ## ( 1, 2 ] 346772 51.832% 62.941% ########## ( 2, 3 ] 114193 17.068% 80.009% ### ( 3, 4 ] 45065 6.736% 86.745% # ( 4, 6 ] 42439 6.343% 93.089% # ( 6, 10 ] 8334 1.246% 94.334% ( 10, 15 ] 2088 0.312% 94.646% ( 15, 22 ] 235 0.035% 94.681% ( 22, 34 ] 49 0.007% 94.689% ( 34, 51 ] 59 0.009% 94.698% ( 51, 76 ] 73 0.011% 94.708% ( 76, 110 ] 1147 0.171% 94.880% ( 110, 170 ] 10669 1.595% 96.475% ( 170, 250 ] 11504 1.719% 98.194% ( 250, 380 ] 4290 0.641% 98.835% ( 380, 580 ] 3667 0.548% 99.383% ( 580, 870 ] 2245 0.336% 99.719% ( 870, 1300 ] 797 0.119% 99.838% ( 1300, 1900 ] 287 0.043% 99.881% ( 1900, 2900 ] 349 0.052% 99.933% ( 2900, 4400 ] 433 0.065% 99.998% ( 4400, 6600 ] 106 0.016% 100.014% ( 6600, 9900 ] 34 0.005% 100.019% ( 9900, 14000 ] 8 0.001% 100.020% ( 14000, 22000 ] 30 0.004% 100.025% ( 22000, 33000 ] 30 0.004% 100.029% ( 33000, 50000 ] 9 0.001% 100.030% ( 50000, 75000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 196422 Average: 15.4684 StdDev: 340.73 Min: 1 Median: 2.2674 Max: 53813 Percentiles: P50: 2.27 P75: 3.39 P99: 13.04 P99.9: 3558.04 P99.99: 18178.90 ------------------------------------------------------ [ 0, 1 ] 1860 0.947% 0.947% ( 1, 2 ] 81849 41.670% 42.617% ######## ( 2, 3 ] 54240 27.614% 70.231% ###### ( 3, 4 ] 24155 12.298% 82.528% ## ( 4, 6 ] 25007 12.731% 95.260% ### ( 6, 10 ] 6414 3.265% 98.525% # ( 10, 15 ] 1533 0.780% 99.306% ( 15, 22 ] 252 0.128% 99.434% ( 22, 34 ] 34 0.017% 99.451% ( 34, 51 ] 30 0.015% 99.466% ( 51, 76 ] 35 0.018% 99.484% ( 76, 110 ] 16 0.008% 99.492% ( 110, 170 ] 20 0.010% 99.503% ( 170, 250 ] 35 0.018% 99.520% ( 250, 380 ] 93 0.047% 99.568% ( 380, 580 ] 150 0.076% 99.644% ( 580, 870 ] 135 0.069% 99.713% ( 870, 1300 ] 111 0.057% 99.769% ( 1300, 1900 ] 65 0.033% 99.802% ( 1900, 2900 ] 117 0.060% 99.862% ( 2900, 4400 ] 170 0.087% 99.949% ( 4400, 6600 ] 48 0.024% 99.973% ( 6600, 9900 ] 19 0.010% 99.983% ( 9900, 14000 ] 6 0.003% 99.986% ( 14000, 22000 ] 16 0.008% 99.994% ( 22000, 33000 ] 8 0.004% 99.998% ( 33000, 50000 ] 3 0.002% 99.999% ( 50000, 75000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 624466 Average: 15.0156 StdDev: 336.77 Min: 1 Median: 2.2583 Max: 42088 Percentiles: P50: 2.26 P75: 3.39 P99: 12.65 P99.9: 1655.71 P99.99: 3546.49 ------------------------------------------------------ [ 0, 1 ] 6991 1.120% 1.120% ( 1, 2 ] 261107 41.813% 42.932% ######## ( 2, 3 ] 170867 27.362% 70.294% ##### ( 3, 4 ] 75419 12.077% 82.372% ## ( 4, 6 ] 80402 12.875% 95.247% ### ( 6, 10 ] 20837 3.337% 98.584% # ( 10, 15 ] 4897 0.784% 99.368% ( 15, 22 ] 773 0.124% 99.492% ( 22, 34 ] 143 0.023% 99.515% ( 34, 51 ] 149 0.024% 99.539% ( 51, 76 ] 148 0.024% 99.562% ( 76, 110 ] 50 0.008% 99.570% ( 110, 170 ] 156 0.025% 99.595% ( 170, 250 ] 172 0.028% 99.623% ( 250, 380 ] 260 0.042% 99.665% ( 380, 580 ] 472 0.076% 99.740% ( 580, 870 ] 526 0.084% 99.824% ( 870, 1300 ] 351 0.056% 99.881% ( 1300, 1900 ] 205 0.033% 99.913% ( 1900, 2900 ] 304 0.049% 99.962% ( 2900, 4400 ] 405 0.065% 100.027% ( 4400, 6600 ] 147 0.024% 100.050% ( 6600, 9900 ] 64 0.010% 100.061% ( 9900, 14000 ] 37 0.006% 100.067% ( 14000, 22000 ] 53 0.008% 100.075% ( 22000, 33000 ] 34 0.005% 100.081% ( 33000, 50000 ] 8 0.001% 100.082% ** Level 3 read latency histogram (micros): Count: 1208655 Average: 12.3388 StdDev: 326.31 Min: 1 Median: 2.1962 Max: 86897 Percentiles: P50: 2.20 P75: 3.23 P99: 10.51 P99.9: 609.84 P99.99: 984.40 ------------------------------------------------------ [ 0, 1 ] 14050 1.162% 1.162% ( 1, 2 ] 524311 43.380% 44.542% ######### ( 2, 3 ] 336257 27.821% 72.363% ###### ( 3, 4 ] 136898 11.326% 83.689% ## ( 4, 6 ] 151412 12.527% 96.217% ### ( 6, 10 ] 32949 2.726% 98.943% # ( 10, 15 ] 6725 0.556% 99.499% ( 15, 22 ] 983 0.081% 99.581% ( 22, 34 ] 189 0.016% 99.596% ( 34, 51 ] 345 0.029% 99.625% ( 51, 76 ] 336 0.028% 99.653% ( 76, 110 ] 124 0.010% 99.663% ( 110, 170 ] 358 0.030% 99.692% ( 170, 250 ] 545 0.045% 99.737% ( 250, 380 ] 698 0.058% 99.795% ( 380, 580 ] 1158 0.096% 99.891% ( 580, 870 ] 1053 0.087% 99.978% ( 870, 1300 ] 538 0.045% 100.023% ( 1300, 1900 ] 259 0.021% 100.044% ( 1900, 2900 ] 396 0.033% 100.077% ( 2900, 4400 ] 538 0.045% 100.121% ( 4400, 6600 ] 151 0.012% 100.134% ( 6600, 9900 ] 85 0.007% 100.141% ( 9900, 14000 ] 46 0.004% 100.145% ( 14000, 22000 ] 79 0.007% 100.151% ( 22000, 33000 ] 58 0.005% 100.156% ( 33000, 50000 ] 12 0.001% 100.157% ( 50000, 75000 ] 4 0.000% 100.157% ( 75000, 110000 ] 1 0.000% 100.157% ** Level 4 read latency histogram (micros): Count: 1392499 Average: 18.4106 StdDev: 379.84 Min: 0 Median: 2.1185 Max: 67800 Percentiles: P50: 2.12 P75: 3.16 P99: 181.31 P99.9: 878.05 P99.99: 1387.11 ------------------------------------------------------ [ 0, 1 ] 20941 1.504% 1.504% ( 1, 2 ] 631560 45.354% 46.858% ######### ( 2, 3 ] 369121 26.508% 73.366% ##### ( 3, 4 ] 146711 10.536% 83.902% ## ( 4, 6 ] 154666 11.107% 95.009% ## ( 6, 10 ] 41063 2.949% 97.958% # ( 10, 15 ] 8098 0.582% 98.539% ( 15, 22 ] 1212 0.087% 98.626% ( 22, 34 ] 168 0.012% 98.638% ( 34, 51 ] 367 0.026% 98.665% ( 51, 76 ] 343 0.025% 98.689% ( 76, 110 ] 434 0.031% 98.721% ( 110, 170 ] 3296 0.237% 98.957% ( 170, 250 ] 4200 0.302% 99.259% ( 250, 380 ] 2816 0.202% 99.461% ( 380, 580 ] 3454 0.248% 99.709% ( 580, 870 ] 2634 0.189% 99.898% ( 870, 1300 ] 1202 0.086% 99.985% ( 1300, 1900 ] 508 0.036% 100.021% ( 1900, 2900 ] 665 0.048% 100.069% ( 2900, 4400 ] 967 0.069% 100.138% ( 4400, 6600 ] 262 0.019% 100.157% ( 6600, 9900 ] 103 0.007% 100.165% ( 9900, 14000 ] 49 0.004% 100.168% ( 14000, 22000 ] 134 0.010% 100.178% ( 22000, 33000 ] 82 0.006% 100.184% ( 33000, 50000 ] 28 0.002% 100.186% ( 50000, 75000 ] 5 0.000% 100.186% ** Level 5 read latency histogram (micros): Count: 91852 Average: 574.9620 StdDev: 1687.27 Min: 84 Median: 242.5238 Max: 75616 Percentiles: P50: 242.52 P75: 520.74 P99: 4739.04 P99.9: 25784.58 P99.99: 45973.29 ------------------------------------------------------ ( 76, 110 ] 2236 2.434% 2.434% ( 110, 170 ] 21563 23.476% 25.910% ##### ( 170, 250 ] 24408 26.573% 52.483% ##### ( 250, 380 ] 11646 12.679% 65.162% ### ( 380, 580 ] 12841 13.980% 79.143% ### ( 580, 870 ] 8809 9.590% 88.733% ## ( 870, 1300 ] 4130 4.496% 93.229% # ( 1300, 1900 ] 1621 1.765% 94.994% ( 1900, 2900 ] 1558 1.696% 96.690% ( 2900, 4400 ] 2021 2.200% 98.891% ( 4400, 6600 ] 652 0.710% 99.600% ( 6600, 9900 ] 141 0.154% 99.754% ( 9900, 14000 ] 28 0.030% 99.784% ( 14000, 22000 ] 80 0.087% 99.872% ( 22000, 33000 ] 76 0.083% 99.954% ( 33000, 50000 ] 43 0.047% 100.001% ( 50000, 75000 ] 16 0.017% 100.019% ( 75000, 110000 ] 1 0.001% 100.020% ** DB Stats ** Uptime(secs): 19.2 total, 3.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 153.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.612 H:M:S, 24.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.086 H:M:S, 2.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-09:26:06 ... thread 0: (1000000,4000000) ops and (104749.6,140028.9) ops/second in (9.546575,28.565535) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 4.36 GB 257.0 4.7 0.0 4.7 8.5 3.7 0.0 2.3 113.9 203.7 42.63 30.84 68 0.627 4930K 14K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.8 0.8 0.1 0.8 0.8 0.0 1.1 98.0 97.6 8.50 4.57 1 8.500 784K 0 0.0 0.0 L3 12/0 890.36 MB 0.9 3.8 2.6 1.1 3.7 2.6 0.8 1.4 100.8 100.2 38.17 21.26 17 2.245 1894K 1938 0.0 0.0 L4 167/0 9.56 GB 1.0 9.6 4.3 5.3 9.3 4.0 0.3 2.2 116.7 113.5 84.11 52.88 55 1.529 4261K 19K 0.0 0.0 L5 1164/0 94.18 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1360/11 108.97 GB 0.0 18.9 7.7 11.2 22.3 11.1 5.4 6.0 111.6 132.0 173.41 109.55 141 1.230 11M 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.9 7.7 11.2 22.3 11.1 5.4 6.0 111.6 132.0 173.41 109.55 141 1.230 11M 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.9 7.7 11.2 18.6 7.4 0.0 0.0 126.8 124.7 152.66 97.99 86 1.775 11M 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 185.2 20.75 11.57 55 0.377 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.7 total, 28.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.35 GB write, 796.15 MB/s write, 18.90 GB read, 673.38 MB/s read, 173.4 seconds Interval compaction: 22.35 GB write, 801.00 MB/s write, 18.90 GB read, 677.48 MB/s read, 173.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 37, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1383110 Average: 21.5242 StdDev: 226.76 Min: 0 Median: 1.5906 Max: 61122 Percentiles: P50: 1.59 P75: 2.29 P99: 277.98 P99.9: 865.91 P99.99: 2245.81 ------------------------------------------------------ [ 0, 1 ] 261066 18.875% 18.875% #### ( 1, 2 ] 728877 52.698% 71.574% ########### ( 2, 3 ] 162023 11.714% 83.288% ## ( 3, 4 ] 60689 4.388% 87.676% # ( 4, 6 ] 51297 3.709% 91.385% # ( 6, 10 ] 10449 0.755% 92.140% ( 10, 15 ] 2529 0.183% 92.323% ( 15, 22 ] 312 0.023% 92.346% ( 22, 34 ] 80 0.006% 92.351% ( 34, 51 ] 66 0.005% 92.356% ( 51, 76 ] 78 0.006% 92.362% ( 76, 110 ] 6282 0.454% 92.816% ( 110, 170 ] 49236 3.560% 96.376% # ( 170, 250 ] 34761 2.513% 98.889% # ( 250, 380 ] 7136 0.516% 99.405% ( 380, 580 ] 4531 0.328% 99.733% ( 580, 870 ] 2350 0.170% 99.903% ( 870, 1300 ] 801 0.058% 99.960% ( 1300, 1900 ] 290 0.021% 99.981% ( 1900, 2900 ] 349 0.025% 100.007% ( 2900, 4400 ] 434 0.031% 100.038% ( 4400, 6600 ] 107 0.008% 100.046% ( 6600, 9900 ] 34 0.002% 100.048% ( 9900, 14000 ] 9 0.001% 100.049% ( 14000, 22000 ] 30 0.002% 100.051% ( 22000, 33000 ] 30 0.002% 100.053% ( 33000, 50000 ] 9 0.001% 100.054% ( 50000, 75000 ] 1 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 196422 Average: 15.4684 StdDev: 340.73 Min: 1 Median: 2.2674 Max: 53813 Percentiles: P50: 2.27 P75: 3.39 P99: 13.04 P99.9: 3558.04 P99.99: 18178.90 ------------------------------------------------------ [ 0, 1 ] 1860 0.947% 0.947% ( 1, 2 ] 81849 41.670% 42.617% ######## ( 2, 3 ] 54240 27.614% 70.231% ###### ( 3, 4 ] 24155 12.298% 82.528% ## ( 4, 6 ] 25007 12.731% 95.260% ### ( 6, 10 ] 6414 3.265% 98.525% # ( 10, 15 ] 1533 0.780% 99.306% ( 15, 22 ] 252 0.128% 99.434% ( 22, 34 ] 34 0.017% 99.451% ( 34, 51 ] 30 0.015% 99.466% ( 51, 76 ] 35 0.018% 99.484% ( 76, 110 ] 16 0.008% 99.492% ( 110, 170 ] 20 0.010% 99.503% ( 170, 250 ] 35 0.018% 99.520% ( 250, 380 ] 93 0.047% 99.568% ( 380, 580 ] 150 0.076% 99.644% ( 580, 870 ] 135 0.069% 99.713% ( 870, 1300 ] 111 0.057% 99.769% ( 1300, 1900 ] 65 0.033% 99.802% ( 1900, 2900 ] 117 0.060% 99.862% ( 2900, 4400 ] 170 0.087% 99.949% ( 4400, 6600 ] 48 0.024% 99.973% ( 6600, 9900 ] 19 0.010% 99.983% ( 9900, 14000 ] 6 0.003% 99.986% ( 14000, 22000 ] 16 0.008% 99.994% ( 22000, 33000 ] 8 0.004% 99.998% ( 33000, 50000 ] 3 0.002% 99.999% ( 50000, 75000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 625069 Average: 15.1638 StdDev: 336.64 Min: 1 Median: 2.2601 Max: 42088 Percentiles: P50: 2.26 P75: 3.40 P99: 13.26 P99.9: 1653.94 P99.99: 3546.27 ------------------------------------------------------ [ 0, 1 ] 6991 1.118% 1.118% ( 1, 2 ] 261107 41.773% 42.891% ######## ( 2, 3 ] 170867 27.336% 70.227% ##### ( 3, 4 ] 75419 12.066% 82.292% ## ( 4, 6 ] 80402 12.863% 95.155% ### ( 6, 10 ] 20837 3.334% 98.489% # ( 10, 15 ] 4897 0.783% 99.272% ( 15, 22 ] 773 0.124% 99.396% ( 22, 34 ] 143 0.023% 99.419% ( 34, 51 ] 149 0.024% 99.443% ( 51, 76 ] 148 0.024% 99.466% ( 76, 110 ] 92 0.015% 99.481% ( 110, 170 ] 485 0.078% 99.559% ( 170, 250 ] 374 0.060% 99.618% ( 250, 380 ] 280 0.045% 99.663% ( 380, 580 ] 482 0.077% 99.740% ( 580, 870 ] 526 0.084% 99.824% ( 870, 1300 ] 351 0.056% 99.881% ( 1300, 1900 ] 205 0.033% 99.913% ( 1900, 2900 ] 304 0.049% 99.962% ( 2900, 4400 ] 405 0.065% 100.027% ( 4400, 6600 ] 147 0.024% 100.050% ( 6600, 9900 ] 64 0.010% 100.061% ( 9900, 14000 ] 37 0.006% 100.067% ( 14000, 22000 ] 53 0.008% 100.075% ( 22000, 33000 ] 34 0.005% 100.080% ( 33000, 50000 ] 8 0.001% 100.082% ** Level 3 read latency histogram (micros): Count: 1210175 Average: 12.5366 StdDev: 326.16 Min: 1 Median: 2.1984 Max: 86897 Percentiles: P50: 2.20 P75: 3.24 P99: 11.63 P99.9: 610.16 P99.99: 984.28 ------------------------------------------------------ [ 0, 1 ] 14050 1.161% 1.161% ( 1, 2 ] 524311 43.325% 44.486% ######### ( 2, 3 ] 336257 27.786% 72.272% ###### ( 3, 4 ] 136898 11.312% 83.584% ## ( 4, 6 ] 151412 12.512% 96.096% ### ( 6, 10 ] 32949 2.723% 98.819% # ( 10, 15 ] 6725 0.556% 99.374% ( 15, 22 ] 983 0.081% 99.455% ( 22, 34 ] 189 0.016% 99.471% ( 34, 51 ] 345 0.029% 99.500% ( 51, 76 ] 336 0.028% 99.527% ( 76, 110 ] 224 0.019% 99.546% ( 110, 170 ] 1164 0.096% 99.642% ( 170, 250 ] 1094 0.090% 99.732% ( 250, 380 ] 745 0.062% 99.794% ( 380, 580 ] 1173 0.097% 99.891% ( 580, 870 ] 1056 0.087% 99.978% ( 870, 1300 ] 538 0.044% 100.023% ( 1300, 1900 ] 259 0.021% 100.044% ( 1900, 2900 ] 396 0.033% 100.077% ( 2900, 4400 ] 538 0.044% 100.121% ( 4400, 6600 ] 151 0.012% 100.134% ( 6600, 9900 ] 85 0.007% 100.141% ( 9900, 14000 ] 46 0.004% 100.145% ( 14000, 22000 ] 79 0.007% 100.151% ( 22000, 33000 ] 58 0.005% 100.156% ( 33000, 50000 ] 12 0.001% 100.157% ( 50000, 75000 ] 4 0.000% 100.157% ( 75000, 110000 ] 1 0.000% 100.157% ** Level 4 read latency histogram (micros): Count: 1415429 Average: 20.6762 StdDev: 377.27 Min: 0 Median: 2.1489 Max: 67800 Percentiles: P50: 2.15 P75: 3.27 P99: 231.40 P99.9: 870.20 P99.99: 1384.40 ------------------------------------------------------ [ 0, 1 ] 20941 1.479% 1.479% ( 1, 2 ] 631750 44.633% 46.113% ######### ( 2, 3 ] 369628 26.114% 72.227% ##### ( 3, 4 ] 147097 10.392% 82.619% ## ( 4, 6 ] 155301 10.972% 93.591% ## ( 6, 10 ] 41116 2.905% 96.496% # ( 10, 15 ] 8117 0.573% 97.070% ( 15, 22 ] 1214 0.086% 97.155% ( 22, 34 ] 168 0.012% 97.167% ( 34, 51 ] 367 0.026% 97.193% ( 51, 76 ] 343 0.024% 97.217% ( 76, 110 ] 1818 0.128% 97.346% ( 110, 170 ] 14664 1.036% 98.382% ( 170, 250 ] 11402 0.806% 99.187% ( 250, 380 ] 3674 0.260% 99.447% ( 380, 580 ] 3743 0.264% 99.711% ( 580, 870 ] 2670 0.189% 99.900% ( 870, 1300 ] 1203 0.085% 99.985% ( 1300, 1900 ] 508 0.036% 100.021% ( 1900, 2900 ] 665 0.047% 100.068% ( 2900, 4400 ] 967 0.068% 100.136% ( 4400, 6600 ] 262 0.019% 100.155% ( 6600, 9900 ] 103 0.007% 100.162% ( 9900, 14000 ] 49 0.003% 100.165% ( 14000, 22000 ] 134 0.009% 100.175% ( 22000, 33000 ] 82 0.006% 100.181% ( 33000, 50000 ] 28 0.002% 100.183% ( 50000, 75000 ] 5 0.000% 100.183% ** Level 5 read latency histogram (micros): Count: 227090 Average: 334.2730 StdDev: 1092.17 Min: 83 Median: 179.2858 Max: 75616 Percentiles: P50: 179.29 P75: 243.38 P99: 3452.67 P99.9: 9242.57 P99.99: 31884.22 ------------------------------------------------------ ( 76, 110 ] 11136 4.904% 4.904% # ( 110, 170 ] 94184 41.474% 46.378% ######## ( 170, 250 ] 70861 31.204% 77.582% ###### ( 250, 380 ] 17011 7.491% 85.073% # ( 380, 580 ] 14552 6.408% 91.481% # ( 580, 870 ] 9019 3.972% 95.452% # ( 870, 1300 ] 4130 1.819% 97.271% ( 1300, 1900 ] 1622 0.714% 97.985% ( 1900, 2900 ] 1558 0.686% 98.671% ( 2900, 4400 ] 2025 0.892% 99.563% ( 4400, 6600 ] 652 0.287% 99.850% ( 6600, 9900 ] 141 0.062% 99.912% ( 9900, 14000 ] 28 0.012% 99.925% ( 14000, 22000 ] 80 0.035% 99.960% ( 22000, 33000 ] 76 0.033% 99.993% ( 33000, 50000 ] 43 0.019% 100.012% ( 50000, 75000 ] 16 0.007% 100.019% ( 75000, 110000 ] 1 0.000% 100.020% ** DB Stats ** Uptime(secs): 28.7 total, 9.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 136.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.129 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.516 H:M:S, 57.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-09:26:13 ... thread 0: (1000000,5000000) ops and (156472.0,143035.1) ops/second in (6.390919,34.956454) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 5.34 GB 250.7 6.0 0.0 6.0 10.7 4.7 0.0 2.3 121.2 217.0 50.47 38.30 89 0.567 6210K 15K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.8 0.8 0.1 0.8 0.8 0.0 1.1 98.0 97.6 8.50 4.57 1 8.500 784K 0 0.0 0.0 L3 12/0 890.36 MB 0.9 3.8 2.6 1.1 3.7 2.6 0.8 1.4 100.8 100.2 38.17 21.26 17 2.245 1894K 1938 0.0 0.0 L4 167/0 9.56 GB 1.0 9.6 4.3 5.3 9.3 4.0 0.3 2.2 116.7 113.5 84.11 52.88 55 1.529 4261K 19K 0.0 0.0 L5 1164/0 94.18 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1361/13 109.95 GB 0.0 20.1 7.7 12.5 24.6 12.1 5.4 5.2 113.7 138.8 181.24 117.01 162 1.119 13M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 7.7 12.5 24.6 12.1 5.4 5.2 113.7 138.8 181.24 117.01 162 1.119 13M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 7.7 12.5 19.8 7.4 0.0 0.0 130.9 128.9 157.43 102.68 91 1.730 13M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 203.7 23.81 14.33 71 0.335 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.1 total, 35.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.56 GB write, 715.85 MB/s write, 20.13 GB read, 586.75 MB/s read, 181.2 seconds Interval compaction: 24.56 GB write, 719.40 MB/s write, 20.13 GB read, 589.67 MB/s read, 181.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 37, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1887718 Average: 20.5840 StdDev: 196.15 Min: 0 Median: 1.5565 Max: 61122 Percentiles: P50: 1.56 P75: 2.12 P99: 249.07 P99.9: 766.35 P99.99: 1308.57 ------------------------------------------------------ [ 0, 1 ] 382105 20.242% 20.242% #### ( 1, 2 ] 1009410 53.472% 73.714% ########### ( 2, 3 ] 198891 10.536% 84.250% ## ( 3, 4 ] 71983 3.813% 88.063% # ( 4, 6 ] 57718 3.058% 91.121% # ( 6, 10 ] 12123 0.642% 91.763% ( 10, 15 ] 2952 0.156% 91.920% ( 15, 22 ] 355 0.019% 91.938% ( 22, 34 ] 97 0.005% 91.944% ( 34, 51 ] 67 0.004% 91.947% ( 51, 76 ] 83 0.004% 91.951% ( 76, 110 ] 9129 0.484% 92.435% ( 110, 170 ] 72861 3.860% 96.295% # ( 170, 250 ] 51670 2.737% 99.032% # ( 250, 380 ] 9555 0.506% 99.538% ( 380, 580 ] 5247 0.278% 99.816% ( 580, 870 ] 2467 0.131% 99.947% ( 870, 1300 ] 813 0.043% 99.990% ( 1300, 1900 ] 296 0.016% 100.006% ( 1900, 2900 ] 349 0.018% 100.024% ( 2900, 4400 ] 435 0.023% 100.047% ( 4400, 6600 ] 108 0.006% 100.053% ( 6600, 9900 ] 34 0.002% 100.055% ( 9900, 14000 ] 9 0.000% 100.055% ( 14000, 22000 ] 30 0.002% 100.057% ( 22000, 33000 ] 30 0.002% 100.058% ( 33000, 50000 ] 9 0.000% 100.059% ( 50000, 75000 ] 1 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 196422 Average: 15.4684 StdDev: 340.73 Min: 1 Median: 2.2674 Max: 53813 Percentiles: P50: 2.27 P75: 3.39 P99: 13.04 P99.9: 3558.04 P99.99: 18178.90 ------------------------------------------------------ [ 0, 1 ] 1860 0.947% 0.947% ( 1, 2 ] 81849 41.670% 42.617% ######## ( 2, 3 ] 54240 27.614% 70.231% ###### ( 3, 4 ] 24155 12.298% 82.528% ## ( 4, 6 ] 25007 12.731% 95.260% ### ( 6, 10 ] 6414 3.265% 98.525% # ( 10, 15 ] 1533 0.780% 99.306% ( 15, 22 ] 252 0.128% 99.434% ( 22, 34 ] 34 0.017% 99.451% ( 34, 51 ] 30 0.015% 99.466% ( 51, 76 ] 35 0.018% 99.484% ( 76, 110 ] 16 0.008% 99.492% ( 110, 170 ] 20 0.010% 99.503% ( 170, 250 ] 35 0.018% 99.520% ( 250, 380 ] 93 0.047% 99.568% ( 380, 580 ] 150 0.076% 99.644% ( 580, 870 ] 135 0.069% 99.713% ( 870, 1300 ] 111 0.057% 99.769% ( 1300, 1900 ] 65 0.033% 99.802% ( 1900, 2900 ] 117 0.060% 99.862% ( 2900, 4400 ] 170 0.087% 99.949% ( 4400, 6600 ] 48 0.024% 99.973% ( 6600, 9900 ] 19 0.010% 99.983% ( 9900, 14000 ] 6 0.003% 99.986% ( 14000, 22000 ] 16 0.008% 99.994% ( 22000, 33000 ] 8 0.004% 99.998% ( 33000, 50000 ] 3 0.002% 99.999% ( 50000, 75000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 625469 Average: 15.2654 StdDev: 336.56 Min: 1 Median: 2.2612 Max: 42088 Percentiles: P50: 2.26 P75: 3.40 P99: 13.67 P99.9: 1652.77 P99.99: 3546.12 ------------------------------------------------------ [ 0, 1 ] 6991 1.118% 1.118% ( 1, 2 ] 261107 41.746% 42.864% ######## ( 2, 3 ] 170867 27.318% 70.182% ##### ( 3, 4 ] 75419 12.058% 82.240% ## ( 4, 6 ] 80402 12.855% 95.094% ### ( 6, 10 ] 20837 3.331% 98.426% # ( 10, 15 ] 4897 0.783% 99.209% ( 15, 22 ] 773 0.124% 99.332% ( 22, 34 ] 143 0.023% 99.355% ( 34, 51 ] 149 0.024% 99.379% ( 51, 76 ] 148 0.024% 99.403% ( 76, 110 ] 110 0.018% 99.420% ( 110, 170 ] 694 0.111% 99.531% ( 170, 250 ] 522 0.083% 99.615% ( 250, 380 ] 299 0.048% 99.662% ( 380, 580 ] 488 0.078% 99.741% ( 580, 870 ] 526 0.084% 99.825% ( 870, 1300 ] 351 0.056% 99.881% ( 1300, 1900 ] 205 0.033% 99.914% ( 1900, 2900 ] 304 0.049% 99.962% ( 2900, 4400 ] 405 0.065% 100.027% ( 4400, 6600 ] 147 0.024% 100.050% ( 6600, 9900 ] 64 0.010% 100.061% ( 9900, 14000 ] 37 0.006% 100.067% ( 14000, 22000 ] 53 0.008% 100.075% ( 22000, 33000 ] 34 0.005% 100.080% ( 33000, 50000 ] 8 0.001% 100.082% ** Level 3 read latency histogram (micros): Count: 1211189 Average: 12.6738 StdDev: 326.06 Min: 1 Median: 2.1999 Max: 86897 Percentiles: P50: 2.20 P75: 3.25 P99: 12.38 P99.9: 610.37 P99.99: 984.20 ------------------------------------------------------ [ 0, 1 ] 14050 1.160% 1.160% ( 1, 2 ] 524311 43.289% 44.449% ######### ( 2, 3 ] 336257 27.763% 72.212% ###### ( 3, 4 ] 136898 11.303% 83.514% ## ( 4, 6 ] 151412 12.501% 96.015% ### ( 6, 10 ] 32949 2.720% 98.736% # ( 10, 15 ] 6725 0.555% 99.291% ( 15, 22 ] 983 0.081% 99.372% ( 22, 34 ] 189 0.016% 99.388% ( 34, 51 ] 345 0.028% 99.416% ( 51, 76 ] 336 0.028% 99.444% ( 76, 110 ] 273 0.023% 99.467% ( 110, 170 ] 1654 0.137% 99.603% ( 170, 250 ] 1500 0.124% 99.727% ( 250, 380 ] 794 0.066% 99.793% ( 380, 580 ] 1191 0.098% 99.891% ( 580, 870 ] 1058 0.087% 99.978% ( 870, 1300 ] 538 0.044% 100.023% ( 1300, 1900 ] 259 0.021% 100.044% ( 1900, 2900 ] 396 0.033% 100.077% ( 2900, 4400 ] 538 0.044% 100.121% ( 4400, 6600 ] 151 0.012% 100.134% ( 6600, 9900 ] 85 0.007% 100.141% ( 9900, 14000 ] 46 0.004% 100.144% ( 14000, 22000 ] 79 0.007% 100.151% ( 22000, 33000 ] 58 0.005% 100.156% ( 33000, 50000 ] 12 0.001% 100.157% ( 50000, 75000 ] 4 0.000% 100.157% ( 75000, 110000 ] 1 0.000% 100.157% ** Level 4 read latency histogram (micros): Count: 1430359 Average: 22.2720 StdDev: 375.69 Min: 0 Median: 2.1690 Max: 67800 Percentiles: P50: 2.17 P75: 3.34 P99: 241.48 P99.9: 869.00 P99.99: 1383.65 ------------------------------------------------------ [ 0, 1 ] 20941 1.464% 1.464% ( 1, 2 ] 631773 44.169% 45.633% ######### ( 2, 3 ] 369686 25.846% 71.479% ##### ( 3, 4 ] 147139 10.287% 81.765% ## ( 4, 6 ] 155377 10.863% 92.628% ## ( 6, 10 ] 41120 2.875% 95.503% # ( 10, 15 ] 8122 0.568% 96.071% ( 15, 22 ] 1214 0.085% 96.156% ( 22, 34 ] 168 0.012% 96.167% ( 34, 51 ] 367 0.026% 96.193% ( 51, 76 ] 343 0.024% 96.217% ( 76, 110 ] 2681 0.187% 96.405% ( 110, 170 ] 22164 1.550% 97.954% ( 170, 250 ] 16744 1.171% 99.125% ( 250, 380 ] 4432 0.310% 99.435% ( 380, 580 ] 3960 0.277% 99.711% ( 580, 870 ] 2707 0.189% 99.901% ( 870, 1300 ] 1207 0.084% 99.985% ( 1300, 1900 ] 509 0.036% 100.021% ( 1900, 2900 ] 665 0.046% 100.067% ( 2900, 4400 ] 968 0.068% 100.135% ( 4400, 6600 ] 262 0.018% 100.153% ( 6600, 9900 ] 103 0.007% 100.160% ( 9900, 14000 ] 49 0.003% 100.164% ( 14000, 22000 ] 134 0.009% 100.173% ( 22000, 33000 ] 82 0.006% 100.179% ( 33000, 50000 ] 28 0.002% 100.181% ( 50000, 75000 ] 5 0.000% 100.181% ** Level 5 read latency histogram (micros): Count: 313717 Average: 290.4366 StdDev: 932.56 Min: 83 Median: 172.0306 Max: 75616 Percentiles: P50: 172.03 P75: 233.08 P99: 2814.53 P99.9: 6864.07 P99.99: 28459.36 ------------------------------------------------------ ( 76, 110 ] 16503 5.260% 5.260% # ( 110, 170 ] 137747 43.908% 49.169% ######### ( 170, 250 ] 102767 32.758% 81.926% ####### ( 250, 380 ] 21144 6.740% 88.666% # ( 380, 580 ] 16011 5.104% 93.770% # ( 580, 870 ] 9207 2.935% 96.705% # ( 870, 1300 ] 4151 1.323% 98.028% ( 1300, 1900 ] 1625 0.518% 98.546% ( 1900, 2900 ] 1558 0.497% 99.042% ( 2900, 4400 ] 2026 0.646% 99.688% ( 4400, 6600 ] 653 0.208% 99.896% ( 6600, 9900 ] 141 0.045% 99.941% ( 9900, 14000 ] 28 0.009% 99.950% ( 14000, 22000 ] 80 0.026% 99.976% ( 22000, 33000 ] 76 0.024% 100.000% ( 33000, 50000 ] 43 0.014% 100.014% ( 50000, 75000 ] 16 0.005% 100.019% ( 75000, 110000 ] 1 0.000% 100.019% ** DB Stats ** Uptime(secs): 35.1 total, 6.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 140.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.741 H:M:S, 36.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 154.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.612 H:M:S, 40.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 275.805 micros/op 14489 ops/sec 60.181 seconds 871996 operations; 14.0 MB/s (215999 of 215999 found) Microseconds per read: Count: 871996 Average: 275.8084 StdDev: 1026.44 Min: 2 Median: 206.6124 Max: 247086 Percentiles: P50: 206.61 P75: 245.10 P99: 1181.74 P99.9: 11338.12 P99.99: 41452.87 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 42 0.005% 0.006% ( 3, 4 ] 52 0.006% 0.012% ( 4, 6 ] 75 0.009% 0.020% ( 6, 10 ] 408 0.047% 0.067% ( 10, 15 ] 3599 0.413% 0.480% ( 15, 22 ] 2944 0.338% 0.817% ( 22, 34 ] 7650 0.877% 1.695% ( 34, 51 ] 2752 0.316% 2.010% ( 51, 76 ] 515 0.059% 2.069% ( 76, 110 ] 5843 0.670% 2.739% ( 110, 170 ] 204747 23.480% 26.220% ##### ( 170, 250 ] 453101 51.961% 78.181% ########## ( 250, 380 ] 105768 12.129% 90.310% ## ( 380, 580 ] 55712 6.389% 96.699% # ( 580, 870 ] 16173 1.855% 98.554% ( 870, 1300 ] 5363 0.615% 99.169% ( 1300, 1900 ] 1744 0.200% 99.369% ( 1900, 2900 ] 1383 0.159% 99.528% ( 2900, 4400 ] 1816 0.208% 99.736% ( 4400, 6600 ] 845 0.097% 99.833% ( 6600, 9900 ] 491 0.056% 99.889% ( 9900, 14000 ] 268 0.031% 99.920% ( 14000, 22000 ] 379 0.043% 99.963% ( 22000, 33000 ] 196 0.022% 99.986% ( 33000, 50000 ] 72 0.008% 99.994% ( 50000, 75000 ] 31 0.004% 99.998% ( 75000, 110000 ] 15 0.002% 99.999% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15299774 rocksdb.bloom.filter.full.positive COUNT : 1020388 rocksdb.bloom.filter.full.true.positive COUNT : 871546 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 450 rocksdb.memtable.miss COUNT : 871546 rocksdb.l0.hit COUNT : 43479 rocksdb.l1.hit COUNT : 146 rocksdb.l2andup.hit COUNT : 827921 rocksdb.compaction.key.drop.new COUNT : 334674 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5473324 rocksdb.number.keys.read COUNT : 871996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5648470368 rocksdb.bytes.read COUNT : 871996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1663 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35440859 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24533215423 rocksdb.compact.write.bytes COUNT : 24184910347 rocksdb.flush.write.bytes COUNT : 5615063273 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 1124 rocksdb.number.superversion_releases COUNT : 1086 rocksdb.number.superversion_cleanups COUNT : 275 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 143 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5569606656 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2002944 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28358403156 rocksdb.non.last.level.read.count COUNT : 6708914 rocksdb.block.checksum.compute.count COUNT : 6972882 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 206.077401 P95 : 525.718748 P99 : 1180.599063 P100 : 247084.000000 COUNT : 871996 SUM : 239724736 rocksdb.db.write.micros P50 : 1.625011 P95 : 5.416681 P99 : 11.490006 P100 : 689061.000000 COUNT : 5473324 SUM : 52355024 rocksdb.compaction.times.micros P50 : 1260869.565217 P95 : 4872000.000000 P99 : 6698000.000000 P100 : 8499918.000000 COUNT : 94 SUM : 164457417 rocksdb.compaction.times.cpu_micros P50 : 912307.692308 P95 : 3506666.666667 P99 : 5810666.666667 P100 : 5843271.000000 COUNT : 94 SUM : 109579577 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 775.000000 P95 : 5527.500000 P99 : 10761.000000 P100 : 11614.000000 COUNT : 79 SUM : 116041 rocksdb.compaction.outfile.sync.micros P50 : 3196.296296 P95 : 9582.692308 P99 : 30433.333333 P100 : 93704.000000 COUNT : 270 SUM : 1174072 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 232.500000 P95 : 3632.692308 P99 : 5184.666667 P100 : 5824.000000 COUNT : 193 SUM : 123422 rocksdb.table.open.io.micros P50 : 5287.311178 P95 : 19713.888889 P99 : 44458.000000 P100 : 145942.000000 COUNT : 1663 SUM : 12349226 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.127708 P95 : 14.206319 P99 : 223.170677 P100 : 86904.000000 COUNT : 5940939 SUM : 114392398 rocksdb.read.block.get.micros P50 : 157.086955 P95 : 356.557138 P99 : 1025.023003 P100 : 83596.000000 COUNT : 1030300 SUM : 205795535 rocksdb.write.raw.block.micros P50 : 0.538377 P95 : 1.444687 P99 : 4.123333 P100 : 118427.000000 COUNT : 7217969 SUM : 28456214 rocksdb.numfiles.in.singlecompaction P50 : 2.769231 P95 : 5.822222 P99 : 9.072000 P100 : 10.000000 COUNT : 116 SUM : 382 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.572308 P95 : 1238.374587 P99 : 2633.552691 P100 : 688872.000000 COUNT : 178947 SUM : 35458227 rocksdb.sst.read.micros P50 : 2.106022 P95 : 194.976463 P99 : 376.643280 P100 : 86897.000000 COUNT : 6708994 SUM : 295753132 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 871996 SUM : 871996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5473324 SUM : 5648470368 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 227454.545455 P95 : 949250.000000 P99 : 1305064.000000 P100 : 1305064.000000 COUNT : 79 SUM : 25504190 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 305 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0