[2024-07-22 12:10:37.263201] Starting SPDK v24.09-pre git sha1 8fb860b73 / DPDK 23.11.0 initialization... [2024-07-22 12:10:37.263324] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759951 ] Set seed to 1721643037260686 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-22 12:10:37.361778] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-22 12:10:37.402990] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-22 12:10:37.403041] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 759951' to capture a snapshot of events at runtime. [2024-07-22 12:10:37.403051] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-22 12:10:37.403065] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-22 12:10:37.403073] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid759951 for offline analysis/debug. [2024-07-22 12:10:37.403158] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 22 12:10:41 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/22-12:10:48 ... thread 0: (1000000,1000000) ops and (136656.1,136656.1) ops/second in (7.317637,7.317637) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 692.89 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 131.0 6.73 2.43 10 0.673 0 0 0.0 0.0 L1 1/1 81.44 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 1.4 132.2 132.1 3.20 1.88 2 1.598 428K 351 0.0 0.0 L2 5/3 352.72 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 174.9 174.9 1.28 0.99 1 1.280 227K 0 0.0 0.0 L3 42/25 3.81 GB 1.3 2.9 1.9 1.0 2.9 1.8 0.2 1.5 105.1 103.9 28.41 13.78 17 1.671 1778K 588 0.0 0.0 L4 196/14 12.36 GB 1.2 3.1 2.7 0.5 3.1 2.7 0.1 1.2 116.3 115.9 27.58 14.59 24 1.149 1805K 596 0.0 0.0 L5 1076/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1328/48 105.79 GB 0.0 6.7 5.1 1.6 7.5 5.9 0.3 8.7 101.8 114.2 67.19 33.68 54 1.244 4240K 1535 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 5.1 1.6 7.5 5.9 0.3 8.7 101.8 114.2 67.19 33.68 54 1.244 4240K 1535 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 5.1 1.6 6.6 5.0 0.0 0.0 113.1 112.3 60.46 31.24 44 1.374 4240K 1535 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 131.0 6.73 2.43 10 0.673 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.5 total, 7.3 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.49 GB write, 1025.19 MB/s write, 6.68 GB read, 913.78 MB/s read, 67.2 seconds Interval compaction: 7.49 GB write, 1048.38 MB/s write, 6.68 GB read, 934.45 MB/s read, 67.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 27, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 108045 Average: 12.4594 StdDev: 150.21 Min: 1 Median: 1.9064 Max: 6256 Percentiles: P50: 1.91 P75: 2.90 P99: 10.79 P99.9: 2714.73 P99.99: 5201.77 ------------------------------------------------------ [ 0, 1 ] 3524 3.262% 3.262% # ( 1, 2 ] 55716 51.567% 54.829% ########## ( 2, 3 ] 24145 22.347% 77.176% #### ( 3, 4 ] 10646 9.853% 87.029% ## ( 4, 6 ] 10728 9.929% 96.959% ## ( 6, 10 ] 2144 1.984% 98.943% ( 10, 15 ] 388 0.359% 99.302% ( 15, 22 ] 48 0.044% 99.347% ( 22, 34 ] 8 0.007% 99.354% ( 34, 51 ] 3 0.003% 99.357% ( 51, 76 ] 3 0.003% 99.360% ( 76, 110 ] 9 0.008% 99.368% ( 110, 170 ] 1 0.001% 99.369% ( 170, 250 ] 24 0.022% 99.391% ( 250, 380 ] 37 0.034% 99.425% ( 380, 580 ] 68 0.063% 99.488% ( 580, 870 ] 100 0.093% 99.581% ( 870, 1300 ] 150 0.139% 99.720% ( 1300, 1900 ] 121 0.112% 99.832% ( 1900, 2900 ] 92 0.085% 99.917% ( 2900, 4400 ] 74 0.068% 99.985% ( 4400, 6600 ] 17 0.016% 100.001% ** Level 1 read latency histogram (micros): Count: 107229 Average: 4.5424 StdDev: 69.06 Min: 1 Median: 1.9105 Max: 7566 Percentiles: P50: 1.91 P75: 2.90 P99: 8.56 P99.9: 262.53 P99.99: 4076.96 ------------------------------------------------------ [ 0, 1 ] 2454 2.289% 2.289% ( 1, 2 ] 56188 52.400% 54.689% ########## ( 2, 3 ] 24128 22.501% 77.190% ##### ( 3, 4 ] 11353 10.588% 87.778% ## ( 4, 6 ] 11031 10.287% 98.065% ## ( 6, 10 ] 1565 1.459% 99.524% ( 10, 15 ] 351 0.327% 99.852% ( 15, 22 ] 40 0.037% 99.889% ( 34, 51 ] 1 0.001% 99.890% ( 51, 76 ] 1 0.001% 99.891% ( 76, 110 ] 1 0.001% 99.892% ( 110, 170 ] 2 0.002% 99.894% ( 170, 250 ] 6 0.006% 99.899% ( 250, 380 ] 8 0.007% 99.907% ( 380, 580 ] 12 0.011% 99.918% ( 580, 870 ] 21 0.020% 99.938% ( 870, 1300 ] 20 0.019% 99.956% ( 1300, 1900 ] 20 0.019% 99.975% ( 1900, 2900 ] 10 0.009% 99.984% ( 2900, 4400 ] 8 0.007% 99.992% ( 4400, 6600 ] 8 0.007% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 363996 Average: 16.5397 StdDev: 193.39 Min: 1 Median: 2.0289 Max: 10357 Percentiles: P50: 2.03 P75: 3.15 P99: 13.39 P99.9: 1958.42 P99.99: 2723.83 ------------------------------------------------------ [ 0, 1 ] 8232 2.262% 2.262% ( 1, 2 ] 171231 47.042% 49.304% ######### ( 2, 3 ] 87707 24.096% 73.399% ##### ( 3, 4 ] 40026 10.996% 84.395% ## ( 4, 6 ] 40974 11.257% 95.652% ## ( 6, 10 ] 10606 2.914% 98.566% # ( 10, 15 ] 2332 0.641% 99.207% ( 15, 22 ] 357 0.098% 99.305% ( 22, 34 ] 50 0.014% 99.318% ( 34, 51 ] 29 0.008% 99.326% ( 51, 76 ] 20 0.005% 99.332% ( 76, 110 ] 16 0.004% 99.336% ( 110, 170 ] 31 0.009% 99.345% ( 170, 250 ] 56 0.015% 99.360% ( 250, 380 ] 150 0.041% 99.401% ( 380, 580 ] 312 0.086% 99.487% ( 580, 870 ] 482 0.132% 99.620% ( 870, 1300 ] 561 0.154% 99.774% ( 1300, 1900 ] 435 0.120% 99.893% ( 1900, 2900 ] 428 0.118% 100.011% ( 2900, 4400 ] 363 0.100% 100.110% ( 4400, 6600 ] 116 0.032% 100.142% ( 6600, 9900 ] 19 0.005% 100.148% ( 9900, 14000 ] 2 0.001% 100.148% ** Level 3 read latency histogram (micros): Count: 1040648 Average: 12.5233 StdDev: 161.15 Min: 1 Median: 1.9871 Max: 10285 Percentiles: P50: 1.99 P75: 3.00 P99: 9.69 P99.9: 918.19 P99.99: 1293.17 ------------------------------------------------------ [ 0, 1 ] 15390 1.479% 1.479% ( 1, 2 ] 511555 49.157% 50.636% ########## ( 2, 3 ] 254727 24.478% 75.114% ##### ( 3, 4 ] 115606 11.109% 86.223% ## ( 4, 6 ] 111224 10.688% 96.911% ## ( 6, 10 ] 23597 2.268% 99.178% ( 10, 15 ] 4745 0.456% 99.634% ( 15, 22 ] 560 0.054% 99.688% ( 22, 34 ] 56 0.005% 99.694% ( 34, 51 ] 63 0.006% 99.700% ( 51, 76 ] 89 0.009% 99.708% ( 76, 110 ] 31 0.003% 99.711% ( 110, 170 ] 50 0.005% 99.716% ( 170, 250 ] 96 0.009% 99.725% ( 250, 380 ] 266 0.026% 99.751% ( 380, 580 ] 544 0.052% 99.803% ( 580, 870 ] 889 0.085% 99.889% ( 870, 1300 ] 1074 0.103% 99.992% ( 1300, 1900 ] 906 0.087% 100.079% ( 1900, 2900 ] 890 0.086% 100.164% ( 2900, 4400 ] 844 0.081% 100.245% ( 4400, 6600 ] 215 0.021% 100.266% ( 6600, 9900 ] 35 0.003% 100.269% ( 9900, 14000 ] 1 0.000% 100.270% ** Level 4 read latency histogram (micros): Count: 165972 Average: 41.6242 StdDev: 317.90 Min: 1 Median: 1.9644 Max: 10043 Percentiles: P50: 1.96 P75: 2.98 P99: 1329.92 P99.9: 4160.19 P99.99: 5466.32 ------------------------------------------------------ [ 0, 1 ] 2918 1.758% 1.758% ( 1, 2 ] 83026 50.024% 51.782% ########## ( 2, 3 ] 39442 23.764% 75.546% ##### ( 3, 4 ] 17897 10.783% 86.330% ## ( 4, 6 ] 15060 9.074% 95.403% ## ( 6, 10 ] 2955 1.780% 97.184% ( 10, 15 ] 591 0.356% 97.540% ( 15, 22 ] 78 0.047% 97.587% ( 22, 34 ] 12 0.007% 97.594% ( 34, 51 ] 5 0.003% 97.597% ( 51, 76 ] 13 0.008% 97.605% ( 76, 110 ] 12 0.007% 97.612% ( 110, 170 ] 38 0.023% 97.635% ( 170, 250 ] 114 0.069% 97.704% ( 250, 380 ] 167 0.101% 97.804% ( 380, 580 ] 415 0.250% 98.054% ( 580, 870 ] 715 0.431% 98.485% ( 870, 1300 ] 825 0.497% 98.982% ( 1300, 1900 ] 607 0.366% 99.348% ( 1900, 2900 ] 481 0.290% 99.638% ( 2900, 4400 ] 519 0.313% 99.951% ( 4400, 6600 ] 137 0.083% 100.033% ( 6600, 9900 ] 18 0.011% 100.044% ( 9900, 14000 ] 1 0.001% 100.045% ** Level 5 read latency histogram (micros): Count: 11043 Average: 1922.5440 StdDev: 1565.08 Min: 90 Median: 1352.8953 Max: 13417 Percentiles: P50: 1352.90 P75: 2812.25 P99: 7347.27 P99.9: 9776.73 P99.99: 13245.39 ------------------------------------------------------ ( 76, 110 ] 5 0.045% 0.045% ( 110, 170 ] 53 0.480% 0.525% ( 170, 250 ] 131 1.186% 1.711% ( 250, 380 ] 438 3.966% 5.678% # ( 380, 580 ] 1074 9.726% 15.403% ## ( 580, 870 ] 1741 15.766% 31.169% ### ( 870, 1300 ] 1944 17.604% 48.773% #### ( 1300, 1900 ] 1537 13.918% 62.691% ### ( 1900, 2900 ] 1490 13.493% 76.184% ### ( 2900, 4400 ] 1725 15.621% 91.805% ### ( 4400, 6600 ] 764 6.918% 98.723% # ( 6600, 9900 ] 135 1.222% 99.946% ( 9900, 14000 ] 6 0.054% 100.000% ** DB Stats ** Uptime(secs): 7.5 total, 7.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 131.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.375 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 134.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.375 H:M:S, 46.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/22-12:10:53 ... thread 0: (1000000,2000000) ops and (210998.0,165878.5) ops/second in (4.739382,12.057019) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.23 GB 44.1 0.6 0.0 0.6 2.4 1.8 0.0 1.3 40.2 174.4 14.09 7.54 27 0.522 575K 638 0.0 0.0 L1 8/8 521.19 MB 0.0 0.9 0.7 0.2 0.9 0.7 0.0 1.3 126.9 126.7 7.45 4.35 3 2.482 959K 1469 0.0 0.0 L2 3/1 163.64 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 174.9 174.9 1.28 0.99 1 1.280 227K 0 0.0 0.0 L3 34/17 2.58 GB 1.2 4.0 2.1 2.0 4.0 2.0 0.2 1.9 112.9 111.8 36.48 19.04 19 1.920 2163K 1956 0.0 0.0 L4 168/8 9.76 GB 1.0 4.9 3.7 1.2 4.9 3.7 0.5 1.3 115.0 114.4 43.84 23.28 33 1.328 2550K 4995 0.0 0.0 L5 1124/0 92.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/42 106.76 GB 0.0 10.6 6.7 3.9 12.4 8.5 4.7 6.7 105.6 123.3 103.13 55.21 83 1.243 6476K 9058 0.0 0.0 Int 0/0 0.00 KB 0.0 10.6 6.7 3.9 12.4 8.5 4.7 6.7 105.6 123.3 103.13 55.21 83 1.243 6476K 9058 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.6 6.7 3.9 10.6 6.7 0.0 0.0 118.8 118.0 91.72 49.96 58 1.581 6476K 9058 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 165.6 11.41 5.25 25 0.457 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.42 GB write, 1040.24 MB/s write, 10.64 GB read, 891.20 MB/s read, 103.1 seconds Interval compaction: 12.42 GB write, 1054.53 MB/s write, 10.64 GB read, 903.44 MB/s read, 103.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 36, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 427182 Average: 9.0825 StdDev: 125.68 Min: 1 Median: 1.8080 Max: 16454 Percentiles: P50: 1.81 P75: 2.70 P99: 9.83 P99.9: 1377.45 P99.99: 3277.71 ------------------------------------------------------ [ 0, 1 ] 22370 5.237% 5.237% # ( 1, 2 ] 236666 55.402% 60.638% ########### ( 2, 3 ] 87411 20.462% 81.101% #### ( 3, 4 ] 35763 8.372% 89.472% ## ( 4, 6 ] 34272 8.023% 97.495% ## ( 6, 10 ] 6720 1.573% 99.068% ( 10, 15 ] 1102 0.258% 99.326% ( 15, 22 ] 139 0.033% 99.359% ( 22, 34 ] 11 0.003% 99.361% ( 34, 51 ] 11 0.003% 99.364% ( 51, 76 ] 12 0.003% 99.367% ( 76, 110 ] 38 0.009% 99.376% ( 110, 170 ] 281 0.066% 99.441% ( 170, 250 ] 364 0.085% 99.527% ( 250, 380 ] 358 0.084% 99.610% ( 380, 580 ] 430 0.101% 99.711% ( 580, 870 ] 418 0.098% 99.809% ( 870, 1300 ] 364 0.085% 99.894% ( 1300, 1900 ] 200 0.047% 99.941% ( 1900, 2900 ] 171 0.040% 99.981% ( 2900, 4400 ] 156 0.037% 100.018% ( 4400, 6600 ] 43 0.010% 100.028% ( 6600, 9900 ] 5 0.001% 100.029% ( 9900, 14000 ] 5 0.001% 100.030% ( 14000, 22000 ] 2 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 165783 Average: 4.9997 StdDev: 61.37 Min: 1 Median: 1.8822 Max: 7566 Percentiles: P50: 1.88 P75: 2.83 P99: 9.42 P99.9: 595.48 P99.99: 3263.25 ------------------------------------------------------ [ 0, 1 ] 4355 2.627% 2.627% # ( 1, 2 ] 89027 53.701% 56.328% ########### ( 2, 3 ] 37151 22.409% 78.737% #### ( 3, 4 ] 15928 9.608% 88.345% ## ( 4, 6 ] 15067 9.088% 97.433% ## ( 6, 10 ] 3036 1.831% 99.265% ( 10, 15 ] 505 0.305% 99.569% ( 15, 22 ] 68 0.041% 99.610% ( 22, 34 ] 1 0.001% 99.611% ( 34, 51 ] 1 0.001% 99.612% ( 51, 76 ] 4 0.002% 99.614% ( 76, 110 ] 35 0.021% 99.635% ( 110, 170 ] 136 0.082% 99.717% ( 170, 250 ] 107 0.065% 99.782% ( 250, 380 ] 97 0.059% 99.840% ( 380, 580 ] 96 0.058% 99.898% ( 580, 870 ] 79 0.048% 99.946% ( 870, 1300 ] 37 0.022% 99.968% ( 1300, 1900 ] 25 0.015% 99.983% ( 1900, 2900 ] 10 0.006% 99.989% ( 2900, 4400 ] 10 0.006% 99.995% ( 4400, 6600 ] 8 0.005% 100.000% ( 6600, 9900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 407040 Average: 16.6569 StdDev: 193.67 Min: 1 Median: 2.0099 Max: 13218 Percentiles: P50: 2.01 P75: 3.10 P99: 14.07 P99.9: 2093.05 P99.99: 2879.18 ------------------------------------------------------ [ 0, 1 ] 9490 2.331% 2.331% ( 1, 2 ] 193054 47.429% 49.760% ######### ( 2, 3 ] 98324 24.156% 73.916% ##### ( 3, 4 ] 43739 10.746% 84.662% ## ( 4, 6 ] 44642 10.967% 95.629% ## ( 6, 10 ] 11677 2.869% 98.498% # ( 10, 15 ] 2513 0.617% 99.115% ( 15, 22 ] 385 0.095% 99.210% ( 22, 34 ] 52 0.013% 99.223% ( 34, 51 ] 30 0.007% 99.230% ( 51, 76 ] 23 0.006% 99.236% ( 76, 110 ] 38 0.009% 99.245% ( 110, 170 ] 137 0.034% 99.279% ( 170, 250 ] 177 0.043% 99.322% ( 250, 380 ] 245 0.060% 99.382% ( 380, 580 ] 382 0.094% 99.476% ( 580, 870 ] 555 0.136% 99.613% ( 870, 1300 ] 611 0.150% 99.763% ( 1300, 1900 ] 470 0.115% 99.878% ( 1900, 2900 ] 466 0.114% 99.993% ( 2900, 4400 ] 425 0.104% 100.097% ( 4400, 6600 ] 123 0.030% 100.127% ( 6600, 9900 ] 20 0.005% 100.132% ( 9900, 14000 ] 3 0.001% 100.133% ** Level 3 read latency histogram (micros): Count: 1589813 Average: 12.0123 StdDev: 165.69 Min: 1 Median: 1.9621 Max: 26744 Percentiles: P50: 1.96 P75: 2.94 P99: 9.73 P99.9: 919.18 P99.99: 1393.84 ------------------------------------------------------ [ 0, 1 ] 23828 1.499% 1.499% ( 1, 2 ] 801462 50.412% 51.911% ########## ( 2, 3 ] 388634 24.445% 76.356% ##### ( 3, 4 ] 165806 10.429% 86.786% ## ( 4, 6 ] 159858 10.055% 96.841% ## ( 6, 10 ] 36769 2.313% 99.154% ( 10, 15 ] 6745 0.424% 99.578% ( 15, 22 ] 816 0.051% 99.629% ( 22, 34 ] 75 0.005% 99.634% ( 34, 51 ] 86 0.005% 99.639% ( 51, 76 ] 125 0.008% 99.647% ( 76, 110 ] 95 0.006% 99.653% ( 110, 170 ] 350 0.022% 99.675% ( 170, 250 ] 468 0.029% 99.705% ( 250, 380 ] 633 0.040% 99.744% ( 380, 580 ] 985 0.062% 99.806% ( 580, 870 ] 1327 0.083% 99.890% ( 870, 1300 ] 1418 0.089% 99.979% ( 1300, 1900 ] 1119 0.070% 100.049% ( 1900, 2900 ] 1190 0.075% 100.124% ( 2900, 4400 ] 1227 0.077% 100.201% ( 4400, 6600 ] 314 0.020% 100.221% ( 6600, 9900 ] 62 0.004% 100.225% ( 9900, 14000 ] 7 0.000% 100.226% ( 14000, 22000 ] 6 0.000% 100.226% ( 22000, 33000 ] 3 0.000% 100.226% ** Level 4 read latency histogram (micros): Count: 315445 Average: 36.1704 StdDev: 341.35 Min: 1 Median: 2.0010 Max: 51723 Percentiles: P50: 2.00 P75: 3.06 P99: 1000.40 P99.9: 3863.82 P99.99: 4577.09 ------------------------------------------------------ [ 0, 1 ] 4878 1.546% 1.546% ( 1, 2 ] 152767 48.429% 49.975% ########## ( 2, 3 ] 76783 24.341% 74.317% ##### ( 3, 4 ] 33384 10.583% 84.900% ## ( 4, 6 ] 30834 9.775% 94.675% ## ( 6, 10 ] 6628 2.101% 96.776% ( 10, 15 ] 1314 0.417% 97.192% ( 15, 22 ] 155 0.049% 97.241% ( 22, 34 ] 18 0.006% 97.247% ( 34, 51 ] 12 0.004% 97.251% ( 51, 76 ] 31 0.010% 97.261% ( 76, 110 ] 148 0.047% 97.308% ( 110, 170 ] 681 0.216% 97.523% ( 170, 250 ] 888 0.282% 97.805% ( 250, 380 ] 893 0.283% 98.088% ( 380, 580 ] 1169 0.371% 98.459% ( 580, 870 ] 1350 0.428% 98.887% ( 870, 1300 ] 1179 0.374% 99.260% ( 1300, 1900 ] 822 0.261% 99.521% ( 1900, 2900 ] 713 0.226% 99.747% ( 2900, 4400 ] 751 0.238% 99.985% ( 4400, 6600 ] 192 0.061% 100.046% ( 6600, 9900 ] 30 0.010% 100.055% ( 9900, 14000 ] 2 0.001% 100.056% ( 14000, 22000 ] 4 0.001% 100.057% ( 33000, 50000 ] 3 0.001% 100.058% ( 50000, 75000 ] 2 0.001% 100.059% ** Level 5 read latency histogram (micros): Count: 35423 Average: 990.9055 StdDev: 1326.17 Min: 76 Median: 500.7447 Max: 42088 Percentiles: P50: 500.74 P75: 1137.15 P99: 6165.84 P99.9: 9577.87 P99.99: 20553.87 ------------------------------------------------------ ( 51, 76 ] 1 0.003% 0.003% ( 76, 110 ] 851 2.402% 2.405% ( 110, 170 ] 4364 12.320% 14.725% ## ( 170, 250 ] 4882 13.782% 28.507% ### ( 250, 380 ] 4549 12.842% 41.349% ### ( 380, 580 ] 5076 14.330% 55.679% ### ( 580, 870 ] 4694 13.251% 68.930% ### ( 870, 1300 ] 3461 9.770% 78.700% ## ( 1300, 1900 ] 2175 6.140% 84.840% # ( 1900, 2900 ] 2027 5.722% 90.563% # ( 2900, 4400 ] 2272 6.414% 96.977% # ( 4400, 6600 ] 893 2.521% 99.498% # ( 6600, 9900 ] 158 0.446% 99.944% ( 9900, 14000 ] 14 0.040% 99.983% ( 14000, 22000 ] 3 0.008% 99.992% ( 22000, 33000 ] 3 0.008% 100.000% ( 33000, 50000 ] 2 0.006% 100.006% ** DB Stats ** Uptime(secs): 12.2 total, 4.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 161.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.485 H:M:S, 36.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 207.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.110 H:M:S, 23.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/22-12:10:59 ... thread 0: (1000000,3000000) ops and (158692.6,163412.0) ops/second in (6.301490,18.358509) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1.60 GB 0.0 2.5 0.0 2.5 5.2 2.8 0.0 1.9 83.6 177.6 30.12 18.07 44 0.685 2557K 4659 0.0 0.0 L1 0/0 0.00 KB 0.0 2.0 1.3 0.7 2.0 1.3 0.0 1.5 143.1 142.7 14.20 9.38 4 3.550 2063K 5517 0.0 0.0 L2 6/5 582.86 MB 0.6 0.4 0.4 0.0 0.4 0.4 0.9 1.1 168.1 167.9 2.38 1.80 2 1.190 406K 459 0.0 0.0 L3 22/12 1.55 GB 0.6 5.4 2.4 2.9 5.3 2.4 0.5 2.2 116.0 115.1 47.39 25.47 23 2.061 2991K 2897 0.0 0.0 L4 178/0 9.76 GB 1.0 8.0 5.4 2.6 7.9 5.3 0.5 1.5 118.8 117.3 69.02 37.72 56 1.233 4465K 12K 0.0 0.0 L5 1144/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/22 107.60 GB 0.0 18.2 9.5 8.7 20.8 12.1 7.5 7.5 114.3 130.8 163.11 92.44 129 1.264 12M 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.2 9.5 8.7 20.8 12.1 7.5 7.5 114.3 130.8 163.11 92.44 129 1.264 12M 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.2 9.5 8.7 18.1 9.3 0.0 0.0 128.0 126.9 145.68 84.46 92 1.583 12M 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 162.6 17.44 7.98 37 0.471 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.4 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.83 GB write, 1151.25 MB/s write, 18.21 GB read, 1006.45 MB/s read, 163.1 seconds Interval compaction: 20.83 GB write, 1161.63 MB/s write, 18.21 GB read, 1015.53 MB/s read, 163.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 978132 Average: 8.4757 StdDev: 118.39 Min: 1 Median: 1.8173 Max: 16454 Percentiles: P50: 1.82 P75: 2.73 P99: 9.63 P99.9: 1113.21 P99.99: 2290.14 ------------------------------------------------------ [ 0, 1 ] 49717 5.083% 5.083% # ( 1, 2 ] 537545 54.956% 60.039% ########### ( 2, 3 ] 200406 20.489% 80.528% #### ( 3, 4 ] 83892 8.577% 89.105% ## ( 4, 6 ] 81701 8.353% 97.457% ## ( 6, 10 ] 16623 1.699% 99.157% ( 10, 15 ] 2580 0.264% 99.421% ( 15, 22 ] 310 0.032% 99.452% ( 22, 34 ] 23 0.002% 99.455% ( 34, 51 ] 15 0.002% 99.456% ( 51, 76 ] 31 0.003% 99.459% ( 76, 110 ] 93 0.010% 99.469% ( 110, 170 ] 605 0.062% 99.531% ( 170, 250 ] 710 0.073% 99.603% ( 250, 380 ] 705 0.072% 99.675% ( 380, 580 ] 893 0.091% 99.767% ( 580, 870 ] 875 0.089% 99.856% ( 870, 1300 ] 760 0.078% 99.934% ( 1300, 1900 ] 423 0.043% 99.977% ( 1900, 2900 ] 326 0.033% 100.010% ( 2900, 4400 ] 306 0.031% 100.042% ( 4400, 6600 ] 111 0.011% 100.053% ( 6600, 9900 ] 16 0.002% 100.055% ( 9900, 14000 ] 5 0.001% 100.055% ( 14000, 22000 ] 3 0.000% 100.055% ** Level 1 read latency histogram (micros): Count: 433814 Average: 8.3384 StdDev: 129.76 Min: 1 Median: 1.9549 Max: 15476 Percentiles: P50: 1.95 P75: 2.94 P99: 9.67 P99.9: 1002.21 P99.99: 2881.82 ------------------------------------------------------ [ 0, 1 ] 7877 1.816% 1.816% ( 1, 2 ] 218914 50.463% 52.278% ########## ( 2, 3 ] 104964 24.196% 76.474% ##### ( 3, 4 ] 44631 10.288% 86.762% ## ( 4, 6 ] 44138 10.174% 96.936% ## ( 6, 10 ] 9753 2.248% 99.185% ( 10, 15 ] 1566 0.361% 99.546% ( 15, 22 ] 196 0.045% 99.591% ( 22, 34 ] 7 0.002% 99.592% ( 34, 51 ] 20 0.005% 99.597% ( 51, 76 ] 38 0.009% 99.606% ( 76, 110 ] 52 0.012% 99.618% ( 110, 170 ] 205 0.047% 99.665% ( 170, 250 ] 168 0.039% 99.704% ( 250, 380 ] 220 0.051% 99.755% ( 380, 580 ] 280 0.065% 99.819% ( 580, 870 ] 291 0.067% 99.886% ( 870, 1300 ] 199 0.046% 99.932% ( 1300, 1900 ] 124 0.029% 99.961% ( 1900, 2900 ] 131 0.030% 99.991% ( 2900, 4400 ] 165 0.038% 100.029% ( 4400, 6600 ] 73 0.017% 100.046% ( 6600, 9900 ] 19 0.004% 100.050% ( 9900, 14000 ] 1 0.000% 100.050% ( 14000, 22000 ] 2 0.000% 100.051% ** Level 2 read latency histogram (micros): Count: 493889 Average: 16.1812 StdDev: 191.96 Min: 1 Median: 2.0012 Max: 13218 Percentiles: P50: 2.00 P75: 3.07 P99: 13.90 P99.9: 2177.02 P99.99: 3125.34 ------------------------------------------------------ [ 0, 1 ] 10816 2.190% 2.190% ( 1, 2 ] 235986 47.781% 49.971% ########## ( 2, 3 ] 119885 24.274% 74.245% ##### ( 3, 4 ] 52523 10.635% 84.879% ## ( 4, 6 ] 53453 10.823% 95.702% ## ( 6, 10 ] 14061 2.847% 98.549% # ( 10, 15 ] 2856 0.578% 99.128% ( 15, 22 ] 431 0.087% 99.215% ( 22, 34 ] 57 0.012% 99.226% ( 34, 51 ] 40 0.008% 99.234% ( 51, 76 ] 38 0.008% 99.242% ( 76, 110 ] 44 0.009% 99.251% ( 110, 170 ] 154 0.031% 99.282% ( 170, 250 ] 208 0.042% 99.324% ( 250, 380 ] 296 0.060% 99.384% ( 380, 580 ] 484 0.098% 99.482% ( 580, 870 ] 671 0.136% 99.618% ( 870, 1300 ] 709 0.144% 99.762% ( 1300, 1900 ] 541 0.110% 99.871% ( 1900, 2900 ] 513 0.104% 99.975% ( 2900, 4400 ] 490 0.099% 100.074% ( 4400, 6600 ] 153 0.031% 100.105% ( 6600, 9900 ] 28 0.006% 100.111% ( 9900, 14000 ] 4 0.001% 100.112% ** Level 3 read latency histogram (micros): Count: 2125693 Average: 11.6071 StdDev: 162.07 Min: 1 Median: 1.9719 Max: 26744 Percentiles: P50: 1.97 P75: 2.96 P99: 9.70 P99.9: 934.12 P99.99: 1454.15 ------------------------------------------------------ [ 0, 1 ] 31498 1.482% 1.482% ( 1, 2 ] 1061118 49.919% 51.400% ########## ( 2, 3 ] 522756 24.592% 75.993% ##### ( 3, 4 ] 223209 10.501% 86.493% ## ( 4, 6 ] 220128 10.356% 96.849% ## ( 6, 10 ] 49384 2.323% 99.172% ( 10, 15 ] 8967 0.422% 99.594% ( 15, 22 ] 1053 0.050% 99.643% ( 22, 34 ] 100 0.005% 99.648% ( 34, 51 ] 126 0.006% 99.654% ( 51, 76 ] 183 0.009% 99.663% ( 76, 110 ] 114 0.005% 99.668% ( 110, 170 ] 390 0.018% 99.686% ( 170, 250 ] 534 0.025% 99.711% ( 250, 380 ] 766 0.036% 99.748% ( 380, 580 ] 1254 0.059% 99.807% ( 580, 870 ] 1717 0.081% 99.887% ( 870, 1300 ] 1826 0.086% 99.973% ( 1300, 1900 ] 1399 0.066% 100.039% ( 1900, 2900 ] 1454 0.068% 100.107% ( 2900, 4400 ] 1545 0.073% 100.180% ( 4400, 6600 ] 440 0.021% 100.201% ( 6600, 9900 ] 90 0.004% 100.205% ( 9900, 14000 ] 9 0.000% 100.205% ( 14000, 22000 ] 6 0.000% 100.206% ( 22000, 33000 ] 3 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 684101 Average: 26.8123 StdDev: 274.35 Min: 1 Median: 1.9988 Max: 51723 Percentiles: P50: 2.00 P75: 3.07 P99: 653.10 P99.9: 3046.07 P99.99: 3879.59 ------------------------------------------------------ [ 0, 1 ] 11095 1.622% 1.622% ( 1, 2 ] 331342 48.435% 50.056% ########## ( 2, 3 ] 165616 24.209% 74.266% ##### ( 3, 4 ] 71821 10.499% 84.764% ## ( 4, 6 ] 71008 10.380% 95.144% ## ( 6, 10 ] 16881 2.468% 97.612% ( 10, 15 ] 2872 0.420% 98.032% ( 15, 22 ] 334 0.049% 98.080% ( 22, 34 ] 33 0.005% 98.085% ( 34, 51 ] 42 0.006% 98.091% ( 51, 76 ] 77 0.011% 98.103% ( 76, 110 ] 211 0.031% 98.133% ( 110, 170 ] 954 0.139% 98.273% ( 170, 250 ] 1253 0.183% 98.456% ( 250, 380 ] 1310 0.191% 98.648% ( 380, 580 ] 1836 0.268% 98.916% ( 580, 870 ] 2281 0.333% 99.249% ( 870, 1300 ] 2029 0.297% 99.546% ( 1300, 1900 ] 1286 0.188% 99.734% ( 1900, 2900 ] 1028 0.150% 99.884% ( 2900, 4400 ] 1108 0.162% 100.046% ( 4400, 6600 ] 340 0.050% 100.096% ( 6600, 9900 ] 54 0.008% 100.104% ( 9900, 14000 ] 2 0.000% 100.104% ( 14000, 22000 ] 5 0.001% 100.105% ( 33000, 50000 ] 3 0.000% 100.105% ( 50000, 75000 ] 2 0.000% 100.106% ** Level 5 read latency histogram (micros): Count: 53936 Average: 990.2179 StdDev: 1262.56 Min: 76 Median: 547.1796 Max: 42088 Percentiles: P50: 547.18 P75: 1150.23 P99: 6093.40 P99.9: 9461.98 P99.99: 18170.24 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 1131 2.097% 2.099% ( 110, 170 ] 5961 11.052% 13.151% ## ( 170, 250 ] 6625 12.283% 25.434% ## ( 250, 380 ] 6623 12.279% 37.713% ## ( 380, 580 ] 7928 14.699% 52.412% ### ( 580, 870 ] 8162 15.133% 67.545% ### ( 870, 1300 ] 6170 11.439% 78.984% ## ( 1300, 1900 ] 3681 6.825% 85.809% # ( 1900, 2900 ] 2914 5.403% 91.212% # ( 2900, 4400 ] 3210 5.951% 97.163% # ( 4400, 6600 ] 1287 2.386% 99.549% ( 6600, 9900 ] 218 0.404% 99.954% ( 9900, 14000 ] 17 0.032% 99.985% ( 14000, 22000 ] 5 0.009% 99.994% ( 22000, 33000 ] 3 0.006% 100.000% ( 33000, 50000 ] 2 0.004% 100.004% ** DB Stats ** Uptime(secs): 18.5 total, 6.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 159.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.860 H:M:S, 37.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 156.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.375 H:M:S, 37.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/22-12:11:04 ... thread 0: (1000000,4000000) ops and (203557.3,171886.8) ops/second in (4.912621,23.271130) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.58 GB 75.5 3.0 0.0 3.0 6.8 3.7 0.0 1.8 82.6 185.3 37.37 23.00 60 0.623 3133K 5230 0.0 0.0 L1 0/0 0.00 KB 0.0 2.0 1.3 0.7 2.0 1.3 0.0 1.5 143.1 142.7 14.20 9.38 4 3.550 2063K 5517 0.0 0.0 L2 1/0 58.40 MB 0.6 0.4 0.4 0.0 0.4 0.4 0.9 1.1 168.1 167.9 2.38 1.80 2 1.190 406K 459 0.0 0.0 L3 19/2 1.06 GB 1.0 6.8 2.9 3.9 6.8 2.9 0.5 2.3 120.9 120.0 57.66 32.17 28 2.059 4199K 7307 0.0 0.0 L4 185/16 10.35 GB 1.0 10.2 6.2 4.0 10.1 6.1 0.6 1.6 123.5 121.9 84.91 48.16 65 1.306 6477K 22K 0.0 0.0 L5 1148/0 94.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/27 108.53 GB 0.0 22.4 10.8 11.6 26.0 14.4 8.0 6.9 116.9 135.4 196.52 114.51 159 1.236 16M 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 10.8 11.6 26.0 14.4 8.0 6.9 116.9 135.4 196.52 114.51 159 1.236 16M 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 10.8 11.6 22.2 10.6 0.0 0.0 131.9 130.7 174.20 103.80 108 1.613 16M 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 172.2 22.32 10.71 51 0.438 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.4 total, 23.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.99 GB write, 1135.55 MB/s write, 22.44 GB read, 980.35 MB/s read, 196.5 seconds Interval compaction: 25.99 GB write, 1143.63 MB/s write, 22.44 GB read, 987.32 MB/s read, 196.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1361832 Average: 8.3435 StdDev: 112.38 Min: 1 Median: 1.8193 Max: 16454 Percentiles: P50: 1.82 P75: 2.73 P99: 9.65 P99.9: 1113.48 P99.99: 2262.05 ------------------------------------------------------ [ 0, 1 ] 66368 4.873% 4.873% # ( 1, 2 ] 750052 55.077% 59.950% ########### ( 2, 3 ] 281718 20.687% 80.637% #### ( 3, 4 ] 115957 8.515% 89.152% ## ( 4, 6 ] 113063 8.302% 97.454% ## ( 6, 10 ] 23046 1.692% 99.146% ( 10, 15 ] 3538 0.260% 99.406% ( 15, 22 ] 408 0.030% 99.436% ( 22, 34 ] 29 0.002% 99.438% ( 34, 51 ] 27 0.002% 99.440% ( 51, 76 ] 42 0.003% 99.443% ( 76, 110 ] 128 0.009% 99.453% ( 110, 170 ] 817 0.060% 99.512% ( 170, 250 ] 1020 0.075% 99.587% ( 250, 380 ] 1016 0.075% 99.662% ( 380, 580 ] 1283 0.094% 99.756% ( 580, 870 ] 1337 0.098% 99.854% ( 870, 1300 ] 1097 0.081% 99.935% ( 1300, 1900 ] 584 0.043% 99.978% ( 1900, 2900 ] 458 0.034% 100.011% ( 2900, 4400 ] 400 0.029% 100.041% ( 4400, 6600 ] 124 0.009% 100.050% ( 6600, 9900 ] 18 0.001% 100.051% ( 9900, 14000 ] 5 0.000% 100.052% ( 14000, 22000 ] 3 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 460404 Average: 8.2138 StdDev: 127.11 Min: 1 Median: 1.9507 Max: 15476 Percentiles: P50: 1.95 P75: 2.93 P99: 9.66 P99.9: 988.85 P99.99: 2855.26 ------------------------------------------------------ [ 0, 1 ] 8365 1.817% 1.817% ( 1, 2 ] 233339 50.681% 52.498% ########## ( 2, 3 ] 111534 24.225% 76.723% ##### ( 3, 4 ] 46874 10.181% 86.905% ## ( 4, 6 ] 46193 10.033% 96.938% ## ( 6, 10 ] 10363 2.251% 99.189% ( 10, 15 ] 1635 0.355% 99.544% ( 15, 22 ] 209 0.045% 99.589% ( 22, 34 ] 9 0.002% 99.591% ( 34, 51 ] 21 0.005% 99.596% ( 51, 76 ] 39 0.008% 99.604% ( 76, 110 ] 53 0.012% 99.616% ( 110, 170 ] 213 0.046% 99.662% ( 170, 250 ] 185 0.040% 99.702% ( 250, 380 ] 233 0.051% 99.753% ( 380, 580 ] 304 0.066% 99.819% ( 580, 870 ] 316 0.069% 99.887% ( 870, 1300 ] 212 0.046% 99.933% ( 1300, 1900 ] 132 0.029% 99.962% ( 1900, 2900 ] 135 0.029% 99.991% ( 2900, 4400 ] 169 0.037% 100.028% ( 4400, 6600 ] 73 0.016% 100.044% ( 6600, 9900 ] 19 0.004% 100.048% ( 9900, 14000 ] 1 0.000% 100.048% ( 14000, 22000 ] 2 0.000% 100.049% ** Level 2 read latency histogram (micros): Count: 502969 Average: 15.9958 StdDev: 190.52 Min: 1 Median: 1.9997 Max: 13218 Percentiles: P50: 2.00 P75: 3.06 P99: 13.82 P99.9: 2164.14 P99.99: 3125.62 ------------------------------------------------------ [ 0, 1 ] 10979 2.183% 2.183% ( 1, 2 ] 240589 47.834% 50.017% ########## ( 2, 3 ] 122307 24.317% 74.334% ##### ( 3, 4 ] 53395 10.616% 84.950% ## ( 4, 6 ] 54302 10.796% 95.746% ## ( 6, 10 ] 14170 2.817% 98.563% # ( 10, 15 ] 2876 0.572% 99.135% ( 15, 22 ] 437 0.087% 99.222% ( 22, 34 ] 57 0.011% 99.233% ( 34, 51 ] 41 0.008% 99.241% ( 51, 76 ] 38 0.008% 99.249% ( 76, 110 ] 45 0.009% 99.258% ( 110, 170 ] 155 0.031% 99.289% ( 170, 250 ] 213 0.042% 99.331% ( 250, 380 ] 304 0.060% 99.391% ( 380, 580 ] 491 0.098% 99.489% ( 580, 870 ] 674 0.134% 99.623% ( 870, 1300 ] 715 0.142% 99.765% ( 1300, 1900 ] 542 0.108% 99.873% ( 1900, 2900 ] 515 0.102% 99.975% ( 2900, 4400 ] 490 0.097% 100.073% ( 4400, 6600 ] 154 0.031% 100.103% ( 6600, 9900 ] 28 0.006% 100.109% ( 9900, 14000 ] 4 0.001% 100.110% ** Level 3 read latency histogram (micros): Count: 2490069 Average: 10.8803 StdDev: 153.81 Min: 1 Median: 1.9657 Max: 26744 Percentiles: P50: 1.97 P75: 2.95 P99: 9.64 P99.9: 889.84 P99.99: 1427.07 ------------------------------------------------------ [ 0, 1 ] 37234 1.495% 1.495% ( 1, 2 ] 1250689 50.227% 51.722% ########## ( 2, 3 ] 611337 24.551% 76.273% ##### ( 3, 4 ] 258795 10.393% 86.666% ## ( 4, 6 ] 255628 10.266% 96.932% ## ( 6, 10 ] 56643 2.275% 99.207% ( 10, 15 ] 10026 0.403% 99.610% ( 15, 22 ] 1169 0.047% 99.657% ( 22, 34 ] 111 0.004% 99.661% ( 34, 51 ] 174 0.007% 99.668% ( 51, 76 ] 206 0.008% 99.676% ( 76, 110 ] 125 0.005% 99.681% ( 110, 170 ] 439 0.018% 99.699% ( 170, 250 ] 629 0.025% 99.724% ( 250, 380 ] 904 0.036% 99.761% ( 380, 580 ] 1434 0.058% 99.818% ( 580, 870 ] 1943 0.078% 99.896% ( 870, 1300 ] 2014 0.081% 99.977% ( 1300, 1900 ] 1511 0.061% 100.038% ( 1900, 2900 ] 1561 0.063% 100.101% ( 2900, 4400 ] 1627 0.065% 100.166% ( 4400, 6600 ] 459 0.018% 100.184% ( 6600, 9900 ] 95 0.004% 100.188% ( 9900, 14000 ] 9 0.000% 100.188% ( 14000, 22000 ] 6 0.000% 100.189% ( 22000, 33000 ] 3 0.000% 100.189% ** Level 4 read latency histogram (micros): Count: 1253882 Average: 21.6037 StdDev: 229.72 Min: 1 Median: 1.9795 Max: 51723 Percentiles: P50: 1.98 P75: 2.99 P99: 435.58 P99.9: 2295.06 P99.99: 3104.43 ------------------------------------------------------ [ 0, 1 ] 18681 1.490% 1.490% ( 1, 2 ] 620975 49.524% 51.014% ########## ( 2, 3 ] 304326 24.271% 75.285% ##### ( 3, 4 ] 127776 10.190% 85.475% ## ( 4, 6 ] 125901 10.041% 95.516% ## ( 6, 10 ] 31488 2.511% 98.027% # ( 10, 15 ] 4906 0.391% 98.419% ( 15, 22 ] 542 0.043% 98.462% ( 22, 34 ] 54 0.004% 98.466% ( 34, 51 ] 112 0.009% 98.475% ( 51, 76 ] 120 0.010% 98.485% ( 76, 110 ] 294 0.023% 98.508% ( 110, 170 ] 1377 0.110% 98.618% ( 170, 250 ] 1905 0.152% 98.770% ( 250, 380 ] 2064 0.165% 98.934% ( 380, 580 ] 2962 0.236% 99.171% ( 580, 870 ] 3710 0.296% 99.467% ( 870, 1300 ] 3011 0.240% 99.707% ( 1300, 1900 ] 1827 0.146% 99.852% ( 1900, 2900 ] 1514 0.121% 99.973% ( 2900, 4400 ] 1560 0.124% 100.098% ( 4400, 6600 ] 415 0.033% 100.131% ( 6600, 9900 ] 67 0.005% 100.136% ( 9900, 14000 ] 2 0.000% 100.136% ( 14000, 22000 ] 5 0.000% 100.137% ( 33000, 50000 ] 3 0.000% 100.137% ( 50000, 75000 ] 2 0.000% 100.137% ** Level 5 read latency histogram (micros): Count: 71667 Average: 946.8052 StdDev: 1180.60 Min: 76 Median: 547.4265 Max: 42088 Percentiles: P50: 547.43 P75: 1102.27 P99: 5884.62 P99.9: 9221.58 P99.99: 15333.28 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 1421 1.983% 1.984% ( 110, 170 ] 7539 10.519% 12.504% ## ( 170, 250 ] 8664 12.089% 24.593% ## ( 250, 380 ] 8954 12.494% 37.087% ## ( 380, 580 ] 11055 15.426% 52.512% ### ( 580, 870 ] 11501 16.048% 68.560% ### ( 870, 1300 ] 8544 11.922% 80.482% ## ( 1300, 1900 ] 4727 6.596% 87.078% # ( 1900, 2900 ] 3693 5.153% 92.231% # ( 2900, 4400 ] 3887 5.424% 97.654% # ( 4400, 6600 ] 1429 1.994% 99.648% ( 6600, 9900 ] 227 0.317% 99.965% ( 9900, 14000 ] 17 0.024% 99.989% ( 14000, 22000 ] 5 0.007% 99.996% ( 22000, 33000 ] 3 0.004% 100.000% ( 33000, 50000 ] 2 0.003% 100.003% ** DB Stats ** Uptime(secs): 23.4 total, 4.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 167.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.906 H:M:S, 33.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 200.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.046 H:M:S, 21.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/22-12:11:08 ... thread 0: (1000000,5000000) ops and (285796.7,186775.4) ops/second in (3.498991,26.770121) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.56 GB 176.2 4.0 0.0 4.0 8.7 4.7 0.0 1.8 91.9 200.6 44.57 29.62 80 0.557 4157K 6253 0.0 0.0 L1 0/0 0.00 KB 0.0 2.0 1.3 0.7 2.0 1.3 0.0 1.5 143.1 142.7 14.20 9.38 4 3.550 2063K 5517 0.0 0.0 L2 1/0 58.40 MB 0.6 0.4 0.4 0.0 0.4 0.4 0.9 1.1 168.1 167.9 2.38 1.80 2 1.190 406K 459 0.0 0.0 L3 17/0 953.54 MB 1.0 6.8 2.9 3.9 6.8 2.9 0.5 2.3 120.9 120.0 57.66 32.17 28 2.059 4199K 7307 0.0 0.0 L4 173/0 9.48 GB 1.0 11.2 6.4 4.8 11.0 6.2 0.6 1.7 126.0 124.3 90.77 52.45 67 1.355 7440K 34K 0.0 0.0 L5 1160/0 95.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1368/9 109.50 GB 0.0 24.3 10.9 13.4 28.9 15.5 9.0 6.1 119.0 141.1 209.58 125.42 181 1.158 18M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 10.9 13.4 28.9 15.5 9.0 6.1 119.0 141.1 209.58 125.42 181 1.158 18M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 10.9 13.4 24.1 10.7 0.0 0.0 135.5 134.3 183.99 111.89 114 1.614 18M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 189.6 25.59 13.53 67 0.382 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.9 total, 26.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.87 GB write, 1097.64 MB/s write, 24.35 GB read, 925.62 MB/s read, 209.6 seconds Interval compaction: 28.87 GB write, 1104.43 MB/s write, 24.35 GB read, 931.35 MB/s read, 209.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1707597 Average: 8.7749 StdDev: 103.00 Min: 0 Median: 1.7516 Max: 16454 Percentiles: P50: 1.75 P75: 2.60 P99: 129.59 P99.9: 906.35 P99.99: 1779.23 ------------------------------------------------------ [ 0, 1 ] 137760 8.067% 8.067% ## ( 1, 2 ] 952706 55.792% 63.860% ########### ( 2, 3 ] 318124 18.630% 82.490% #### ( 3, 4 ] 127880 7.489% 89.978% # ( 4, 6 ] 119636 7.006% 96.985% # ( 6, 10 ] 25398 1.487% 98.472% ( 10, 15 ] 4033 0.236% 98.708% ( 15, 22 ] 507 0.030% 98.738% ( 22, 34 ] 52 0.003% 98.741% ( 34, 51 ] 29 0.002% 98.743% ( 51, 76 ] 45 0.003% 98.745% ( 76, 110 ] 1953 0.114% 98.860% ( 110, 170 ] 7349 0.430% 99.290% ( 170, 250 ] 3966 0.232% 99.522% ( 250, 380 ] 2342 0.137% 99.659% ( 380, 580 ] 2310 0.135% 99.795% ( 580, 870 ] 1702 0.100% 99.894% ( 870, 1300 ] 1164 0.068% 99.962% ( 1300, 1900 ] 590 0.035% 99.997% ( 1900, 2900 ] 470 0.028% 100.025% ( 2900, 4400 ] 400 0.023% 100.048% ( 4400, 6600 ] 124 0.007% 100.055% ( 6600, 9900 ] 18 0.001% 100.056% ( 9900, 14000 ] 5 0.000% 100.057% ( 14000, 22000 ] 3 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 460588 Average: 8.2972 StdDev: 127.18 Min: 1 Median: 1.9511 Max: 15476 Percentiles: P50: 1.95 P75: 2.93 P99: 9.74 P99.9: 988.48 P99.99: 2855.12 ------------------------------------------------------ [ 0, 1 ] 8365 1.816% 1.816% ( 1, 2 ] 233339 50.661% 52.477% ########## ( 2, 3 ] 111534 24.216% 76.693% ##### ( 3, 4 ] 46874 10.177% 86.870% ## ( 4, 6 ] 46193 10.029% 96.899% ## ( 6, 10 ] 10363 2.250% 99.149% ( 10, 15 ] 1635 0.355% 99.504% ( 15, 22 ] 209 0.045% 99.549% ( 22, 34 ] 9 0.002% 99.551% ( 34, 51 ] 21 0.005% 99.556% ( 51, 76 ] 39 0.008% 99.564% ( 76, 110 ] 72 0.016% 99.580% ( 110, 170 ] 297 0.064% 99.644% ( 170, 250 ] 219 0.048% 99.692% ( 250, 380 ] 259 0.056% 99.748% ( 380, 580 ] 319 0.069% 99.817% ( 580, 870 ] 322 0.070% 99.887% ( 870, 1300 ] 212 0.046% 99.933% ( 1300, 1900 ] 132 0.029% 99.962% ( 1900, 2900 ] 135 0.029% 99.991% ( 2900, 4400 ] 169 0.037% 100.028% ( 4400, 6600 ] 73 0.016% 100.044% ( 6600, 9900 ] 19 0.004% 100.048% ( 9900, 14000 ] 1 0.000% 100.048% ( 14000, 22000 ] 2 0.000% 100.049% ** Level 2 read latency histogram (micros): Count: 503073 Average: 16.0346 StdDev: 190.52 Min: 1 Median: 1.9999 Max: 13218 Percentiles: P50: 2.00 P75: 3.06 P99: 14.00 P99.9: 2163.94 P99.99: 3125.59 ------------------------------------------------------ [ 0, 1 ] 10979 2.182% 2.182% ( 1, 2 ] 240589 47.824% 50.006% ########## ( 2, 3 ] 122307 24.312% 74.318% ##### ( 3, 4 ] 53395 10.614% 84.932% ## ( 4, 6 ] 54302 10.794% 95.726% ## ( 6, 10 ] 14170 2.817% 98.543% # ( 10, 15 ] 2876 0.572% 99.114% ( 15, 22 ] 437 0.087% 99.201% ( 22, 34 ] 57 0.011% 99.213% ( 34, 51 ] 41 0.008% 99.221% ( 51, 76 ] 38 0.008% 99.228% ( 76, 110 ] 60 0.012% 99.240% ( 110, 170 ] 198 0.039% 99.280% ( 170, 250 ] 236 0.047% 99.327% ( 250, 380 ] 316 0.063% 99.389% ( 380, 580 ] 501 0.100% 99.489% ( 580, 870 ] 675 0.134% 99.623% ( 870, 1300 ] 715 0.142% 99.765% ( 1300, 1900 ] 542 0.108% 99.873% ( 1900, 2900 ] 515 0.102% 99.975% ( 2900, 4400 ] 490 0.097% 100.073% ( 4400, 6600 ] 154 0.031% 100.103% ( 6600, 9900 ] 28 0.006% 100.109% ( 9900, 14000 ] 4 0.001% 100.110% ** Level 3 read latency histogram (micros): Count: 2491669 Average: 10.9519 StdDev: 153.86 Min: 1 Median: 1.9660 Max: 26744 Percentiles: P50: 1.97 P75: 2.95 P99: 9.70 P99.9: 891.17 P99.99: 1428.42 ------------------------------------------------------ [ 0, 1 ] 37261 1.495% 1.495% ( 1, 2 ] 1251129 50.212% 51.708% ########## ( 2, 3 ] 611481 24.541% 76.249% ##### ( 3, 4 ] 258838 10.388% 86.637% ## ( 4, 6 ] 255673 10.261% 96.898% ## ( 6, 10 ] 56653 2.274% 99.172% ( 10, 15 ] 10026 0.402% 99.574% ( 15, 22 ] 1169 0.047% 99.621% ( 22, 34 ] 111 0.004% 99.626% ( 34, 51 ] 174 0.007% 99.633% ( 51, 76 ] 207 0.008% 99.641% ( 76, 110 ] 245 0.010% 99.651% ( 110, 170 ] 838 0.034% 99.684% ( 170, 250 ] 800 0.032% 99.716% ( 250, 380 ] 1003 0.040% 99.757% ( 380, 580 ] 1506 0.060% 99.817% ( 580, 870 ] 1964 0.079% 99.896% ( 870, 1300 ] 2018 0.081% 99.977% ( 1300, 1900 ] 1513 0.061% 100.038% ( 1900, 2900 ] 1562 0.063% 100.100% ( 2900, 4400 ] 1628 0.065% 100.166% ( 4400, 6600 ] 459 0.018% 100.184% ( 6600, 9900 ] 95 0.004% 100.188% ( 9900, 14000 ] 9 0.000% 100.188% ( 14000, 22000 ] 6 0.000% 100.189% ( 22000, 33000 ] 3 0.000% 100.189% ** Level 4 read latency histogram (micros): Count: 1267075 Average: 22.6454 StdDev: 229.25 Min: 1 Median: 1.9849 Max: 51723 Percentiles: P50: 1.98 P75: 3.01 P99: 465.70 P99.9: 2286.75 P99.99: 3103.17 ------------------------------------------------------ [ 0, 1 ] 18859 1.488% 1.488% ( 1, 2 ] 624087 49.254% 50.743% ########## ( 2, 3 ] 305621 24.120% 74.863% ##### ( 3, 4 ] 128181 10.116% 84.979% ## ( 4, 6 ] 126287 9.967% 94.946% ## ( 6, 10 ] 31607 2.494% 97.440% ( 10, 15 ] 4914 0.388% 97.828% ( 15, 22 ] 545 0.043% 97.871% ( 22, 34 ] 54 0.004% 97.875% ( 34, 51 ] 112 0.009% 97.884% ( 51, 76 ] 120 0.009% 97.894% ( 76, 110 ] 1332 0.105% 97.999% ( 110, 170 ] 4851 0.383% 98.382% ( 170, 250 ] 3550 0.280% 98.662% ( 250, 380 ] 2745 0.217% 98.879% ( 380, 580 ] 3592 0.283% 99.162% ( 580, 870 ] 3890 0.307% 99.469% ( 870, 1300 ] 3047 0.240% 99.709% ( 1300, 1900 ] 1828 0.144% 99.854% ( 1900, 2900 ] 1515 0.120% 99.973% ( 2900, 4400 ] 1560 0.123% 100.096% ( 4400, 6600 ] 415 0.033% 100.129% ( 6600, 9900 ] 67 0.005% 100.134% ( 9900, 14000 ] 2 0.000% 100.135% ( 14000, 22000 ] 5 0.000% 100.135% ( 33000, 50000 ] 3 0.000% 100.135% ( 50000, 75000 ] 2 0.000% 100.135% ** Level 5 read latency histogram (micros): Count: 113136 Average: 676.0435 StdDev: 1009.00 Min: 75 Median: 309.0771 Max: 42088 Percentiles: P50: 309.08 P75: 742.77 P99: 5241.57 P99.9: 8575.12 P99.99: 12477.31 ------------------------------------------------------ ( 51, 76 ] 5 0.004% 0.004% ( 76, 110 ] 7020 6.205% 6.209% # ( 110, 170 ] 26351 23.291% 29.501% ##### ( 170, 250 ] 17377 15.359% 44.860% ### ( 250, 380 ] 12796 11.310% 56.170% ## ( 380, 580 ] 14253 12.598% 68.769% ### ( 580, 870 ] 12561 11.103% 79.871% ## ( 870, 1300 ] 8734 7.720% 87.591% ## ( 1300, 1900 ] 4760 4.207% 91.798% # ( 1900, 2900 ] 3713 3.282% 95.080% # ( 2900, 4400 ] 3888 3.437% 98.517% # ( 4400, 6600 ] 1429 1.263% 99.780% ( 6600, 9900 ] 227 0.201% 99.981% ( 9900, 14000 ] 17 0.015% 99.996% ( 14000, 22000 ] 5 0.004% 100.000% ( 22000, 33000 ] 3 0.003% 100.003% ( 33000, 50000 ] 2 0.002% 100.004% ** DB Stats ** Uptime(secs): 26.9 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 182.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.906 H:M:S, 29.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/22-12:11:13 ... thread 0: (1000000,6000000) ops and (186143.3,186669.7) ops/second in (5.372206,32.142327) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 2.89 GB 138.5 5.0 0.0 5.0 10.6 5.7 0.0 1.9 99.4 212.2 51.32 35.91 99 0.518 5180K 7224 0.0 0.0 L1 11/0 1.16 GB 119.2 3.6 2.9 0.7 3.6 2.9 0.0 1.2 131.9 131.4 27.79 17.69 5 5.557 3722K 14K 0.0 0.0 L2 5/4 490.90 MB 1.3 0.4 0.4 0.0 0.4 0.4 1.3 1.1 168.1 167.9 2.38 1.80 2 1.190 406K 459 0.0 0.0 L3 17/5 953.54 MB 0.8 6.8 2.9 3.9 6.8 2.9 0.5 2.3 120.9 120.0 57.66 32.17 28 2.059 4199K 7307 0.0 0.0 L4 173/0 9.48 GB 1.0 11.2 6.4 4.8 11.0 6.2 0.6 1.7 126.0 124.3 90.77 52.45 67 1.355 7440K 34K 0.0 0.0 L5 1160/0 95.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1381/16 110.42 GB 0.0 26.9 12.5 14.4 32.4 18.0 9.4 5.7 119.9 144.2 229.91 140.03 201 1.144 20M 63K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.9 12.5 14.4 32.4 18.0 9.4 5.7 119.9 144.2 229.91 140.03 201 1.144 20M 63K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.9 12.5 14.4 26.7 12.3 0.0 0.0 137.0 135.8 201.34 123.90 119 1.692 20M 63K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 202.9 28.57 16.13 82 0.348 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.3 total, 32.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.37 GB write, 1025.83 MB/s write, 26.93 GB read, 853.48 MB/s read, 229.9 seconds Interval compaction: 32.37 GB write, 1031.11 MB/s write, 26.93 GB read, 857.88 MB/s read, 229.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 66, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2164095 Average: 9.4857 StdDev: 95.00 Min: 0 Median: 1.7001 Max: 16454 Percentiles: P50: 1.70 P75: 2.49 P99: 165.89 P99.9: 792.47 P99.99: 1443.63 ------------------------------------------------------ [ 0, 1 ] 238335 11.013% 11.013% ## ( 1, 2 ] 1205117 55.687% 66.700% ########### ( 2, 3 ] 366201 16.922% 83.622% ### ( 3, 4 ] 145673 6.731% 90.353% # ( 4, 6 ] 129947 6.005% 96.358% # ( 6, 10 ] 28237 1.305% 97.663% ( 10, 15 ] 4604 0.213% 97.875% ( 15, 22 ] 667 0.031% 97.906% ( 22, 34 ] 79 0.004% 97.910% ( 34, 51 ] 33 0.002% 97.911% ( 51, 76 ] 57 0.003% 97.914% ( 76, 110 ] 5615 0.259% 98.173% ( 110, 170 ] 19203 0.887% 99.061% ( 170, 250 ] 8678 0.401% 99.462% ( 250, 380 ] 4246 0.196% 99.658% ( 380, 580 ] 3682 0.170% 99.828% ( 580, 870 ] 2125 0.098% 99.926% ( 870, 1300 ] 1235 0.057% 99.983% ( 1300, 1900 ] 604 0.028% 100.011% ( 1900, 2900 ] 483 0.022% 100.034% ( 2900, 4400 ] 414 0.019% 100.053% ( 4400, 6600 ] 124 0.006% 100.058% ( 6600, 9900 ] 18 0.001% 100.059% ( 9900, 14000 ] 5 0.000% 100.059% ( 14000, 22000 ] 3 0.000% 100.060% ** Level 1 read latency histogram (micros): Count: 478876 Average: 8.4258 StdDev: 125.63 Min: 1 Median: 1.9498 Max: 15476 Percentiles: P50: 1.95 P75: 2.93 P99: 9.87 P99.9: 980.43 P99.99: 2747.54 ------------------------------------------------------ [ 0, 1 ] 8604 1.797% 1.797% ( 1, 2 ] 243033 50.751% 52.547% ########## ( 2, 3 ] 115899 24.202% 76.750% ##### ( 3, 4 ] 48572 10.143% 86.893% ## ( 4, 6 ] 47681 9.957% 96.849% ## ( 6, 10 ] 10651 2.224% 99.074% ( 10, 15 ] 1654 0.345% 99.419% ( 15, 22 ] 217 0.045% 99.464% ( 22, 34 ] 10 0.002% 99.466% ( 34, 51 ] 21 0.004% 99.471% ( 51, 76 ] 39 0.008% 99.479% ( 76, 110 ] 131 0.027% 99.506% ( 110, 170 ] 463 0.097% 99.603% ( 170, 250 ] 307 0.064% 99.667% ( 250, 380 ] 321 0.067% 99.734% ( 380, 580 ] 380 0.079% 99.814% ( 580, 870 ] 356 0.074% 99.888% ( 870, 1300 ] 238 0.050% 99.938% ( 1300, 1900 ] 138 0.029% 99.966% ( 1900, 2900 ] 137 0.029% 99.995% ( 2900, 4400 ] 170 0.035% 100.030% ( 4400, 6600 ] 73 0.015% 100.046% ( 6600, 9900 ] 19 0.004% 100.050% ( 9900, 14000 ] 1 0.000% 100.050% ( 14000, 22000 ] 2 0.000% 100.050% ** Level 2 read latency histogram (micros): Count: 503256 Average: 16.1027 StdDev: 190.60 Min: 1 Median: 2.0005 Max: 13218 Percentiles: P50: 2.00 P75: 3.07 P99: 14.31 P99.9: 2165.52 P99.99: 3128.13 ------------------------------------------------------ [ 0, 1 ] 10979 2.182% 2.182% ( 1, 2 ] 240589 47.806% 49.988% ########## ( 2, 3 ] 122307 24.303% 74.291% ##### ( 3, 4 ] 53395 10.610% 84.901% ## ( 4, 6 ] 54302 10.790% 95.691% ## ( 6, 10 ] 14170 2.816% 98.507% # ( 10, 15 ] 2876 0.571% 99.078% ( 15, 22 ] 437 0.087% 99.165% ( 22, 34 ] 57 0.011% 99.177% ( 34, 51 ] 41 0.008% 99.185% ( 51, 76 ] 38 0.008% 99.192% ( 76, 110 ] 89 0.018% 99.210% ( 110, 170 ] 292 0.058% 99.268% ( 170, 250 ] 266 0.053% 99.321% ( 250, 380 ] 333 0.066% 99.387% ( 380, 580 ] 510 0.101% 99.488% ( 580, 870 ] 678 0.135% 99.623% ( 870, 1300 ] 715 0.142% 99.765% ( 1300, 1900 ] 542 0.108% 99.873% ( 1900, 2900 ] 515 0.102% 99.975% ( 2900, 4400 ] 491 0.098% 100.073% ( 4400, 6600 ] 154 0.031% 100.103% ( 6600, 9900 ] 28 0.006% 100.109% ( 9900, 14000 ] 4 0.001% 100.110% ** Level 3 read latency histogram (micros): Count: 2506175 Average: 11.0285 StdDev: 153.54 Min: 1 Median: 1.9671 Max: 26744 Percentiles: P50: 1.97 P75: 2.95 P99: 9.80 P99.9: 889.70 P99.99: 1427.76 ------------------------------------------------------ [ 0, 1 ] 37331 1.490% 1.490% ( 1, 2 ] 1257151 50.162% 51.652% ########## ( 2, 3 ] 614954 24.538% 76.189% ##### ( 3, 4 ] 260324 10.387% 86.577% ## ( 4, 6 ] 257107 10.259% 96.835% ## ( 6, 10 ] 57073 2.277% 99.113% ( 10, 15 ] 10071 0.402% 99.515% ( 15, 22 ] 1186 0.047% 99.562% ( 22, 34 ] 112 0.004% 99.566% ( 34, 51 ] 174 0.007% 99.573% ( 51, 76 ] 207 0.008% 99.582% ( 76, 110 ] 474 0.019% 99.601% ( 110, 170 ] 1599 0.064% 99.664% ( 170, 250 ] 1072 0.043% 99.707% ( 250, 380 ] 1133 0.045% 99.752% ( 380, 580 ] 1600 0.064% 99.816% ( 580, 870 ] 2008 0.080% 99.896% ( 870, 1300 ] 2026 0.081% 99.977% ( 1300, 1900 ] 1514 0.060% 100.038% ( 1900, 2900 ] 1563 0.062% 100.100% ( 2900, 4400 ] 1628 0.065% 100.165% ( 4400, 6600 ] 459 0.018% 100.183% ( 6600, 9900 ] 95 0.004% 100.187% ( 9900, 14000 ] 9 0.000% 100.187% ( 14000, 22000 ] 6 0.000% 100.188% ( 22000, 33000 ] 3 0.000% 100.188% ** Level 4 read latency histogram (micros): Count: 1280264 Average: 24.3465 StdDev: 229.29 Min: 1 Median: 1.9954 Max: 51723 Percentiles: P50: 2.00 P75: 3.09 P99: 492.47 P99.9: 2287.11 P99.99: 3107.70 ------------------------------------------------------ [ 0, 1 ] 18859 1.473% 1.473% ( 1, 2 ] 624116 48.749% 50.222% ########## ( 2, 3 ] 305743 23.881% 74.103% ##### ( 3, 4 ] 128247 10.017% 84.121% ## ( 4, 6 ] 126399 9.873% 93.993% ## ( 6, 10 ] 31620 2.470% 96.463% ( 10, 15 ] 4918 0.384% 96.847% ( 15, 22 ] 545 0.043% 96.890% ( 22, 34 ] 54 0.004% 96.894% ( 34, 51 ] 112 0.009% 96.903% ( 51, 76 ] 120 0.009% 96.912% ( 76, 110 ] 3346 0.261% 97.174% ( 110, 170 ] 11280 0.881% 98.055% ( 170, 250 ] 5946 0.464% 98.519% ( 250, 380 ] 3722 0.291% 98.810% ( 380, 580 ] 4329 0.338% 99.148% ( 580, 870 ] 4114 0.321% 99.469% ( 870, 1300 ] 3087 0.241% 99.710% ( 1300, 1900 ] 1836 0.143% 99.854% ( 1900, 2900 ] 1526 0.119% 99.973% ( 2900, 4400 ] 1567 0.122% 100.095% ( 4400, 6600 ] 415 0.032% 100.128% ( 6600, 9900 ] 67 0.005% 100.133% ( 9900, 14000 ] 2 0.000% 100.133% ( 14000, 22000 ] 5 0.000% 100.134% ( 33000, 50000 ] 3 0.000% 100.134% ( 50000, 75000 ] 2 0.000% 100.134% ** Level 5 read latency histogram (micros): Count: 180579 Average: 495.6706 StdDev: 837.53 Min: 73 Median: 203.7968 Max: 42088 Percentiles: P50: 203.80 P75: 489.54 P99: 4349.34 P99.9: 7536.52 P99.99: 9899.16 ------------------------------------------------------ ( 51, 76 ] 14 0.008% 0.008% ( 76, 110 ] 17696 9.800% 9.807% ## ( 110, 170 ] 59953 33.200% 43.008% ####### ( 170, 250 ] 29888 16.551% 59.559% ### ( 250, 380 ] 17864 9.893% 69.452% ## ( 380, 580 ] 18293 10.130% 79.582% ## ( 580, 870 ] 13728 7.602% 87.184% ## ( 870, 1300 ] 8977 4.971% 92.155% # ( 1300, 1900 ] 4815 2.666% 94.822% # ( 1900, 2900 ] 3775 2.090% 96.912% ( 2900, 4400 ] 3902 2.161% 99.073% ( 4400, 6600 ] 1429 0.791% 99.864% ( 6600, 9900 ] 227 0.126% 99.990% ( 9900, 14000 ] 17 0.009% 99.999% ( 14000, 22000 ] 5 0.003% 100.002% ( 22000, 33000 ] 3 0.002% 100.004% ( 33000, 50000 ] 2 0.001% 100.005% ** DB Stats ** Uptime(secs): 32.3 total, 5.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 182.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.662 H:M:S, 29.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 183.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.756 H:M:S, 32.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/07/22-12:11:18 ... thread 0: (1000000,7000000) ops and (196648.5,188032.8) ops/second in (5.085216,37.227543) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/7 3.87 GB 239.2 6.0 0.0 6.0 12.6 6.6 0.0 1.9 103.7 219.0 58.93 42.45 119 0.495 6204K 8175 0.0 0.0 L1 11/0 1.16 GB 119.2 3.6 2.9 0.7 3.6 2.9 0.0 1.2 131.9 131.4 27.79 17.69 5 5.557 3722K 14K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.4 0.0 0.4 0.4 1.3 1.1 168.1 167.9 2.38 1.80 2 1.190 406K 459 0.0 0.0 L3 16/0 984.99 MB 1.0 7.6 3.4 4.2 7.6 3.4 0.5 2.2 125.5 124.6 62.04 35.87 33 1.880 5028K 9981 0.0 0.0 L4 177/0 9.64 GB 1.0 12.7 6.7 6.0 12.5 6.5 0.7 1.9 131.5 129.7 98.74 59.33 72 1.371 9014K 62K 0.0 0.0 L5 1164/0 95.73 GB 1.0 0.0 0.0 0.0 0.0 0.0 7.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1387/7 111.37 GB 0.0 30.2 13.3 16.9 36.6 19.7 9.8 5.5 123.9 150.1 249.87 157.14 231 1.082 24M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.2 13.3 16.9 36.6 19.7 9.8 5.5 123.9 150.1 249.87 157.14 231 1.082 24M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.2 13.3 16.9 30.0 13.1 0.0 0.0 142.2 141.0 217.61 138.29 133 1.636 24M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 210.9 32.26 18.85 98 0.329 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.4 total, 37.2 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.61 GB write, 1002.65 MB/s write, 30.22 GB read, 827.64 MB/s read, 249.9 seconds Interval compaction: 36.61 GB write, 1007.10 MB/s write, 30.22 GB read, 831.32 MB/s read, 249.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 66, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2654784 Average: 9.5968 StdDev: 91.27 Min: 0 Median: 1.7033 Max: 16454 Percentiles: P50: 1.70 P75: 2.50 P99: 168.94 P99.9: 779.00 P99.99: 1317.35 ------------------------------------------------------ [ 0, 1 ] 283385 10.675% 10.675% ## ( 1, 2 ] 1484385 55.914% 66.588% ########### ( 2, 3 ] 449611 16.936% 83.524% ### ( 3, 4 ] 179469 6.760% 90.284% # ( 4, 6 ] 159406 6.004% 96.289% # ( 6, 10 ] 32928 1.240% 97.529% ( 10, 15 ] 5242 0.197% 97.726% ( 15, 22 ] 727 0.027% 97.754% ( 22, 34 ] 89 0.003% 97.757% ( 34, 51 ] 43 0.002% 97.759% ( 51, 76 ] 61 0.002% 97.761% ( 76, 110 ] 7492 0.282% 98.043% ( 110, 170 ] 25854 0.974% 99.017% ( 170, 250 ] 11163 0.420% 99.438% ( 250, 380 ] 5541 0.209% 99.646% ( 380, 580 ] 4817 0.181% 99.828% ( 580, 870 ] 2794 0.105% 99.933% ( 870, 1300 ] 1493 0.056% 99.989% ( 1300, 1900 ] 675 0.025% 100.015% ( 1900, 2900 ] 554 0.021% 100.036% ( 2900, 4400 ] 465 0.018% 100.053% ( 4400, 6600 ] 130 0.005% 100.058% ( 6600, 9900 ] 18 0.001% 100.059% ( 9900, 14000 ] 5 0.000% 100.059% ( 14000, 22000 ] 3 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 586531 Average: 8.3387 StdDev: 119.05 Min: 1 Median: 1.9477 Max: 15476 Percentiles: P50: 1.95 P75: 2.92 P99: 9.99 P99.9: 865.82 P99.99: 2288.97 ------------------------------------------------------ [ 0, 1 ] 9914 1.690% 1.690% ( 1, 2 ] 298994 50.977% 52.667% ########## ( 2, 3 ] 142238 24.251% 76.918% ##### ( 3, 4 ] 58642 9.998% 86.916% ## ( 4, 6 ] 57625 9.825% 96.740% ## ( 6, 10 ] 13276 2.263% 99.004% ( 10, 15 ] 1926 0.328% 99.332% ( 15, 22 ] 244 0.042% 99.374% ( 22, 34 ] 14 0.002% 99.376% ( 34, 51 ] 34 0.006% 99.382% ( 51, 76 ] 51 0.009% 99.391% ( 76, 110 ] 214 0.036% 99.427% ( 110, 170 ] 845 0.144% 99.571% ( 170, 250 ] 494 0.084% 99.656% ( 250, 380 ] 465 0.079% 99.735% ( 380, 580 ] 522 0.089% 99.824% ( 580, 870 ] 453 0.077% 99.901% ( 870, 1300 ] 287 0.049% 99.950% ( 1300, 1900 ] 169 0.029% 99.979% ( 1900, 2900 ] 168 0.029% 100.008% ( 2900, 4400 ] 192 0.033% 100.040% ( 4400, 6600 ] 76 0.013% 100.053% ( 6600, 9900 ] 19 0.003% 100.056% ( 9900, 14000 ] 1 0.000% 100.057% ( 14000, 22000 ] 2 0.000% 100.057% ** Level 2 read latency histogram (micros): Count: 503361 Average: 16.1798 StdDev: 190.90 Min: 1 Median: 2.0009 Max: 13218 Percentiles: P50: 2.00 P75: 3.07 P99: 14.49 P99.9: 2174.49 P99.99: 3138.38 ------------------------------------------------------ [ 0, 1 ] 10979 2.181% 2.181% ( 1, 2 ] 240589 47.797% 49.978% ########## ( 2, 3 ] 122307 24.298% 74.276% ##### ( 3, 4 ] 53395 10.608% 84.883% ## ( 4, 6 ] 54302 10.788% 95.671% ## ( 6, 10 ] 14170 2.815% 98.486% # ( 10, 15 ] 2876 0.571% 99.058% ( 15, 22 ] 437 0.087% 99.145% ( 22, 34 ] 57 0.011% 99.156% ( 34, 51 ] 41 0.008% 99.164% ( 51, 76 ] 38 0.008% 99.172% ( 76, 110 ] 97 0.019% 99.191% ( 110, 170 ] 329 0.065% 99.256% ( 170, 250 ] 293 0.058% 99.314% ( 250, 380 ] 345 0.069% 99.383% ( 380, 580 ] 520 0.103% 99.486% ( 580, 870 ] 684 0.136% 99.622% ( 870, 1300 ] 715 0.142% 99.764% ( 1300, 1900 ] 542 0.108% 99.872% ( 1900, 2900 ] 516 0.103% 99.974% ( 2900, 4400 ] 495 0.098% 100.073% ( 4400, 6600 ] 154 0.031% 100.103% ( 6600, 9900 ] 28 0.006% 100.109% ( 9900, 14000 ] 4 0.001% 100.110% ** Level 3 read latency histogram (micros): Count: 2660132 Average: 10.6873 StdDev: 149.49 Min: 1 Median: 1.9606 Max: 26744 Percentiles: P50: 1.96 P75: 2.94 P99: 9.78 P99.9: 867.76 P99.99: 1423.22 ------------------------------------------------------ [ 0, 1 ] 40680 1.529% 1.529% ( 1, 2 ] 1342228 50.457% 51.986% ########## ( 2, 3 ] 650895 24.469% 76.455% ##### ( 3, 4 ] 274107 10.304% 86.759% ## ( 4, 6 ] 269787 10.142% 96.901% ## ( 6, 10 ] 59011 2.218% 99.119% ( 10, 15 ] 10276 0.386% 99.506% ( 15, 22 ] 1204 0.045% 99.551% ( 22, 34 ] 120 0.005% 99.556% ( 34, 51 ] 196 0.007% 99.563% ( 51, 76 ] 217 0.008% 99.571% ( 76, 110 ] 549 0.021% 99.592% ( 110, 170 ] 1878 0.071% 99.662% ( 170, 250 ] 1263 0.047% 99.710% ( 250, 380 ] 1256 0.047% 99.757% ( 380, 580 ] 1735 0.065% 99.822% ( 580, 870 ] 2086 0.078% 99.901% ( 870, 1300 ] 2065 0.078% 99.978% ( 1300, 1900 ] 1524 0.057% 100.036% ( 1900, 2900 ] 1578 0.059% 100.095% ( 2900, 4400 ] 1638 0.062% 100.156% ( 4400, 6600 ] 459 0.017% 100.174% ( 6600, 9900 ] 95 0.004% 100.177% ( 9900, 14000 ] 9 0.000% 100.178% ( 14000, 22000 ] 6 0.000% 100.178% ( 22000, 33000 ] 3 0.000% 100.178% ** Level 4 read latency histogram (micros): Count: 1597145 Average: 22.0702 StdDev: 209.76 Min: 1 Median: 1.9782 Max: 51723 Percentiles: P50: 1.98 P75: 3.02 P99: 432.44 P99.9: 1944.94 P99.99: 2831.70 ------------------------------------------------------ [ 0, 1 ] 24650 1.543% 1.543% ( 1, 2 ] 791156 49.536% 51.079% ########## ( 2, 3 ] 379081 23.735% 74.814% ##### ( 3, 4 ] 156045 9.770% 84.584% ## ( 4, 6 ] 152433 9.544% 94.128% ## ( 6, 10 ] 39326 2.462% 96.591% ( 10, 15 ] 5632 0.353% 96.943% ( 15, 22 ] 636 0.040% 96.983% ( 22, 34 ] 61 0.004% 96.987% ( 34, 51 ] 132 0.008% 96.995% ( 51, 76 ] 125 0.008% 97.003% ( 76, 110 ] 4038 0.253% 97.256% ( 110, 170 ] 13993 0.876% 98.132% ( 170, 250 ] 7574 0.474% 98.606% ( 250, 380 ] 4856 0.304% 98.910% ( 380, 580 ] 5479 0.343% 99.253% ( 580, 870 ] 4872 0.305% 99.558% ( 870, 1300 ] 3444 0.216% 99.774% ( 1300, 1900 ] 1943 0.122% 99.896% ( 1900, 2900 ] 1621 0.101% 99.997% ( 2900, 4400 ] 1628 0.102% 100.099% ( 4400, 6600 ] 420 0.026% 100.125% ( 6600, 9900 ] 68 0.004% 100.129% ( 9900, 14000 ] 2 0.000% 100.130% ( 14000, 22000 ] 5 0.000% 100.130% ( 33000, 50000 ] 3 0.000% 100.130% ( 50000, 75000 ] 2 0.000% 100.130% ** Level 5 read latency histogram (micros): Count: 218068 Average: 468.5102 StdDev: 785.05 Min: 73 Median: 201.3047 Max: 42088 Percentiles: P50: 201.30 P75: 468.55 P99: 4223.20 P99.9: 7002.51 P99.99: 9830.73 ------------------------------------------------------ ( 51, 76 ] 16 0.007% 0.007% ( 76, 110 ] 21092 9.672% 9.680% ## ( 110, 170 ] 73635 33.767% 43.447% ####### ( 170, 250 ] 36521 16.748% 60.194% ### ( 250, 380 ] 22312 10.232% 70.426% ## ( 380, 580 ] 22530 10.332% 80.757% ## ( 580, 870 ] 16505 7.569% 88.326% ## ( 870, 1300 ] 10280 4.714% 93.040% # ( 1300, 1900 ] 5202 2.385% 95.426% ( 1900, 2900 ] 4152 1.904% 97.330% ( 2900, 4400 ] 4129 1.893% 99.223% ( 4400, 6600 ] 1448 0.664% 99.887% ( 6600, 9900 ] 229 0.105% 99.992% ( 9900, 14000 ] 17 0.008% 100.000% ( 14000, 22000 ] 5 0.002% 100.002% ( 22000, 33000 ] 3 0.001% 100.004% ( 33000, 50000 ] 2 0.001% 100.005% ** DB Stats ** Uptime(secs): 37.4 total, 5.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 184.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.006 H:M:S, 29.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.343 H:M:S, 26.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 321.174 micros/op 12444 ops/sec 60.107 seconds 747996 operations; 12.1 MB/s (180999 of 180999 found) Microseconds per read: Count: 747996 Average: 321.1768 StdDev: 914.00 Min: 2 Median: 185.8735 Max: 70882 Percentiles: P50: 185.87 P75: 266.07 P99: 2750.60 P99.9: 15535.95 P99.99: 31546.81 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 39 0.005% 0.007% ( 3, 4 ] 40 0.005% 0.012% ( 4, 6 ] 71 0.009% 0.022% ( 6, 10 ] 424 0.057% 0.078% ( 10, 15 ] 4091 0.547% 0.625% ( 15, 22 ] 3866 0.517% 1.142% ( 22, 34 ] 6266 0.838% 1.980% ( 34, 51 ] 3182 0.425% 2.405% ( 51, 76 ] 307 0.041% 2.446% ( 76, 110 ] 17750 2.373% 4.819% ( 110, 170 ] 294421 39.361% 44.180% ######## ( 170, 250 ] 219385 29.330% 73.510% ###### ( 250, 380 ] 90151 12.052% 85.562% ## ( 380, 580 ] 48001 6.417% 91.980% # ( 580, 870 ] 27274 3.646% 95.626% # ( 870, 1300 ] 14650 1.959% 97.585% ( 1300, 1900 ] 6676 0.893% 98.477% ( 1900, 2900 ] 4598 0.615% 99.092% ( 2900, 4400 ] 3901 0.522% 99.613% ( 4400, 6600 ] 1271 0.170% 99.783% ( 6600, 9900 ] 358 0.048% 99.831% ( 9900, 14000 ] 400 0.053% 99.885% ( 14000, 22000 ] 599 0.080% 99.965% ( 22000, 33000 ] 218 0.029% 99.994% ( 33000, 50000 ] 34 0.005% 99.998% ( 50000, 75000 ] 12 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12947166 rocksdb.bloom.filter.full.positive COUNT : 873570 rocksdb.bloom.filter.full.true.positive COUNT : 747625 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 371 rocksdb.memtable.miss COUNT : 747625 rocksdb.l0.hit COUNT : 29438 rocksdb.l1.hit COUNT : 6387 rocksdb.l2andup.hit COUNT : 711800 rocksdb.compaction.key.drop.new COUNT : 284575 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 7567797 rocksdb.number.keys.read COUNT : 747996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7809966504 rocksdb.bytes.read COUNT : 747996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1847 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31071171 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36274743630 rocksdb.compact.write.bytes COUNT : 35972900694 rocksdb.flush.write.bytes COUNT : 7795032359 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 1602 rocksdb.number.superversion_releases COUNT : 1560 rocksdb.number.superversion_cleanups COUNT : 400 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 467 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7731911680 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2753536 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 39580847864 rocksdb.non.last.level.read.count COUNT : 9422854 rocksdb.block.checksum.compute.count COUNT : 9667487 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 184.357337 P95 : 819.353495 P99 : 2749.508482 P100 : 70880.000000 COUNT : 747996 SUM : 239569618 rocksdb.db.write.micros P50 : 1.554785 P95 : 4.132203 P99 : 7.944439 P100 : 934240.000000 COUNT : 7567797 SUM : 50088808 rocksdb.compaction.times.micros P50 : 1326595.744681 P95 : 4410000.000000 P99 : 12446000.000000 P100 : 22167144.000000 COUNT : 137 SUM : 246436274 rocksdb.compaction.times.cpu_micros P50 : 857410.714286 P95 : 3110000.000000 P99 : 7539500.000000 P100 : 8444987.000000 COUNT : 137 SUM : 153307865 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 977.500000 P95 : 46600.000000 P99 : 109066.666667 P100 : 188662.000000 COUNT : 108 SUM : 876109 rocksdb.compaction.outfile.sync.micros P50 : 11077.659574 P95 : 168428.571429 P99 : 329950.000000 P100 : 422894.000000 COUNT : 431 SUM : 15791304 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 267.727273 P95 : 4228.571429 P99 : 7876.000000 P100 : 56965.000000 COUNT : 284 SUM : 342273 rocksdb.table.open.io.micros P50 : 8810.131579 P95 : 20200.000000 P99 : 25743.928571 P100 : 31798.000000 COUNT : 1847 SUM : 16164723 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.929267 P95 : 9.481352 P99 : 156.446681 P100 : 51730.000000 COUNT : 8782898 SUM : 114361608 rocksdb.read.block.get.micros P50 : 145.511030 P95 : 710.195655 P99 : 2519.984136 P100 : 44567.000000 COUNT : 882742 SUM : 209946299 rocksdb.write.raw.block.micros P50 : 0.523131 P95 : 0.993949 P99 : 3.172538 P100 : 49539.000000 COUNT : 10600925 SUM : 31581696 rocksdb.numfiles.in.singlecompaction P50 : 2.658537 P95 : 7.422222 P99 : 13.100000 P100 : 22.000000 COUNT : 176 SUM : 606 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.572446 P95 : 1216.901435 P99 : 2588.749715 P100 : 934055.000000 COUNT : 138770 SUM : 31085864 rocksdb.sst.read.micros P50 : 1.941104 P95 : 150.213127 P99 : 509.936123 P100 : 51723.000000 COUNT : 9422897 SUM : 301045040 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 747996 SUM : 747996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 7567797 SUM : 7809966504 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 227297.297297 P95 : 937714.285714 P99 : 1147542.857143 P100 : 1188199.000000 COUNT : 108 SUM : 34216056 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 467 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0