[2024-07-15 23:25:13.481904] Starting SPDK v24.09-pre git sha1 0663932f5 / DPDK 24.03.0 initialization... [2024-07-15 23:25:13.482223] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630925 ] Set seed to 1721078713474579 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 23:25:13.627650] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 23:25:13.849595] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 23:25:13.849648] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1630925' to capture a snapshot of events at runtime. [2024-07-15 23:25:13.849661] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 23:25:13.849674] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 23:25:13.849684] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1630925 for offline analysis/debug. [2024-07-15 23:25:13.849789] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 23:25:17 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-23:25:22 ... thread 0: (1000000,1000000) ops and (195728.7,195728.7) ops/second in (5.109112,5.109112) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.51 GB 56.3 0.6 0.0 0.6 1.3 0.8 0.0 1.7 80.1 195.4 7.07 4.78 14 0.505 574K 3075 0.0 0.0 L1 5/5 643.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 10/9 1.15 GB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 24/10 1.57 GB 1.0 2.4 1.4 1.0 2.3 1.3 0.0 1.6 153.2 146.9 16.05 11.97 9 1.783 547K 0 0.0 0.0 L4 133/11 10.21 GB 1.0 0.3 0.1 0.1 0.3 0.1 0.5 1.8 103.4 94.7 2.83 1.71 2 1.414 154K 0 0.0 0.0 L5 116/0 9.10 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 300/45 24.19 GB 0.0 3.2 1.6 1.7 3.9 2.2 0.5 4.9 127.9 154.4 25.94 18.45 25 1.038 1276K 3075 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.6 1.7 3.9 2.2 0.5 4.9 127.9 154.4 25.94 18.45 25 1.038 1276K 3075 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.6 1.7 3.1 1.4 0.0 0.0 155.0 148.9 21.41 15.95 13 1.647 1276K 3075 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 180.2 4.54 2.50 12 0.378 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.2 total, 5.1 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.91 GB write, 770.23 MB/s write, 3.24 GB read, 637.87 MB/s read, 25.9 seconds Interval compaction: 3.91 GB write, 783.52 MB/s write, 3.24 GB read, 648.88 MB/s read, 25.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 159832 Average: 46.7896 StdDev: 410.49 Min: 1 Median: 1.9561 Max: 47784 Percentiles: P50: 1.96 P75: 2.93 P99: 837.38 P99.9: 3928.55 P99.99: 5976.18 ------------------------------------------------------ [ 0, 1 ] 4888 3.058% 3.058% # ( 1, 2 ] 78476 49.099% 52.157% ########## ( 2, 3 ] 39185 24.516% 76.674% ##### ( 3, 4 ] 13411 8.391% 85.064% ## ( 4, 6 ] 11786 7.374% 92.438% # ( 6, 10 ] 2358 1.475% 93.914% ( 10, 15 ] 377 0.236% 94.149% ( 15, 22 ] 49 0.031% 94.180% ( 22, 34 ] 27 0.017% 94.197% ( 34, 51 ] 32 0.020% 94.217% ( 51, 76 ] 13 0.008% 94.225% ( 76, 110 ] 12 0.008% 94.233% ( 110, 170 ] 251 0.157% 94.390% ( 170, 250 ] 1322 0.827% 95.217% ( 250, 380 ] 2189 1.370% 96.586% ( 380, 580 ] 2443 1.528% 98.115% ( 580, 870 ] 1594 0.997% 99.112% ( 870, 1300 ] 555 0.347% 99.459% ( 1300, 1900 ] 202 0.126% 99.586% ( 1900, 2900 ] 304 0.190% 99.776% ( 2900, 4400 ] 289 0.181% 99.957% ( 4400, 6600 ] 74 0.046% 100.003% ( 6600, 9900 ] 17 0.011% 100.014% ( 9900, 14000 ] 13 0.008% 100.022% ( 14000, 22000 ] 9 0.006% 100.028% ( 22000, 33000 ] 5 0.003% 100.031% ( 33000, 50000 ] 5 0.003% 100.034% ** Level 1 read latency histogram (micros): Count: 721 Average: 862.0624 StdDev: 1536.24 Min: 122 Median: 443.5802 Max: 19976 Percentiles: P50: 443.58 P75: 752.88 P99: 8858.14 P99.9: 16232.00 P99.99: 19976.00 ------------------------------------------------------ ( 110, 170 ] 17 2.358% 2.358% ( 170, 250 ] 102 14.147% 16.505% ### ( 250, 380 ] 190 26.352% 42.857% ##### ( 380, 580 ] 162 22.469% 65.326% #### ( 580, 870 ] 117 16.227% 81.553% ### ( 870, 1300 ] 47 6.519% 88.072% # ( 1300, 1900 ] 18 2.497% 90.569% ( 1900, 2900 ] 27 3.745% 94.313% # ( 2900, 4400 ] 21 2.913% 97.226% # ( 4400, 6600 ] 8 1.110% 98.336% ( 6600, 9900 ] 7 0.971% 99.307% ( 9900, 14000 ] 4 0.555% 99.861% ( 14000, 22000 ] 1 0.139% 100.000% ** Level 2 read latency histogram (micros): Count: 469132 Average: 11.5729 StdDev: 227.52 Min: 1 Median: 2.2169 Max: 41993 Percentiles: P50: 2.22 P75: 3.10 P99: 13.77 P99.9: 735.15 P99.99: 1204.40 ------------------------------------------------------ [ 0, 1 ] 4533 0.966% 0.966% ( 1, 2 ] 198896 42.397% 43.363% ######## ( 2, 3 ] 143584 30.606% 73.969% ###### ( 3, 4 ] 48848 10.412% 84.382% ## ( 4, 6 ] 51837 11.050% 95.431% ## ( 6, 10 ] 14003 2.985% 98.416% # ( 10, 15 ] 3636 0.775% 99.191% ( 15, 22 ] 491 0.105% 99.296% ( 22, 34 ] 97 0.021% 99.316% ( 34, 51 ] 112 0.024% 99.340% ( 51, 76 ] 98 0.021% 99.361% ( 76, 110 ] 41 0.009% 99.370% ( 110, 170 ] 90 0.019% 99.389% ( 170, 250 ] 468 0.100% 99.489% ( 250, 380 ] 808 0.172% 99.661% ( 380, 580 ] 840 0.179% 99.840% ( 580, 870 ] 525 0.112% 99.952% ( 870, 1300 ] 229 0.049% 100.001% ( 1300, 1900 ] 137 0.029% 100.030% ( 1900, 2900 ] 188 0.040% 100.070% ( 2900, 4400 ] 156 0.033% 100.103% ( 4400, 6600 ] 47 0.010% 100.113% ( 6600, 9900 ] 50 0.011% 100.124% ( 9900, 14000 ] 15 0.003% 100.127% ( 14000, 22000 ] 17 0.004% 100.131% ( 22000, 33000 ] 5 0.001% 100.132% ( 33000, 50000 ] 3 0.001% 100.133% ** Level 3 read latency histogram (micros): Count: 314335 Average: 14.1049 StdDev: 293.47 Min: 1 Median: 2.2041 Max: 56936 Percentiles: P50: 2.20 P75: 3.03 P99: 14.71 P99.9: 1153.11 P99.99: 2450.12 ------------------------------------------------------ [ 0, 1 ] 3329 1.059% 1.059% ( 1, 2 ] 133981 42.624% 43.683% ######### ( 2, 3 ] 97288 30.950% 74.633% ###### ( 3, 4 ] 33276 10.586% 85.219% ## ( 4, 6 ] 33493 10.655% 95.874% ## ( 6, 10 ] 8141 2.590% 98.464% # ( 10, 15 ] 1789 0.569% 99.034% ( 15, 22 ] 243 0.077% 99.111% ( 22, 34 ] 40 0.013% 99.124% ( 34, 51 ] 85 0.027% 99.151% ( 51, 76 ] 50 0.016% 99.166% ( 76, 110 ] 15 0.005% 99.171% ( 110, 170 ] 54 0.017% 99.188% ( 170, 250 ] 296 0.094% 99.283% ( 250, 380 ] 505 0.161% 99.443% ( 380, 580 ] 659 0.210% 99.653% ( 580, 870 ] 592 0.188% 99.841% ( 870, 1300 ] 282 0.090% 99.931% ( 1300, 1900 ] 109 0.035% 99.966% ( 1900, 2900 ] 141 0.045% 100.010% ( 2900, 4400 ] 149 0.047% 100.058% ( 4400, 6600 ] 23 0.007% 100.065% ( 6600, 9900 ] 35 0.011% 100.076% ( 9900, 14000 ] 16 0.005% 100.081% ( 14000, 22000 ] 12 0.004% 100.085% ( 22000, 33000 ] 7 0.002% 100.087% ( 33000, 50000 ] 4 0.001% 100.089% ( 50000, 75000 ] 1 0.000% 100.089% ** Level 4 read latency histogram (micros): Count: 121376 Average: 71.9731 StdDev: 607.31 Min: 1 Median: 2.3286 Max: 69000 Percentiles: P50: 2.33 P75: 3.68 P99: 1209.99 P99.9: 4112.36 P99.99: 5604.19 ------------------------------------------------------ [ 0, 1 ] 1402 1.155% 1.155% ( 1, 2 ] 48535 39.987% 41.142% ######## ( 2, 3 ] 32713 26.952% 68.094% ##### ( 3, 4 ] 12403 10.219% 78.313% ## ( 4, 6 ] 12739 10.495% 88.808% ## ( 6, 10 ] 3086 2.543% 91.351% # ( 10, 15 ] 603 0.497% 91.848% ( 15, 22 ] 92 0.076% 91.923% ( 22, 34 ] 20 0.016% 91.940% ( 34, 51 ] 25 0.021% 91.961% ( 51, 76 ] 15 0.012% 91.973% ( 76, 110 ] 16 0.013% 91.986% ( 110, 170 ] 264 0.218% 92.204% ( 170, 250 ] 1374 1.132% 93.336% ( 250, 380 ] 2237 1.843% 95.179% ( 380, 580 ] 2446 2.015% 97.194% ( 580, 870 ] 1687 1.390% 98.584% ( 870, 1300 ] 639 0.526% 99.110% ( 1300, 1900 ] 274 0.226% 99.336% ( 1900, 2900 ] 388 0.320% 99.656% ( 2900, 4400 ] 367 0.302% 99.958% ( 4400, 6600 ] 71 0.058% 100.016% ( 6600, 9900 ] 39 0.032% 100.049% ( 9900, 14000 ] 11 0.009% 100.058% ( 14000, 22000 ] 21 0.017% 100.075% ( 22000, 33000 ] 5 0.004% 100.079% ( 33000, 50000 ] 7 0.006% 100.085% ( 50000, 75000 ] 2 0.002% 100.087% ** Level 5 read latency histogram (micros): Count: 8563 Average: 771.5514 StdDev: 1642.65 Min: 97 Median: 455.0455 Max: 48372 Percentiles: P50: 455.05 P75: 730.55 P99: 4681.29 P99.9: 25161.40 P99.99: 47088.58 ------------------------------------------------------ ( 76, 110 ] 7 0.082% 0.082% ( 110, 170 ] 245 2.861% 2.943% # ( 170, 250 ] 1202 14.037% 16.980% ### ( 250, 380 ] 2002 23.380% 40.360% ##### ( 380, 580 ] 2200 25.692% 66.052% ##### ( 580, 870 ] 1476 17.237% 83.289% ### ( 870, 1300 ] 564 6.586% 89.875% # ( 1300, 1900 ] 196 2.289% 92.164% ( 1900, 2900 ] 294 3.433% 95.597% # ( 2900, 4400 ] 286 3.340% 98.937% # ( 4400, 6600 ] 42 0.490% 99.428% ( 6600, 9900 ] 22 0.257% 99.685% ( 9900, 14000 ] 8 0.093% 99.778% ( 14000, 22000 ] 9 0.105% 99.883% ( 22000, 33000 ] 5 0.058% 99.942% ( 33000, 50000 ] 5 0.058% 100.000% ** DB Stats ** Uptime(secs): 5.2 total, 5.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 189.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.731 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.731 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/07/15-23:25:27 ... thread 0: (1000000,2000000) ops and (197254.2,196488.5) ops/second in (5.069601,10.178713) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.55 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 87.8 201.7 16.48 11.45 32 0.515 1468K 8113 0.0 0.0 L1 5/5 643.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 999.72 MB 1.0 3.8 2.4 1.3 3.7 2.3 0.1 1.5 145.4 140.8 26.70 19.49 13 2.054 1634K 0 0.0 0.0 L4 128/0 9.57 GB 1.0 4.3 1.7 2.6 3.9 1.3 0.6 2.3 142.1 128.1 31.26 20.31 16 1.954 2059K 3756 0.0 0.0 L5 142/0 11.07 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 308/15 24.80 GB 0.0 9.5 4.1 5.4 10.8 5.4 2.7 5.9 131.3 148.9 74.44 51.25 61 1.220 5162K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 4.1 5.4 10.8 5.4 2.7 5.9 131.3 148.9 74.44 51.25 61 1.220 5162K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 4.1 5.4 9.0 3.6 0.0 0.0 150.7 141.8 64.86 45.71 34 1.908 5162K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 196.8 9.59 5.54 27 0.355 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.3 total, 10.2 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.83 GB write, 1079.40 MB/s write, 9.54 GB read, 951.33 MB/s read, 74.4 seconds Interval compaction: 10.83 GB write, 1088.76 MB/s write, 9.54 GB read, 959.57 MB/s read, 74.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 450555 Average: 37.3453 StdDev: 299.38 Min: 1 Median: 1.8842 Max: 47784 Percentiles: P50: 1.88 P75: 2.86 P99: 751.72 P99.9: 3290.69 P99.99: 4278.11 ------------------------------------------------------ [ 0, 1 ] 26852 5.960% 5.960% # ( 1, 2 ] 224404 49.806% 55.766% ########## ( 2, 3 ] 100607 22.330% 78.095% #### ( 3, 4 ] 32684 7.254% 85.350% # ( 4, 6 ] 29875 6.631% 91.980% # ( 6, 10 ] 7748 1.720% 93.700% ( 10, 15 ] 1781 0.395% 94.095% ( 15, 22 ] 215 0.048% 94.143% ( 22, 34 ] 33 0.007% 94.150% ( 34, 51 ] 53 0.012% 94.162% ( 51, 76 ] 31 0.007% 94.169% ( 76, 110 ] 109 0.024% 94.193% ( 110, 170 ] 2376 0.527% 94.721% ( 170, 250 ] 6764 1.501% 96.222% ( 250, 380 ] 5145 1.142% 97.364% ( 380, 580 ] 5195 1.153% 98.517% ( 580, 870 ] 3679 0.817% 99.333% ( 870, 1300 ] 1352 0.300% 99.633% ( 1300, 1900 ] 449 0.100% 99.733% ( 1900, 2900 ] 593 0.132% 99.865% ( 2900, 4400 ] 616 0.137% 100.001% ( 4400, 6600 ] 142 0.032% 100.033% ( 6600, 9900 ] 25 0.006% 100.038% ( 9900, 14000 ] 15 0.003% 100.042% ( 14000, 22000 ] 9 0.002% 100.044% ( 22000, 33000 ] 5 0.001% 100.045% ( 33000, 50000 ] 6 0.001% 100.046% ** Level 1 read latency histogram (micros): Count: 1724 Average: 677.7297 StdDev: 1448.29 Min: 97 Median: 358.2081 Max: 37837 Percentiles: P50: 358.21 P75: 631.70 P99: 6052.44 P99.9: 16208.00 P99.99: 37837.00 ------------------------------------------------------ ( 76, 110 ] 4 0.232% 0.232% ( 110, 170 ] 158 9.165% 9.397% ## ( 170, 250 ] 412 23.898% 33.295% ##### ( 250, 380 ] 346 20.070% 53.364% #### ( 380, 580 ] 332 19.258% 72.622% #### ( 580, 870 ] 230 13.341% 85.963% ### ( 870, 1300 ] 96 5.568% 91.531% # ( 1300, 1900 ] 36 2.088% 93.619% ( 1900, 2900 ] 44 2.552% 96.172% # ( 2900, 4400 ] 42 2.436% 98.608% ( 4400, 6600 ] 9 0.522% 99.130% ( 6600, 9900 ] 9 0.522% 99.652% ( 9900, 14000 ] 4 0.232% 99.884% ( 14000, 22000 ] 1 0.058% 99.942% ( 33000, 50000 ] 1 0.058% 100.000% ** Level 2 read latency histogram (micros): Count: 507715 Average: 11.5345 StdDev: 221.12 Min: 1 Median: 2.2345 Max: 41993 Percentiles: P50: 2.23 P75: 3.13 P99: 13.91 P99.9: 758.19 P99.99: 1232.73 ------------------------------------------------------ [ 0, 1 ] 4643 0.914% 0.914% ( 1, 2 ] 212457 41.846% 42.760% ######## ( 2, 3 ] 156722 30.868% 73.628% ###### ( 3, 4 ] 53406 10.519% 84.147% ## ( 4, 6 ] 57033 11.233% 95.380% ## ( 6, 10 ] 15285 3.011% 98.391% # ( 10, 15 ] 3949 0.778% 99.169% ( 15, 22 ] 535 0.105% 99.274% ( 22, 34 ] 102 0.020% 99.294% ( 34, 51 ] 118 0.023% 99.318% ( 51, 76 ] 103 0.020% 99.338% ( 76, 110 ] 44 0.009% 99.346% ( 110, 170 ] 116 0.023% 99.369% ( 170, 250 ] 538 0.106% 99.475% ( 250, 380 ] 871 0.172% 99.647% ( 380, 580 ] 916 0.180% 99.827% ( 580, 870 ] 601 0.118% 99.946% ( 870, 1300 ] 267 0.053% 99.998% ( 1300, 1900 ] 160 0.032% 100.030% ( 1900, 2900 ] 205 0.040% 100.070% ( 2900, 4400 ] 165 0.032% 100.103% ( 4400, 6600 ] 49 0.010% 100.112% ( 6600, 9900 ] 50 0.010% 100.122% ( 9900, 14000 ] 16 0.003% 100.125% ( 14000, 22000 ] 17 0.003% 100.129% ( 22000, 33000 ] 5 0.001% 100.130% ( 33000, 50000 ] 3 0.001% 100.130% ** Level 3 read latency histogram (micros): Count: 716727 Average: 13.3329 StdDev: 227.46 Min: 1 Median: 2.3175 Max: 56936 Percentiles: P50: 2.32 P75: 3.24 P99: 19.40 P99.9: 927.11 P99.99: 1517.13 ------------------------------------------------------ [ 0, 1 ] 5394 0.753% 0.753% ( 1, 2 ] 278333 38.834% 39.586% ######## ( 2, 3 ] 235068 32.797% 72.384% ####### ( 3, 4 ] 78708 10.982% 83.365% ## ( 4, 6 ] 84838 11.837% 95.202% ## ( 6, 10 ] 21644 3.020% 98.222% # ( 10, 15 ] 5142 0.717% 98.940% ( 15, 22 ] 688 0.096% 99.036% ( 22, 34 ] 83 0.012% 99.047% ( 34, 51 ] 176 0.025% 99.072% ( 51, 76 ] 126 0.018% 99.089% ( 76, 110 ] 40 0.006% 99.095% ( 110, 170 ] 372 0.052% 99.147% ( 170, 250 ] 1182 0.165% 99.312% ( 250, 380 ] 1219 0.170% 99.482% ( 380, 580 ] 1565 0.218% 99.700% ( 580, 870 ] 1349 0.188% 99.888% ( 870, 1300 ] 627 0.087% 99.976% ( 1300, 1900 ] 280 0.039% 100.015% ( 1900, 2900 ] 338 0.047% 100.062% ( 2900, 4400 ] 371 0.052% 100.114% ( 4400, 6600 ] 89 0.012% 100.126% ( 6600, 9900 ] 50 0.007% 100.133% ( 9900, 14000 ] 17 0.002% 100.136% ( 14000, 22000 ] 14 0.002% 100.138% ( 22000, 33000 ] 7 0.001% 100.139% ( 33000, 50000 ] 5 0.001% 100.139% ( 50000, 75000 ] 1 0.000% 100.139% ** Level 4 read latency histogram (micros): Count: 706475 Average: 28.9211 StdDev: 301.91 Min: 0 Median: 2.3299 Max: 69000 Percentiles: P50: 2.33 P75: 3.41 P99: 555.79 P99.9: 1590.68 P99.99: 2263.16 ------------------------------------------------------ [ 0, 1 ] 5589 0.791% 0.791% ( 1, 2 ] 276162 39.090% 39.881% ######## ( 2, 3 ] 216691 30.672% 70.553% ###### ( 3, 4 ] 76145 10.778% 81.332% ## ( 4, 6 ] 79241 11.216% 92.548% ## ( 6, 10 ] 21025 2.976% 95.524% # ( 10, 15 ] 5712 0.809% 96.332% ( 15, 22 ] 714 0.101% 96.434% ( 22, 34 ] 94 0.013% 96.447% ( 34, 51 ] 220 0.031% 96.478% ( 51, 76 ] 122 0.017% 96.495% ( 76, 110 ] 109 0.015% 96.511% ( 110, 170 ] 2044 0.289% 96.800% ( 170, 250 ] 6042 0.855% 97.655% ( 250, 380 ] 4935 0.699% 98.354% ( 380, 580 ] 5194 0.735% 99.089% ( 580, 870 ] 3844 0.544% 99.633% ( 870, 1300 ] 1559 0.221% 99.854% ( 1300, 1900 ] 674 0.095% 99.949% ( 1900, 2900 ] 794 0.112% 100.062% ( 2900, 4400 ] 815 0.115% 100.177% ( 4400, 6600 ] 181 0.026% 100.203% ( 6600, 9900 ] 54 0.008% 100.210% ( 9900, 14000 ] 15 0.002% 100.212% ( 14000, 22000 ] 31 0.004% 100.217% ( 22000, 33000 ] 6 0.001% 100.218% ( 33000, 50000 ] 7 0.001% 100.219% ( 50000, 75000 ] 2 0.000% 100.219% ** Level 5 read latency histogram (micros): Count: 20079 Average: 624.9117 StdDev: 1286.72 Min: 94 Median: 364.1266 Max: 48372 Percentiles: P50: 364.13 P75: 631.28 P99: 4272.33 P99.9: 15707.56 P99.99: 45123.67 ------------------------------------------------------ ( 76, 110 ] 62 0.309% 0.309% ( 110, 170 ] 1655 8.242% 8.551% ## ( 170, 250 ] 4875 24.279% 32.830% ##### ( 250, 380 ] 3927 19.558% 52.388% #### ( 380, 580 ] 4023 20.036% 72.424% #### ( 580, 870 ] 2925 14.567% 86.991% ### ( 870, 1300 ] 1096 5.458% 92.450% # ( 1300, 1900 ] 367 1.828% 94.278% ( 1900, 2900 ] 499 2.485% 96.763% ( 2900, 4400 ] 491 2.445% 99.208% ( 4400, 6600 ] 96 0.478% 99.686% ( 6600, 9900 ] 33 0.164% 99.851% ( 9900, 14000 ] 8 0.040% 99.890% ( 14000, 22000 ] 9 0.045% 99.935% ( 22000, 33000 ] 6 0.030% 99.965% ( 33000, 50000 ] 7 0.035% 100.000% ** DB Stats ** Uptime(secs): 10.3 total, 5.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 191.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.500 H:M:S, 14.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 194.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.769 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-23:25:32 ... thread 0: (1000000,3000000) ops and (197963.9,196977.8) ops/second in (5.051426,15.230139) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.47 GB 125.1 2.6 0.0 2.6 5.4 2.7 0.0 2.0 112.0 228.7 24.14 18.67 52 0.464 2746K 14K 0.0 0.0 L1 5/5 643.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 999.72 MB 1.0 3.8 2.4 1.3 3.7 2.3 0.1 1.5 145.4 140.8 26.70 19.49 13 2.054 1634K 0 0.0 0.0 L4 128/0 9.57 GB 1.0 4.3 1.7 2.6 3.9 1.3 0.6 2.3 142.1 128.1 31.26 20.31 16 1.954 2059K 3756 0.0 0.0 L5 142/0 11.07 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 308/18 25.72 GB 0.0 10.8 4.1 6.6 13.0 6.3 2.7 4.7 134.3 161.8 82.10 58.46 81 1.014 6439K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 4.1 6.6 13.0 6.3 2.7 4.7 134.3 161.8 82.10 58.46 81 1.014 6439K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 4.1 6.6 10.2 3.6 0.0 0.0 158.4 150.1 69.64 50.42 39 1.786 6439K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 227.2 12.46 8.04 42 0.297 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.2 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.97 GB write, 866.86 MB/s write, 10.77 GB read, 719.82 MB/s read, 82.1 seconds Interval compaction: 12.97 GB write, 871.88 MB/s write, 10.77 GB read, 723.99 MB/s read, 82.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 15, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 777051 Average: 32.6423 StdDev: 232.23 Min: 0 Median: 1.7261 Max: 47784 Percentiles: P50: 1.73 P75: 2.67 P99: 540.43 P99.9: 2243.93 P99.99: 3655.59 ------------------------------------------------------ [ 0, 1 ] 96050 12.361% 12.361% ## ( 1, 2 ] 402798 51.837% 64.198% ########## ( 2, 3 ] 125014 16.088% 80.286% ### ( 3, 4 ] 40127 5.164% 85.450% # ( 4, 6 ] 34807 4.479% 89.929% # ( 6, 10 ] 8867 1.141% 91.070% ( 10, 15 ] 2133 0.274% 91.345% ( 15, 22 ] 266 0.034% 91.379% ( 22, 34 ] 51 0.007% 91.386% ( 34, 51 ] 56 0.007% 91.393% ( 51, 76 ] 33 0.004% 91.397% ( 76, 110 ] 737 0.095% 91.492% ( 110, 170 ] 15243 1.962% 93.454% ( 170, 250 ] 30087 3.872% 97.326% # ( 250, 380 ] 8182 1.053% 98.378% ( 380, 580 ] 6022 0.775% 99.153% ( 580, 870 ] 3792 0.488% 99.641% ( 870, 1300 ] 1354 0.174% 99.816% ( 1300, 1900 ] 452 0.058% 99.874% ( 1900, 2900 ] 593 0.076% 99.950% ( 2900, 4400 ] 616 0.079% 100.029% ( 4400, 6600 ] 142 0.018% 100.048% ( 6600, 9900 ] 25 0.003% 100.051% ( 9900, 14000 ] 15 0.002% 100.053% ( 14000, 22000 ] 9 0.001% 100.054% ( 22000, 33000 ] 5 0.001% 100.055% ( 33000, 50000 ] 6 0.001% 100.055% ** Level 1 read latency histogram (micros): Count: 4083 Average: 397.1349 StdDev: 972.20 Min: 93 Median: 218.6279 Max: 37837 Percentiles: P50: 218.63 P75: 336.23 P99: 3798.93 P99.9: 11864.93 P99.99: 37837.00 ------------------------------------------------------ ( 76, 110 ] 37 0.906% 0.906% ( 110, 170 ] 959 23.488% 24.394% ##### ( 170, 250 ] 1720 42.126% 66.520% ######## ( 250, 380 ] 522 12.785% 79.304% ### ( 380, 580 ] 369 9.037% 88.342% ## ( 580, 870 ] 234 5.731% 94.073% # ( 870, 1300 ] 96 2.351% 96.424% ( 1300, 1900 ] 36 0.882% 97.306% ( 1900, 2900 ] 44 1.078% 98.384% ( 2900, 4400 ] 42 1.029% 99.412% ( 4400, 6600 ] 9 0.220% 99.633% ( 6600, 9900 ] 9 0.220% 99.853% ( 9900, 14000 ] 4 0.098% 99.951% ( 14000, 22000 ] 1 0.024% 99.976% ( 33000, 50000 ] 1 0.024% 100.000% ** Level 2 read latency histogram (micros): Count: 508215 Average: 11.7149 StdDev: 221.10 Min: 1 Median: 2.2361 Max: 41993 Percentiles: P50: 2.24 P75: 3.14 P99: 14.54 P99.9: 758.69 P99.99: 1232.65 ------------------------------------------------------ [ 0, 1 ] 4643 0.914% 0.914% ( 1, 2 ] 212457 41.805% 42.718% ######## ( 2, 3 ] 156722 30.838% 73.556% ###### ( 3, 4 ] 53406 10.509% 84.064% ## ( 4, 6 ] 57033 11.222% 95.287% ## ( 6, 10 ] 15285 3.008% 98.294% # ( 10, 15 ] 3949 0.777% 99.071% ( 15, 22 ] 535 0.105% 99.177% ( 22, 34 ] 102 0.020% 99.197% ( 34, 51 ] 118 0.023% 99.220% ( 51, 76 ] 103 0.020% 99.240% ( 76, 110 ] 53 0.010% 99.251% ( 110, 170 ] 288 0.057% 99.307% ( 170, 250 ] 813 0.160% 99.467% ( 250, 380 ] 900 0.177% 99.644% ( 380, 580 ] 927 0.182% 99.827% ( 580, 870 ] 605 0.119% 99.946% ( 870, 1300 ] 267 0.053% 99.998% ( 1300, 1900 ] 160 0.031% 100.030% ( 1900, 2900 ] 205 0.040% 100.070% ( 2900, 4400 ] 165 0.032% 100.103% ( 4400, 6600 ] 49 0.010% 100.112% ( 6600, 9900 ] 50 0.010% 100.122% ( 9900, 14000 ] 16 0.003% 100.125% ( 14000, 22000 ] 17 0.003% 100.128% ( 22000, 33000 ] 5 0.001% 100.129% ( 33000, 50000 ] 3 0.001% 100.130% ** Level 3 read latency histogram (micros): Count: 722472 Average: 14.7787 StdDev: 227.20 Min: 1 Median: 2.3297 Max: 56936 Percentiles: P50: 2.33 P75: 3.29 P99: 218.79 P99.9: 923.77 P99.99: 1515.90 ------------------------------------------------------ [ 0, 1 ] 5394 0.747% 0.747% ( 1, 2 ] 278333 38.525% 39.272% ######## ( 2, 3 ] 235068 32.537% 71.808% ####### ( 3, 4 ] 78708 10.894% 82.703% ## ( 4, 6 ] 84838 11.743% 94.445% ## ( 6, 10 ] 21644 2.996% 97.441% # ( 10, 15 ] 5142 0.712% 98.153% ( 15, 22 ] 688 0.095% 98.248% ( 22, 34 ] 83 0.011% 98.260% ( 34, 51 ] 176 0.024% 98.284% ( 51, 76 ] 126 0.017% 98.301% ( 76, 110 ] 125 0.017% 98.319% ( 110, 170 ] 2208 0.306% 98.624% ( 170, 250 ] 4451 0.616% 99.240% ( 250, 380 ] 1635 0.226% 99.467% ( 380, 580 ] 1686 0.233% 99.700% ( 580, 870 ] 1366 0.189% 99.889% ( 870, 1300 ] 628 0.087% 99.976% ( 1300, 1900 ] 280 0.039% 100.015% ( 1900, 2900 ] 338 0.047% 100.062% ( 2900, 4400 ] 371 0.051% 100.113% ( 4400, 6600 ] 89 0.012% 100.125% ( 6600, 9900 ] 50 0.007% 100.132% ( 9900, 14000 ] 17 0.002% 100.135% ( 14000, 22000 ] 14 0.002% 100.136% ( 22000, 33000 ] 7 0.001% 100.137% ( 33000, 50000 ] 5 0.001% 100.138% ( 50000, 75000 ] 1 0.000% 100.138% ** Level 4 read latency histogram (micros): Count: 741987 Average: 36.5502 StdDev: 296.96 Min: 0 Median: 2.4104 Max: 69000 Percentiles: P50: 2.41 P75: 3.75 P99: 549.81 P99.9: 1559.06 P99.99: 2258.69 ------------------------------------------------------ [ 0, 1 ] 5589 0.753% 0.753% ( 1, 2 ] 276284 37.236% 37.989% ####### ( 2, 3 ] 217172 29.269% 67.258% ###### ( 3, 4 ] 76341 10.289% 77.547% ## ( 4, 6 ] 79645 10.734% 88.281% ## ( 6, 10 ] 21057 2.838% 91.119% # ( 10, 15 ] 5737 0.773% 91.892% ( 15, 22 ] 719 0.097% 91.989% ( 22, 34 ] 96 0.013% 92.002% ( 34, 51 ] 220 0.030% 92.031% ( 51, 76 ] 122 0.016% 92.048% ( 76, 110 ] 641 0.086% 92.134% ( 110, 170 ] 12994 1.751% 93.885% ( 170, 250 ] 25458 3.431% 97.316% # ( 250, 380 ] 7486 1.009% 98.325% ( 380, 580 ] 5896 0.795% 99.120% ( 580, 870 ] 3936 0.530% 99.650% ( 870, 1300 ] 1561 0.210% 99.861% ( 1300, 1900 ] 674 0.091% 99.952% ( 1900, 2900 ] 794 0.107% 100.059% ( 2900, 4400 ] 815 0.110% 100.168% ( 4400, 6600 ] 181 0.024% 100.193% ( 6600, 9900 ] 54 0.007% 100.200% ( 9900, 14000 ] 15 0.002% 100.202% ( 14000, 22000 ] 31 0.004% 100.206% ( 22000, 33000 ] 6 0.001% 100.207% ( 33000, 50000 ] 7 0.001% 100.208% ( 50000, 75000 ] 2 0.000% 100.208% ** Level 5 read latency histogram (micros): Count: 47524 Average: 376.2791 StdDev: 864.32 Min: 91 Median: 219.5967 Max: 48372 Percentiles: P50: 219.60 P75: 342.19 P99: 3433.89 P99.9: 8147.60 P99.99: 38458.46 ------------------------------------------------------ ( 76, 110 ] 455 0.957% 0.957% ( 110, 170 ] 10702 22.519% 23.477% ##### ( 170, 250 ] 20332 42.783% 66.259% ######### ( 250, 380 ] 5858 12.326% 78.586% ## ( 380, 580 ] 4569 9.614% 88.200% ## ( 580, 870 ] 2993 6.298% 94.498% # ( 870, 1300 ] 1097 2.308% 96.806% ( 1300, 1900 ] 368 0.774% 97.580% ( 1900, 2900 ] 500 1.052% 98.632% ( 2900, 4400 ] 491 1.033% 99.665% ( 4400, 6600 ] 96 0.202% 99.867% ( 6600, 9900 ] 33 0.069% 99.937% ( 9900, 14000 ] 8 0.017% 99.954% ( 14000, 22000 ] 9 0.019% 99.973% ( 22000, 33000 ] 6 0.013% 99.985% ( 33000, 50000 ] 7 0.015% 100.000% ** DB Stats ** Uptime(secs): 15.3 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 192.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.766 H:M:S, 18.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 194.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.266 H:M:S, 25.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 363.668 micros/op 10970 ops/sec 20.237 seconds 221996 operations; 10.6 MB/s (54999 of 54999 found) Microseconds per read: Count: 221996 Average: 363.6831 StdDev: 912.52 Min: 2 Median: 232.6516 Max: 75605 Percentiles: P50: 232.65 P75: 353.51 P99: 2857.96 P99.9: 12084.27 P99.99: 37816.95 ------------------------------------------------------ ( 1, 2 ] 9 0.004% 0.004% ( 2, 3 ] 55 0.025% 0.029% ( 3, 4 ] 112 0.050% 0.079% ( 4, 6 ] 204 0.092% 0.171% ( 6, 10 ] 365 0.164% 0.336% ( 10, 15 ] 2484 1.119% 1.455% ( 15, 22 ] 2688 1.211% 2.665% ( 22, 34 ] 4695 2.115% 4.780% ( 34, 51 ] 1506 0.678% 5.459% ( 51, 76 ] 252 0.114% 5.572% ( 76, 110 ] 118 0.053% 5.625% ( 110, 170 ] 18121 8.163% 13.788% ## ( 170, 250 ] 102649 46.239% 60.027% ######### ( 250, 380 ] 41745 18.804% 78.832% #### ( 380, 580 ] 26325 11.858% 90.690% ## ( 580, 870 ] 11454 5.160% 95.849% # ( 870, 1300 ] 4266 1.922% 97.771% ( 1300, 1900 ] 1453 0.655% 98.426% ( 1900, 2900 ] 1331 0.600% 99.025% ( 2900, 4400 ] 1296 0.584% 99.609% ( 4400, 6600 ] 385 0.173% 99.782% ( 6600, 9900 ] 204 0.092% 99.874% ( 9900, 14000 ] 107 0.048% 99.923% ( 14000, 22000 ] 102 0.046% 99.968% ( 22000, 33000 ] 41 0.018% 99.987% ( 33000, 50000 ] 24 0.011% 99.998% ( 50000, 75000 ] 4 0.002% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3807857 rocksdb.bloom.filter.full.positive COUNT : 258265 rocksdb.bloom.filter.full.true.positive COUNT : 221112 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 884 rocksdb.memtable.miss COUNT : 221112 rocksdb.l0.hit COUNT : 31745 rocksdb.l1.hit COUNT : 6116 rocksdb.l2andup.hit COUNT : 183251 rocksdb.compaction.key.drop.new COUNT : 606995 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3267347 rocksdb.number.keys.read COUNT : 221996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3371902104 rocksdb.bytes.read COUNT : 221996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 461 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6524272 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12587080556 rocksdb.compact.write.bytes COUNT : 11958454323 rocksdb.flush.write.bytes COUNT : 3363791753 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 608 rocksdb.number.superversion_releases COUNT : 587 rocksdb.number.superversion_cleanups COUNT : 150 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341777920 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5981184 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12966880631 rocksdb.non.last.level.read.count COUNT : 3104067 rocksdb.block.checksum.compute.count COUNT : 3310949 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 232.069515 P95 : 821.705625 P99 : 2857.172932 P100 : 75603.000000 COUNT : 221996 SUM : 80552688 rocksdb.db.write.micros P50 : 1.618958 P95 : 5.252614 P99 : 8.972529 P100 : 425604.000000 COUNT : 3267347 SUM : 15758078 rocksdb.compaction.times.micros P50 : 1570588.235294 P95 : 3950000.000000 P99 : 5518318.000000 P100 : 5518318.000000 COUNT : 40 SUM : 70558377 rocksdb.compaction.times.cpu_micros P50 : 1098000.000000 P95 : 2650000.000000 P99 : 3740000.000000 P100 : 4183144.000000 COUNT : 40 SUM : 51330403 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 787.142857 P95 : 5830.000000 P99 : 7824.000000 P100 : 7824.000000 COUNT : 48 SUM : 72048 rocksdb.compaction.outfile.sync.micros P50 : 1900.000000 P95 : 8360.000000 P99 : 45240.000000 P100 : 52199.000000 COUNT : 128 SUM : 402111 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 211.600000 P95 : 1320.000000 P99 : 3199.000000 P100 : 3199.000000 COUNT : 98 SUM : 39006 rocksdb.table.open.io.micros P50 : 5238.613861 P95 : 13799.880952 P99 : 27929.000000 P100 : 30708.000000 COUNT : 461 SUM : 2752033 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.406517 P95 : 11.273294 P99 : 241.529597 P100 : 56940.000000 COUNT : 3049117 SUM : 51967783 rocksdb.read.block.get.micros P50 : 203.120487 P95 : 697.650117 P99 : 2441.753890 P100 : 69003.000000 COUNT : 261396 SUM : 72695168 rocksdb.write.raw.block.micros P50 : 0.533808 P95 : 1.329005 P99 : 3.958198 P100 : 72929.000000 COUNT : 3712485 SUM : 13609882 rocksdb.numfiles.in.singlecompaction P50 : 3.210526 P95 : 6.600000 P99 : 11.000000 P100 : 11.000000 COUNT : 54 SUM : 201 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564000 P95 : 1139.990495 P99 : 2147.525355 P100 : 425423.000000 COUNT : 37797 SUM : 6528473 rocksdb.sst.read.micros P50 : 2.181514 P95 : 211.862212 P99 : 531.633903 P100 : 69000.000000 COUNT : 3104161 SUM : 113450854 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 221996 SUM : 221996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3267347 SUM : 3371902104 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 228181.818182 P95 : 628000.000000 P99 : 765875.000000 P100 : 765875.000000 COUNT : 48 SUM : 13615029 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 150 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0