[2024-12-10 03:57:09.836706] Starting SPDK v25.01-pre git sha1 1ae735a5d / DPDK 24.03.0 initialization... [2024-12-10 03:57:09.836992] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2561418 ] Set seed to 1733799429829876 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-10 03:57:09.974030] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-10 03:57:10.091852] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-10 03:57:10.091940] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2561418' to capture a snapshot of events at runtime. [2024-12-10 03:57:10.091952] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-10 03:57:10.091963] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-10 03:57:10.091971] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2561418 for offline analysis/debug. [2024-12-10 03:57:10.093216] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 10 03:57:15 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/10-03:57:21 ... thread 0: (1000000,1000000) ops and (171112.2,171112.2) ops/second in (5.844119,5.844119) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.57 GB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 156.2 5.23 2.27 10 0.523 0 0 0.0 0.0 L1 6/6 484.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/5 1.36 GB 0.9 2.7 1.9 0.8 2.6 1.8 0.0 1.4 118.8 114.6 23.48 12.97 13 1.806 692K 0 0.0 0.0 L4 142/14 10.71 GB 1.0 2.4 1.3 1.1 2.2 1.1 0.1 1.7 138.7 128.3 17.48 10.35 11 1.589 1338K 0 0.0 0.0 L5 120/0 9.84 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 306/39 24.95 GB 0.0 5.1 3.2 1.9 5.6 3.7 0.1 7.0 112.9 124.5 46.19 25.59 34 1.359 2031K 0 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 3.2 1.9 5.6 3.7 0.1 7.0 112.9 124.5 46.19 25.59 34 1.359 2031K 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 3.2 1.9 4.8 2.9 0.0 0.0 127.3 120.4 40.96 23.32 24 1.707 2031K 0 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 156.2 5.23 2.27 10 0.523 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.61 GB write, 958.95 MB/s write, 5.09 GB read, 869.47 MB/s read, 46.2 seconds Interval compaction: 5.61 GB write, 983.21 MB/s write, 5.09 GB read, 891.46 MB/s read, 46.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 33071 Average: 354.6248 StdDev: 860.48 Min: 1 Median: 2.9171 Max: 27459 Percentiles: P50: 2.92 P75: 376.98 P99: 4078.10 P99.9: 6557.24 P99.99: 25724.38 ------------------------------------------------------ [ 0, 1 ] 413 1.249% 1.249% ( 1, 2 ] 8894 26.894% 28.142% ##### ( 2, 3 ] 7882 23.834% 51.976% ##### ( 3, 4 ] 2527 7.641% 59.617% ## ( 4, 6 ] 2742 8.291% 67.908% ## ( 6, 10 ] 1096 3.314% 71.223% # ( 10, 15 ] 296 0.895% 72.118% ( 15, 22 ] 68 0.206% 72.323% ( 22, 34 ] 7 0.021% 72.344% ( 34, 51 ] 2 0.006% 72.350% ( 51, 76 ] 1 0.003% 72.353% ( 76, 110 ] 3 0.009% 72.362% ( 110, 170 ] 61 0.184% 72.547% ( 170, 250 ] 233 0.705% 73.251% ( 250, 380 ] 593 1.793% 75.045% ( 380, 580 ] 1350 4.082% 79.127% # ( 580, 870 ] 2178 6.586% 85.713% # ( 870, 1300 ] 1994 6.029% 91.742% # ( 1300, 1900 ] 1100 3.326% 95.068% # ( 1900, 2900 ] 779 2.356% 97.424% ( 2900, 4400 ] 665 2.011% 99.435% ( 4400, 6600 ] 158 0.478% 99.912% ( 6600, 9900 ] 21 0.063% 99.976% ( 9900, 14000 ] 2 0.006% 99.982% ( 14000, 22000 ] 2 0.006% 99.988% ( 22000, 33000 ] 5 0.015% 100.003% ** Level 1 read latency histogram (micros): Count: 355 Average: 1630.7380 StdDev: 3101.83 Min: 84 Median: 864.9419 Max: 28026 Percentiles: P50: 864.94 P75: 1580.77 P99: 25190.00 P99.9: 28026.00 P99.99: 28026.00 ------------------------------------------------------ ( 76, 110 ] 3 0.845% 0.845% ( 110, 170 ] 3 0.845% 1.690% ( 170, 250 ] 6 1.690% 3.380% ( 250, 380 ] 21 5.915% 9.296% # ( 380, 580 ] 60 16.901% 26.197% ### ( 580, 870 ] 86 24.225% 50.423% ##### ( 870, 1300 ] 69 19.437% 69.859% #### ( 1300, 1900 ] 39 10.986% 80.845% ## ( 1900, 2900 ] 29 8.169% 89.014% ## ( 2900, 4400 ] 19 5.352% 94.366% # ( 4400, 6600 ] 12 3.380% 97.746% # ( 6600, 9900 ] 2 0.563% 98.310% ( 9900, 14000 ] 1 0.282% 98.592% ( 22000, 33000 ] 5 1.408% 100.000% ** Level 2 read latency histogram (micros): Count: 362074 Average: 14.0424 StdDev: 185.60 Min: 1 Median: 2.1136 Max: 27380 Percentiles: P50: 2.11 P75: 3.08 P99: 12.47 P99.9: 1249.87 P99.99: 1822.18 ------------------------------------------------------ [ 0, 1 ] 5547 1.532% 1.532% ( 1, 2 ] 164262 45.367% 46.899% ######### ( 2, 3 ] 98795 27.286% 74.185% ##### ( 3, 4 ] 35458 9.793% 83.978% ## ( 4, 6 ] 42008 11.602% 95.580% ## ( 6, 10 ] 11267 3.112% 98.692% # ( 10, 15 ] 2258 0.624% 99.315% ( 15, 22 ] 355 0.098% 99.413% ( 22, 34 ] 38 0.010% 99.424% ( 34, 51 ] 31 0.009% 99.432% ( 51, 76 ] 35 0.010% 99.442% ( 76, 110 ] 11 0.003% 99.445% ( 110, 170 ] 31 0.009% 99.454% ( 170, 250 ] 85 0.023% 99.477% ( 250, 380 ] 206 0.057% 99.534% ( 380, 580 ] 374 0.103% 99.637% ( 580, 870 ] 526 0.145% 99.783% ( 870, 1300 ] 481 0.133% 99.915% ( 1300, 1900 ] 310 0.086% 100.001% ( 1900, 2900 ] 272 0.075% 100.076% ( 2900, 4400 ] 284 0.078% 100.155% ( 4400, 6600 ] 85 0.023% 100.178% ( 6600, 9900 ] 20 0.006% 100.184% ( 9900, 14000 ] 2 0.001% 100.184% ( 22000, 33000 ] 3 0.001% 100.185% ** Level 3 read latency histogram (micros): Count: 523983 Average: 13.0268 StdDev: 145.72 Min: 1 Median: 2.2034 Max: 14323 Percentiles: P50: 2.20 P75: 3.10 P99: 12.51 P99.9: 1202.60 P99.99: 1651.18 ------------------------------------------------------ [ 0, 1 ] 5346 1.020% 1.020% ( 1, 2 ] 224570 42.858% 43.879% ######### ( 2, 3 ] 157734 30.103% 73.981% ###### ( 3, 4 ] 53008 10.116% 84.098% ## ( 4, 6 ] 61369 11.712% 95.810% ## ( 6, 10 ] 15412 2.941% 98.751% # ( 10, 15 ] 2593 0.495% 99.246% ( 15, 22 ] 375 0.072% 99.318% ( 22, 34 ] 59 0.011% 99.329% ( 34, 51 ] 57 0.011% 99.340% ( 51, 76 ] 64 0.012% 99.352% ( 76, 110 ] 18 0.003% 99.355% ( 110, 170 ] 43 0.008% 99.364% ( 170, 250 ] 138 0.026% 99.390% ( 250, 380 ] 377 0.072% 99.462% ( 380, 580 ] 703 0.134% 99.596% ( 580, 870 ] 934 0.178% 99.774% ( 870, 1300 ] 852 0.163% 99.937% ( 1300, 1900 ] 476 0.091% 100.028% ( 1900, 2900 ] 379 0.072% 100.100% ( 2900, 4400 ] 332 0.063% 100.163% ( 4400, 6600 ] 59 0.011% 100.175% ( 6600, 9900 ] 6 0.001% 100.176% ( 9900, 14000 ] 1 0.000% 100.176% ( 14000, 22000 ] 1 0.000% 100.176% ** Level 4 read latency histogram (micros): Count: 450829 Average: 30.9121 StdDev: 257.66 Min: 1 Median: 2.1876 Max: 16214 Percentiles: P50: 2.19 P75: 3.13 P99: 745.36 P99.9: 1889.40 P99.99: 2383.61 ------------------------------------------------------ [ 0, 1 ] 5102 1.132% 1.132% ( 1, 2 ] 195641 43.396% 44.528% ######### ( 2, 3 ] 131480 29.164% 73.692% ###### ( 3, 4 ] 45159 10.017% 83.708% ## ( 4, 6 ] 50905 11.291% 95.000% ## ( 6, 10 ] 12050 2.673% 97.673% # ( 10, 15 ] 2158 0.479% 98.151% ( 15, 22 ] 291 0.065% 98.216% ( 22, 34 ] 63 0.014% 98.230% ( 34, 51 ] 42 0.009% 98.239% ( 51, 76 ] 47 0.010% 98.250% ( 76, 110 ] 16 0.004% 98.253% ( 110, 170 ] 66 0.015% 98.268% ( 170, 250 ] 229 0.051% 98.319% ( 250, 380 ] 548 0.122% 98.440% ( 380, 580 ] 1338 0.297% 98.737% ( 580, 870 ] 2083 0.462% 99.199% ( 870, 1300 ] 2060 0.457% 99.656% ( 1300, 1900 ] 1122 0.249% 99.905% ( 1900, 2900 ] 798 0.177% 100.082% ( 2900, 4400 ] 847 0.188% 100.270% ( 4400, 6600 ] 217 0.048% 100.318% ( 6600, 9900 ] 34 0.008% 100.325% ( 9900, 14000 ] 2 0.000% 100.326% ( 14000, 22000 ] 2 0.000% 100.326% ** Level 5 read latency histogram (micros): Count: 5900 Average: 1393.6071 StdDev: 1244.06 Min: 105 Median: 998.3825 Max: 16314 Percentiles: P50: 998.38 P75: 1711.28 P99: 6258.39 P99.9: 9982.00 P99.99: 16314.00 ------------------------------------------------------ ( 76, 110 ] 2 0.034% 0.034% ( 110, 170 ] 49 0.831% 0.864% ( 170, 250 ] 125 2.119% 2.983% ( 250, 380 ] 325 5.508% 8.492% # ( 380, 580 ] 796 13.492% 21.983% ### ( 580, 870 ] 1258 21.322% 43.305% #### ( 870, 1300 ] 1323 22.424% 65.729% #### ( 1300, 1900 ] 798 13.525% 79.254% ### ( 1900, 2900 ] 509 8.627% 87.881% ## ( 2900, 4400 ] 520 8.814% 96.695% ## ( 4400, 6600 ] 161 2.729% 99.424% # ( 6600, 9900 ] 28 0.475% 99.898% ( 9900, 14000 ] 5 0.085% 99.983% ( 14000, 22000 ] 1 0.017% 100.000% ** DB Stats ** Uptime(secs): 6.0 total, 5.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 164.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.938 H:M:S, 32.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 168.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.938 H:M:S, 33.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/10-03:57:26 ... thread 0: (1000000,2000000) ops and (202242.6,185379.6) ops/second in (4.944556,10.788675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.54 GB 118.9 1.1 0.0 1.1 2.9 1.8 0.0 1.6 76.1 198.2 14.88 9.66 29 0.513 1149K 6150 0.0 0.0 L1 6/6 484.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 878.30 MB 0.9 2.7 1.9 0.8 2.6 1.8 0.0 1.4 118.8 114.6 23.48 12.97 13 1.806 692K 0 0.0 0.0 L4 132/0 9.72 GB 1.0 4.0 1.8 2.2 3.7 1.5 0.1 2.1 150.5 138.8 27.22 17.32 16 1.701 2268K 4946 0.0 0.0 L5 140/0 11.20 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 314/20 25.80 GB 0.0 7.8 3.7 4.2 9.2 5.0 1.4 5.2 122.3 143.6 65.58 39.95 58 1.131 4110K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.8 3.7 4.2 9.2 5.0 1.4 5.2 122.3 143.6 65.58 39.95 58 1.131 4110K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.8 3.7 4.2 7.4 3.3 0.0 0.0 141.4 134.0 56.69 34.76 33 1.718 4110K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 205.2 8.89 5.19 25 0.356 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.9 total, 10.8 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.20 GB write, 860.85 MB/s write, 7.83 GB read, 732.77 MB/s read, 65.6 seconds Interval compaction: 9.20 GB write, 872.65 MB/s write, 7.83 GB read, 742.81 MB/s read, 65.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 21, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 416609 Average: 62.4953 StdDev: 287.08 Min: 1 Median: 1.7217 Max: 27459 Percentiles: P50: 1.72 P75: 2.86 P99: 1095.08 P99.9: 3202.78 P99.99: 3952.68 ------------------------------------------------------ [ 0, 1 ] 58569 14.059% 14.059% ### ( 1, 2 ] 207485 49.803% 63.862% ########## ( 2, 3 ] 54256 13.023% 76.885% ### ( 3, 4 ] 17960 4.311% 81.196% # ( 4, 6 ] 15262 3.663% 84.859% # ( 6, 10 ] 4473 1.074% 85.933% ( 10, 15 ] 791 0.190% 86.123% ( 15, 22 ] 166 0.040% 86.163% ( 22, 34 ] 21 0.005% 86.168% ( 34, 51 ] 6 0.001% 86.169% ( 51, 76 ] 4 0.001% 86.170% ( 76, 110 ] 446 0.107% 86.277% ( 110, 170 ] 13827 3.319% 89.596% # ( 170, 250 ] 20390 4.894% 94.491% # ( 250, 380 ] 7478 1.795% 96.285% ( 380, 580 ] 5552 1.333% 97.618% ( 580, 870 ] 4276 1.026% 98.645% ( 870, 1300 ] 2833 0.680% 99.325% ( 1300, 1900 ] 1312 0.315% 99.639% ( 1900, 2900 ] 936 0.225% 99.864% ( 2900, 4400 ] 750 0.180% 100.044% ( 4400, 6600 ] 164 0.039% 100.084% ( 6600, 9900 ] 22 0.005% 100.089% ( 9900, 14000 ] 2 0.000% 100.089% ( 14000, 22000 ] 2 0.000% 100.090% ( 22000, 33000 ] 5 0.001% 100.091% ** Level 1 read latency histogram (micros): Count: 1610 Average: 572.3665 StdDev: 1578.26 Min: 84 Median: 234.8771 Max: 28026 Percentiles: P50: 234.88 P75: 510.57 P99: 5115.00 P99.9: 28026.00 P99.99: 28026.00 ------------------------------------------------------ ( 76, 110 ] 17 1.056% 1.056% ( 110, 170 ] 359 22.298% 23.354% #### ( 170, 250 ] 529 32.857% 56.211% ####### ( 250, 380 ] 200 12.422% 68.634% ## ( 380, 580 ] 157 9.752% 78.385% ## ( 580, 870 ] 140 8.696% 87.081% ## ( 870, 1300 ] 90 5.590% 92.671% # ( 1300, 1900 ] 44 2.733% 95.404% # ( 1900, 2900 ] 33 2.050% 97.453% ( 2900, 4400 ] 21 1.304% 98.758% ( 4400, 6600 ] 12 0.745% 99.503% ( 6600, 9900 ] 2 0.124% 99.627% ( 9900, 14000 ] 1 0.062% 99.689% ( 22000, 33000 ] 5 0.311% 100.000% ** Level 2 read latency histogram (micros): Count: 362074 Average: 14.0424 StdDev: 185.60 Min: 1 Median: 2.1136 Max: 27380 Percentiles: P50: 2.11 P75: 3.08 P99: 12.47 P99.9: 1249.87 P99.99: 1822.18 ------------------------------------------------------ [ 0, 1 ] 5547 1.532% 1.532% ( 1, 2 ] 164262 45.367% 46.899% ######### ( 2, 3 ] 98795 27.286% 74.185% ##### ( 3, 4 ] 35458 9.793% 83.978% ## ( 4, 6 ] 42008 11.602% 95.580% ## ( 6, 10 ] 11267 3.112% 98.692% # ( 10, 15 ] 2258 0.624% 99.315% ( 15, 22 ] 355 0.098% 99.413% ( 22, 34 ] 38 0.010% 99.424% ( 34, 51 ] 31 0.009% 99.432% ( 51, 76 ] 35 0.010% 99.442% ( 76, 110 ] 11 0.003% 99.445% ( 110, 170 ] 31 0.009% 99.454% ( 170, 250 ] 85 0.023% 99.477% ( 250, 380 ] 206 0.057% 99.534% ( 380, 580 ] 374 0.103% 99.637% ( 580, 870 ] 526 0.145% 99.783% ( 870, 1300 ] 481 0.133% 99.915% ( 1300, 1900 ] 310 0.086% 100.001% ( 1900, 2900 ] 272 0.075% 100.076% ( 2900, 4400 ] 284 0.078% 100.155% ( 4400, 6600 ] 85 0.023% 100.178% ( 6600, 9900 ] 20 0.006% 100.184% ( 9900, 14000 ] 2 0.001% 100.184% ( 22000, 33000 ] 3 0.001% 100.185% ** Level 3 read latency histogram (micros): Count: 596109 Average: 13.2271 StdDev: 140.27 Min: 1 Median: 2.2002 Max: 14323 Percentiles: P50: 2.20 P75: 3.10 P99: 101.61 P99.9: 1168.40 P99.99: 1607.02 ------------------------------------------------------ [ 0, 1 ] 5957 0.999% 0.999% ( 1, 2 ] 256221 42.982% 43.982% ######### ( 2, 3 ] 179188 30.060% 74.041% ###### ( 3, 4 ] 59414 9.967% 84.008% ## ( 4, 6 ] 68571 11.503% 95.511% ## ( 6, 10 ] 17337 2.908% 98.420% # ( 10, 15 ] 2813 0.472% 98.891% ( 15, 22 ] 414 0.069% 98.961% ( 22, 34 ] 65 0.011% 98.972% ( 34, 51 ] 64 0.011% 98.983% ( 51, 76 ] 67 0.011% 98.994% ( 76, 110 ] 49 0.008% 99.002% ( 110, 170 ] 786 0.132% 99.134% ( 170, 250 ] 1133 0.190% 99.324% ( 250, 380 ] 756 0.127% 99.451% ( 380, 580 ] 952 0.160% 99.610% ( 580, 870 ] 1093 0.183% 99.794% ( 870, 1300 ] 912 0.153% 99.947% ( 1300, 1900 ] 503 0.084% 100.031% ( 1900, 2900 ] 399 0.067% 100.098% ( 2900, 4400 ] 340 0.057% 100.155% ( 4400, 6600 ] 61 0.010% 100.165% ( 6600, 9900 ] 6 0.001% 100.166% ( 9900, 14000 ] 1 0.000% 100.167% ( 14000, 22000 ] 1 0.000% 100.167% ** Level 4 read latency histogram (micros): Count: 601771 Average: 34.5995 StdDev: 234.61 Min: 0 Median: 2.2117 Max: 16214 Percentiles: P50: 2.21 P75: 3.33 P99: 698.63 P99.9: 1802.58 P99.99: 2280.86 ------------------------------------------------------ [ 0, 1 ] 6994 1.162% 1.162% ( 1, 2 ] 258464 42.951% 44.113% ######### ( 2, 3 ] 167313 27.803% 71.916% ###### ( 3, 4 ] 56478 9.385% 81.302% ## ( 4, 6 ] 63077 10.482% 91.783% ## ( 6, 10 ] 15486 2.573% 94.357% # ( 10, 15 ] 2515 0.418% 94.775% ( 15, 22 ] 359 0.060% 94.834% ( 22, 34 ] 69 0.011% 94.846% ( 34, 51 ] 56 0.009% 94.855% ( 51, 76 ] 54 0.009% 94.864% ( 76, 110 ] 244 0.041% 94.905% ( 110, 170 ] 6752 1.122% 96.027% ( 170, 250 ] 9560 1.589% 97.615% ( 250, 380 ] 3685 0.612% 98.228% ( 380, 580 ] 3346 0.556% 98.784% ( 580, 870 ] 3181 0.529% 99.312% ( 870, 1300 ] 2485 0.413% 99.725% ( 1300, 1900 ] 1255 0.209% 99.934% ( 1900, 2900 ] 887 0.147% 100.081% ( 2900, 4400 ] 874 0.145% 100.226% ( 4400, 6600 ] 219 0.036% 100.263% ( 6600, 9900 ] 34 0.006% 100.269% ( 9900, 14000 ] 2 0.000% 100.269% ( 14000, 22000 ] 2 0.000% 100.269% ** Level 5 read latency histogram (micros): Count: 26149 Average: 526.2624 StdDev: 787.06 Min: 84 Median: 235.5909 Max: 16314 Percentiles: P50: 235.59 P75: 536.37 P99: 4221.07 P99.9: 7525.30 P99.99: 12675.78 ------------------------------------------------------ ( 76, 110 ] 229 0.876% 0.876% ( 110, 170 ] 6047 23.125% 24.001% ##### ( 170, 250 ] 8292 31.711% 55.711% ###### ( 250, 380 ] 3050 11.664% 67.375% ## ( 380, 580 ] 2550 9.752% 77.127% ## ( 580, 870 ] 2134 8.161% 85.288% ## ( 870, 1300 ] 1643 6.283% 91.571% # ( 1300, 1900 ] 892 3.411% 94.983% # ( 1900, 2900 ] 567 2.168% 97.151% ( 2900, 4400 ] 549 2.100% 99.250% ( 4400, 6600 ] 162 0.620% 99.870% ( 6600, 9900 ] 28 0.107% 99.977% ( 9900, 14000 ] 5 0.019% 99.996% ( 14000, 22000 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 10.9 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 179.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.249 H:M:S, 29.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 199.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.311 H:M:S, 26.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/10-03:57:32 ... thread 0: (1000000,3000000) ops and (186717.1,185823.3) ops/second in (5.355695,16.144370) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 4.52 GB 125.0 2.7 0.0 2.7 5.5 2.7 0.0 2.0 86.8 175.0 31.89 19.35 51 0.625 2810K 14K 0.0 0.0 L1 6/6 484.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 878.30 MB 0.9 2.7 1.9 0.8 2.6 1.8 0.0 1.4 118.8 114.6 23.48 12.97 13 1.806 692K 0 0.0 0.0 L4 132/0 9.72 GB 1.0 4.0 1.8 2.2 3.7 1.5 0.1 2.1 150.5 138.8 27.22 17.32 16 1.701 2268K 4946 0.0 0.0 L5 140/0 11.20 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 312/19 26.77 GB 0.0 9.4 3.7 5.7 11.8 6.0 1.4 4.3 116.9 145.9 82.58 49.64 80 1.032 5771K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.4 3.7 5.7 11.8 6.0 1.4 4.3 116.9 145.9 82.58 49.64 80 1.032 5771K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.4 3.7 5.7 9.0 3.3 0.0 0.0 137.2 131.1 70.35 41.60 39 1.804 5771K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 231.2 12.24 8.04 41 0.299 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.3 total, 16.1 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.77 GB write, 739.51 MB/s write, 9.43 GB read, 592.29 MB/s read, 82.6 seconds Interval compaction: 11.77 GB write, 746.29 MB/s write, 9.43 GB read, 597.72 MB/s read, 82.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 21, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 820267 Average: 43.4330 StdDev: 212.81 Min: 0 Median: 1.6420 Max: 27459 Percentiles: P50: 1.64 P75: 2.56 P99: 714.34 P99.9: 2272.37 P99.99: 3168.93 ------------------------------------------------------ [ 0, 1 ] 135683 16.541% 16.541% ### ( 1, 2 ] 427484 52.115% 68.657% ########## ( 2, 3 ] 92860 11.321% 79.977% ## ( 3, 4 ] 31185 3.802% 83.779% # ( 4, 6 ] 25292 3.083% 86.862% # ( 6, 10 ] 7097 0.865% 87.728% ( 10, 15 ] 1409 0.172% 87.899% ( 15, 22 ] 258 0.031% 87.931% ( 22, 34 ] 40 0.005% 87.936% ( 34, 51 ] 10 0.001% 87.937% ( 51, 76 ] 5 0.001% 87.938% ( 76, 110 ] 1557 0.190% 88.127% ( 110, 170 ] 32468 3.958% 92.086% # ( 170, 250 ] 34795 4.242% 96.328% # ( 250, 380 ] 11614 1.416% 97.743% ( 380, 580 ] 7963 0.971% 98.714% ( 580, 870 ] 5065 0.617% 99.332% ( 870, 1300 ] 2970 0.362% 99.694% ( 1300, 1900 ] 1337 0.163% 99.857% ( 1900, 2900 ] 958 0.117% 99.974% ( 2900, 4400 ] 764 0.093% 100.067% ( 4400, 6600 ] 164 0.020% 100.087% ( 6600, 9900 ] 22 0.003% 100.089% ( 9900, 14000 ] 2 0.000% 100.090% ( 14000, 22000 ] 2 0.000% 100.090% ( 22000, 33000 ] 5 0.001% 100.090% ** Level 1 read latency histogram (micros): Count: 3271 Average: 384.2140 StdDev: 1125.88 Min: 84 Median: 199.9452 Max: 28026 Percentiles: P50: 199.95 P75: 301.40 P99: 3492.14 P99.9: 25803.80 P99.99: 28026.00 ------------------------------------------------------ ( 76, 110 ] 73 2.232% 2.232% ( 110, 170 ] 1153 35.249% 37.481% ####### ( 170, 250 ] 1094 33.445% 70.926% ####### ( 250, 380 ] 337 10.303% 81.229% ## ( 380, 580 ] 236 7.215% 88.444% # ( 580, 870 ] 163 4.983% 93.427% # ( 870, 1300 ] 96 2.935% 96.362% # ( 1300, 1900 ] 45 1.376% 97.738% ( 1900, 2900 ] 33 1.009% 98.747% ( 2900, 4400 ] 21 0.642% 99.389% ( 4400, 6600 ] 12 0.367% 99.755% ( 6600, 9900 ] 2 0.061% 99.817% ( 9900, 14000 ] 1 0.031% 99.847% ( 22000, 33000 ] 5 0.153% 100.000% ** Level 2 read latency histogram (micros): Count: 362074 Average: 14.0424 StdDev: 185.60 Min: 1 Median: 2.1136 Max: 27380 Percentiles: P50: 2.11 P75: 3.08 P99: 12.47 P99.9: 1249.87 P99.99: 1822.18 ------------------------------------------------------ [ 0, 1 ] 5547 1.532% 1.532% ( 1, 2 ] 164262 45.367% 46.899% ######### ( 2, 3 ] 98795 27.286% 74.185% ##### ( 3, 4 ] 35458 9.793% 83.978% ## ( 4, 6 ] 42008 11.602% 95.580% ## ( 6, 10 ] 11267 3.112% 98.692% # ( 10, 15 ] 2258 0.624% 99.315% ( 15, 22 ] 355 0.098% 99.413% ( 22, 34 ] 38 0.010% 99.424% ( 34, 51 ] 31 0.009% 99.432% ( 51, 76 ] 35 0.010% 99.442% ( 76, 110 ] 11 0.003% 99.445% ( 110, 170 ] 31 0.009% 99.454% ( 170, 250 ] 85 0.023% 99.477% ( 250, 380 ] 206 0.057% 99.534% ( 380, 580 ] 374 0.103% 99.637% ( 580, 870 ] 526 0.145% 99.783% ( 870, 1300 ] 481 0.133% 99.915% ( 1300, 1900 ] 310 0.086% 100.001% ( 1900, 2900 ] 272 0.075% 100.076% ( 2900, 4400 ] 284 0.078% 100.155% ( 4400, 6600 ] 85 0.023% 100.178% ( 6600, 9900 ] 20 0.006% 100.184% ( 9900, 14000 ] 2 0.001% 100.184% ( 22000, 33000 ] 3 0.001% 100.185% ** Level 3 read latency histogram (micros): Count: 599316 Average: 14.2818 StdDev: 141.00 Min: 1 Median: 2.2092 Max: 14323 Percentiles: P50: 2.21 P75: 3.14 P99: 199.09 P99.9: 1171.09 P99.99: 1610.75 ------------------------------------------------------ [ 0, 1 ] 5957 0.994% 0.994% ( 1, 2 ] 256221 42.752% 43.746% ######### ( 2, 3 ] 179188 29.899% 73.645% ###### ( 3, 4 ] 59414 9.914% 83.559% ## ( 4, 6 ] 68571 11.442% 95.000% ## ( 6, 10 ] 17337 2.893% 97.893% # ( 10, 15 ] 2813 0.469% 98.362% ( 15, 22 ] 414 0.069% 98.431% ( 22, 34 ] 65 0.011% 98.442% ( 34, 51 ] 64 0.011% 98.453% ( 51, 76 ] 67 0.011% 98.464% ( 76, 110 ] 151 0.025% 98.489% ( 110, 170 ] 2262 0.377% 98.867% ( 170, 250 ] 2197 0.367% 99.233% ( 250, 380 ] 1056 0.176% 99.409% ( 380, 580 ] 1138 0.190% 99.599% ( 580, 870 ] 1154 0.193% 99.792% ( 870, 1300 ] 925 0.154% 99.946% ( 1300, 1900 ] 506 0.084% 100.031% ( 1900, 2900 ] 401 0.067% 100.098% ( 2900, 4400 ] 340 0.057% 100.154% ( 4400, 6600 ] 61 0.010% 100.165% ( 6600, 9900 ] 6 0.001% 100.166% ( 9900, 14000 ] 1 0.000% 100.166% ( 14000, 22000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 634346 Average: 43.4548 StdDev: 233.46 Min: 0 Median: 2.3091 Max: 16214 Percentiles: P50: 2.31 P75: 3.76 P99: 710.54 P99.9: 1793.98 P99.99: 2286.61 ------------------------------------------------------ [ 0, 1 ] 6994 1.103% 1.103% ( 1, 2 ] 258468 40.746% 41.848% ######## ( 2, 3 ] 167317 26.376% 68.224% ##### ( 3, 4 ] 56522 8.910% 77.135% ## ( 4, 6 ] 63143 9.954% 87.089% ## ( 6, 10 ] 15494 2.443% 89.531% ( 10, 15 ] 2517 0.397% 89.928% ( 15, 22 ] 359 0.057% 89.985% ( 22, 34 ] 69 0.011% 89.996% ( 34, 51 ] 56 0.009% 90.004% ( 51, 76 ] 54 0.009% 90.013% ( 76, 110 ] 1250 0.197% 90.210% ( 110, 170 ] 21841 3.443% 93.653% # ( 170, 250 ] 20302 3.200% 96.853% # ( 250, 380 ] 6636 1.046% 97.900% ( 380, 580 ] 5266 0.830% 98.730% ( 580, 870 ] 3809 0.600% 99.330% ( 870, 1300 ] 2574 0.406% 99.736% ( 1300, 1900 ] 1264 0.199% 99.935% ( 1900, 2900 ] 899 0.142% 100.077% ( 2900, 4400 ] 875 0.138% 100.215% ( 4400, 6600 ] 219 0.035% 100.249% ( 6600, 9900 ] 34 0.005% 100.255% ( 9900, 14000 ] 2 0.000% 100.255% ( 14000, 22000 ] 2 0.000% 100.255% ** Level 5 read latency histogram (micros): Count: 53477 Average: 363.4236 StdDev: 580.80 Min: 84 Median: 201.3663 Max: 16314 Percentiles: P50: 201.37 P75: 317.19 P99: 3477.76 P99.9: 6335.50 P99.99: 10434.89 ------------------------------------------------------ ( 76, 110 ] 1122 2.098% 2.098% ( 110, 170 ] 18801 35.157% 37.255% ####### ( 170, 250 ] 17383 32.506% 69.761% ####### ( 250, 380 ] 5421 10.137% 79.898% ## ( 380, 580 ] 4120 7.704% 87.602% ## ( 580, 870 ] 2664 4.982% 92.584% # ( 870, 1300 ] 1733 3.241% 95.824% # ( 1300, 1900 ] 910 1.702% 97.526% ( 1900, 2900 ] 576 1.077% 98.603% ( 2900, 4400 ] 551 1.030% 99.633% ( 4400, 6600 ] 162 0.303% 99.936% ( 6600, 9900 ] 28 0.052% 99.989% ( 9900, 14000 ] 5 0.009% 99.998% ( 14000, 22000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 16.3 total, 5.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 181.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.011 H:M:S, 30.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 183.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.761 H:M:S, 32.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 373.248 micros/op 10691 ops/sec 20.202 seconds 215996 operations; 10.4 MB/s (53999 of 53999 found) Microseconds per read: Count: 215996 Average: 373.2594 StdDev: 886.96 Min: 2 Median: 232.0038 Max: 49561 Percentiles: P50: 232.00 P75: 357.14 P99: 2765.97 P99.9: 13414.62 P99.99: 32172.32 ------------------------------------------------------ ( 1, 2 ] 1 0.000% 0.000% ( 2, 3 ] 8 0.004% 0.004% ( 3, 4 ] 13 0.006% 0.010% ( 4, 6 ] 111 0.051% 0.062% ( 6, 10 ] 351 0.163% 0.224% ( 10, 15 ] 375 0.174% 0.398% ( 15, 22 ] 653 0.302% 0.700% ( 22, 34 ] 7040 3.259% 3.959% # ( 34, 51 ] 3434 1.590% 5.549% ( 51, 76 ] 435 0.201% 5.751% ( 76, 110 ] 53 0.025% 5.775% ( 110, 170 ] 21314 9.868% 15.643% ## ( 170, 250 ] 95749 44.329% 59.972% ######### ( 250, 380 ] 39387 18.235% 78.207% #### ( 380, 580 ] 23678 10.962% 89.169% ## ( 580, 870 ] 11593 5.367% 94.536% # ( 870, 1300 ] 5731 2.653% 97.190% # ( 1300, 1900 ] 2560 1.185% 98.375% ( 1900, 2900 ] 1559 0.722% 99.097% ( 2900, 4400 ] 1245 0.576% 99.673% ( 4400, 6600 ] 358 0.166% 99.839% ( 6600, 9900 ] 90 0.042% 99.881% ( 9900, 14000 ] 49 0.023% 99.903% ( 14000, 22000 ] 94 0.044% 99.947% ( 22000, 33000 ] 101 0.047% 99.994% ( 33000, 50000 ] 14 0.006% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3790631 rocksdb.bloom.filter.full.positive COUNT : 252256 rocksdb.bloom.filter.full.true.positive COUNT : 215191 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 805 rocksdb.memtable.miss COUNT : 215191 rocksdb.l0.hit COUNT : 40128 rocksdb.l1.hit COUNT : 4290 rocksdb.l2andup.hit COUNT : 170773 rocksdb.compaction.key.drop.new COUNT : 455623 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3347703 rocksdb.number.keys.read COUNT : 215996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3454829496 rocksdb.bytes.read COUNT : 215996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 447 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7727096 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11034309716 rocksdb.compact.write.bytes COUNT : 10561115125 rocksdb.flush.write.bytes COUNT : 3429544715 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 26 rocksdb.number.superversion_acquires COUNT : 604 rocksdb.number.superversion_releases COUNT : 583 rocksdb.number.superversion_cleanups COUNT : 147 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3407282176 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6268928 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 11357673397 rocksdb.non.last.level.read.count COUNT : 2712231 rocksdb.block.checksum.compute.count COUNT : 2928110 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 231.159265 P95 : 942.961485 P99 : 2765.793192 P100 : 49559.000000 COUNT : 215996 SUM : 80350899 rocksdb.db.write.micros P50 : 1.509912 P95 : 4.144788 P99 : 8.092031 P100 : 646610.000000 COUNT : 3347703 SUM : 15954199 rocksdb.compaction.times.micros P50 : 1500000.000000 P95 : 3600000.000000 P99 : 8480000.000000 P100 : 8791971.000000 COUNT : 40 SUM : 71267829 rocksdb.compaction.times.cpu_micros P50 : 1030000.000000 P95 : 1836363.636364 P99 : 2070718.000000 P100 : 2070718.000000 COUNT : 40 SUM : 42507767 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 20400.000000 P99 : 37801.000000 P100 : 37801.000000 COUNT : 48 SUM : 181329 rocksdb.compaction.outfile.sync.micros P50 : 4950.000000 P95 : 115500.000000 P99 : 159100.000000 P100 : 161937.000000 COUNT : 109 SUM : 2420273 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 244.782609 P95 : 2050.000000 P99 : 6699.000000 P100 : 7587.000000 COUNT : 97 SUM : 57304 rocksdb.table.open.io.micros P50 : 7850.000000 P95 : 25850.000000 P99 : 42401.000000 P100 : 45060.000000 COUNT : 447 SUM : 4239458 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.041013 P95 : 12.687719 P99 : 348.584178 P100 : 16217.000000 COUNT : 2672613 SUM : 56602293 rocksdb.read.block.get.micros P50 : 186.607235 P95 : 801.062965 P99 : 2465.289093 P100 : 28866.000000 COUNT : 255163 SUM : 70567439 rocksdb.write.raw.block.micros P50 : 0.539274 P95 : 1.471363 P99 : 4.513683 P100 : 17332.000000 COUNT : 3389690 SUM : 10339001 rocksdb.numfiles.in.singlecompaction P50 : 2.909091 P95 : 5.750000 P99 : 12.000000 P100 : 12.000000 COUNT : 50 SUM : 173 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565461 P95 : 1128.255207 P99 : 1294.234244 P100 : 646448.000000 COUNT : 43087 SUM : 7732817 rocksdb.sst.read.micros P50 : 2.010151 P95 : 216.372393 P99 : 728.043069 P100 : 28026.000000 COUNT : 2712461 SUM : 116962947 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 215996 SUM : 215996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3347703 SUM : 3454829496 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223333.333333 P95 : 724666.666667 P99 : 866685.000000 P100 : 866685.000000 COUNT : 48 SUM : 13768809 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 131 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0