[2024-12-06 18:21:23.237899] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-06 18:21:23.238024] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid543642 ] Set seed to 1733505683235401 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 18:21:23.342626] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 18:21:23.379171] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 18:21:23.379216] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 543642' to capture a snapshot of events at runtime. [2024-12-06 18:21:23.379231] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid543642 for offline analysis/debug. [2024-12-06 18:21:23.379276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 18:21:27 2024 CPU: 112 * Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz CPUCache: 39424 KB 2024/12/06-18:21:36 ... thread 0: (1000000,1000000) ops and (110043.1,110043.1) ops/second in (9.087346,9.087346) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 1.67 GB 56.7 0.3 0.0 0.3 1.2 0.9 0.0 1.4 38.6 146.5 8.16 3.64 12 0.680 319K 390 0.0 0.0 L1 6/6 715.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 12/11 1.46 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/2 1.07 GB 0.9 2.0 1.2 0.8 1.9 1.1 0.0 1.7 113.8 112.5 17.69 8.92 9 1.966 1231K 0 0.0 0.0 L4 182/6 9.66 GB 1.0 5.0 2.7 2.3 4.9 2.6 0.0 1.8 120.3 118.0 42.30 22.80 27 1.567 1819K 0 0.0 0.0 L5 1124/0 92.21 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/31 106.78 GB 0.0 7.2 3.8 3.4 8.0 4.6 2.7 9.3 108.8 120.0 68.16 35.36 48 1.420 3370K 390 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 3.8 3.4 8.0 4.6 2.7 9.3 108.8 120.0 68.16 35.36 48 1.420 3370K 390 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 3.8 3.4 7.1 3.7 0.0 0.0 119.2 117.3 62.23 32.95 37 1.682 3370K 390 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 148.6 5.93 2.41 11 0.540 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.99 GB write, 880.03 MB/s write, 7.24 GB read, 798.17 MB/s read, 68.2 seconds Interval compaction: 7.99 GB write, 899.69 MB/s write, 7.24 GB read, 816.00 MB/s read, 68.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 18, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 348492 Average: 11.8517 StdDev: 206.73 Min: 1 Median: 1.8235 Max: 53803 Percentiles: P50: 1.82 P75: 2.92 P99: 13.99 P99.9: 1938.70 P99.99: 3989.86 ------------------------------------------------------ [ 0, 1 ] 25655 7.362% 7.362% # ( 1, 2 ] 180438 51.777% 59.139% ########## ( 2, 3 ] 60260 17.292% 76.430% ### ( 3, 4 ] 36957 10.605% 87.035% ## ( 4, 6 ] 32946 9.454% 96.489% ## ( 6, 10 ] 7171 2.058% 98.547% ( 10, 15 ] 1983 0.569% 99.116% ( 15, 22 ] 196 0.056% 99.172% ( 22, 34 ] 45 0.013% 99.185% ( 34, 51 ] 36 0.010% 99.195% ( 51, 76 ] 40 0.011% 99.207% ( 76, 110 ] 17 0.005% 99.211% ( 110, 170 ] 77 0.022% 99.234% ( 170, 250 ] 218 0.063% 99.296% ( 250, 380 ] 379 0.109% 99.405% ( 380, 580 ] 531 0.152% 99.557% ( 580, 870 ] 564 0.162% 99.719% ( 870, 1300 ] 378 0.108% 99.828% ( 1300, 1900 ] 248 0.071% 99.899% ( 1900, 2900 ] 194 0.056% 99.954% ( 2900, 4400 ] 175 0.050% 100.005% ( 4400, 6600 ] 32 0.009% 100.014% ( 6600, 9900 ] 9 0.003% 100.016% ( 9900, 14000 ] 2 0.001% 100.017% ( 14000, 22000 ] 2 0.001% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ( 33000, 50000 ] 2 0.001% 100.018% ( 50000, 75000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 101383 Average: 8.2318 StdDev: 136.69 Min: 1 Median: 1.8469 Max: 18243 Percentiles: P50: 1.85 P75: 2.87 P99: 11.78 P99.9: 1240.33 P99.99: 6238.13 ------------------------------------------------------ [ 0, 1 ] 3790 3.738% 3.738% # ( 1, 2 ] 55380 54.625% 58.363% ########### ( 2, 3 ] 19307 19.044% 77.406% #### ( 3, 4 ] 10066 9.929% 87.335% ## ( 4, 6 ] 9259 9.133% 96.468% ## ( 6, 10 ] 2342 2.310% 98.778% ( 10, 15 ] 632 0.623% 99.401% ( 15, 22 ] 54 0.053% 99.455% ( 22, 34 ] 8 0.008% 99.462% ( 34, 51 ] 12 0.012% 99.474% ( 51, 76 ] 19 0.019% 99.493% ( 76, 110 ] 2 0.002% 99.495% ( 110, 170 ] 16 0.016% 99.511% ( 170, 250 ] 46 0.045% 99.556% ( 250, 380 ] 100 0.099% 99.655% ( 380, 580 ] 117 0.115% 99.770% ( 580, 870 ] 92 0.091% 99.861% ( 870, 1300 ] 46 0.045% 99.906% ( 1300, 1900 ] 27 0.027% 99.933% ( 1900, 2900 ] 24 0.024% 99.957% ( 2900, 4400 ] 23 0.023% 99.979% ( 4400, 6600 ] 13 0.013% 99.992% ( 6600, 9900 ] 5 0.005% 99.997% ( 9900, 14000 ] 2 0.002% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 390175 Average: 10.3201 StdDev: 175.03 Min: 1 Median: 1.8591 Max: 53742 Percentiles: P50: 1.86 P75: 2.99 P99: 11.89 P99.9: 1880.22 P99.99: 4071.20 ------------------------------------------------------ [ 0, 1 ] 21516 5.514% 5.514% # ( 1, 2 ] 202047 51.784% 57.298% ########## ( 2, 3 ] 69494 17.811% 75.109% #### ( 3, 4 ] 42790 10.967% 86.076% ## ( 4, 6 ] 39562 10.140% 96.216% ## ( 6, 10 ] 9935 2.546% 98.762% # ( 10, 15 ] 2462 0.631% 99.393% ( 15, 22 ] 239 0.061% 99.454% ( 22, 34 ] 44 0.011% 99.465% ( 34, 51 ] 54 0.014% 99.479% ( 51, 76 ] 50 0.013% 99.492% ( 76, 110 ] 26 0.007% 99.499% ( 110, 170 ] 39 0.010% 99.509% ( 170, 250 ] 100 0.026% 99.534% ( 250, 380 ] 192 0.049% 99.584% ( 380, 580 ] 301 0.077% 99.661% ( 580, 870 ] 354 0.091% 99.751% ( 870, 1300 ] 340 0.087% 99.839% ( 1300, 1900 ] 248 0.064% 99.902% ( 1900, 2900 ] 204 0.052% 99.954% ( 2900, 4400 ] 178 0.046% 100.000% ( 4400, 6600 ] 52 0.013% 100.013% ( 6600, 9900 ] 14 0.004% 100.017% ( 9900, 14000 ] 1 0.000% 100.017% ( 14000, 22000 ] 4 0.001% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ( 50000, 75000 ] 1 0.000% 100.019% ** Level 3 read latency histogram (micros): Count: 834492 Average: 7.7120 StdDev: 139.52 Min: 1 Median: 1.8546 Max: 39567 Percentiles: P50: 1.85 P75: 2.98 P99: 9.63 P99.9: 688.75 P99.99: 1194.35 ------------------------------------------------------ [ 0, 1 ] 47849 5.734% 5.734% # ( 1, 2 ] 432251 51.798% 57.532% ########## ( 2, 3 ] 148786 17.830% 75.362% #### ( 3, 4 ] 92638 11.101% 86.463% ## ( 4, 6 ] 87699 10.509% 96.972% ## ( 6, 10 ] 18635 2.233% 99.205% ( 10, 15 ] 4168 0.499% 99.704% ( 15, 22 ] 399 0.048% 99.752% ( 22, 34 ] 78 0.009% 99.762% ( 34, 51 ] 72 0.009% 99.770% ( 51, 76 ] 76 0.009% 99.779% ( 76, 110 ] 33 0.004% 99.783% ( 110, 170 ] 41 0.005% 99.788% ( 170, 250 ] 88 0.011% 99.799% ( 250, 380 ] 223 0.027% 99.826% ( 380, 580 ] 413 0.049% 99.875% ( 580, 870 ] 556 0.067% 99.942% ( 870, 1300 ] 535 0.064% 100.006% ( 1300, 1900 ] 414 0.050% 100.055% ( 1900, 2900 ] 307 0.037% 100.092% ( 2900, 4400 ] 226 0.027% 100.119% ( 4400, 6600 ] 55 0.007% 100.126% ( 6600, 9900 ] 10 0.001% 100.127% ( 9900, 14000 ] 4 0.000% 100.128% ( 14000, 22000 ] 2 0.000% 100.128% ( 22000, 33000 ] 1 0.000% 100.128% ( 33000, 50000 ] 4 0.000% 100.128% ** Level 4 read latency histogram (micros): Count: 641554 Average: 18.4336 StdDev: 254.47 Min: 1 Median: 1.8588 Max: 54479 Percentiles: P50: 1.86 P75: 3.02 P99: 299.02 P99.9: 1888.86 P99.99: 2790.40 ------------------------------------------------------ [ 0, 1 ] 34390 5.360% 5.360% # ( 1, 2 ] 333472 51.979% 57.339% ########## ( 2, 3 ] 112160 17.483% 74.822% ### ( 3, 4 ] 70292 10.957% 85.778% ## ( 4, 6 ] 65147 10.155% 95.933% ## ( 6, 10 ] 14856 2.316% 98.248% ( 10, 15 ] 3454 0.538% 98.787% ( 15, 22 ] 313 0.049% 98.836% ( 22, 34 ] 45 0.007% 98.843% ( 34, 51 ] 59 0.009% 98.852% ( 51, 76 ] 78 0.012% 98.864% ( 76, 110 ] 35 0.005% 98.869% ( 110, 170 ] 117 0.018% 98.888% ( 170, 250 ] 410 0.064% 98.952% ( 250, 380 ] 826 0.129% 99.080% ( 380, 580 ] 1341 0.209% 99.289% ( 580, 870 ] 1628 0.254% 99.543% ( 870, 1300 ] 1468 0.229% 99.772% ( 1300, 1900 ] 838 0.131% 99.903% ( 1900, 2900 ] 631 0.098% 100.001% ( 2900, 4400 ] 547 0.085% 100.086% ( 4400, 6600 ] 142 0.022% 100.108% ( 6600, 9900 ] 20 0.003% 100.111% ( 9900, 14000 ] 7 0.001% 100.113% ( 14000, 22000 ] 9 0.001% 100.114% ( 22000, 33000 ] 6 0.001% 100.115% ( 33000, 50000 ] 6 0.001% 100.116% ( 50000, 75000 ] 1 0.000% 100.116% ** Level 5 read latency histogram (micros): Count: 24335 Average: 1075.3298 StdDev: 1383.81 Min: 55 Median: 702.0602 Max: 71232 Percentiles: P50: 702.06 P75: 1289.18 P99: 5386.17 P99.9: 10810.54 P99.99: 41726.10 ------------------------------------------------------ ( 51, 76 ] 10 0.041% 0.041% ( 76, 110 ] 30 0.123% 0.164% ( 110, 170 ] 519 2.133% 2.297% ( 170, 250 ] 1767 7.261% 9.558% # ( 250, 380 ] 3425 14.074% 23.633% ### ( 380, 580 ] 4493 18.463% 42.096% #### ( 580, 870 ] 4570 18.780% 60.875% #### ( 870, 1300 ] 3526 14.489% 75.365% ### ( 1300, 1900 ] 2320 9.534% 84.898% ## ( 1900, 2900 ] 2000 8.219% 93.117% ## ( 2900, 4400 ] 1290 5.301% 98.418% # ( 4400, 6600 ] 316 1.299% 99.716% ( 6600, 9900 ] 42 0.173% 99.889% ( 9900, 14000 ] 12 0.049% 99.938% ( 14000, 22000 ] 3 0.012% 99.951% ( 22000, 33000 ] 7 0.029% 99.979% ( 33000, 50000 ] 5 0.021% 100.000% ( 50000, 75000 ] 1 0.004% 100.004% ** DB Stats ** Uptime(secs): 9.3 total, 9.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 105.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.016 H:M:S, 54.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 108.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.016 H:M:S, 55.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/06-18:21:41 ... thread 0: (1000000,2000000) ops and (204240.0,143025.2) ops/second in (4.896200,13.983546) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 1.84 GB 12.6 1.2 0.0 1.2 3.0 1.8 0.0 1.6 72.6 187.2 16.48 9.78 29 0.568 1215K 1365 0.0 0.0 L1 12/12 1.19 GB 0.0 1.5 0.8 0.7 1.5 0.8 0.0 1.9 131.2 130.7 11.80 7.05 1 11.798 1572K 6119 0.0 0.0 L2 1/0 82.02 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 965.76 MB 1.0 3.6 2.7 0.9 3.6 2.7 0.1 1.3 122.2 121.3 30.45 16.64 13 2.343 1571K 164 0.0 0.0 L4 174/0 9.41 GB 1.0 7.8 4.4 3.4 7.7 4.2 0.1 1.8 126.2 124.0 63.53 36.26 43 1.477 3446K 257 0.0 0.0 L5 1148/0 94.24 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/23 107.72 GB 0.0 14.1 7.9 6.2 15.8 9.6 5.3 8.6 118.5 132.5 122.26 69.74 86 1.422 7806K 7905 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 7.9 6.2 15.8 9.6 5.3 8.6 118.5 132.5 122.26 69.74 86 1.422 7806K 7905 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 7.9 6.2 14.0 7.7 0.0 0.0 129.7 128.2 111.65 64.49 61 1.830 7806K 7905 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 178.0 10.62 5.25 25 0.425 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.2 total, 14.0 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.82 GB write, 1141.71 MB/s write, 14.14 GB read, 1020.63 MB/s read, 122.3 seconds Interval compaction: 15.82 GB write, 1158.29 MB/s write, 14.14 GB read, 1035.45 MB/s read, 122.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 32, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 612709 Average: 11.4202 StdDev: 205.64 Min: 1 Median: 1.7259 Max: 66932 Percentiles: P50: 1.73 P75: 2.65 P99: 170.49 P99.9: 1552.20 P99.99: 3607.50 ------------------------------------------------------ [ 0, 1 ] 63409 10.349% 10.349% ## ( 1, 2 ] 334700 54.626% 64.975% ########### ( 2, 3 ] 94381 15.404% 80.379% ### ( 3, 4 ] 54526 8.899% 89.278% ## ( 4, 6 ] 46227 7.545% 96.823% ## ( 6, 10 ] 9649 1.575% 98.398% ( 10, 15 ] 2507 0.409% 98.807% ( 15, 22 ] 243 0.040% 98.847% ( 22, 34 ] 53 0.009% 98.855% ( 34, 51 ] 44 0.007% 98.862% ( 51, 76 ] 74 0.012% 98.875% ( 76, 110 ] 97 0.016% 98.890% ( 110, 170 ] 664 0.108% 98.999% ( 170, 250 ] 1291 0.211% 99.209% ( 250, 380 ] 1383 0.226% 99.435% ( 380, 580 ] 1207 0.197% 99.632% ( 580, 870 ] 935 0.153% 99.785% ( 870, 1300 ] 568 0.093% 99.877% ( 1300, 1900 ] 329 0.054% 99.931% ( 1900, 2900 ] 248 0.040% 99.972% ( 2900, 4400 ] 239 0.039% 100.011% ( 4400, 6600 ] 61 0.010% 100.021% ( 6600, 9900 ] 15 0.002% 100.023% ( 9900, 14000 ] 3 0.000% 100.024% ( 14000, 22000 ] 4 0.001% 100.024% ( 22000, 33000 ] 1 0.000% 100.024% ( 33000, 50000 ] 4 0.001% 100.025% ( 50000, 75000 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 221302 Average: 10.3063 StdDev: 240.85 Min: 1 Median: 1.8569 Max: 59189 Percentiles: P50: 1.86 P75: 2.92 P99: 13.42 P99.9: 1555.93 P99.99: 6306.89 ------------------------------------------------------ [ 0, 1 ] 8564 3.870% 3.870% # ( 1, 2 ] 119134 53.833% 57.703% ########### ( 2, 3 ] 41791 18.884% 76.587% #### ( 3, 4 ] 22684 10.250% 86.837% ## ( 4, 6 ] 20522 9.273% 96.111% ## ( 6, 10 ] 5419 2.449% 98.559% ( 10, 15 ] 1425 0.644% 99.203% ( 15, 22 ] 179 0.081% 99.284% ( 22, 34 ] 23 0.010% 99.295% ( 34, 51 ] 22 0.010% 99.305% ( 51, 76 ] 39 0.018% 99.322% ( 76, 110 ] 14 0.006% 99.329% ( 110, 170 ] 77 0.035% 99.363% ( 170, 250 ] 189 0.085% 99.449% ( 250, 380 ] 272 0.123% 99.572% ( 380, 580 ] 265 0.120% 99.691% ( 580, 870 ] 264 0.119% 99.811% ( 870, 1300 ] 164 0.074% 99.885% ( 1300, 1900 ] 79 0.036% 99.920% ( 1900, 2900 ] 68 0.031% 99.951% ( 2900, 4400 ] 59 0.027% 99.978% ( 4400, 6600 ] 31 0.014% 99.992% ( 6600, 9900 ] 9 0.004% 99.996% ( 9900, 14000 ] 3 0.001% 99.997% ( 14000, 22000 ] 2 0.001% 99.998% ( 22000, 33000 ] 4 0.002% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.001% ** Level 2 read latency histogram (micros): Count: 469873 Average: 9.9766 StdDev: 193.73 Min: 1 Median: 1.8326 Max: 53742 Percentiles: P50: 1.83 P75: 2.92 P99: 11.74 P99.9: 1799.91 P99.99: 4116.93 ------------------------------------------------------ [ 0, 1 ] 26050 5.544% 5.544% # ( 1, 2 ] 250897 53.397% 58.941% ########### ( 2, 3 ] 82448 17.547% 76.488% #### ( 3, 4 ] 48827 10.392% 86.879% ## ( 4, 6 ] 44443 9.459% 96.338% ## ( 6, 10 ] 11528 2.453% 98.791% ( 10, 15 ] 2815 0.599% 99.390% ( 15, 22 ] 272 0.058% 99.448% ( 22, 34 ] 50 0.011% 99.459% ( 34, 51 ] 56 0.012% 99.471% ( 51, 76 ] 57 0.012% 99.483% ( 76, 110 ] 39 0.008% 99.491% ( 110, 170 ] 85 0.018% 99.509% ( 170, 250 ] 194 0.041% 99.551% ( 250, 380 ] 298 0.063% 99.614% ( 380, 580 ] 368 0.078% 99.692% ( 580, 870 ] 401 0.085% 99.778% ( 870, 1300 ] 356 0.076% 99.853% ( 1300, 1900 ] 263 0.056% 99.909% ( 1900, 2900 ] 220 0.047% 99.956% ( 2900, 4400 ] 196 0.042% 99.998% ( 4400, 6600 ] 56 0.012% 100.010% ( 6600, 9900 ] 15 0.003% 100.013% ( 9900, 14000 ] 1 0.000% 100.013% ( 14000, 22000 ] 5 0.001% 100.014% ( 22000, 33000 ] 3 0.001% 100.015% ( 33000, 50000 ] 2 0.000% 100.015% ( 50000, 75000 ] 1 0.000% 100.016% ** Level 3 read latency histogram (micros): Count: 1262700 Average: 8.4315 StdDev: 157.85 Min: 1 Median: 1.8486 Max: 42130 Percentiles: P50: 1.85 P75: 2.94 P99: 9.74 P99.9: 690.01 P99.99: 1190.12 ------------------------------------------------------ [ 0, 1 ] 66271 5.248% 5.248% # ( 1, 2 ] 665862 52.733% 57.982% ########### ( 2, 3 ] 228385 18.087% 76.069% #### ( 3, 4 ] 136427 10.804% 86.873% ## ( 4, 6 ] 127304 10.082% 96.955% ## ( 6, 10 ] 27655 2.190% 99.145% ( 10, 15 ] 6509 0.515% 99.660% ( 15, 22 ] 577 0.046% 99.706% ( 22, 34 ] 103 0.008% 99.714% ( 34, 51 ] 109 0.009% 99.723% ( 51, 76 ] 129 0.010% 99.733% ( 76, 110 ] 57 0.005% 99.738% ( 110, 170 ] 126 0.010% 99.748% ( 170, 250 ] 268 0.021% 99.769% ( 250, 380 ] 539 0.043% 99.812% ( 380, 580 ] 773 0.061% 99.873% ( 580, 870 ] 905 0.072% 99.944% ( 870, 1300 ] 772 0.061% 100.006% ( 1300, 1900 ] 552 0.044% 100.049% ( 1900, 2900 ] 503 0.040% 100.089% ( 2900, 4400 ] 440 0.035% 100.124% ( 4400, 6600 ] 110 0.009% 100.133% ( 6600, 9900 ] 35 0.003% 100.136% ( 9900, 14000 ] 7 0.001% 100.136% ( 14000, 22000 ] 6 0.000% 100.137% ( 22000, 33000 ] 4 0.000% 100.137% ( 33000, 50000 ] 6 0.000% 100.137% ** Level 4 read latency histogram (micros): Count: 900156 Average: 19.6704 StdDev: 260.90 Min: 1 Median: 1.8513 Max: 54479 Percentiles: P50: 1.85 P75: 2.98 P99: 380.62 P99.9: 1976.47 P99.99: 2949.30 ------------------------------------------------------ [ 0, 1 ] 47774 5.307% 5.307% # ( 1, 2 ] 472590 52.501% 57.808% ########### ( 2, 3 ] 157158 17.459% 75.267% ### ( 3, 4 ] 96251 10.693% 85.960% ## ( 4, 6 ] 87650 9.737% 95.697% ## ( 6, 10 ] 20244 2.249% 97.946% ( 10, 15 ] 4732 0.526% 98.472% ( 15, 22 ] 419 0.047% 98.518% ( 22, 34 ] 60 0.007% 98.525% ( 34, 51 ] 85 0.009% 98.534% ( 51, 76 ] 122 0.014% 98.548% ( 76, 110 ] 98 0.011% 98.559% ( 110, 170 ] 633 0.070% 98.629% ( 170, 250 ] 1386 0.154% 98.783% ( 250, 380 ] 1945 0.216% 98.999% ( 380, 580 ] 2400 0.267% 99.266% ( 580, 870 ] 2519 0.280% 99.546% ( 870, 1300 ] 2006 0.223% 99.768% ( 1300, 1900 ] 1119 0.124% 99.893% ( 1900, 2900 ] 848 0.094% 99.987% ( 2900, 4400 ] 821 0.091% 100.078% ( 4400, 6600 ] 222 0.025% 100.103% ( 6600, 9900 ] 31 0.003% 100.106% ( 9900, 14000 ] 11 0.001% 100.108% ( 14000, 22000 ] 14 0.002% 100.109% ( 22000, 33000 ] 15 0.002% 100.111% ( 33000, 50000 ] 6 0.001% 100.111% ( 50000, 75000 ] 1 0.000% 100.112% ** Level 5 read latency histogram (micros): Count: 50654 Average: 795.9482 StdDev: 1309.59 Min: 55 Median: 453.1468 Max: 71232 Percentiles: P50: 453.15 P75: 866.75 P99: 4715.12 P99.9: 9508.79 P99.99: 40626.20 ------------------------------------------------------ ( 51, 76 ] 10 0.020% 0.020% ( 76, 110 ] 308 0.608% 0.628% ( 110, 170 ] 3972 7.841% 8.469% ## ( 170, 250 ] 8258 16.303% 24.772% ### ( 250, 380 ] 9577 18.907% 43.679% #### ( 380, 580 ] 8755 17.284% 60.963% ### ( 580, 870 ] 7191 14.196% 75.159% ### ( 870, 1300 ] 4951 9.774% 84.933% ## ( 1300, 1900 ] 2900 5.725% 90.658% # ( 1900, 2900 ] 2408 4.754% 95.412% # ( 2900, 4400 ] 1752 3.459% 98.871% # ( 4400, 6600 ] 457 0.902% 99.773% ( 6600, 9900 ] 73 0.144% 99.917% ( 9900, 14000 ] 14 0.028% 99.945% ( 14000, 22000 ] 9 0.018% 99.962% ( 22000, 33000 ] 9 0.018% 99.980% ( 33000, 50000 ] 11 0.022% 100.002% ( 50000, 75000 ] 3 0.006% 100.008% ** DB Stats ** Uptime(secs): 14.2 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 138.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.109 H:M:S, 43.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 201.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.093 H:M:S, 22.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-18:21:45 ... thread 0: (1000000,3000000) ops and (291006.2,172216.8) ops/second in (3.436353,17.419899) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 2.83 GB 125.8 2.3 0.0 2.3 5.1 2.8 0.0 1.8 98.1 219.9 23.77 16.57 49 0.485 2366K 2667 0.0 0.0 L1 12/12 1.19 GB 0.0 1.5 0.8 0.7 1.5 0.8 0.0 1.9 131.2 130.7 11.80 7.05 1 11.798 1572K 6119 0.0 0.0 L2 1/0 82.02 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 965.76 MB 1.0 3.6 2.7 0.9 3.6 2.7 0.1 1.3 122.2 121.3 30.45 16.64 13 2.343 1571K 164 0.0 0.0 L4 174/0 9.41 GB 1.0 7.8 4.4 3.4 7.7 4.2 0.1 1.8 126.2 124.0 63.53 36.26 43 1.477 3446K 257 0.0 0.0 L5 1148/0 94.24 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1369/23 108.70 GB 0.0 15.3 7.9 7.3 17.9 10.6 5.3 6.3 120.5 141.6 129.55 76.52 106 1.222 8957K 9207 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 7.9 7.3 17.9 10.6 5.3 6.3 120.5 141.6 129.55 76.52 106 1.222 8957K 9207 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 7.9 7.3 15.1 7.7 0.0 0.0 134.8 133.3 115.82 68.55 65 1.782 8957K 9207 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 211.1 13.73 7.97 41 0.335 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.6 total, 17.4 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.91 GB write, 1040.56 MB/s write, 15.25 GB read, 885.98 MB/s read, 129.5 seconds Interval compaction: 17.91 GB write, 1052.69 MB/s write, 15.25 GB read, 896.31 MB/s read, 129.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 32, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 922467 Average: 12.5661 StdDev: 170.74 Min: 0 Median: 1.6127 Max: 66932 Percentiles: P50: 1.61 P75: 2.32 P99: 249.63 P99.9: 1024.34 P99.99: 2389.06 ------------------------------------------------------ [ 0, 1 ] 154191 16.715% 16.715% ### ( 1, 2 ] 501137 54.326% 71.041% ########### ( 2, 3 ] 114474 12.410% 83.450% ## ( 3, 4 ] 62694 6.796% 90.247% # ( 4, 6 ] 49936 5.413% 95.660% # ( 6, 10 ] 10773 1.168% 96.828% ( 10, 15 ] 2692 0.292% 97.120% ( 15, 22 ] 270 0.029% 97.149% ( 22, 34 ] 74 0.008% 97.157% ( 34, 51 ] 47 0.005% 97.162% ( 51, 76 ] 470 0.051% 97.213% ( 76, 110 ] 1210 0.131% 97.344% ( 110, 170 ] 6851 0.743% 98.087% ( 170, 250 ] 8464 0.918% 99.004% ( 250, 380 ] 4895 0.531% 99.535% ( 380, 580 ] 2143 0.232% 99.767% ( 580, 870 ] 1016 0.110% 99.878% ( 870, 1300 ] 581 0.063% 99.940% ( 1300, 1900 ] 335 0.036% 99.977% ( 1900, 2900 ] 251 0.027% 100.004% ( 2900, 4400 ] 240 0.026% 100.030% ( 4400, 6600 ] 61 0.007% 100.037% ( 6600, 9900 ] 15 0.002% 100.038% ( 9900, 14000 ] 3 0.000% 100.039% ( 14000, 22000 ] 4 0.000% 100.039% ( 22000, 33000 ] 1 0.000% 100.039% ( 33000, 50000 ] 4 0.000% 100.040% ( 50000, 75000 ] 2 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 222399 Average: 11.2804 StdDev: 240.75 Min: 1 Median: 1.8615 Max: 59189 Percentiles: P50: 1.86 P75: 2.94 P99: 150.76 P99.9: 1547.60 P99.99: 6299.10 ------------------------------------------------------ [ 0, 1 ] 8564 3.851% 3.851% # ( 1, 2 ] 119135 53.568% 57.419% ########### ( 2, 3 ] 41802 18.796% 76.215% #### ( 3, 4 ] 22686 10.201% 86.415% ## ( 4, 6 ] 20529 9.231% 95.646% ## ( 6, 10 ] 5419 2.437% 98.083% ( 10, 15 ] 1425 0.641% 98.723% ( 15, 22 ] 179 0.080% 98.804% ( 22, 34 ] 23 0.010% 98.814% ( 34, 51 ] 22 0.010% 98.824% ( 51, 76 ] 41 0.018% 98.843% ( 76, 110 ] 45 0.020% 98.863% ( 110, 170 ] 449 0.202% 99.065% ( 170, 250 ] 619 0.278% 99.343% ( 250, 380 ] 458 0.206% 99.549% ( 380, 580 ] 313 0.141% 99.690% ( 580, 870 ] 270 0.121% 99.811% ( 870, 1300 ] 165 0.074% 99.885% ( 1300, 1900 ] 79 0.036% 99.921% ( 1900, 2900 ] 68 0.031% 99.951% ( 2900, 4400 ] 59 0.027% 99.978% ( 4400, 6600 ] 31 0.014% 99.992% ( 6600, 9900 ] 9 0.004% 99.996% ( 9900, 14000 ] 3 0.001% 99.997% ( 14000, 22000 ] 2 0.001% 99.998% ( 22000, 33000 ] 4 0.002% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.001% ** Level 2 read latency histogram (micros): Count: 469873 Average: 9.9766 StdDev: 193.73 Min: 1 Median: 1.8326 Max: 53742 Percentiles: P50: 1.83 P75: 2.92 P99: 11.74 P99.9: 1799.91 P99.99: 4116.93 ------------------------------------------------------ [ 0, 1 ] 26050 5.544% 5.544% # ( 1, 2 ] 250897 53.397% 58.941% ########### ( 2, 3 ] 82448 17.547% 76.488% #### ( 3, 4 ] 48827 10.392% 86.879% ## ( 4, 6 ] 44443 9.459% 96.338% ## ( 6, 10 ] 11528 2.453% 98.791% ( 10, 15 ] 2815 0.599% 99.390% ( 15, 22 ] 272 0.058% 99.448% ( 22, 34 ] 50 0.011% 99.459% ( 34, 51 ] 56 0.012% 99.471% ( 51, 76 ] 57 0.012% 99.483% ( 76, 110 ] 39 0.008% 99.491% ( 110, 170 ] 85 0.018% 99.509% ( 170, 250 ] 194 0.041% 99.551% ( 250, 380 ] 298 0.063% 99.614% ( 380, 580 ] 368 0.078% 99.692% ( 580, 870 ] 401 0.085% 99.778% ( 870, 1300 ] 356 0.076% 99.853% ( 1300, 1900 ] 263 0.056% 99.909% ( 1900, 2900 ] 220 0.047% 99.956% ( 2900, 4400 ] 196 0.042% 99.998% ( 4400, 6600 ] 56 0.012% 100.010% ( 6600, 9900 ] 15 0.003% 100.013% ( 9900, 14000 ] 1 0.000% 100.013% ( 14000, 22000 ] 5 0.001% 100.014% ( 22000, 33000 ] 3 0.001% 100.015% ( 33000, 50000 ] 2 0.000% 100.015% ( 50000, 75000 ] 1 0.000% 100.016% ** Level 3 read latency histogram (micros): Count: 1263302 Average: 8.4981 StdDev: 157.87 Min: 1 Median: 1.8491 Max: 42130 Percentiles: P50: 1.85 P75: 2.94 P99: 9.80 P99.9: 690.65 P99.99: 1190.79 ------------------------------------------------------ [ 0, 1 ] 66271 5.246% 5.246% # ( 1, 2 ] 665885 52.710% 57.956% ########### ( 2, 3 ] 228444 18.083% 76.039% #### ( 3, 4 ] 136463 10.802% 86.841% ## ( 4, 6 ] 127355 10.081% 96.922% ## ( 6, 10 ] 27660 2.190% 99.112% ( 10, 15 ] 6511 0.515% 99.627% ( 15, 22 ] 579 0.046% 99.673% ( 22, 34 ] 103 0.008% 99.681% ( 34, 51 ] 109 0.009% 99.690% ( 51, 76 ] 129 0.010% 99.700% ( 76, 110 ] 75 0.006% 99.706% ( 110, 170 ] 281 0.022% 99.728% ( 170, 250 ] 432 0.034% 99.762% ( 250, 380 ] 606 0.048% 99.810% ( 380, 580 ] 790 0.063% 99.873% ( 580, 870 ] 906 0.072% 99.944% ( 870, 1300 ] 773 0.061% 100.006% ( 1300, 1900 ] 553 0.044% 100.049% ( 1900, 2900 ] 503 0.040% 100.089% ( 2900, 4400 ] 440 0.035% 100.124% ( 4400, 6600 ] 110 0.009% 100.133% ( 6600, 9900 ] 35 0.003% 100.135% ( 9900, 14000 ] 7 0.001% 100.136% ( 14000, 22000 ] 6 0.000% 100.136% ( 22000, 33000 ] 4 0.000% 100.137% ( 33000, 50000 ] 6 0.000% 100.137% ** Level 4 read latency histogram (micros): Count: 907273 Average: 20.9601 StdDev: 260.45 Min: 1 Median: 1.8586 Max: 54479 Percentiles: P50: 1.86 P75: 3.03 P99: 398.66 P99.9: 1968.07 P99.99: 2948.00 ------------------------------------------------------ [ 0, 1 ] 47774 5.266% 5.266% # ( 1, 2 ] 472695 52.101% 57.366% ########## ( 2, 3 ] 157458 17.355% 74.721% ### ( 3, 4 ] 96425 10.628% 85.349% ## ( 4, 6 ] 87904 9.689% 95.038% ## ( 6, 10 ] 20271 2.234% 97.272% ( 10, 15 ] 4747 0.523% 97.796% ( 15, 22 ] 420 0.046% 97.842% ( 22, 34 ] 60 0.007% 97.849% ( 34, 51 ] 85 0.009% 97.858% ( 51, 76 ] 122 0.013% 97.871% ( 76, 110 ] 357 0.039% 97.911% ( 110, 170 ] 2804 0.309% 98.220% ( 170, 250 ] 3810 0.420% 98.640% ( 250, 380 ] 3018 0.333% 98.972% ( 380, 580 ] 2683 0.296% 99.268% ( 580, 870 ] 2549 0.281% 99.549% ( 870, 1300 ] 2006 0.221% 99.770% ( 1300, 1900 ] 1120 0.123% 99.894% ( 1900, 2900 ] 848 0.093% 99.987% ( 2900, 4400 ] 821 0.090% 100.078% ( 4400, 6600 ] 222 0.024% 100.102% ( 6600, 9900 ] 31 0.003% 100.105% ( 9900, 14000 ] 11 0.001% 100.107% ( 14000, 22000 ] 14 0.002% 100.108% ( 22000, 33000 ] 15 0.002% 100.110% ( 33000, 50000 ] 6 0.001% 100.111% ( 50000, 75000 ] 1 0.000% 100.111% ** Level 5 read latency histogram (micros): Count: 91728 Average: 533.5825 StdDev: 1017.67 Min: 55 Median: 259.6438 Max: 71232 Percentiles: P50: 259.64 P75: 522.97 P99: 4088.97 P99.9: 6838.32 P99.99: 14735.29 ------------------------------------------------------ ( 51, 76 ] 10 0.011% 0.011% ( 76, 110 ] 1717 1.872% 1.883% ( 110, 170 ] 18186 19.826% 21.709% #### ( 170, 250 ] 24718 26.947% 48.656% ##### ( 250, 380 ] 16621 18.120% 66.776% #### ( 380, 580 ] 10553 11.505% 78.280% ## ( 580, 870 ] 7324 7.984% 86.265% ## ( 870, 1300 ] 4968 5.416% 91.681% # ( 1300, 1900 ] 2913 3.176% 94.857% # ( 1900, 2900 ] 2412 2.630% 97.486% # ( 2900, 4400 ] 1752 1.910% 99.396% ( 4400, 6600 ] 457 0.498% 99.894% ( 6600, 9900 ] 73 0.080% 99.974% ( 9900, 14000 ] 14 0.015% 99.989% ( 14000, 22000 ] 9 0.010% 99.999% ( 22000, 33000 ] 9 0.010% 100.009% ( 33000, 50000 ] 11 0.012% 100.021% ( 50000, 75000 ] 3 0.003% 100.024% ** DB Stats ** Uptime(secs): 17.6 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 167.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.109 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/06-18:21:49 ... thread 0: (1000000,4000000) ops and (204245.5,179243.8) ops/second in (4.896069,22.315968) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.81 GB 251.7 3.5 0.0 3.5 7.3 3.8 0.0 1.9 114.8 239.5 31.28 23.63 70 0.447 3645K 3950 0.0 0.0 L1 12/12 1.19 GB 0.0 1.5 0.8 0.7 1.5 0.8 0.0 1.9 131.2 130.7 11.80 7.05 1 11.798 1572K 6119 0.0 0.0 L2 1/0 82.02 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 965.76 MB 1.0 3.6 2.7 0.9 3.6 2.7 0.1 1.3 122.2 121.3 30.45 16.64 13 2.343 1571K 164 0.0 0.0 L4 174/0 9.41 GB 1.0 7.8 4.4 3.4 7.7 4.2 0.1 1.8 126.2 124.0 63.53 36.26 43 1.477 3446K 257 0.0 0.0 L5 1148/0 94.24 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1370/19 109.68 GB 0.0 16.5 7.9 8.6 20.1 11.5 5.3 5.3 123.1 150.4 137.06 83.58 127 1.079 10M 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.5 7.9 8.6 20.1 11.5 5.3 5.3 123.1 150.4 137.06 83.58 127 1.079 10M 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.5 7.9 8.6 16.3 7.7 0.0 0.0 140.2 138.7 120.40 73.03 70 1.720 10M 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 234.4 16.66 10.55 57 0.292 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.5 total, 22.3 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.12 GB write, 915.00 MB/s write, 16.48 GB read, 749.32 MB/s read, 137.1 seconds Interval compaction: 20.12 GB write, 923.32 MB/s write, 16.48 GB read, 756.14 MB/s read, 137.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 32, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1251418 Average: 14.1991 StdDev: 149.95 Min: 0 Median: 1.5532 Max: 66932 Percentiles: P50: 1.55 P75: 2.12 P99: 269.04 P99.9: 797.66 P99.99: 1766.23 ------------------------------------------------------ [ 0, 1 ] 257328 20.563% 20.563% #### ( 1, 2 ] 665911 53.213% 73.775% ########### ( 2, 3 ] 132406 10.580% 84.356% ## ( 3, 4 ] 70578 5.640% 89.996% # ( 4, 6 ] 54554 4.359% 94.355% # ( 6, 10 ] 11985 0.958% 95.313% ( 10, 15 ] 2932 0.234% 95.547% ( 15, 22 ] 299 0.024% 95.571% ( 22, 34 ] 96 0.008% 95.579% ( 34, 51 ] 52 0.004% 95.583% ( 51, 76 ] 1112 0.089% 95.672% ( 76, 110 ] 3506 0.280% 95.952% ( 110, 170 ] 17710 1.415% 97.367% ( 170, 250 ] 19145 1.530% 98.897% ( 250, 380 ] 8805 0.704% 99.601% ( 380, 580 ] 2940 0.235% 99.835% ( 580, 870 ] 1076 0.086% 99.921% ( 870, 1300 ] 589 0.047% 99.969% ( 1300, 1900 ] 346 0.028% 99.996% ( 1900, 2900 ] 260 0.021% 100.017% ( 2900, 4400 ] 241 0.019% 100.036% ( 4400, 6600 ] 61 0.005% 100.041% ( 6600, 9900 ] 15 0.001% 100.042% ( 9900, 14000 ] 3 0.000% 100.043% ( 14000, 22000 ] 4 0.000% 100.043% ( 22000, 33000 ] 1 0.000% 100.043% ( 33000, 50000 ] 4 0.000% 100.043% ( 50000, 75000 ] 2 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 224069 Average: 12.6505 StdDev: 240.46 Min: 1 Median: 1.8685 Max: 59189 Percentiles: P50: 1.87 P75: 2.97 P99: 218.11 P99.9: 1534.92 P99.99: 6287.25 ------------------------------------------------------ [ 0, 1 ] 8564 3.822% 3.822% # ( 1, 2 ] 119135 53.169% 56.991% ########### ( 2, 3 ] 41802 18.656% 75.647% #### ( 3, 4 ] 22687 10.125% 85.772% ## ( 4, 6 ] 20530 9.162% 94.934% ## ( 6, 10 ] 5419 2.418% 97.353% ( 10, 15 ] 1425 0.636% 97.989% ( 15, 22 ] 179 0.080% 98.068% ( 22, 34 ] 23 0.010% 98.079% ( 34, 51 ] 22 0.010% 98.089% ( 51, 76 ] 41 0.018% 98.107% ( 76, 110 ] 141 0.063% 98.170% ( 110, 170 ] 1105 0.493% 98.663% ( 170, 250 ] 1256 0.561% 99.223% ( 250, 380 ] 685 0.306% 99.529% ( 380, 580 ] 361 0.161% 99.690% ( 580, 870 ] 273 0.122% 99.812% ( 870, 1300 ] 166 0.074% 99.886% ( 1300, 1900 ] 79 0.035% 99.921% ( 1900, 2900 ] 68 0.030% 99.952% ( 2900, 4400 ] 59 0.026% 99.978% ( 4400, 6600 ] 31 0.014% 99.992% ( 6600, 9900 ] 9 0.004% 99.996% ( 9900, 14000 ] 3 0.001% 99.997% ( 14000, 22000 ] 2 0.001% 99.998% ( 22000, 33000 ] 4 0.002% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.001% ** Level 2 read latency histogram (micros): Count: 469873 Average: 9.9766 StdDev: 193.73 Min: 1 Median: 1.8326 Max: 53742 Percentiles: P50: 1.83 P75: 2.92 P99: 11.74 P99.9: 1799.91 P99.99: 4116.93 ------------------------------------------------------ [ 0, 1 ] 26050 5.544% 5.544% # ( 1, 2 ] 250897 53.397% 58.941% ########### ( 2, 3 ] 82448 17.547% 76.488% #### ( 3, 4 ] 48827 10.392% 86.879% ## ( 4, 6 ] 44443 9.459% 96.338% ## ( 6, 10 ] 11528 2.453% 98.791% ( 10, 15 ] 2815 0.599% 99.390% ( 15, 22 ] 272 0.058% 99.448% ( 22, 34 ] 50 0.011% 99.459% ( 34, 51 ] 56 0.012% 99.471% ( 51, 76 ] 57 0.012% 99.483% ( 76, 110 ] 39 0.008% 99.491% ( 110, 170 ] 85 0.018% 99.509% ( 170, 250 ] 194 0.041% 99.551% ( 250, 380 ] 298 0.063% 99.614% ( 380, 580 ] 368 0.078% 99.692% ( 580, 870 ] 401 0.085% 99.778% ( 870, 1300 ] 356 0.076% 99.853% ( 1300, 1900 ] 263 0.056% 99.909% ( 1900, 2900 ] 220 0.047% 99.956% ( 2900, 4400 ] 196 0.042% 99.998% ( 4400, 6600 ] 56 0.012% 100.010% ( 6600, 9900 ] 15 0.003% 100.013% ( 9900, 14000 ] 1 0.000% 100.013% ( 14000, 22000 ] 5 0.001% 100.014% ( 22000, 33000 ] 3 0.001% 100.015% ( 33000, 50000 ] 2 0.000% 100.015% ( 50000, 75000 ] 1 0.000% 100.016% ** Level 3 read latency histogram (micros): Count: 1264243 Average: 8.6261 StdDev: 157.92 Min: 1 Median: 1.8498 Max: 42130 Percentiles: P50: 1.85 P75: 2.95 P99: 9.92 P99.9: 691.90 P99.99: 1191.99 ------------------------------------------------------ [ 0, 1 ] 66271 5.242% 5.242% # ( 1, 2 ] 665897 52.672% 57.914% ########### ( 2, 3 ] 228472 18.072% 75.985% #### ( 3, 4 ] 136486 10.796% 86.781% ## ( 4, 6 ] 127392 10.077% 96.858% ## ( 6, 10 ] 27663 2.188% 99.046% ( 10, 15 ] 6512 0.515% 99.561% ( 15, 22 ] 579 0.046% 99.607% ( 22, 34 ] 103 0.008% 99.615% ( 34, 51 ] 109 0.009% 99.624% ( 51, 76 ] 129 0.010% 99.634% ( 76, 110 ] 115 0.009% 99.643% ( 110, 170 ] 611 0.048% 99.691% ( 170, 250 ] 761 0.060% 99.751% ( 250, 380 ] 713 0.056% 99.808% ( 380, 580 ] 815 0.064% 99.872% ( 580, 870 ] 909 0.072% 99.944% ( 870, 1300 ] 774 0.061% 100.005% ( 1300, 1900 ] 554 0.044% 100.049% ( 1900, 2900 ] 504 0.040% 100.089% ( 2900, 4400 ] 440 0.035% 100.124% ( 4400, 6600 ] 110 0.009% 100.133% ( 6600, 9900 ] 35 0.003% 100.135% ( 9900, 14000 ] 7 0.001% 100.136% ( 14000, 22000 ] 6 0.000% 100.136% ( 22000, 33000 ] 4 0.000% 100.137% ( 33000, 50000 ] 6 0.000% 100.137% ** Level 4 read latency histogram (micros): Count: 918031 Average: 22.8930 StdDev: 259.71 Min: 1 Median: 1.8699 Max: 54479 Percentiles: P50: 1.87 P75: 3.11 P99: 409.86 P99.9: 1957.61 P99.99: 2946.04 ------------------------------------------------------ [ 0, 1 ] 47774 5.204% 5.204% # ( 1, 2 ] 472753 51.496% 56.700% ########## ( 2, 3 ] 157601 17.167% 73.868% ### ( 3, 4 ] 96529 10.515% 84.382% ## ( 4, 6 ] 88101 9.597% 93.979% ## ( 6, 10 ] 20295 2.211% 96.190% ( 10, 15 ] 4755 0.518% 96.708% ( 15, 22 ] 425 0.046% 96.754% ( 22, 34 ] 60 0.007% 96.761% ( 34, 51 ] 85 0.009% 96.770% ( 51, 76 ] 123 0.013% 96.783% ( 76, 110 ] 819 0.089% 96.873% ( 110, 170 ] 6963 0.758% 97.631% ( 170, 250 ] 7812 0.851% 98.482% ( 250, 380 ] 4314 0.470% 98.952% ( 380, 580 ] 2958 0.322% 99.274% ( 580, 870 ] 2565 0.279% 99.554% ( 870, 1300 ] 2009 0.219% 99.772% ( 1300, 1900 ] 1123 0.122% 99.895% ( 1900, 2900 ] 850 0.093% 99.987% ( 2900, 4400 ] 821 0.089% 100.077% ( 4400, 6600 ] 222 0.024% 100.101% ( 6600, 9900 ] 31 0.003% 100.104% ( 9900, 14000 ] 11 0.001% 100.105% ( 14000, 22000 ] 14 0.002% 100.107% ( 22000, 33000 ] 15 0.002% 100.109% ( 33000, 50000 ] 6 0.001% 100.109% ( 50000, 75000 ] 1 0.000% 100.109% ** Level 5 read latency histogram (micros): Count: 153646 Average: 397.2287 StdDev: 805.42 Min: 55 Median: 217.0625 Max: 71232 Percentiles: P50: 217.06 P75: 347.37 P99: 3532.31 P99.9: 6178.07 P99.99: 8889.00 ------------------------------------------------------ ( 51, 76 ] 10 0.007% 0.007% ( 76, 110 ] 4523 2.944% 2.950% # ( 110, 170 ] 43516 28.322% 31.273% ###### ( 170, 250 ] 48912 31.834% 63.107% ###### ( 250, 380 ] 24396 15.878% 78.985% ### ( 380, 580 ] 12235 7.963% 86.948% ## ( 580, 870 ] 7446 4.846% 91.794% # ( 870, 1300 ] 4981 3.242% 95.036% # ( 1300, 1900 ] 2927 1.905% 96.941% ( 1900, 2900 ] 2425 1.578% 98.519% ( 2900, 4400 ] 1752 1.140% 99.660% ( 4400, 6600 ] 457 0.297% 99.957% ( 6600, 9900 ] 73 0.048% 100.005% ( 9900, 14000 ] 14 0.009% 100.014% ( 14000, 22000 ] 9 0.006% 100.020% ( 22000, 33000 ] 9 0.006% 100.025% ( 33000, 50000 ] 11 0.007% 100.033% ( 50000, 75000 ] 3 0.002% 100.034% ** DB Stats ** Uptime(secs): 22.5 total, 4.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 174.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.431 H:M:S, 33.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 201.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.322 H:M:S, 27.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 269.727 micros/op 14812 ops/sec 60.152 seconds 890996 operations; 14.4 MB/s (227999 of 227999 found) Microseconds per read: Count: 890996 Average: 269.7304 StdDev: 717.19 Min: 2 Median: 208.4590 Max: 138885 Percentiles: P50: 208.46 P75: 261.57 P99: 1183.44 P99.9: 10851.16 P99.99: 28926.84 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 46 0.005% 0.006% ( 3, 4 ] 48 0.005% 0.011% ( 4, 6 ] 58 0.007% 0.018% ( 6, 10 ] 575 0.065% 0.082% ( 10, 15 ] 4886 0.548% 0.631% ( 15, 22 ] 2057 0.231% 0.862% ( 22, 34 ] 8900 0.999% 1.860% ( 34, 51 ] 1808 0.203% 2.063% ( 51, 76 ] 315 0.035% 2.099% ( 76, 110 ] 8360 0.938% 3.037% ( 110, 170 ] 224629 25.211% 28.248% ##### ( 170, 250 ] 403151 45.247% 73.495% ######### ( 250, 380 ] 150617 16.904% 90.400% ### ( 380, 580 ] 57799 6.487% 96.887% # ( 580, 870 ] 14631 1.642% 98.529% ( 870, 1300 ] 5762 0.647% 99.175% ( 1300, 1900 ] 2496 0.280% 99.455% ( 1900, 2900 ] 1573 0.177% 99.632% ( 2900, 4400 ] 1417 0.159% 99.791% ( 4400, 6600 ] 505 0.057% 99.848% ( 6600, 9900 ] 363 0.041% 99.888% ( 9900, 14000 ] 444 0.050% 99.938% ( 14000, 22000 ] 374 0.042% 99.980% ( 22000, 33000 ] 138 0.015% 99.996% ( 33000, 50000 ] 28 0.003% 99.999% ( 50000, 75000 ] 6 0.001% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13998532 rocksdb.bloom.filter.full.positive COUNT : 1026625 rocksdb.bloom.filter.full.true.positive COUNT : 890632 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 364 rocksdb.memtable.miss COUNT : 890632 rocksdb.l0.hit COUNT : 33545 rocksdb.l1.hit COUNT : 10534 rocksdb.l2andup.hit COUNT : 846553 rocksdb.compaction.key.drop.new COUNT : 199810 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4259543 rocksdb.number.keys.read COUNT : 890996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4395848376 rocksdb.bytes.read COUNT : 890996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1632 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43227358 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 21312485470 rocksdb.compact.write.bytes COUNT : 21106443309 rocksdb.flush.write.bytes COUNT : 4359751567 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 36 rocksdb.number.superversion_acquires COUNT : 894 rocksdb.number.superversion_releases COUNT : 859 rocksdb.number.superversion_cleanups COUNT : 222 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 180 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324608000 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1702912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 24907330907 rocksdb.non.last.level.read.count COUNT : 5875098 rocksdb.block.checksum.compute.count COUNT : 6199437 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 207.599994 P95 : 520.947161 P99 : 1182.192724 P100 : 138883.000000 COUNT : 890996 SUM : 239574634 rocksdb.db.write.micros P50 : 1.535413 P95 : 5.338832 P99 : 14.471542 P100 : 763950.000000 COUNT : 4259543 SUM : 54781928 rocksdb.compaction.times.micros P50 : 1331250.000000 P95 : 2870000.000000 P99 : 11797789.000000 P100 : 11797789.000000 COUNT : 72 SUM : 126496460 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 1872000.000000 P99 : 7049410.000000 P100 : 7049410.000000 COUNT : 72 SUM : 79065131 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 774.843750 P95 : 74375.000000 P99 : 300700.000000 P100 : 358961.000000 COUNT : 61 SUM : 849406 rocksdb.compaction.outfile.sync.micros P50 : 21428.571429 P95 : 275000.000000 P99 : 375000.000000 P100 : 796737.000000 COUNT : 250 SUM : 16423342 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 188.666667 P95 : 3591.666667 P99 : 7309.500000 P100 : 9723.000000 COUNT : 157 SUM : 130507 rocksdb.table.open.io.micros P50 : 7359.470468 P95 : 17994.160584 P99 : 21806.131387 P100 : 125002.000000 COUNT : 1632 SUM : 12744040 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.757273 P95 : 16.099159 P99 : 229.504552 P100 : 66937.000000 COUNT : 5161628 SUM : 85738722 rocksdb.read.block.get.micros P50 : 162.723862 P95 : 360.819655 P99 : 1137.504973 P100 : 71281.000000 COUNT : 1036171 SUM : 207697454 rocksdb.write.raw.block.micros P50 : 0.530715 P95 : 1.228237 P99 : 3.765969 P100 : 66316.000000 COUNT : 6168320 SUM : 16752185 rocksdb.numfiles.in.singlecompaction P50 : 3.029412 P95 : 5.854545 P99 : 15.280000 P100 : 19.000000 COUNT : 96 SUM : 354 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574537 P95 : 1288.871518 P99 : 2698.145249 P100 : 763766.000000 COUNT : 214432 SUM : 43248477 rocksdb.sst.read.micros P50 : 1.944109 P95 : 216.975469 P99 : 389.102145 P100 : 71232.000000 COUNT : 5875145 SUM : 277402406 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 890996 SUM : 890996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4259543 SUM : 4395848376 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223023.255814 P95 : 852750.000000 P99 : 983046.000000 P100 : 983046.000000 COUNT : 61 SUM : 17487292 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 271 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0