[2024-07-23 11:48:32.776672] Starting SPDK v24.05.1-pre git sha1 241d0f3c9 / DPDK 23.11.0 initialization... [2024-07-23 11:48:32.776980] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625560 ] Set seed to 1721728112769343 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-23 11:48:32.917708] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-23 11:48:32.962217] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-23 11:48:32.962273] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1625560' to capture a snapshot of events at runtime. [2024-07-23 11:48:32.962287] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-23 11:48:32.962302] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-23 11:48:32.962313] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1625560 for offline analysis/debug. [2024-07-23 11:48:32.962443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Jul 23 11:48:34 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/23-11:48:42 ... thread 0: (1000000,1000000) ops and (129684.7,129684.7) ops/second in (7.711012,7.711012) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 3.06 GB 56.7 0.3 0.0 0.3 1.2 0.9 0.0 1.4 31.9 121.3 9.86 4.90 12 0.822 319K 367 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/3 1.09 GB 1.0 1.6 0.9 0.7 1.6 0.9 0.0 1.8 105.5 104.8 15.93 8.88 6 2.654 1001K 0 0.0 0.0 L4 160/0 9.53 GB 1.0 4.0 1.7 2.3 4.0 1.7 0.0 2.3 100.6 98.9 41.13 24.30 35 1.175 1416K 0 0.0 0.0 L5 1144/0 92.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/15 106.51 GB 0.0 6.0 2.6 3.4 6.8 3.4 2.3 7.9 91.7 103.6 66.92 38.08 53 1.263 2738K 367 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 2.6 3.4 6.8 3.4 2.3 7.9 91.7 103.6 66.92 38.08 53 1.263 2738K 367 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 2.6 3.4 5.9 2.5 0.0 0.0 102.5 101.1 59.88 35.11 42 1.426 2738K 367 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 125.2 7.04 2.98 11 0.640 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.77 GB write, 882.76 MB/s write, 5.99 GB read, 781.00 MB/s read, 66.9 seconds Interval compaction: 6.77 GB write, 898.94 MB/s write, 5.99 GB read, 795.32 MB/s read, 66.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 308871 Average: 23.2498 StdDev: 439.94 Min: 1 Median: 1.9839 Max: 49514 Percentiles: P50: 1.98 P75: 3.05 P99: 311.88 P99.9: 3679.41 P99.99: 14393.08 ------------------------------------------------------ [ 0, 1 ] 12192 3.947% 3.947% # ( 1, 2 ] 144573 46.807% 50.754% ######### ( 2, 3 ] 73314 23.736% 74.490% ##### ( 3, 4 ] 30808 9.974% 84.465% ## ( 4, 6 ] 33126 10.725% 95.190% ## ( 6, 10 ] 7258 2.350% 97.539% ( 10, 15 ] 1853 0.600% 98.139% ( 15, 22 ] 218 0.071% 98.210% ( 22, 34 ] 54 0.017% 98.227% ( 34, 51 ] 72 0.023% 98.251% ( 51, 76 ] 65 0.021% 98.272% ( 76, 110 ] 79 0.026% 98.297% ( 110, 170 ] 567 0.184% 98.481% ( 170, 250 ] 1184 0.383% 98.864% ( 250, 380 ] 883 0.286% 99.150% ( 380, 580 ] 878 0.284% 99.434% ( 580, 870 ] 618 0.200% 99.634% ( 870, 1300 ] 314 0.102% 99.736% ( 1300, 1900 ] 164 0.053% 99.789% ( 1900, 2900 ] 194 0.063% 99.852% ( 2900, 4400 ] 287 0.093% 99.945% ( 4400, 6600 ] 79 0.026% 99.971% ( 6600, 9900 ] 43 0.014% 99.984% ( 9900, 14000 ] 16 0.005% 99.990% ( 14000, 22000 ] 43 0.014% 100.004% ( 22000, 33000 ] 26 0.008% 100.012% ( 33000, 50000 ] 9 0.003% 100.015% ** Level 2 read latency histogram (micros): Count: 233233 Average: 13.9439 StdDev: 318.69 Min: 1 Median: 2.1093 Max: 54981 Percentiles: P50: 2.11 P75: 3.33 P99: 13.14 P99.9: 1286.00 P99.99: 2632.96 ------------------------------------------------------ [ 0, 1 ] 5253 2.252% 2.252% ( 1, 2 ] 105388 45.186% 47.438% ######### ( 2, 3 ] 54671 23.441% 70.878% ##### ( 3, 4 ] 29287 12.557% 83.435% ### ( 4, 6 ] 27456 11.772% 95.207% ## ( 6, 10 ] 7309 3.134% 98.341% # ( 10, 15 ] 2450 1.050% 99.392% ( 15, 22 ] 371 0.159% 99.551% ( 22, 34 ] 86 0.037% 99.588% ( 34, 51 ] 65 0.028% 99.615% ( 51, 76 ] 57 0.024% 99.640% ( 76, 110 ] 32 0.014% 99.654% ( 110, 170 ] 24 0.010% 99.664% ( 170, 250 ] 52 0.022% 99.686% ( 250, 380 ] 88 0.038% 99.724% ( 380, 580 ] 133 0.057% 99.781% ( 580, 870 ] 152 0.065% 99.846% ( 870, 1300 ] 130 0.056% 99.902% ( 1300, 1900 ] 95 0.041% 99.943% ( 1900, 2900 ] 151 0.065% 100.007% ( 2900, 4400 ] 161 0.069% 100.076% ( 4400, 6600 ] 48 0.021% 100.097% ( 6600, 9900 ] 20 0.009% 100.105% ( 9900, 14000 ] 2 0.001% 100.106% ( 14000, 22000 ] 15 0.006% 100.113% ( 22000, 33000 ] 9 0.004% 100.117% ( 33000, 50000 ] 2 0.001% 100.117% ( 50000, 75000 ] 1 0.000% 100.118% ** Level 3 read latency histogram (micros): Count: 527552 Average: 12.3054 StdDev: 292.93 Min: 1 Median: 2.0008 Max: 45059 Percentiles: P50: 2.00 P75: 3.06 P99: 10.59 P99.9: 756.22 P99.99: 1366.34 ------------------------------------------------------ [ 0, 1 ] 12387 2.348% 2.348% ( 1, 2 ] 251292 47.634% 49.982% ########## ( 2, 3 ] 128568 24.371% 74.352% ##### ( 3, 4 ] 58449 11.079% 85.432% ## ( 4, 6 ] 59504 11.279% 96.711% ## ( 6, 10 ] 11722 2.222% 98.933% ( 10, 15 ] 3006 0.570% 99.503% ( 15, 22 ] 376 0.071% 99.574% ( 22, 34 ] 78 0.015% 99.589% ( 34, 51 ] 84 0.016% 99.605% ( 51, 76 ] 115 0.022% 99.626% ( 76, 110 ] 56 0.011% 99.637% ( 110, 170 ] 101 0.019% 99.656% ( 170, 250 ] 229 0.043% 99.700% ( 250, 380 ] 349 0.066% 99.766% ( 380, 580 ] 435 0.082% 99.848% ( 580, 870 ] 450 0.085% 99.933% ( 870, 1300 ] 280 0.053% 99.987% ( 1300, 1900 ] 165 0.031% 100.018% ( 1900, 2900 ] 173 0.033% 100.051% ( 2900, 4400 ] 252 0.048% 100.098% ( 4400, 6600 ] 83 0.016% 100.114% ( 6600, 9900 ] 45 0.009% 100.123% ( 9900, 14000 ] 19 0.004% 100.126% ( 14000, 22000 ] 40 0.008% 100.134% ( 22000, 33000 ] 16 0.003% 100.137% ( 33000, 50000 ] 6 0.001% 100.138% ** Level 4 read latency histogram (micros): Count: 563866 Average: 26.3419 StdDev: 521.91 Min: 1 Median: 2.0094 Max: 83427 Percentiles: P50: 2.01 P75: 3.10 P99: 26.11 P99.9: 2358.98 P99.99: 3737.97 ------------------------------------------------------ [ 0, 1 ] 12415 2.202% 2.202% ( 1, 2 ] 268246 47.573% 49.774% ########## ( 2, 3 ] 135864 24.095% 73.870% ##### ( 3, 4 ] 61349 10.880% 84.750% ## ( 4, 6 ] 61914 10.980% 95.730% ## ( 6, 10 ] 13654 2.421% 98.151% ( 10, 15 ] 4311 0.765% 98.916% ( 15, 22 ] 435 0.077% 98.993% ( 22, 34 ] 115 0.020% 99.013% ( 34, 51 ] 115 0.020% 99.034% ( 51, 76 ] 97 0.017% 99.051% ( 76, 110 ] 45 0.008% 99.059% ( 110, 170 ] 218 0.039% 99.098% ( 170, 250 ] 548 0.097% 99.195% ( 250, 380 ] 735 0.130% 99.325% ( 380, 580 ] 943 0.167% 99.492% ( 580, 870 ] 1022 0.181% 99.674% ( 870, 1300 ] 690 0.122% 99.796% ( 1300, 1900 ] 403 0.071% 99.868% ( 1900, 2900 ] 399 0.071% 99.938% ( 2900, 4400 ] 522 0.093% 100.031% ( 4400, 6600 ] 227 0.040% 100.071% ( 6600, 9900 ] 101 0.018% 100.089% ( 9900, 14000 ] 48 0.009% 100.098% ( 14000, 22000 ] 116 0.021% 100.118% ( 22000, 33000 ] 85 0.015% 100.133% ( 33000, 50000 ] 17 0.003% 100.136% ( 75000, 110000 ] 1 0.000% 100.136% ** Level 5 read latency histogram (micros): Count: 17614 Average: 1243.3301 StdDev: 3200.73 Min: 89 Median: 507.3936 Max: 95579 Percentiles: P50: 507.39 P75: 1092.74 P99: 9715.80 P99.9: 44804.26 P99.99: 65137.86 ------------------------------------------------------ ( 76, 110 ] 94 0.534% 0.534% ( 110, 170 ] 1286 7.301% 7.835% # ( 170, 250 ] 2811 15.959% 23.794% ### ( 250, 380 ] 2700 15.329% 39.122% ### ( 380, 580 ] 3008 17.077% 56.200% ### ( 580, 870 ] 2477 14.063% 70.262% ### ( 870, 1300 ] 1611 9.146% 79.408% ## ( 1300, 1900 ] 963 5.467% 84.876% # ( 1900, 2900 ] 795 4.513% 89.389% # ( 2900, 4400 ] 1140 6.472% 95.861% # ( 4400, 6600 ] 449 2.549% 98.410% # ( 6600, 9900 ] 110 0.625% 99.035% ( 9900, 14000 ] 15 0.085% 99.120% ( 14000, 22000 ] 54 0.307% 99.427% ( 22000, 33000 ] 57 0.324% 99.750% ( 33000, 50000 ] 38 0.216% 99.966% ( 50000, 75000 ] 7 0.040% 100.006% ( 75000, 110000 ] 2 0.011% 100.017% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 125.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.344 H:M:S, 29.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.344 H:M:S, 30.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/23-11:48:46 ... thread 0: (1000000,2000000) ops and (254853.9,171897.7) ops/second in (3.923816,11.634828) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.05 GB 163.6 1.4 0.0 1.4 3.3 1.8 0.0 1.8 82.6 190.3 17.53 12.07 32 0.548 1471K 1560 0.0 0.0 L3 14/0 997.89 MB 1.0 1.9 1.0 0.9 1.9 1.0 0.0 1.8 110.7 109.9 17.53 10.06 7 2.504 1187K 0 0.0 0.0 L4 164/0 9.76 GB 1.0 4.3 1.8 2.5 4.2 1.8 0.1 2.3 104.1 102.3 42.44 25.52 37 1.147 1535K 0 0.0 0.0 L5 1144/0 92.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1341/11 107.49 GB 0.0 7.6 2.9 4.8 9.4 4.6 2.4 5.1 100.7 124.0 77.51 47.65 76 1.020 4194K 1560 0.0 0.0 Int 0/0 0.00 KB 0.0 7.6 2.9 4.8 9.4 4.6 2.4 5.1 100.7 124.0 77.51 47.65 76 1.020 4194K 1560 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.6 2.9 4.8 7.5 2.8 0.0 0.0 116.0 114.6 67.32 41.84 49 1.374 4194K 1560 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 185.6 10.18 5.81 27 0.377 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.8 total, 11.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.38 GB write, 815.72 MB/s write, 7.62 GB read, 662.89 MB/s read, 77.5 seconds Interval compaction: 9.38 GB write, 825.63 MB/s write, 7.62 GB read, 670.95 MB/s read, 77.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 623068 Average: 19.5707 StdDev: 312.08 Min: 0 Median: 1.7241 Max: 49514 Percentiles: P50: 1.72 P75: 2.68 P99: 249.26 P99.9: 1267.76 P99.99: 3828.71 ------------------------------------------------------ [ 0, 1 ] 83277 13.366% 13.366% ### ( 1, 2 ] 315218 50.591% 63.957% ########## ( 2, 3 ] 101358 16.268% 80.224% ### ( 3, 4 ] 43284 6.947% 87.171% # ( 4, 6 ] 39620 6.359% 93.530% # ( 6, 10 ] 9025 1.448% 94.979% ( 10, 15 ] 2279 0.366% 95.344% ( 15, 22 ] 353 0.057% 95.401% ( 22, 34 ] 107 0.017% 95.418% ( 34, 51 ] 83 0.013% 95.432% ( 51, 76 ] 68 0.011% 95.443% ( 76, 110 ] 1194 0.192% 95.634% ( 110, 170 ] 10693 1.716% 97.350% ( 170, 250 ] 10375 1.665% 99.016% ( 250, 380 ] 2919 0.468% 99.484% ( 380, 580 ] 1588 0.255% 99.739% ( 580, 870 ] 708 0.114% 99.853% ( 870, 1300 ] 321 0.052% 99.904% ( 1300, 1900 ] 164 0.026% 99.930% ( 1900, 2900 ] 195 0.031% 99.962% ( 2900, 4400 ] 287 0.046% 100.008% ( 4400, 6600 ] 79 0.013% 100.020% ( 6600, 9900 ] 43 0.007% 100.027% ( 9900, 14000 ] 16 0.003% 100.030% ( 14000, 22000 ] 43 0.007% 100.037% ( 22000, 33000 ] 26 0.004% 100.041% ( 33000, 50000 ] 9 0.001% 100.042% ** Level 2 read latency histogram (micros): Count: 233266 Average: 13.9696 StdDev: 318.68 Min: 1 Median: 2.1096 Max: 54981 Percentiles: P50: 2.11 P75: 3.33 P99: 13.20 P99.9: 1285.89 P99.99: 2632.94 ------------------------------------------------------ [ 0, 1 ] 5253 2.252% 2.252% ( 1, 2 ] 105388 45.179% 47.431% ######### ( 2, 3 ] 54671 23.437% 70.868% ##### ( 3, 4 ] 29287 12.555% 83.424% ### ( 4, 6 ] 27456 11.770% 95.194% ## ( 6, 10 ] 7309 3.133% 98.327% # ( 10, 15 ] 2450 1.050% 99.378% ( 15, 22 ] 371 0.159% 99.537% ( 22, 34 ] 86 0.037% 99.573% ( 34, 51 ] 65 0.028% 99.601% ( 51, 76 ] 57 0.024% 99.626% ( 76, 110 ] 32 0.014% 99.639% ( 110, 170 ] 36 0.015% 99.655% ( 170, 250 ] 69 0.030% 99.684% ( 250, 380 ] 91 0.039% 99.723% ( 380, 580 ] 134 0.057% 99.781% ( 580, 870 ] 152 0.065% 99.846% ( 870, 1300 ] 130 0.056% 99.902% ( 1300, 1900 ] 95 0.041% 99.943% ( 1900, 2900 ] 151 0.065% 100.007% ( 2900, 4400 ] 161 0.069% 100.076% ( 4400, 6600 ] 48 0.021% 100.097% ( 6600, 9900 ] 20 0.009% 100.105% ( 9900, 14000 ] 2 0.001% 100.106% ( 14000, 22000 ] 15 0.006% 100.113% ( 22000, 33000 ] 9 0.004% 100.117% ( 33000, 50000 ] 2 0.001% 100.117% ( 50000, 75000 ] 1 0.000% 100.118% ** Level 3 read latency histogram (micros): Count: 564874 Average: 11.9207 StdDev: 283.20 Min: 0 Median: 1.9744 Max: 45059 Percentiles: P50: 1.97 P75: 2.99 P99: 11.39 P99.9: 728.60 P99.99: 1327.32 ------------------------------------------------------ [ 0, 1 ] 14583 2.582% 2.582% # ( 1, 2 ] 274897 48.665% 51.247% ########## ( 2, 3 ] 135539 23.995% 75.241% ##### ( 3, 4 ] 60487 10.708% 85.949% ## ( 4, 6 ] 60880 10.778% 96.727% ## ( 6, 10 ] 11985 2.122% 98.849% ( 10, 15 ] 3077 0.545% 99.393% ( 15, 22 ] 389 0.069% 99.462% ( 22, 34 ] 79 0.014% 99.476% ( 34, 51 ] 85 0.015% 99.491% ( 51, 76 ] 115 0.020% 99.512% ( 76, 110 ] 90 0.016% 99.528% ( 110, 170 ] 420 0.074% 99.602% ( 170, 250 ] 566 0.100% 99.702% ( 250, 380 ] 424 0.075% 99.777% ( 380, 580 ] 461 0.082% 99.859% ( 580, 870 ] 453 0.080% 99.939% ( 870, 1300 ] 280 0.050% 99.989% ( 1300, 1900 ] 165 0.029% 100.018% ( 1900, 2900 ] 173 0.031% 100.049% ( 2900, 4400 ] 252 0.045% 100.093% ( 4400, 6600 ] 83 0.015% 100.108% ( 6600, 9900 ] 45 0.008% 100.116% ( 9900, 14000 ] 19 0.003% 100.119% ( 14000, 22000 ] 40 0.007% 100.126% ( 22000, 33000 ] 16 0.003% 100.129% ( 33000, 50000 ] 6 0.001% 100.130% ** Level 4 read latency histogram (micros): Count: 612654 Average: 26.3954 StdDev: 501.07 Min: 1 Median: 1.9890 Max: 83427 Percentiles: P50: 1.99 P75: 3.09 P99: 227.32 P99.9: 2204.13 P99.99: 3686.59 ------------------------------------------------------ [ 0, 1 ] 14671 2.395% 2.395% ( 1, 2 ] 294892 48.134% 50.528% ########## ( 2, 3 ] 143934 23.494% 74.022% ##### ( 3, 4 ] 63939 10.436% 84.458% ## ( 4, 6 ] 63730 10.402% 94.860% ## ( 6, 10 ] 14418 2.353% 97.214% ( 10, 15 ] 4512 0.736% 97.950% ( 15, 22 ] 459 0.075% 98.025% ( 22, 34 ] 120 0.020% 98.045% ( 34, 51 ] 115 0.019% 98.064% ( 51, 76 ] 97 0.016% 98.079% ( 76, 110 ] 373 0.061% 98.140% ( 110, 170 ] 2987 0.488% 98.628% ( 170, 250 ] 3183 0.520% 99.147% ( 250, 380 ] 1231 0.201% 99.348% ( 380, 580 ] 1108 0.181% 99.529% ( 580, 870 ] 1055 0.172% 99.701% ( 870, 1300 ] 693 0.113% 99.814% ( 1300, 1900 ] 403 0.066% 99.880% ( 1900, 2900 ] 399 0.065% 99.945% ( 2900, 4400 ] 522 0.085% 100.031% ( 4400, 6600 ] 227 0.037% 100.068% ( 6600, 9900 ] 101 0.016% 100.084% ( 9900, 14000 ] 48 0.008% 100.092% ( 14000, 22000 ] 116 0.019% 100.111% ( 22000, 33000 ] 85 0.014% 100.125% ( 33000, 50000 ] 17 0.003% 100.127% ( 75000, 110000 ] 1 0.000% 100.128% ** Level 5 read latency histogram (micros): Count: 71177 Average: 449.4368 StdDev: 1657.36 Min: 84 Median: 196.7649 Max: 95579 Percentiles: P50: 196.76 P75: 280.25 P99: 4391.09 P99.9: 23123.74 P99.99: 38763.13 ------------------------------------------------------ ( 76, 110 ] 2723 3.826% 3.826% # ( 110, 170 ] 24733 34.749% 38.574% ####### ( 170, 250 ] 24308 34.151% 72.726% ####### ( 250, 380 ] 6956 9.773% 82.499% ## ( 380, 580 ] 4524 6.356% 88.855% # ( 580, 870 ] 2698 3.791% 92.645% # ( 870, 1300 ] 1628 2.287% 94.932% ( 1300, 1900 ] 966 1.357% 96.290% ( 1900, 2900 ] 796 1.118% 97.408% ( 2900, 4400 ] 1140 1.602% 99.010% ( 4400, 6600 ] 449 0.631% 99.640% ( 6600, 9900 ] 110 0.155% 99.795% ( 9900, 14000 ] 15 0.021% 99.816% ( 14000, 22000 ] 54 0.076% 99.892% ( 22000, 33000 ] 57 0.080% 99.972% ( 33000, 50000 ] 38 0.053% 100.025% ( 50000, 75000 ] 7 0.010% 100.035% ( 75000, 110000 ] 2 0.003% 100.038% ** DB Stats ** Uptime(secs): 11.8 total, 3.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 167.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.344 H:M:S, 19.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 250.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/23-11:48:55 ... thread 0: (1000000,3000000) ops and (112617.1,146238.2) ops/second in (8.879644,20.514472) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 20/14 5.03 GB 132.1 2.6 0.0 2.6 5.5 2.8 0.0 1.9 106.8 221.0 25.36 19.52 53 0.478 2750K 2758 0.0 0.0 L3 14/0 997.89 MB 1.0 1.9 1.0 0.9 1.9 1.0 0.0 1.8 110.7 109.9 17.53 10.06 7 2.504 1187K 0 0.0 0.0 L4 164/0 9.76 GB 1.0 4.3 1.8 2.5 4.2 1.8 0.1 2.3 104.1 102.3 42.44 25.52 37 1.147 1535K 0 0.0 0.0 L5 1144/0 92.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1342/14 108.47 GB 0.0 8.9 2.9 6.0 11.6 5.6 2.4 4.1 106.3 139.2 85.33 55.10 97 0.880 5474K 2758 0.0 0.0 Int 0/0 0.00 KB 0.0 8.9 2.9 6.0 11.6 5.6 2.4 4.1 106.3 139.2 85.33 55.10 97 0.880 5474K 2758 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.9 2.9 6.0 8.8 2.8 0.0 0.0 125.7 124.4 72.14 46.55 54 1.336 5474K 2758 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 219.7 13.19 8.55 43 0.307 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.60 GB write, 574.81 MB/s write, 8.86 GB read, 438.95 MB/s read, 85.3 seconds Interval compaction: 11.60 GB write, 578.77 MB/s write, 8.86 GB read, 441.97 MB/s read, 85.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 20, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1397125 Average: 17.0022 StdDev: 211.53 Min: 0 Median: 1.5705 Max: 49514 Percentiles: P50: 1.57 P75: 2.21 P99: 238.20 P99.9: 556.29 P99.99: 1008.88 ------------------------------------------------------ [ 0, 1 ] 279656 20.017% 20.017% #### ( 1, 2 ] 734342 52.561% 72.577% ########### ( 2, 3 ] 158754 11.363% 83.940% ## ( 3, 4 ] 68101 4.874% 88.815% # ( 4, 6 ] 53285 3.814% 92.629% # ( 6, 10 ] 12654 0.906% 93.534% ( 10, 15 ] 3011 0.216% 93.750% ( 15, 22 ] 627 0.045% 93.795% ( 22, 34 ] 202 0.014% 93.809% ( 34, 51 ] 105 0.008% 93.817% ( 51, 76 ] 72 0.005% 93.822% ( 76, 110 ] 5451 0.390% 94.212% ( 110, 170 ] 41724 2.986% 97.198% # ( 170, 250 ] 29530 2.114% 99.312% ( 250, 380 ] 6030 0.432% 99.744% ( 380, 580 ] 2481 0.178% 99.921% ( 580, 870 ] 858 0.061% 99.983% ( 870, 1300 ] 326 0.023% 100.006% ( 1300, 1900 ] 168 0.012% 100.018% ( 1900, 2900 ] 196 0.014% 100.032% ( 2900, 4400 ] 287 0.021% 100.053% ( 4400, 6600 ] 79 0.006% 100.058% ( 6600, 9900 ] 43 0.003% 100.061% ( 9900, 14000 ] 16 0.001% 100.062% ( 14000, 22000 ] 43 0.003% 100.066% ( 22000, 33000 ] 26 0.002% 100.067% ( 33000, 50000 ] 9 0.001% 100.068% ** Level 2 read latency histogram (micros): Count: 233339 Average: 14.0182 StdDev: 318.64 Min: 1 Median: 2.1103 Max: 54981 Percentiles: P50: 2.11 P75: 3.33 P99: 13.35 P99.9: 1285.65 P99.99: 2632.89 ------------------------------------------------------ [ 0, 1 ] 5253 2.251% 2.251% ( 1, 2 ] 105388 45.165% 47.416% ######### ( 2, 3 ] 54671 23.430% 70.846% ##### ( 3, 4 ] 29287 12.551% 83.398% ### ( 4, 6 ] 27456 11.767% 95.164% ## ( 6, 10 ] 7309 3.132% 98.296% # ( 10, 15 ] 2450 1.050% 99.346% ( 15, 22 ] 371 0.159% 99.505% ( 22, 34 ] 86 0.037% 99.542% ( 34, 51 ] 65 0.028% 99.570% ( 51, 76 ] 57 0.024% 99.595% ( 76, 110 ] 37 0.016% 99.610% ( 110, 170 ] 71 0.030% 99.641% ( 170, 250 ] 99 0.042% 99.683% ( 250, 380 ] 94 0.040% 99.724% ( 380, 580 ] 134 0.057% 99.781% ( 580, 870 ] 152 0.065% 99.846% ( 870, 1300 ] 130 0.056% 99.902% ( 1300, 1900 ] 95 0.041% 99.943% ( 1900, 2900 ] 151 0.065% 100.007% ( 2900, 4400 ] 161 0.069% 100.076% ( 4400, 6600 ] 48 0.021% 100.097% ( 6600, 9900 ] 20 0.009% 100.105% ( 9900, 14000 ] 2 0.001% 100.106% ( 14000, 22000 ] 15 0.006% 100.113% ( 22000, 33000 ] 9 0.004% 100.117% ( 33000, 50000 ] 2 0.001% 100.117% ( 50000, 75000 ] 1 0.000% 100.118% ** Level 3 read latency histogram (micros): Count: 566776 Average: 12.4353 StdDev: 282.89 Min: 0 Median: 1.9778 Max: 45059 Percentiles: P50: 1.98 P75: 3.00 P99: 14.24 P99.9: 729.55 P99.99: 1326.63 ------------------------------------------------------ [ 0, 1 ] 14583 2.573% 2.573% # ( 1, 2 ] 274907 48.504% 51.077% ########## ( 2, 3 ] 135571 23.920% 74.996% ##### ( 3, 4 ] 60526 10.679% 85.675% ## ( 4, 6 ] 60923 10.749% 96.424% ## ( 6, 10 ] 11987 2.115% 98.539% ( 10, 15 ] 3077 0.543% 99.082% ( 15, 22 ] 389 0.069% 99.151% ( 22, 34 ] 79 0.014% 99.165% ( 34, 51 ] 85 0.015% 99.180% ( 51, 76 ] 115 0.020% 99.200% ( 76, 110 ] 187 0.033% 99.233% ( 110, 170 ] 1323 0.233% 99.466% ( 170, 250 ] 1224 0.216% 99.682% ( 250, 380 ] 506 0.089% 99.772% ( 380, 580 ] 490 0.086% 99.858% ( 580, 870 ] 460 0.081% 99.939% ( 870, 1300 ] 280 0.049% 99.989% ( 1300, 1900 ] 165 0.029% 100.018% ( 1900, 2900 ] 173 0.031% 100.048% ( 2900, 4400 ] 252 0.044% 100.093% ( 4400, 6600 ] 83 0.015% 100.107% ( 6600, 9900 ] 45 0.008% 100.115% ( 9900, 14000 ] 19 0.003% 100.119% ( 14000, 22000 ] 40 0.007% 100.126% ( 22000, 33000 ] 16 0.003% 100.129% ( 33000, 50000 ] 6 0.001% 100.130% ** Level 4 read latency histogram (micros): Count: 630384 Average: 30.1870 StdDev: 494.63 Min: 1 Median: 2.0383 Max: 83427 Percentiles: P50: 2.04 P75: 3.29 P99: 249.99 P99.9: 2159.69 P99.99: 3681.50 ------------------------------------------------------ [ 0, 1 ] 14673 2.328% 2.328% ( 1, 2 ] 294999 46.797% 49.124% ######### ( 2, 3 ] 144253 22.883% 72.008% ##### ( 3, 4 ] 64316 10.203% 82.210% ## ( 4, 6 ] 64254 10.193% 92.403% ## ( 6, 10 ] 14459 2.294% 94.697% ( 10, 15 ] 4530 0.719% 95.415% ( 15, 22 ] 462 0.073% 95.489% ( 22, 34 ] 120 0.019% 95.508% ( 34, 51 ] 115 0.018% 95.526% ( 51, 76 ] 97 0.015% 95.541% ( 76, 110 ] 1350 0.214% 95.756% ( 110, 170 ] 11507 1.825% 97.581% ( 170, 250 ] 8946 1.419% 99.000% ( 250, 380 ] 2014 0.319% 99.320% ( 380, 580 ] 1364 0.216% 99.536% ( 580, 870 ] 1092 0.173% 99.709% ( 870, 1300 ] 696 0.110% 99.820% ( 1300, 1900 ] 403 0.064% 99.884% ( 1900, 2900 ] 399 0.063% 99.947% ( 2900, 4400 ] 522 0.083% 100.030% ( 4400, 6600 ] 227 0.036% 100.066% ( 6600, 9900 ] 101 0.016% 100.082% ( 9900, 14000 ] 48 0.008% 100.089% ( 14000, 22000 ] 116 0.018% 100.108% ( 22000, 33000 ] 85 0.013% 100.121% ( 33000, 50000 ] 17 0.003% 100.124% ( 75000, 110000 ] 1 0.000% 100.124% ** Level 5 read latency histogram (micros): Count: 196936 Average: 273.8536 StdDev: 1006.26 Min: 84 Median: 168.9606 Max: 95579 Percentiles: P50: 168.96 P75: 224.96 P99: 2707.34 P99.9: 7501.92 P99.99: 27462.64 ------------------------------------------------------ ( 76, 110 ] 10320 5.240% 5.240% # ( 110, 170 ] 89702 45.549% 50.789% ######### ( 170, 250 ] 69403 35.241% 86.030% ####### ( 250, 380 ] 12838 6.519% 92.549% # ( 380, 580 ] 6482 3.291% 95.841% # ( 580, 870 ] 2967 1.507% 97.347% ( 870, 1300 ] 1642 0.834% 98.181% ( 1300, 1900 ] 970 0.493% 98.674% ( 1900, 2900 ] 796 0.404% 99.078% ( 2900, 4400 ] 1140 0.579% 99.657% ( 4400, 6600 ] 449 0.228% 99.885% ( 6600, 9900 ] 110 0.056% 99.941% ( 9900, 14000 ] 15 0.008% 99.948% ( 14000, 22000 ] 54 0.027% 99.976% ( 22000, 33000 ] 57 0.029% 100.005% ( 33000, 50000 ] 38 0.019% 100.024% ( 50000, 75000 ] 7 0.004% 100.027% ( 75000, 110000 ] 2 0.001% 100.028% ** DB Stats ** Uptime(secs): 20.7 total, 8.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 142.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.103 H:M:S, 34.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.759 H:M:S, 53.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 232.810 micros/op 17164 ops/sec 60.123 seconds 1031996 operations; 16.6 MB/s (264999 of 264999 found) Microseconds per read: Count: 1031996 Average: 232.8140 StdDev: 927.11 Min: 2 Median: 197.5386 Max: 245298 Percentiles: P50: 197.54 P75: 235.72 P99: 651.05 P99.9: 8225.85 P99.99: 31514.68 ------------------------------------------------------ ( 1, 2 ] 4 0.000% 0.000% ( 2, 3 ] 41 0.004% 0.004% ( 3, 4 ] 67 0.006% 0.011% ( 4, 6 ] 87 0.008% 0.019% ( 6, 10 ] 400 0.039% 0.058% ( 10, 15 ] 4485 0.435% 0.493% ( 15, 22 ] 3158 0.306% 0.799% ( 22, 34 ] 7628 0.739% 1.538% ( 34, 51 ] 2159 0.209% 1.747% ( 51, 76 ] 299 0.029% 1.776% ( 76, 110 ] 10929 1.059% 2.835% ( 110, 170 ] 300634 29.131% 31.966% ###### ( 170, 250 ] 540643 52.388% 84.354% ########## ( 250, 380 ] 106481 10.318% 94.672% ## ( 380, 580 ] 42783 4.146% 98.818% # ( 580, 870 ] 7666 0.743% 99.561% ( 870, 1300 ] 1477 0.143% 99.704% ( 1300, 1900 ] 465 0.045% 99.749% ( 1900, 2900 ] 389 0.038% 99.787% ( 2900, 4400 ] 593 0.057% 99.844% ( 4400, 6600 ] 408 0.040% 99.884% ( 6600, 9900 ] 341 0.033% 99.917% ( 9900, 14000 ] 263 0.025% 99.942% ( 14000, 22000 ] 357 0.035% 99.977% ( 22000, 33000 ] 157 0.015% 99.992% ( 33000, 50000 ] 49 0.005% 99.997% ( 50000, 75000 ] 10 0.001% 99.998% ( 75000, 110000 ] 8 0.001% 99.999% ( 110000, 170000 ] 10 0.001% 100.000% ( 170000, 250000 ] 5 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14437604 rocksdb.bloom.filter.full.positive COUNT : 1172118 rocksdb.bloom.filter.full.true.positive COUNT : 1031542 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 454 rocksdb.memtable.miss COUNT : 1031542 rocksdb.l0.hit COUNT : 50678 rocksdb.l1.hit COUNT : 5609 rocksdb.l2andup.hit COUNT : 975255 rocksdb.compaction.key.drop.new COUNT : 129476 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3769391 rocksdb.number.keys.read COUNT : 1031996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3890011512 rocksdb.bytes.read COUNT : 1031996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1530 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42653023 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15813472381 rocksdb.compact.write.bytes COUNT : 15674745195 rocksdb.flush.write.bytes COUNT : 3831466240 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 34 rocksdb.number.superversion_acquires COUNT : 732 rocksdb.number.superversion_releases COUNT : 697 rocksdb.number.superversion_cleanups COUNT : 178 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 174 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3800470528 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1393664 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 20480486150 rocksdb.non.last.level.read.count COUNT : 4802467 rocksdb.block.checksum.compute.count COUNT : 5011456 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 196.952833 P95 : 392.923442 P99 : 649.141604 P100 : 245297.000000 COUNT : 1031996 SUM : 239477255 rocksdb.db.write.micros P50 : 1.714638 P95 : 5.684665 P99 : 17.880035 P100 : 1319448.000000 COUNT : 3769391 SUM : 54480065 rocksdb.compaction.times.micros P50 : 1129166.666667 P95 : 3950000.000000 P99 : 39400000.000000 P100 : 48655001.000000 COUNT : 60 SUM : 133111995 rocksdb.compaction.times.cpu_micros P50 : 877000.000000 P95 : 2900000.000000 P99 : 17200000.000000 P100 : 18387527.000000 COUNT : 60 SUM : 77126727 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 729.531250 P95 : 4675.000000 P99 : 6960.000000 P100 : 6960.000000 COUNT : 55 SUM : 58701 rocksdb.compaction.outfile.sync.micros P50 : 2900.000000 P95 : 9255.714286 P99 : 39460.000000 P100 : 58326.000000 COUNT : 162 SUM : 624937 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 161.428571 P95 : 3500.000000 P99 : 6072.000000 P100 : 8138.000000 COUNT : 124 SUM : 87034 rocksdb.table.open.io.micros P50 : 6055.108359 P95 : 19898.734177 P99 : 83500.000000 P100 : 187659.000000 COUNT : 1530 SUM : 13185127 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.863138 P95 : 126.061556 P99 : 231.245435 P100 : 83431.000000 COUNT : 3828340 SUM : 80575294 rocksdb.read.block.get.micros P50 : 152.598722 P95 : 247.883656 P99 : 526.460927 P100 : 95740.000000 COUNT : 1181507 SUM : 204967272 rocksdb.write.raw.block.micros P50 : 0.553740 P95 : 1.654781 P99 : 3.833639 P100 : 83919.000000 COUNT : 4724447 SUM : 18011374 rocksdb.numfiles.in.singlecompaction P50 : 2.444444 P95 : 5.500000 P99 : 25.600000 P100 : 27.000000 COUNT : 70 SUM : 239 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570074 P95 : 1240.537322 P99 : 2639.630039 P100 : 1319254.000000 COUNT : 236265 SUM : 42673207 rocksdb.sst.read.micros P50 : 2.265880 P95 : 210.384632 P99 : 319.888523 P100 : 95579.000000 COUNT : 4802523 SUM : 270900990 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1031996 SUM : 1031996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3769391 SUM : 3890011512 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217441.860465 P95 : 805625.000000 P99 : 1515000.000000 P100 : 1681554.000000 COUNT : 55 SUM : 15575617 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 182 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0