[2024-11-19 23:37:46.670873] Starting SPDK v25.01-pre git sha1 f22e807f1 / DPDK 22.11.4 initialization... [2024-11-19 23:37:46.671033] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2720188 ] Set seed to 1732055866667371 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 23:37:46.763332] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 23:37:46.784564] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 23:37:46.784605] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2720188' to capture a snapshot of events at runtime. [2024-11-19 23:37:46.784616] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 23:37:46.784643] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 23:37:46.784651] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2720188 for offline analysis/debug. [2024-11-19 23:37:46.785203] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 23:37:51 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-23:37:58 ... thread 0: (1000000,1000000) ops and (143715.3,143715.3) ops/second in (6.958202,6.958202) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.12 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 42.4 141.4 8.90 4.12 11 0.809 383K 507 0.0 0.0 L1 10/10 1.20 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 70.98 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/2 1.05 GB 1.0 1.5 0.8 0.7 1.5 0.8 0.1 1.8 97.0 96.1 16.08 7.43 12 1.340 72K 0 0.0 0.0 L4 168/2 9.71 GB 1.0 4.1 2.5 1.6 4.1 2.5 0.0 1.6 111.2 109.8 38.09 19.89 31 1.229 1354K 0 0.0 0.0 L5 1132/0 92.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1351/26 106.61 GB 0.0 6.0 3.4 2.7 6.8 4.2 2.5 7.9 97.9 110.8 63.07 31.44 54 1.168 1810K 507 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 3.4 2.7 6.8 4.2 2.5 7.9 97.9 110.8 63.07 31.44 54 1.168 1810K 507 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 3.4 2.7 6.0 3.3 0.0 0.0 109.0 107.8 56.63 28.92 44 1.287 1810K 507 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 136.8 6.45 2.52 10 0.645 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.1 total, 7.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.82 GB write, 981.09 MB/s write, 6.03 GB read, 866.76 MB/s read, 63.1 seconds Interval compaction: 6.82 GB write, 1003.80 MB/s write, 6.03 GB read, 886.83 MB/s read, 63.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 43, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 294978 Average: 16.2671 StdDev: 175.26 Min: 1 Median: 1.9027 Max: 23573 Percentiles: P50: 1.90 P75: 2.89 P99: 292.73 P99.9: 2632.64 P99.99: 4277.35 ------------------------------------------------------ [ 0, 1 ] 10648 3.610% 3.610% # ( 1, 2 ] 151591 51.391% 55.000% ########## ( 2, 3 ] 66383 22.504% 77.505% ##### ( 3, 4 ] 27133 9.198% 86.703% ## ( 4, 6 ] 27732 9.401% 96.104% ## ( 6, 10 ] 6370 2.159% 98.264% ( 10, 15 ] 1242 0.421% 98.685% ( 15, 22 ] 133 0.045% 98.730% ( 22, 34 ] 12 0.004% 98.734% ( 34, 51 ] 13 0.004% 98.739% ( 51, 76 ] 8 0.003% 98.741% ( 76, 110 ] 62 0.021% 98.762% ( 110, 170 ] 278 0.094% 98.857% ( 170, 250 ] 299 0.101% 98.958% ( 250, 380 ] 384 0.130% 99.088% ( 380, 580 ] 538 0.182% 99.270% ( 580, 870 ] 657 0.223% 99.493% ( 870, 1300 ] 641 0.217% 99.710% ( 1300, 1900 ] 372 0.126% 99.837% ( 1900, 2900 ] 258 0.087% 99.924% ( 2900, 4400 ] 214 0.073% 99.997% ( 4400, 6600 ] 55 0.019% 100.015% ( 6600, 9900 ] 6 0.002% 100.017% ( 9900, 14000 ] 1 0.000% 100.018% ( 14000, 22000 ] 1 0.000% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 138 Average: 1286.3696 StdDev: 1390.01 Min: 104 Median: 795.1613 Max: 7177 Percentiles: P50: 795.16 P75: 1581.25 P99: 7177.00 P99.9: 7177.00 P99.99: 7177.00 ------------------------------------------------------ ( 76, 110 ] 2 1.449% 1.449% ( 110, 170 ] 6 4.348% 5.797% # ( 170, 250 ] 8 5.797% 11.594% # ( 250, 380 ] 13 9.420% 21.014% ## ( 380, 580 ] 17 12.319% 33.333% ## ( 580, 870 ] 31 22.464% 55.797% #### ( 870, 1300 ] 19 13.768% 69.565% ### ( 1300, 1900 ] 16 11.594% 81.159% ## ( 1900, 2900 ] 14 10.145% 91.304% ## ( 2900, 4400 ] 4 2.899% 94.203% # ( 4400, 6600 ] 6 4.348% 98.551% # ( 6600, 9900 ] 2 1.449% 100.000% ** Level 2 read latency histogram (micros): Count: 54253 Average: 11.2844 StdDev: 132.43 Min: 1 Median: 1.9361 Max: 7228 Percentiles: P50: 1.94 P75: 2.89 P99: 12.40 P99.9: 1852.74 P99.99: 3557.47 ------------------------------------------------------ [ 0, 1 ] 1737 3.202% 3.202% # ( 1, 2 ] 27122 49.992% 53.193% ########## ( 2, 3 ] 13298 24.511% 77.704% ##### ( 3, 4 ] 5027 9.266% 86.970% ## ( 4, 6 ] 5014 9.242% 96.212% ## ( 6, 10 ] 1400 2.581% 98.793% # ( 10, 15 ] 234 0.431% 99.224% ( 15, 22 ] 38 0.070% 99.294% ( 22, 34 ] 11 0.020% 99.314% ( 34, 51 ] 2 0.004% 99.318% ( 51, 76 ] 3 0.006% 99.324% ( 76, 110 ] 2 0.004% 99.327% ( 110, 170 ] 8 0.015% 99.342% ( 170, 250 ] 15 0.028% 99.370% ( 250, 380 ] 33 0.061% 99.430% ( 380, 580 ] 43 0.079% 99.510% ( 580, 870 ] 74 0.136% 99.646% ( 870, 1300 ] 88 0.162% 99.808% ( 1300, 1900 ] 54 0.100% 99.908% ( 1900, 2900 ] 38 0.070% 99.978% ( 2900, 4400 ] 15 0.028% 100.006% ( 4400, 6600 ] 6 0.011% 100.017% ( 6600, 9900 ] 2 0.004% 100.020% ** Level 3 read latency histogram (micros): Count: 747399 Average: 13.2505 StdDev: 178.46 Min: 1 Median: 1.9853 Max: 34827 Percentiles: P50: 1.99 P75: 2.96 P99: 10.07 P99.9: 1237.14 P99.99: 1736.80 ------------------------------------------------------ [ 0, 1 ] 13088 1.751% 1.751% ( 1, 2 ] 365980 48.967% 50.718% ########## ( 2, 3 ] 188948 25.281% 75.999% ##### ( 3, 4 ] 75734 10.133% 86.132% ## ( 4, 6 ] 76574 10.245% 96.377% ## ( 6, 10 ] 19550 2.616% 98.993% # ( 10, 15 ] 3519 0.471% 99.464% ( 15, 22 ] 477 0.064% 99.528% ( 22, 34 ] 70 0.009% 99.537% ( 34, 51 ] 49 0.007% 99.544% ( 51, 76 ] 53 0.007% 99.551% ( 76, 110 ] 19 0.003% 99.553% ( 110, 170 ] 57 0.008% 99.561% ( 170, 250 ] 112 0.015% 99.576% ( 250, 380 ] 205 0.027% 99.603% ( 380, 580 ] 467 0.062% 99.666% ( 580, 870 ] 912 0.122% 99.788% ( 870, 1300 ] 981 0.131% 99.919% ( 1300, 1900 ] 727 0.097% 100.016% ( 1900, 2900 ] 623 0.083% 100.100% ( 2900, 4400 ] 547 0.073% 100.173% ( 4400, 6600 ] 149 0.020% 100.193% ( 6600, 9900 ] 22 0.003% 100.196% ( 9900, 14000 ] 5 0.001% 100.197% ( 14000, 22000 ] 3 0.000% 100.197% ( 22000, 33000 ] 3 0.000% 100.197% ( 33000, 50000 ] 1 0.000% 100.197% ** Level 4 read latency histogram (micros): Count: 438631 Average: 20.9687 StdDev: 242.17 Min: 1 Median: 1.9769 Max: 39967 Percentiles: P50: 1.98 P75: 2.97 P99: 270.87 P99.9: 2257.77 P99.99: 2955.28 ------------------------------------------------------ [ 0, 1 ] 8376 1.910% 1.910% ( 1, 2 ] 215922 49.226% 51.136% ########## ( 2, 3 ] 108166 24.660% 75.796% ##### ( 3, 4 ] 43869 10.001% 85.797% ## ( 4, 6 ] 43703 9.964% 95.761% ## ( 6, 10 ] 11424 2.604% 98.365% # ( 10, 15 ] 2060 0.470% 98.835% ( 15, 22 ] 285 0.065% 98.900% ( 22, 34 ] 36 0.008% 98.908% ( 34, 51 ] 19 0.004% 98.912% ( 51, 76 ] 21 0.005% 98.917% ( 76, 110 ] 22 0.005% 98.922% ( 110, 170 ] 107 0.024% 98.946% ( 170, 250 ] 187 0.043% 98.989% ( 250, 380 ] 297 0.068% 99.057% ( 380, 580 ] 622 0.142% 99.199% ( 580, 870 ] 976 0.223% 99.421% ( 870, 1300 ] 1107 0.252% 99.674% ( 1300, 1900 ] 783 0.179% 99.852% ( 1900, 2900 ] 588 0.134% 99.986% ( 2900, 4400 ] 465 0.106% 100.092% ( 4400, 6600 ] 142 0.032% 100.124% ( 6600, 9900 ] 38 0.009% 100.133% ( 9900, 14000 ] 7 0.002% 100.135% ( 14000, 22000 ] 5 0.001% 100.136% ( 22000, 33000 ] 3 0.001% 100.137% ( 33000, 50000 ] 1 0.000% 100.137% ** Level 5 read latency histogram (micros): Count: 12607 Average: 1553.4013 StdDev: 1660.65 Min: 81 Median: 1032.2075 Max: 32076 Percentiles: P50: 1032.21 P75: 2076.61 P99: 6578.11 P99.9: 14786.00 P99.99: 31459.14 ------------------------------------------------------ ( 76, 110 ] 103 0.817% 0.817% ( 110, 170 ] 535 4.244% 5.061% # ( 170, 250 ] 610 4.839% 9.899% # ( 250, 380 ] 830 6.584% 16.483% # ( 380, 580 ] 1390 11.026% 27.509% ## ( 580, 870 ] 2052 16.277% 43.785% ### ( 870, 1300 ] 2077 16.475% 60.260% ### ( 1300, 1900 ] 1614 12.802% 73.063% ### ( 1900, 2900 ] 1383 10.970% 84.033% ## ( 2900, 4400 ] 1283 10.177% 94.210% ## ( 4400, 6600 ] 610 4.839% 99.048% # ( 6600, 9900 ] 98 0.777% 99.825% ( 9900, 14000 ] 9 0.071% 99.897% ( 14000, 22000 ] 4 0.032% 99.929% ( 22000, 33000 ] 9 0.071% 100.000% ** DB Stats ** Uptime(secs): 7.1 total, 7.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 138.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.090 H:M:S, 43.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 141.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.090 H:M:S, 44.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-23:38:01 ... thread 0: (1000000,2000000) ops and (268934.8,187326.0) ops/second in (3.718374,10.676576) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.11 GB 163.6 1.4 0.0 1.4 3.3 1.8 0.0 1.8 89.3 205.6 16.23 10.82 31 0.524 1471K 1592 0.0 0.0 L1 10/10 1.20 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 70.98 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 23/0 971.99 MB 1.0 1.5 0.8 0.7 1.5 0.8 0.1 1.8 97.0 96.1 16.08 7.43 12 1.340 72K 0 0.0 0.0 L4 166/0 9.44 GB 1.0 4.4 2.6 1.7 4.3 2.6 0.0 1.6 113.3 111.8 39.35 20.87 32 1.230 1461K 0 0.0 0.0 L5 1136/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/22 107.59 GB 0.0 7.3 3.5 3.8 9.1 5.2 2.9 4.9 104.2 129.5 71.66 39.12 75 0.956 3005K 1592 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 3.5 3.8 9.1 5.2 2.9 4.9 104.2 129.5 71.66 39.12 75 0.956 3005K 1592 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 3.5 3.8 7.2 3.4 0.0 0.0 120.3 119.1 62.07 33.91 49 1.267 3005K 1592 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 197.0 9.59 5.22 26 0.369 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.8 total, 10.7 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.06 GB write, 856.30 MB/s write, 7.29 GB read, 688.76 MB/s read, 71.7 seconds Interval compaction: 9.06 GB write, 869.22 MB/s write, 7.29 GB read, 699.15 MB/s read, 71.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 43, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 544325 Average: 18.1276 StdDev: 138.78 Min: 0 Median: 1.6907 Max: 23573 Percentiles: P50: 1.69 P75: 2.56 P99: 324.40 P99.9: 1657.34 P99.99: 3278.73 ------------------------------------------------------ [ 0, 1 ] 72350 13.292% 13.292% ### ( 1, 2 ] 289280 53.145% 66.436% ########### ( 2, 3 ] 83898 15.413% 81.850% ### ( 3, 4 ] 32280 5.930% 87.780% # ( 4, 6 ] 30576 5.617% 93.397% # ( 6, 10 ] 7016 1.289% 94.686% ( 10, 15 ] 1427 0.262% 94.948% ( 15, 22 ] 169 0.031% 94.979% ( 22, 34 ] 21 0.004% 94.983% ( 34, 51 ] 14 0.003% 94.986% ( 51, 76 ] 20 0.004% 94.989% ( 76, 110 ] 3323 0.610% 95.600% ( 110, 170 ] 11991 2.203% 97.803% ( 170, 250 ] 5264 0.967% 98.770% ( 250, 380 ] 2189 0.402% 99.172% ( 380, 580 ] 1943 0.357% 99.529% ( 580, 870 ] 1070 0.197% 99.726% ( 870, 1300 ] 718 0.132% 99.857% ( 1300, 1900 ] 389 0.071% 99.929% ( 1900, 2900 ] 275 0.051% 99.979% ( 2900, 4400 ] 228 0.042% 100.021% ( 4400, 6600 ] 55 0.010% 100.031% ( 6600, 9900 ] 6 0.001% 100.033% ( 9900, 14000 ] 1 0.000% 100.033% ( 14000, 22000 ] 1 0.000% 100.033% ( 22000, 33000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 895 Average: 373.4894 StdDev: 693.17 Min: 85 Median: 164.0617 Max: 7177 Percentiles: P50: 164.06 P75: 315.46 P99: 4043.75 P99.9: 7177.00 P99.99: 7177.00 ------------------------------------------------------ ( 76, 110 ] 97 10.838% 10.838% ## ( 110, 170 ] 389 43.464% 54.302% ######### ( 170, 250 ] 150 16.760% 71.061% ### ( 250, 380 ] 70 7.821% 78.883% ## ( 380, 580 ] 79 8.827% 87.709% ## ( 580, 870 ] 42 4.693% 92.402% # ( 870, 1300 ] 21 2.346% 94.749% ( 1300, 1900 ] 19 2.123% 96.872% ( 1900, 2900 ] 16 1.788% 98.659% ( 2900, 4400 ] 4 0.447% 99.106% ( 4400, 6600 ] 6 0.670% 99.777% ( 6600, 9900 ] 2 0.223% 100.000% ** Level 2 read latency histogram (micros): Count: 54410 Average: 11.7825 StdDev: 132.70 Min: 1 Median: 1.9390 Max: 7228 Percentiles: P50: 1.94 P75: 2.90 P99: 21.24 P99.9: 1851.00 P99.99: 3555.90 ------------------------------------------------------ [ 0, 1 ] 1737 3.192% 3.192% # ( 1, 2 ] 27122 49.847% 53.040% ########## ( 2, 3 ] 13298 24.440% 77.480% ##### ( 3, 4 ] 5027 9.239% 86.719% ## ( 4, 6 ] 5014 9.215% 95.935% ## ( 6, 10 ] 1400 2.573% 98.508% # ( 10, 15 ] 234 0.430% 98.938% ( 15, 22 ] 38 0.070% 99.008% ( 22, 34 ] 11 0.020% 99.028% ( 34, 51 ] 2 0.004% 99.031% ( 51, 76 ] 3 0.006% 99.037% ( 76, 110 ] 32 0.059% 99.096% ( 110, 170 ] 82 0.151% 99.246% ( 170, 250 ] 45 0.083% 99.329% ( 250, 380 ] 40 0.074% 99.403% ( 380, 580 ] 58 0.107% 99.509% ( 580, 870 ] 75 0.138% 99.647% ( 870, 1300 ] 88 0.162% 99.809% ( 1300, 1900 ] 54 0.099% 99.908% ( 1900, 2900 ] 38 0.070% 99.978% ( 2900, 4400 ] 15 0.028% 100.006% ( 4400, 6600 ] 6 0.011% 100.017% ( 6600, 9900 ] 2 0.004% 100.020% ** Level 3 read latency histogram (micros): Count: 757188 Average: 13.2924 StdDev: 177.44 Min: 1 Median: 1.9790 Max: 34827 Percentiles: P50: 1.98 P75: 2.95 P99: 11.02 P99.9: 1233.29 P99.99: 1736.22 ------------------------------------------------------ [ 0, 1 ] 14429 1.906% 1.906% ( 1, 2 ] 371971 49.125% 51.031% ########## ( 2, 3 ] 190135 25.111% 76.142% ##### ( 3, 4 ] 75967 10.033% 86.174% ## ( 4, 6 ] 76706 10.130% 96.305% ## ( 6, 10 ] 19685 2.600% 98.904% # ( 10, 15 ] 3533 0.467% 99.371% ( 15, 22 ] 478 0.063% 99.434% ( 22, 34 ] 70 0.009% 99.443% ( 34, 51 ] 49 0.006% 99.450% ( 51, 76 ] 53 0.007% 99.457% ( 76, 110 ] 127 0.017% 99.474% ( 110, 170 ] 437 0.058% 99.531% ( 170, 250 ] 263 0.035% 99.566% ( 250, 380 ] 262 0.035% 99.601% ( 380, 580 ] 514 0.068% 99.669% ( 580, 870 ] 923 0.122% 99.791% ( 870, 1300 ] 981 0.130% 99.920% ( 1300, 1900 ] 728 0.096% 100.016% ( 1900, 2900 ] 623 0.082% 100.099% ( 2900, 4400 ] 547 0.072% 100.171% ( 4400, 6600 ] 149 0.020% 100.190% ( 6600, 9900 ] 22 0.003% 100.193% ( 9900, 14000 ] 5 0.001% 100.194% ( 14000, 22000 ] 3 0.000% 100.194% ( 22000, 33000 ] 3 0.000% 100.195% ( 33000, 50000 ] 1 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 456001 Average: 22.7954 StdDev: 238.91 Min: 1 Median: 1.9797 Max: 39967 Percentiles: P50: 1.98 P75: 2.99 P99: 395.74 P99.9: 2228.26 P99.99: 2943.23 ------------------------------------------------------ [ 0, 1 ] 9802 2.150% 2.150% ( 1, 2 ] 222713 48.840% 50.990% ########## ( 2, 3 ] 110041 24.132% 75.122% ##### ( 3, 4 ] 44339 9.723% 84.845% ## ( 4, 6 ] 44187 9.690% 94.535% ## ( 6, 10 ] 11636 2.552% 97.087% # ( 10, 15 ] 2090 0.458% 97.545% ( 15, 22 ] 289 0.063% 97.609% ( 22, 34 ] 36 0.008% 97.617% ( 34, 51 ] 19 0.004% 97.621% ( 51, 76 ] 26 0.006% 97.627% ( 76, 110 ] 927 0.203% 97.830% ( 110, 170 ] 3133 0.687% 98.517% ( 170, 250 ] 1392 0.305% 98.822% ( 250, 380 ] 733 0.161% 98.983% ( 380, 580 ] 991 0.217% 99.200% ( 580, 870 ] 1079 0.237% 99.437% ( 870, 1300 ] 1128 0.247% 99.684% ( 1300, 1900 ] 790 0.173% 99.857% ( 1900, 2900 ] 591 0.130% 99.987% ( 2900, 4400 ] 465 0.102% 100.089% ( 4400, 6600 ] 142 0.031% 100.120% ( 6600, 9900 ] 38 0.008% 100.129% ( 9900, 14000 ] 7 0.002% 100.130% ( 14000, 22000 ] 5 0.001% 100.131% ( 22000, 33000 ] 3 0.001% 100.132% ( 33000, 50000 ] 1 0.000% 100.132% ** Level 5 read latency histogram (micros): Count: 61335 Average: 472.3086 StdDev: 941.15 Min: 74 Median: 167.3315 Max: 32076 Percentiles: P50: 167.33 P75: 353.66 P99: 4799.07 P99.9: 8373.41 P99.99: 15733.00 ------------------------------------------------------ ( 51, 76 ] 6 0.010% 0.010% ( 76, 110 ] 7061 11.512% 11.522% ## ( 110, 170 ] 24699 40.269% 51.791% ######## ( 170, 250 ] 10667 17.391% 69.182% ### ( 250, 380 ] 4475 7.296% 76.478% # ( 380, 580 ] 4228 6.893% 83.372% # ( 580, 870 ] 2907 4.740% 88.111% # ( 870, 1300 ] 2216 3.613% 91.724% # ( 1300, 1900 ] 1647 2.685% 94.409% # ( 1900, 2900 ] 1413 2.304% 96.713% ( 2900, 4400 ] 1292 2.106% 98.820% ( 4400, 6600 ] 610 0.995% 99.814% ( 6600, 9900 ] 98 0.160% 99.974% ( 9900, 14000 ] 9 0.015% 99.989% ( 14000, 22000 ] 4 0.007% 99.995% ( 22000, 33000 ] 9 0.015% 100.010% ** DB Stats ** Uptime(secs): 10.8 total, 3.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 181.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.363 H:M:S, 31.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 264.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.272 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-23:38:49 ... thread 0: (1000000,3000000) ops and (20924.7,51311.0) ops/second in (47.790415,58.466991) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 2.82 GB 0.0 4.2 0.0 4.2 7.0 2.8 0.0 2.5 142.3 238.1 30.10 24.06 53 0.568 4348K 13K 0.0 0.0 L1 31/31 2.44 GB 0.0 2.5 1.3 1.2 2.4 1.2 0.0 1.9 52.0 51.5 48.44 17.93 1 48.436 2558K 23K 0.0 0.0 L2 1/0 70.98 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 23/0 971.99 MB 1.0 1.5 0.8 0.7 1.5 0.8 0.1 1.8 97.0 96.1 16.08 7.43 12 1.340 72K 0 0.0 0.0 L4 166/0 9.44 GB 1.0 4.4 2.6 1.7 4.3 2.6 0.0 1.6 113.3 111.8 39.35 20.87 32 1.230 1461K 0 0.0 0.0 L5 1136/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1363/37 108.54 GB 0.0 12.5 4.7 7.8 15.2 7.5 2.9 5.4 95.7 116.5 133.96 70.29 98 1.367 8440K 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.5 4.7 7.8 15.2 7.5 2.9 5.4 95.7 116.5 133.96 70.29 98 1.367 8440K 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.5 4.7 7.8 12.4 4.6 0.0 0.0 105.9 105.0 121.08 62.25 56 2.162 8440K 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 225.0 12.88 8.04 42 0.307 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.6 total, 58.5 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.24 GB write, 266.19 MB/s write, 12.52 GB read, 218.62 MB/s read, 134.0 seconds Interval compaction: 15.24 GB write, 266.92 MB/s write, 12.52 GB read, 219.23 MB/s read, 134.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 43, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1688919 Average: 36.6606 StdDev: 106.01 Min: 0 Median: 1.7201 Max: 23573 Percentiles: P50: 1.72 P75: 4.36 P99: 294.31 P99.9: 825.32 P99.99: 1771.98 ------------------------------------------------------ [ 0, 1 ] 313086 18.538% 18.538% #### ( 1, 2 ] 737936 43.693% 62.230% ######### ( 2, 3 ] 149850 8.873% 71.103% ## ( 3, 4 ] 57141 3.383% 74.486% # ( 4, 6 ] 48193 2.853% 77.340% # ( 6, 10 ] 9640 0.571% 77.911% ( 10, 15 ] 2328 0.138% 78.048% ( 15, 22 ] 269 0.016% 78.064% ( 22, 34 ] 26 0.002% 78.066% ( 34, 51 ] 19 0.001% 78.067% ( 51, 76 ] 213 0.013% 78.080% ( 76, 110 ] 84156 4.983% 83.062% # ( 110, 170 ] 223223 13.217% 96.279% ### ( 170, 250 ] 42602 2.522% 98.802% # ( 250, 380 ] 9823 0.582% 99.383% ( 380, 580 ] 6804 0.403% 99.786% ( 580, 870 ] 2271 0.134% 99.921% ( 870, 1300 ] 835 0.049% 99.970% ( 1300, 1900 ] 426 0.025% 99.995% ( 1900, 2900 ] 392 0.023% 100.019% ( 2900, 4400 ] 320 0.019% 100.038% ( 4400, 6600 ] 56 0.003% 100.041% ( 6600, 9900 ] 6 0.000% 100.041% ( 9900, 14000 ] 1 0.000% 100.041% ( 14000, 22000 ] 1 0.000% 100.041% ( 22000, 33000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 365922 Average: 9.1308 StdDev: 50.60 Min: 0 Median: 2.4591 Max: 7177 Percentiles: P50: 2.46 P75: 3.29 P99: 161.09 P99.9: 445.49 P99.99: 1720.21 ------------------------------------------------------ [ 0, 1 ] 19550 5.343% 5.343% # ( 1, 2 ] 104361 28.520% 33.863% ###### ( 2, 3 ] 128626 35.151% 69.014% ####### ( 3, 4 ] 75925 20.749% 89.763% #### ( 4, 6 ] 14692 4.015% 93.778% # ( 6, 10 ] 5791 1.583% 95.360% ( 10, 15 ] 2973 0.812% 96.173% ( 15, 22 ] 171 0.047% 96.220% ( 22, 34 ] 15 0.004% 96.224% ( 51, 76 ] 1 0.000% 96.224% ( 76, 110 ] 2982 0.815% 97.039% ( 110, 170 ] 8427 2.303% 99.342% ( 170, 250 ] 1595 0.436% 99.778% ( 250, 380 ] 359 0.098% 99.876% ( 380, 580 ] 269 0.074% 99.949% ( 580, 870 ] 95 0.026% 99.975% ( 870, 1300 ] 38 0.010% 99.986% ( 1300, 1900 ] 22 0.006% 99.992% ( 1900, 2900 ] 20 0.005% 99.997% ( 2900, 4400 ] 6 0.002% 99.999% ( 4400, 6600 ] 6 0.002% 100.001% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 57130 Average: 18.0889 StdDev: 133.09 Min: 1 Median: 1.9892 Max: 7228 Percentiles: P50: 1.99 P75: 3.14 P99: 223.93 P99.9: 1820.78 P99.99: 3528.70 ------------------------------------------------------ [ 0, 1 ] 1737 3.040% 3.040% # ( 1, 2 ] 27122 47.474% 50.515% ######### ( 2, 3 ] 13298 23.277% 73.791% ##### ( 3, 4 ] 5027 8.799% 82.591% ## ( 4, 6 ] 5014 8.776% 91.367% ## ( 6, 10 ] 1400 2.451% 93.818% ( 10, 15 ] 234 0.410% 94.227% ( 15, 22 ] 38 0.067% 94.294% ( 22, 34 ] 11 0.019% 94.313% ( 34, 51 ] 2 0.004% 94.316% ( 51, 76 ] 3 0.005% 94.322% ( 76, 110 ] 619 1.083% 95.405% ( 110, 170 ] 1809 3.166% 98.572% # ( 170, 250 ] 363 0.635% 99.207% ( 250, 380 ] 89 0.156% 99.363% ( 380, 580 ] 93 0.163% 99.526% ( 580, 870 ] 79 0.138% 99.664% ( 870, 1300 ] 88 0.154% 99.818% ( 1300, 1900 ] 54 0.095% 99.912% ( 1900, 2900 ] 38 0.067% 99.979% ( 2900, 4400 ] 15 0.026% 100.005% ( 4400, 6600 ] 6 0.011% 100.016% ( 6600, 9900 ] 2 0.004% 100.019% ** Level 3 read latency histogram (micros): Count: 769209 Average: 15.3216 StdDev: 176.98 Min: 1 Median: 1.9952 Max: 34827 Percentiles: P50: 2.00 P75: 3.00 P99: 150.94 P99.9: 1229.55 P99.99: 1736.50 ------------------------------------------------------ [ 0, 1 ] 14429 1.876% 1.876% ( 1, 2 ] 371971 48.358% 50.233% ########## ( 2, 3 ] 190135 24.718% 74.952% ##### ( 3, 4 ] 75967 9.876% 84.828% ## ( 4, 6 ] 76706 9.972% 94.800% ## ( 6, 10 ] 19685 2.559% 97.359% # ( 10, 15 ] 3533 0.459% 97.818% ( 15, 22 ] 478 0.062% 97.880% ( 22, 34 ] 70 0.009% 97.889% ( 34, 51 ] 49 0.006% 97.896% ( 51, 76 ] 60 0.008% 97.904% ( 76, 110 ] 3068 0.399% 98.302% ( 110, 170 ] 7865 1.022% 99.325% ( 170, 250 ] 1486 0.193% 99.518% ( 250, 380 ] 505 0.066% 99.584% ( 380, 580 ] 657 0.085% 99.669% ( 580, 870 ] 953 0.124% 99.793% ( 870, 1300 ] 984 0.128% 99.921% ( 1300, 1900 ] 730 0.095% 100.016% ( 1900, 2900 ] 624 0.081% 100.097% ( 2900, 4400 ] 547 0.071% 100.168% ( 4400, 6600 ] 149 0.019% 100.187% ( 6600, 9900 ] 22 0.003% 100.190% ( 9900, 14000 ] 5 0.001% 100.191% ( 14000, 22000 ] 3 0.000% 100.191% ( 22000, 33000 ] 3 0.000% 100.192% ( 33000, 50000 ] 1 0.000% 100.192% ** Level 4 read latency histogram (micros): Count: 580392 Average: 47.6485 StdDev: 219.93 Min: 1 Median: 2.5088 Max: 39967 Percentiles: P50: 2.51 P75: 5.98 P99: 443.05 P99.9: 2050.18 P99.99: 2912.61 ------------------------------------------------------ [ 0, 1 ] 9804 1.689% 1.689% ( 1, 2 ] 223483 38.506% 40.195% ######## ( 2, 3 ] 111853 19.272% 59.467% #### ( 3, 4 ] 45443 7.830% 67.296% ## ( 4, 6 ] 45214 7.790% 75.087% ## ( 6, 10 ] 11728 2.021% 77.107% ( 10, 15 ] 2113 0.364% 77.471% ( 15, 22 ] 290 0.050% 77.521% ( 22, 34 ] 36 0.006% 77.528% ( 34, 51 ] 19 0.003% 77.531% ( 51, 76 ] 77 0.013% 77.544% ( 76, 110 ] 29237 5.037% 82.582% # ( 110, 170 ] 77726 13.392% 95.974% ### ( 170, 250 ] 13711 2.362% 98.336% ( 250, 380 ] 3065 0.528% 98.864% ( 380, 580 ] 2503 0.431% 99.295% ( 580, 870 ] 1454 0.251% 99.546% ( 870, 1300 ] 1163 0.200% 99.746% ( 1300, 1900 ] 801 0.138% 99.884% ( 1900, 2900 ] 610 0.105% 99.989% ( 2900, 4400 ] 471 0.081% 100.070% ( 4400, 6600 ] 142 0.024% 100.095% ( 6600, 9900 ] 38 0.007% 100.101% ( 9900, 14000 ] 7 0.001% 100.103% ( 14000, 22000 ] 5 0.001% 100.104% ( 22000, 33000 ] 3 0.001% 100.104% ( 33000, 50000 ] 1 0.000% 100.104% ** Level 5 read latency histogram (micros): Count: 891566 Average: 166.6958 StdDev: 269.80 Min: 70 Median: 136.5924 Max: 32076 Percentiles: P50: 136.59 P75: 161.34 P99: 811.73 P99.9: 4187.51 P99.99: 6796.76 ------------------------------------------------------ ( 51, 76 ] 231 0.026% 0.026% ( 76, 110 ] 206059 23.112% 23.138% ##### ( 110, 170 ] 540365 60.609% 83.746% ############ ( 170, 250 ] 96023 10.770% 94.517% ## ( 250, 380 ] 21103 2.367% 96.884% ( 380, 580 ] 14537 1.631% 98.514% ( 580, 870 ] 5423 0.608% 99.122% ( 870, 1300 ] 2524 0.283% 99.405% ( 1300, 1900 ] 1733 0.194% 99.600% ( 1900, 2900 ] 1547 0.174% 99.773% ( 2900, 4400 ] 1317 0.148% 99.921% ( 4400, 6600 ] 610 0.068% 99.989% ( 6600, 9900 ] 98 0.011% 100.000% ( 9900, 14000 ] 9 0.001% 100.001% ( 14000, 22000 ] 4 0.000% 100.002% ( 22000, 33000 ] 9 0.001% 100.003% ** DB Stats ** Uptime(secs): 58.6 total, 47.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 50.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:46.491 H:M:S, 79.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 20.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:43.128 H:M:S, 90.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 215.625 micros/op 18527 ops/sec 60.182 seconds 1114996 operations; 18.0 MB/s (276999 of 276999 found) Microseconds per read: Count: 1114996 Average: 215.6279 StdDev: 627.18 Min: 2 Median: 166.3944 Max: 71023 Percentiles: P50: 166.39 P75: 225.14 P99: 758.00 P99.9: 9492.67 P99.99: 28169.90 ------------------------------------------------------ ( 1, 2 ] 3 0.000% 0.000% ( 2, 3 ] 40 0.004% 0.004% ( 3, 4 ] 75 0.007% 0.011% ( 4, 6 ] 76 0.007% 0.017% ( 6, 10 ] 376 0.034% 0.051% ( 10, 15 ] 5017 0.450% 0.501% ( 15, 22 ] 5625 0.504% 1.006% ( 22, 34 ] 10763 0.965% 1.971% ( 34, 51 ] 2733 0.245% 2.216% ( 51, 76 ] 287 0.026% 2.242% ( 76, 110 ] 26282 2.357% 4.599% ( 110, 170 ] 538586 48.304% 52.903% ########## ( 170, 250 ] 357473 32.060% 84.963% ###### ( 250, 380 ] 112857 10.122% 95.085% ## ( 380, 580 ] 37002 3.319% 98.403% # ( 580, 870 ] 10836 0.972% 99.375% ( 870, 1300 ] 3023 0.271% 99.646% ( 1300, 1900 ] 1120 0.100% 99.747% ( 1900, 2900 ] 800 0.072% 99.819% ( 2900, 4400 ] 568 0.051% 99.870% ( 4400, 6600 ] 197 0.018% 99.887% ( 6600, 9900 ] 162 0.015% 99.902% ( 9900, 14000 ] 385 0.035% 99.936% ( 14000, 22000 ] 511 0.046% 99.982% ( 22000, 33000 ] 156 0.014% 99.996% ( 33000, 50000 ] 30 0.003% 99.999% ( 50000, 75000 ] 13 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 17013106 rocksdb.bloom.filter.full.positive COUNT : 1280393 rocksdb.bloom.filter.full.true.positive COUNT : 1114604 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 392 rocksdb.memtable.miss COUNT : 1114604 rocksdb.l0.hit COUNT : 41055 rocksdb.l1.hit COUNT : 16706 rocksdb.l2andup.hit COUNT : 1056843 rocksdb.compaction.key.drop.new COUNT : 120726 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3007146 rocksdb.number.keys.read COUNT : 1114996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3103374672 rocksdb.bytes.read COUNT : 1114996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1538 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 48131151 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14088375460 rocksdb.compact.write.bytes COUNT : 13958587039 rocksdb.flush.write.bytes COUNT : 3038581389 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 26 rocksdb.number.superversion_acquires COUNT : 608 rocksdb.number.superversion_releases COUNT : 589 rocksdb.number.superversion_cleanups COUNT : 155 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 175 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3014134784 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1229824 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 18889827724 rocksdb.non.last.level.read.count COUNT : 4419471 rocksdb.block.checksum.compute.count COUNT : 4702480 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 165.516164 P95 : 378.428198 P99 : 757.066444 P100 : 71022.000000 COUNT : 1114996 SUM : 239434555 rocksdb.db.write.micros P50 : 1.567366 P95 : 5.375235 P99 : 115.102152 P100 : 728023.000000 COUNT : 3007146 SUM : 56133572 rocksdb.compaction.times.micros P50 : 1162222.222222 P95 : 2633333.333333 P99 : 40040000.000000 P100 : 48436085.000000 COUNT : 56 SUM : 121084144 rocksdb.compaction.times.cpu_micros P50 : 707368.421053 P95 : 1620000.000000 P99 : 17520000.000000 P100 : 17930630.000000 COUNT : 56 SUM : 62250726 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 731.304348 P95 : 49433.333333 P99 : 325400.000000 P100 : 344591.000000 COUNT : 42 SUM : 746747 rocksdb.compaction.outfile.sync.micros P50 : 27500.000000 P95 : 204769.230769 P99 : 245876.923077 P100 : 570897.000000 COUNT : 167 SUM : 10010457 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 380.000000 P95 : 5610.000000 P99 : 6578.000000 P100 : 6787.000000 COUNT : 110 SUM : 142964 rocksdb.table.open.io.micros P50 : 9481.578947 P95 : 20416.528926 P99 : 27992.800000 P100 : 52249.000000 COUNT : 1538 SUM : 14808198 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.932920 P95 : 126.975288 P99 : 227.320701 P100 : 39972.000000 COUNT : 3410738 SUM : 71904819 rocksdb.read.block.get.micros P50 : 138.074714 P95 : 249.729885 P99 : 642.803896 P100 : 32081.000000 COUNT : 1290204 SUM : 202664848 rocksdb.write.raw.block.micros P50 : 0.538911 P95 : 1.431140 P99 : 3.959364 P100 : 42726.000000 COUNT : 4116966 SUM : 11737194 rocksdb.numfiles.in.singlecompaction P50 : 2.428571 P95 : 3.979167 P99 : 37.000000 P100 : 37.000000 COUNT : 70 SUM : 255 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574240 P95 : 2113.901537 P99 : 2743.235629 P100 : 727829.000000 COUNT : 221148 SUM : 48151957 rocksdb.sst.read.micros P50 : 2.634293 P95 : 183.228653 P99 : 441.958768 P100 : 39967.000000 COUNT : 4419512 SUM : 261231559 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1114996 SUM : 1114996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3007146 SUM : 3103374672 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222500.000000 P95 : 962000.000000 P99 : 962604.000000 P100 : 962604.000000 COUNT : 42 SUM : 12880553 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 179 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0