[2024-11-20 11:50:40.626126] Starting SPDK v25.01-pre git sha1 a5dab6cf7 / DPDK 24.03.0 initialization... [2024-11-20 11:50:40.626386] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4069043 ] Set seed to 1732099840619466 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 11:50:40.748898] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 11:50:40.857886] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 11:50:40.857928] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4069043' to capture a snapshot of events at runtime. [2024-11-20 11:50:40.857939] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 11:50:40.857949] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 11:50:40.857957] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4069043 for offline analysis/debug. [2024-11-20 11:50:40.859346] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 11:50:49 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-11:50:54 ... thread 0: (1000000,1000000) ops and (186932.8,186932.8) ops/second in (5.349516,5.349516) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 2.15 GB 62.9 0.6 0.0 0.6 1.5 0.9 0.0 1.7 93.0 223.1 6.77 4.92 14 0.484 639K 752 0.0 0.0 L1 9/9 543.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 939.75 MB 0.9 0.5 0.2 0.2 0.5 0.2 0.0 1.9 116.1 115.9 4.06 2.28 2 2.030 0 0 0.0 0.0 L4 173/0 9.64 GB 1.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 102.2 102.1 15.10 7.79 17 0.888 358K 0 0.0 0.0 L5 1108/0 91.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/25 104.47 GB 0.0 2.6 1.7 0.9 3.4 2.6 4.9 4.0 102.0 135.9 25.93 14.98 33 0.786 998K 752 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 1.7 0.9 3.4 2.6 4.9 4.0 102.0 135.9 25.93 14.98 33 0.786 998K 752 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 1.7 0.9 2.6 1.7 0.0 0.0 122.3 122.1 21.63 12.48 21 1.030 998K 752 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 205.0 4.30 2.51 12 0.358 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.5 total, 5.4 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.44 GB write, 634.92 MB/s write, 2.58 GB read, 476.60 MB/s read, 25.9 seconds Interval compaction: 3.44 GB write, 658.24 MB/s write, 2.58 GB read, 494.11 MB/s read, 25.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 16, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 278132 Average: 17.3493 StdDev: 183.17 Min: 1 Median: 1.6133 Max: 38945 Percentiles: P50: 1.61 P75: 2.12 P99: 289.35 P99.9: 2149.57 P99.99: 3139.43 ------------------------------------------------------ [ 0, 1 ] 36834 13.243% 13.243% ### ( 1, 2 ] 166704 59.937% 73.180% ############ ( 2, 3 ] 41517 14.927% 88.107% ### ( 3, 4 ] 12283 4.416% 92.524% # ( 4, 6 ] 10112 3.636% 96.159% # ( 6, 10 ] 2419 0.870% 97.029% ( 10, 15 ] 327 0.118% 97.147% ( 15, 22 ] 63 0.023% 97.169% ( 22, 34 ] 10 0.004% 97.173% ( 34, 51 ] 1 0.000% 97.173% ( 76, 110 ] 210 0.076% 97.249% ( 110, 170 ] 2480 0.892% 98.140% ( 170, 250 ] 2144 0.771% 98.911% ( 250, 380 ] 815 0.293% 99.204% ( 380, 580 ] 699 0.251% 99.456% ( 580, 870 ] 457 0.164% 99.620% ( 870, 1300 ] 374 0.134% 99.754% ( 1300, 1900 ] 329 0.118% 99.873% ( 1900, 2900 ] 304 0.109% 99.982% ( 2900, 4400 ] 139 0.050% 100.032% ( 4400, 6600 ] 46 0.017% 100.049% ( 6600, 9900 ] 10 0.004% 100.052% ( 9900, 14000 ] 1 0.000% 100.052% ( 22000, 33000 ] 1 0.000% 100.053% ( 33000, 50000 ] 1 0.000% 100.053% ** Level 1 read latency histogram (micros): Count: 35321 Average: 13.4092 StdDev: 152.47 Min: 1 Median: 1.8450 Max: 7457 Percentiles: P50: 1.85 P75: 2.75 P99: 207.42 P99.9: 2317.44 P99.99: 6482.94 ------------------------------------------------------ [ 0, 1 ] 1955 5.535% 5.535% # ( 1, 2 ] 18586 52.620% 58.155% ########### ( 2, 3 ] 7881 22.313% 80.468% #### ( 3, 4 ] 2438 6.902% 87.370% # ( 4, 6 ] 2802 7.933% 95.303% ## ( 6, 10 ] 891 2.523% 97.826% # ( 10, 15 ] 159 0.450% 98.276% ( 15, 22 ] 36 0.102% 98.378% ( 22, 34 ] 9 0.025% 98.403% ( 76, 110 ] 12 0.034% 98.437% ( 110, 170 ] 145 0.411% 98.848% ( 170, 250 ] 115 0.326% 99.173% ( 250, 380 ] 59 0.167% 99.340% ( 380, 580 ] 65 0.184% 99.524% ( 580, 870 ] 59 0.167% 99.691% ( 870, 1300 ] 42 0.119% 99.810% ( 1300, 1900 ] 25 0.071% 99.881% ( 1900, 2900 ] 16 0.045% 99.926% ( 2900, 4400 ] 13 0.037% 99.963% ( 4400, 6600 ] 10 0.028% 99.992% ( 6600, 9900 ] 3 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 32712 Average: 11.9966 StdDev: 139.53 Min: 1 Median: 1.8165 Max: 6691 Percentiles: P50: 1.82 P75: 2.68 P99: 12.07 P99.9: 2471.49 P99.99: 4263.80 ------------------------------------------------------ [ 0, 1 ] 1597 4.882% 4.882% # ( 1, 2 ] 18076 55.258% 60.140% ########### ( 2, 3 ] 7155 21.873% 82.013% #### ( 3, 4 ] 2393 7.315% 89.328% # ( 4, 6 ] 2344 7.166% 96.494% # ( 6, 10 ] 762 2.329% 98.823% ( 10, 15 ] 140 0.428% 99.251% ( 15, 22 ] 35 0.107% 99.358% ( 22, 34 ] 4 0.012% 99.370% ( 51, 76 ] 1 0.003% 99.373% ( 76, 110 ] 1 0.003% 99.376% ( 110, 170 ] 4 0.012% 99.389% ( 170, 250 ] 5 0.015% 99.404% ( 250, 380 ] 14 0.043% 99.447% ( 380, 580 ] 14 0.043% 99.489% ( 580, 870 ] 23 0.070% 99.560% ( 870, 1300 ] 37 0.113% 99.673% ( 1300, 1900 ] 52 0.159% 99.832% ( 1900, 2900 ] 39 0.119% 99.951% ( 2900, 4400 ] 14 0.043% 99.994% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 235637 Average: 12.2257 StdDev: 137.39 Min: 0 Median: 1.9860 Max: 8369 Percentiles: P50: 1.99 P75: 2.91 P99: 11.16 P99.9: 1162.64 P99.99: 1523.25 ------------------------------------------------------ [ 0, 1 ] 5052 2.144% 2.144% ( 1, 2 ] 114369 48.536% 50.680% ########## ( 2, 3 ] 62692 26.605% 77.285% ##### ( 3, 4 ] 22188 9.416% 86.702% ## ( 4, 6 ] 22787 9.670% 96.372% ## ( 6, 10 ] 5909 2.508% 98.880% # ( 10, 15 ] 1218 0.517% 99.397% ( 15, 22 ] 267 0.113% 99.510% ( 22, 34 ] 22 0.009% 99.519% ( 34, 51 ] 6 0.003% 99.522% ( 51, 76 ] 5 0.002% 99.524% ( 76, 110 ] 9 0.004% 99.528% ( 110, 170 ] 106 0.045% 99.573% ( 170, 250 ] 90 0.038% 99.611% ( 250, 380 ] 103 0.044% 99.655% ( 380, 580 ] 145 0.062% 99.716% ( 580, 870 ] 236 0.100% 99.816% ( 870, 1300 ] 290 0.123% 99.939% ( 1300, 1900 ] 321 0.136% 100.076% ( 1900, 2900 ] 286 0.121% 100.197% ( 2900, 4400 ] 89 0.038% 100.235% ( 4400, 6600 ] 15 0.006% 100.241% ( 6600, 9900 ] 4 0.002% 100.243% ** Level 4 read latency histogram (micros): Count: 7502 Average: 392.1746 StdDev: 1080.95 Min: 1 Median: 3.7793 Max: 40612 Percentiles: P50: 3.78 P75: 247.12 P99: 4221.47 P99.9: 8867.93 P99.99: 37246.60 ------------------------------------------------------ [ 0, 1 ] 130 1.733% 1.733% ( 1, 2 ] 1922 25.620% 27.353% ##### ( 2, 3 ] 1360 18.128% 45.481% #### ( 3, 4 ] 435 5.798% 51.280% # ( 4, 6 ] 376 5.012% 56.292% # ( 6, 10 ] 91 1.213% 57.505% ( 10, 15 ] 27 0.360% 57.865% ( 15, 22 ] 2 0.027% 57.891% ( 22, 34 ] 1 0.013% 57.905% ( 76, 110 ] 83 1.106% 59.011% ( 110, 170 ] 651 8.678% 67.689% ## ( 170, 250 ] 569 7.585% 75.273% ## ( 250, 380 ] 237 3.159% 78.432% # ( 380, 580 ] 296 3.946% 82.378% # ( 580, 870 ] 276 3.679% 86.057% # ( 870, 1300 ] 287 3.826% 89.883% # ( 1300, 1900 ] 286 3.812% 93.695% # ( 1900, 2900 ] 272 3.626% 97.321% # ( 2900, 4400 ] 143 1.906% 99.227% ( 4400, 6600 ] 45 0.600% 99.827% ( 6600, 9900 ] 8 0.107% 99.933% ( 9900, 14000 ] 1 0.013% 99.947% ( 14000, 22000 ] 1 0.013% 99.960% ( 22000, 33000 ] 2 0.027% 99.987% ( 33000, 50000 ] 1 0.013% 100.000% ** Level 5 read latency histogram (micros): Count: 20683 Average: 707.1781 StdDev: 1170.92 Min: 78 Median: 239.0909 Max: 39003 Percentiles: P50: 239.09 P75: 682.77 P99: 5671.43 P99.9: 8331.70 P99.99: 25416.23 ------------------------------------------------------ ( 76, 110 ] 567 2.741% 2.741% # ( 110, 170 ] 5699 27.554% 30.295% ###### ( 170, 250 ] 4719 22.816% 53.111% ##### ( 250, 380 ] 2144 10.366% 63.477% ## ( 380, 580 ] 1874 9.061% 72.538% ## ( 580, 870 ] 1437 6.948% 79.486% # ( 870, 1300 ] 1106 5.347% 84.833% # ( 1300, 1900 ] 937 4.530% 89.363% # ( 1900, 2900 ] 971 4.695% 94.058% # ( 2900, 4400 ] 791 3.824% 97.882% # ( 4400, 6600 ] 400 1.934% 99.816% ( 6600, 9900 ] 33 0.160% 99.976% ( 9900, 14000 ] 1 0.005% 99.981% ( 14000, 22000 ] 1 0.005% 99.985% ( 22000, 33000 ] 3 0.015% 100.000% ( 33000, 50000 ] 1 0.005% 100.005% ** DB Stats ** Uptime(secs): 5.5 total, 5.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 177.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.671 H:M:S, 30.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 183.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.671 H:M:S, 31.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-11:51:02 ... thread 0: (1000000,2000000) ops and (121282.5,147115.9) ops/second in (8.245210,13.594726) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.13 GB 188.6 2.4 0.0 2.4 4.2 1.8 0.0 2.3 146.9 259.8 16.72 14.23 35 0.478 2493K 4116 0.0 0.0 L1 9/9 543.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 939.75 MB 0.9 0.5 0.2 0.2 0.5 0.2 0.0 1.9 116.1 115.9 4.06 2.28 2 2.030 0 0 0.0 0.0 L4 173/0 9.64 GB 1.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 102.2 102.1 15.10 7.79 17 0.888 358K 0 0.0 0.0 L5 1108/0 91.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/21 105.46 GB 0.0 4.4 1.7 2.7 6.2 3.6 4.9 3.4 124.6 177.1 35.87 24.30 54 0.664 2852K 4116 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.7 2.7 6.2 3.6 4.9 3.4 124.6 177.1 35.87 24.30 54 0.664 2852K 4116 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.7 2.7 4.4 1.7 0.0 0.0 157.2 156.9 28.44 19.15 26 1.094 2852K 4116 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 254.3 7.43 5.15 28 0.265 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.8 total, 13.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.20 GB write, 460.63 MB/s write, 4.37 GB read, 324.11 MB/s read, 35.9 seconds Interval compaction: 6.20 GB write, 467.29 MB/s write, 4.37 GB read, 328.80 MB/s read, 35.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 16, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 763960 Average: 20.7635 StdDev: 124.35 Min: 0 Median: 1.5146 Max: 38945 Percentiles: P50: 1.51 P75: 1.96 P99: 297.38 P99.9: 1020.06 P99.99: 2051.69 ------------------------------------------------------ [ 0, 1 ] 159640 20.896% 20.896% #### ( 1, 2 ] 432086 56.559% 77.455% ########### ( 2, 3 ] 70303 9.202% 86.658% ## ( 3, 4 ] 20782 2.720% 89.378% # ( 4, 6 ] 15815 2.070% 91.448% ( 6, 10 ] 3391 0.444% 91.892% ( 10, 15 ] 705 0.092% 91.984% ( 15, 22 ] 106 0.014% 91.998% ( 22, 34 ] 14 0.002% 92.000% ( 34, 51 ] 3 0.000% 92.000% ( 51, 76 ] 5 0.001% 92.001% ( 76, 110 ] 2835 0.371% 92.372% ( 110, 170 ] 29668 3.883% 96.255% # ( 170, 250 ] 19385 2.537% 98.793% # ( 250, 380 ] 4342 0.568% 99.361% ( 380, 580 ] 2947 0.386% 99.747% ( 580, 870 ] 1012 0.132% 99.879% ( 870, 1300 ] 450 0.059% 99.938% ( 1300, 1900 ] 345 0.045% 99.984% ( 1900, 2900 ] 327 0.043% 100.026% ( 2900, 4400 ] 152 0.020% 100.046% ( 4400, 6600 ] 46 0.006% 100.052% ( 6600, 9900 ] 10 0.001% 100.054% ( 9900, 14000 ] 1 0.000% 100.054% ( 22000, 33000 ] 1 0.000% 100.054% ( 33000, 50000 ] 1 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 53801 Average: 16.5640 StdDev: 128.91 Min: 1 Median: 2.2707 Max: 7457 Percentiles: P50: 2.27 P75: 3.90 P99: 245.35 P99.9: 1592.78 P99.99: 5856.38 ------------------------------------------------------ [ 0, 1 ] 2114 3.929% 3.929% # ( 1, 2 ] 21684 40.304% 44.233% ######## ( 2, 3 ] 11461 21.303% 65.536% #### ( 3, 4 ] 5651 10.504% 76.039% ## ( 4, 6 ] 8143 15.135% 91.175% ### ( 6, 10 ] 1728 3.212% 94.387% # ( 10, 15 ] 381 0.708% 95.095% ( 15, 22 ] 184 0.342% 95.437% ( 22, 34 ] 18 0.033% 95.470% ( 34, 51 ] 2 0.004% 95.474% ( 76, 110 ] 105 0.195% 95.669% ( 110, 170 ] 1112 2.067% 97.736% ( 170, 250 ] 722 1.342% 99.078% ( 250, 380 ] 172 0.320% 99.398% ( 380, 580 ] 139 0.258% 99.656% ( 580, 870 ] 74 0.138% 99.794% ( 870, 1300 ] 45 0.084% 99.877% ( 1300, 1900 ] 25 0.046% 99.924% ( 1900, 2900 ] 16 0.030% 99.954% ( 2900, 4400 ] 13 0.024% 99.978% ( 4400, 6600 ] 10 0.019% 99.996% ( 6600, 9900 ] 3 0.006% 100.002% ** Level 2 read latency histogram (micros): Count: 32712 Average: 11.9966 StdDev: 139.53 Min: 1 Median: 1.8165 Max: 6691 Percentiles: P50: 1.82 P75: 2.68 P99: 12.07 P99.9: 2471.49 P99.99: 4263.80 ------------------------------------------------------ [ 0, 1 ] 1597 4.882% 4.882% # ( 1, 2 ] 18076 55.258% 60.140% ########### ( 2, 3 ] 7155 21.873% 82.013% #### ( 3, 4 ] 2393 7.315% 89.328% # ( 4, 6 ] 2344 7.166% 96.494% # ( 6, 10 ] 762 2.329% 98.823% ( 10, 15 ] 140 0.428% 99.251% ( 15, 22 ] 35 0.107% 99.358% ( 22, 34 ] 4 0.012% 99.370% ( 51, 76 ] 1 0.003% 99.373% ( 76, 110 ] 1 0.003% 99.376% ( 110, 170 ] 4 0.012% 99.389% ( 170, 250 ] 5 0.015% 99.404% ( 250, 380 ] 14 0.043% 99.447% ( 380, 580 ] 14 0.043% 99.489% ( 580, 870 ] 23 0.070% 99.560% ( 870, 1300 ] 37 0.113% 99.673% ( 1300, 1900 ] 52 0.159% 99.832% ( 1900, 2900 ] 39 0.119% 99.951% ( 2900, 4400 ] 14 0.043% 99.994% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 237423 Average: 13.3595 StdDev: 137.73 Min: 0 Median: 1.9937 Max: 8369 Percentiles: P50: 1.99 P75: 2.93 P99: 126.53 P99.9: 1160.47 P99.99: 1522.91 ------------------------------------------------------ [ 0, 1 ] 5052 2.128% 2.128% ( 1, 2 ] 114377 48.174% 50.302% ########## ( 2, 3 ] 62748 26.429% 76.731% ##### ( 3, 4 ] 22222 9.360% 86.091% ## ( 4, 6 ] 22848 9.623% 95.714% ## ( 6, 10 ] 5916 2.492% 98.206% ( 10, 15 ] 1221 0.514% 98.720% ( 15, 22 ] 267 0.112% 98.832% ( 22, 34 ] 22 0.009% 98.842% ( 34, 51 ] 6 0.003% 98.844% ( 51, 76 ] 5 0.002% 98.846% ( 76, 110 ] 94 0.040% 98.886% ( 110, 170 ] 983 0.414% 99.300% ( 170, 250 ] 586 0.247% 99.547% ( 250, 380 ] 207 0.087% 99.634% ( 380, 580 ] 188 0.079% 99.713% ( 580, 870 ] 247 0.104% 99.817% ( 870, 1300 ] 291 0.123% 99.940% ( 1300, 1900 ] 321 0.135% 100.075% ( 1900, 2900 ] 286 0.120% 100.195% ( 2900, 4400 ] 89 0.037% 100.233% ( 4400, 6600 ] 15 0.006% 100.239% ( 6600, 9900 ] 4 0.002% 100.241% ** Level 4 read latency histogram (micros): Count: 22020 Average: 249.0873 StdDev: 646.45 Min: 1 Median: 147.8572 Max: 40612 Percentiles: P50: 147.86 P75: 215.63 P99: 2830.94 P99.9: 6159.02 P99.99: 26389.00 ------------------------------------------------------ [ 0, 1 ] 130 0.590% 0.590% ( 1, 2 ] 1961 8.906% 9.496% ## ( 2, 3 ] 1750 7.947% 17.443% ## ( 3, 4 ] 690 3.134% 20.577% # ( 4, 6 ] 806 3.660% 24.237% # ( 6, 10 ] 140 0.636% 24.873% ( 10, 15 ] 40 0.182% 25.054% ( 15, 22 ] 3 0.014% 25.068% ( 22, 34 ] 1 0.005% 25.073% ( 76, 110 ] 707 3.211% 28.283% # ( 110, 170 ] 7579 34.419% 62.702% ####### ( 170, 250 ] 4748 21.562% 84.264% #### ( 250, 380 ] 1119 5.082% 89.346% # ( 380, 580 ] 836 3.797% 93.143% # ( 580, 870 ] 434 1.971% 95.114% ( 870, 1300 ] 308 1.399% 96.512% ( 1300, 1900 ] 289 1.312% 97.825% ( 1900, 2900 ] 278 1.262% 99.087% ( 2900, 4400 ] 143 0.649% 99.737% ( 4400, 6600 ] 45 0.204% 99.941% ( 6600, 9900 ] 8 0.036% 99.977% ( 9900, 14000 ] 1 0.005% 99.982% ( 14000, 22000 ] 1 0.005% 99.986% ( 22000, 33000 ] 2 0.009% 99.995% ( 33000, 50000 ] 1 0.005% 100.000% ** Level 5 read latency histogram (micros): Count: 132224 Average: 269.2154 StdDev: 509.20 Min: 78 Median: 166.1678 Max: 39003 Percentiles: P50: 166.17 P75: 228.69 P99: 2808.67 P99.9: 6087.27 P99.99: 9177.76 ------------------------------------------------------ ( 76, 110 ] 6209 4.696% 4.696% # ( 110, 170 ] 63990 48.395% 53.091% ########## ( 170, 250 ] 39489 29.865% 82.956% ###### ( 250, 380 ] 9132 6.906% 89.863% # ( 380, 580 ] 6330 4.787% 94.650% # ( 580, 870 ] 2629 1.988% 96.638% ( 870, 1300 ] 1261 0.954% 97.592% ( 1300, 1900 ] 954 0.722% 98.313% ( 1900, 2900 ] 999 0.756% 99.069% ( 2900, 4400 ] 792 0.599% 99.668% ( 4400, 6600 ] 400 0.303% 99.971% ( 6600, 9900 ] 33 0.025% 99.995% ( 9900, 14000 ] 1 0.001% 99.996% ( 14000, 22000 ] 1 0.001% 99.997% ( 22000, 33000 ] 3 0.002% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** DB Stats ** Uptime(secs): 13.8 total, 8.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 142.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.274 H:M:S, 45.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.603 H:M:S, 55.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-11:51:13 ... thread 0: (1000000,3000000) ops and (92392.4,122859.5) ops/second in (10.823401,24.418127) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 4.05 GB 282.7 4.2 0.0 4.2 6.9 2.8 0.0 2.5 161.1 267.4 26.59 23.51 55 0.483 4348K 7617 0.0 0.0 L1 9/9 543.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 939.75 MB 0.9 0.5 0.2 0.2 0.5 0.2 0.0 1.9 116.1 115.9 4.06 2.28 2 2.030 0 0 0.0 0.0 L4 173/0 9.64 GB 1.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 102.2 102.1 15.10 7.79 17 0.888 358K 0 0.0 0.0 L5 1108/0 91.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/21 106.37 GB 0.0 6.1 1.7 4.4 8.9 4.5 4.9 3.2 137.6 199.4 45.75 33.58 74 0.618 4706K 7617 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 1.7 4.4 8.9 4.5 4.9 3.2 137.6 199.4 45.75 33.58 74 0.618 4706K 7617 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 1.7 4.4 6.1 1.7 0.0 0.0 178.7 178.4 35.23 25.84 31 1.137 4706K 7617 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 269.6 10.52 7.74 43 0.245 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.6 total, 24.4 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.91 GB write, 370.53 MB/s write, 6.15 GB read, 255.80 MB/s read, 45.7 seconds Interval compaction: 8.91 GB write, 373.52 MB/s write, 6.15 GB read, 257.86 MB/s read, 45.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 16, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1314467 Average: 22.9885 StdDev: 106.83 Min: 0 Median: 1.5015 Max: 38945 Percentiles: P50: 1.50 P75: 1.96 P99: 298.51 P99.9: 770.86 P99.99: 1429.23 ------------------------------------------------------ [ 0, 1 ] 294623 22.414% 22.414% #### ( 1, 2 ] 723013 55.004% 77.418% ########### ( 2, 3 ] 103461 7.871% 85.289% ## ( 3, 4 ] 31061 2.363% 87.652% ( 4, 6 ] 23085 1.756% 89.408% ( 6, 10 ] 4599 0.350% 89.758% ( 10, 15 ] 1206 0.092% 89.850% ( 15, 22 ] 165 0.013% 89.863% ( 22, 34 ] 24 0.002% 89.864% ( 34, 51 ] 3 0.000% 89.865% ( 51, 76 ] 5 0.000% 89.865% ( 76, 110 ] 6527 0.497% 90.361% ( 110, 170 ] 68355 5.200% 95.562% # ( 170, 250 ] 42067 3.200% 98.762% # ( 250, 380 ] 8384 0.638% 99.400% ( 380, 580 ] 5459 0.415% 99.815% ( 580, 870 ] 1695 0.129% 99.944% ( 870, 1300 ] 523 0.040% 99.984% ( 1300, 1900 ] 374 0.028% 100.012% ( 1900, 2900 ] 360 0.027% 100.040% ( 2900, 4400 ] 171 0.013% 100.053% ( 4400, 6600 ] 47 0.004% 100.056% ( 6600, 9900 ] 10 0.001% 100.057% ( 9900, 14000 ] 1 0.000% 100.057% ( 22000, 33000 ] 1 0.000% 100.057% ( 33000, 50000 ] 1 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 78216 Average: 18.5177 StdDev: 112.82 Min: 1 Median: 2.7637 Max: 7457 Percentiles: P50: 2.76 P75: 4.68 P99: 247.39 P99.9: 1215.68 P99.99: 5319.25 ------------------------------------------------------ [ 0, 1 ] 2243 2.868% 2.868% # ( 1, 2 ] 24703 31.583% 34.451% ###### ( 2, 3 ] 15925 20.360% 54.811% #### ( 3, 4 ] 10241 13.093% 67.904% ### ( 4, 6 ] 16259 20.787% 88.692% #### ( 6, 10 ] 2753 3.520% 92.211% # ( 10, 15 ] 695 0.889% 93.100% ( 15, 22 ] 404 0.517% 93.616% ( 22, 34 ] 28 0.036% 93.652% ( 34, 51 ] 6 0.008% 93.660% ( 76, 110 ] 251 0.321% 93.981% ( 110, 170 ] 2530 3.235% 97.215% # ( 170, 250 ] 1443 1.845% 99.060% ( 250, 380 ] 299 0.382% 99.443% ( 380, 580 ] 216 0.276% 99.719% ( 580, 870 ] 104 0.133% 99.852% ( 870, 1300 ] 47 0.060% 99.912% ( 1300, 1900 ] 27 0.035% 99.946% ( 1900, 2900 ] 17 0.022% 99.968% ( 2900, 4400 ] 13 0.017% 99.985% ( 4400, 6600 ] 10 0.013% 99.997% ( 6600, 9900 ] 3 0.004% 100.001% ** Level 2 read latency histogram (micros): Count: 32712 Average: 11.9966 StdDev: 139.53 Min: 1 Median: 1.8165 Max: 6691 Percentiles: P50: 1.82 P75: 2.68 P99: 12.07 P99.9: 2471.49 P99.99: 4263.80 ------------------------------------------------------ [ 0, 1 ] 1597 4.882% 4.882% # ( 1, 2 ] 18076 55.258% 60.140% ########### ( 2, 3 ] 7155 21.873% 82.013% #### ( 3, 4 ] 2393 7.315% 89.328% # ( 4, 6 ] 2344 7.166% 96.494% # ( 6, 10 ] 762 2.329% 98.823% ( 10, 15 ] 140 0.428% 99.251% ( 15, 22 ] 35 0.107% 99.358% ( 22, 34 ] 4 0.012% 99.370% ( 51, 76 ] 1 0.003% 99.373% ( 76, 110 ] 1 0.003% 99.376% ( 110, 170 ] 4 0.012% 99.389% ( 170, 250 ] 5 0.015% 99.404% ( 250, 380 ] 14 0.043% 99.447% ( 380, 580 ] 14 0.043% 99.489% ( 580, 870 ] 23 0.070% 99.560% ( 870, 1300 ] 37 0.113% 99.673% ( 1300, 1900 ] 52 0.159% 99.832% ( 1900, 2900 ] 39 0.119% 99.951% ( 2900, 4400 ] 14 0.043% 99.994% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 239883 Average: 15.1037 StdDev: 138.68 Min: 0 Median: 2.0081 Max: 8369 Percentiles: P50: 2.01 P75: 2.96 P99: 185.09 P99.9: 1163.15 P99.99: 1528.06 ------------------------------------------------------ [ 0, 1 ] 5052 2.106% 2.106% ( 1, 2 ] 114382 47.682% 49.788% ########## ( 2, 3 ] 62755 26.161% 75.949% ##### ( 3, 4 ] 22224 9.265% 85.214% ## ( 4, 6 ] 22855 9.528% 94.741% ## ( 6, 10 ] 5916 2.466% 97.207% ( 10, 15 ] 1221 0.509% 97.716% ( 15, 22 ] 267 0.111% 97.828% ( 22, 34 ] 22 0.009% 97.837% ( 34, 51 ] 6 0.003% 97.839% ( 51, 76 ] 5 0.002% 97.841% ( 76, 110 ] 235 0.098% 97.939% ( 110, 170 ] 2292 0.955% 98.895% ( 170, 250 ] 1337 0.557% 99.452% ( 250, 380 ] 335 0.140% 99.592% ( 380, 580 ] 270 0.113% 99.704% ( 580, 870 ] 268 0.112% 99.816% ( 870, 1300 ] 295 0.123% 99.939% ( 1300, 1900 ] 321 0.134% 100.073% ( 1900, 2900 ] 288 0.120% 100.193% ( 2900, 4400 ] 90 0.038% 100.231% ( 4400, 6600 ] 15 0.006% 100.237% ( 6600, 9900 ] 4 0.002% 100.238% ** Level 4 read latency histogram (micros): Count: 41772 Average: 214.7024 StdDev: 475.37 Min: 1 Median: 153.5296 Max: 40612 Percentiles: P50: 153.53 P75: 211.34 P99: 2126.00 P99.9: 5193.37 P99.99: 13273.48 ------------------------------------------------------ [ 0, 1 ] 130 0.311% 0.311% ( 1, 2 ] 1993 4.771% 5.082% # ( 2, 3 ] 1956 4.683% 9.765% # ( 3, 4 ] 797 1.908% 11.673% ( 4, 6 ] 980 2.346% 14.019% ( 6, 10 ] 149 0.357% 14.376% ( 10, 15 ] 49 0.117% 14.493% ( 15, 22 ] 4 0.010% 14.503% ( 22, 34 ] 1 0.002% 14.505% ( 76, 110 ] 1742 4.170% 18.675% # ( 110, 170 ] 18036 43.177% 61.852% ######### ( 170, 250 ] 10628 25.443% 87.295% ##### ( 250, 380 ] 2161 5.173% 92.469% # ( 380, 580 ] 1462 3.500% 95.969% # ( 580, 870 ] 585 1.400% 97.369% ( 870, 1300 ] 325 0.778% 98.147% ( 1300, 1900 ] 293 0.701% 98.849% ( 1900, 2900 ] 280 0.670% 99.519% ( 2900, 4400 ] 143 0.342% 99.861% ( 4400, 6600 ] 45 0.108% 99.969% ( 6600, 9900 ] 8 0.019% 99.988% ( 9900, 14000 ] 1 0.002% 99.990% ( 14000, 22000 ] 1 0.002% 99.993% ( 22000, 33000 ] 2 0.005% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 5 read latency histogram (micros): Count: 282313 Average: 222.3187 StdDev: 358.63 Min: 78 Median: 161.7091 Max: 39003 Percentiles: P50: 161.71 P75: 217.89 P99: 1565.38 P99.9: 5261.78 P99.99: 7676.87 ------------------------------------------------------ ( 76, 110 ] 14964 5.300% 5.300% # ( 110, 170 ] 146426 51.867% 57.167% ########## ( 170, 250 ] 84102 29.790% 86.957% ###### ( 250, 380 ] 17016 6.027% 92.985% # ( 380, 580 ] 11230 3.978% 96.963% # ( 580, 870 ] 3901 1.382% 98.344% ( 870, 1300 ] 1413 0.501% 98.845% ( 1300, 1900 ] 990 0.351% 99.196% ( 1900, 2900 ] 1036 0.367% 99.563% ( 2900, 4400 ] 796 0.282% 99.844% ( 4400, 6600 ] 400 0.142% 99.986% ( 6600, 9900 ] 33 0.012% 99.998% ( 9900, 14000 ] 1 0.000% 99.998% ( 14000, 22000 ] 1 0.000% 99.999% ( 22000, 33000 ] 3 0.001% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ** DB Stats ** Uptime(secs): 24.6 total, 10.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 119.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.394 H:M:S, 54.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 90.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.120 H:M:S, 65.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 243.170 micros/op 16440 ops/sec 60.156 seconds 988996 operations; 15.9 MB/s (246999 of 246999 found) Microseconds per read: Count: 988996 Average: 243.1719 StdDev: 588.14 Min: 2 Median: 203.3613 Max: 130821 Percentiles: P50: 203.36 P75: 245.66 P99: 783.39 P99.9: 7332.23 P99.99: 24959.22 ------------------------------------------------------ ( 1, 2 ] 9 0.001% 0.001% ( 2, 3 ] 36 0.004% 0.005% ( 3, 4 ] 56 0.006% 0.010% ( 4, 6 ] 84 0.008% 0.019% ( 6, 10 ] 378 0.038% 0.057% ( 10, 15 ] 5093 0.515% 0.572% ( 15, 22 ] 4197 0.424% 0.996% ( 22, 34 ] 9141 0.924% 1.921% ( 34, 51 ] 1938 0.196% 2.116% ( 51, 76 ] 249 0.025% 2.142% ( 76, 110 ] 2736 0.277% 2.418% ( 110, 170 ] 275562 27.863% 30.281% ###### ( 170, 250 ] 467653 47.286% 77.567% ######### ( 250, 380 ] 137044 13.857% 91.424% ### ( 380, 580 ] 64262 6.498% 97.921% # ( 580, 870 ] 15211 1.538% 99.459% ( 870, 1300 ] 2999 0.303% 99.763% ( 1300, 1900 ] 535 0.054% 99.817% ( 1900, 2900 ] 384 0.039% 99.856% ( 2900, 4400 ] 187 0.019% 99.874% ( 4400, 6600 ] 182 0.018% 99.893% ( 6600, 9900 ] 320 0.032% 99.925% ( 9900, 14000 ] 357 0.036% 99.961% ( 14000, 22000 ] 265 0.027% 99.988% ( 22000, 33000 ] 71 0.007% 99.995% ( 33000, 50000 ] 39 0.004% 99.999% ( 50000, 75000 ] 4 0.000% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 21278776 rocksdb.bloom.filter.full.positive COUNT : 1193812 rocksdb.bloom.filter.full.true.positive COUNT : 988646 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 350 rocksdb.memtable.miss COUNT : 988646 rocksdb.l0.hit COUNT : 40348 rocksdb.l1.hit COUNT : 5253 rocksdb.l2andup.hit COUNT : 943045 rocksdb.compaction.key.drop.new COUNT : 28326 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3613091 rocksdb.number.keys.read COUNT : 988996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3728709912 rocksdb.bytes.read COUNT : 988996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1425 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 46046459 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9904409634 rocksdb.compact.write.bytes COUNT : 9877285823 rocksdb.flush.write.bytes COUNT : 3699448805 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 72 rocksdb.number.superversion_acquires COUNT : 603 rocksdb.number.superversion_releases COUNT : 578 rocksdb.number.superversion_cleanups COUNT : 153 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3669364736 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1196032 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14545333287 rocksdb.non.last.level.read.count COUNT : 3370289 rocksdb.block.checksum.compute.count COUNT : 3605590 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 202.508904 P95 : 488.764059 P99 : 782.473494 P100 : 130819.000000 COUNT : 988996 SUM : 239638770 rocksdb.db.write.micros P50 : 1.495879 P95 : 4.788277 P99 : 14.299608 P100 : 613641.000000 COUNT : 3613091 SUM : 55002781 rocksdb.compaction.times.micros P50 : 1038095.238095 P95 : 3017743.000000 P99 : 3017743.000000 P100 : 3017743.000000 COUNT : 34 SUM : 40149665 rocksdb.compaction.times.cpu_micros P50 : 570000.000000 P95 : 2981843.000000 P99 : 2981843.000000 P100 : 2981843.000000 COUNT : 34 SUM : 30677011 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 2550.000000 P99 : 8019.000000 P100 : 8019.000000 COUNT : 54 SUM : 61999 rocksdb.compaction.outfile.sync.micros P50 : 2500.000000 P95 : 11950.000000 P99 : 16624.000000 P100 : 16624.000000 COUNT : 70 SUM : 265064 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 167.750000 P95 : 3532.142857 P99 : 4397.857143 P100 : 4662.000000 COUNT : 101 SUM : 78931 rocksdb.table.open.io.micros P50 : 8206.754032 P95 : 18808.823529 P99 : 24326.923077 P100 : 94704.000000 COUNT : 1425 SUM : 12469798 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.684030 P95 : 165.620594 P99 : 248.491901 P100 : 38950.000000 COUNT : 2399209 SUM : 64992588 rocksdb.read.block.get.micros P50 : 153.850687 P95 : 288.244564 P99 : 574.410300 P100 : 40676.000000 COUNT : 1204907 SUM : 205893510 rocksdb.write.raw.block.micros P50 : 0.553746 P95 : 1.660158 P99 : 4.001265 P100 : 48195.000000 COUNT : 3288180 SUM : 8650755 rocksdb.numfiles.in.singlecompaction P50 : 3.183333 P95 : 3.948333 P99 : 18.430000 P100 : 21.000000 COUNT : 51 SUM : 182 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.591186 P95 : 2280.547748 P99 : 2776.328923 P100 : 613492.000000 COUNT : 180799 SUM : 46066939 rocksdb.sst.read.micros P50 : 2.707258 P95 : 233.459903 P99 : 461.528535 P100 : 40612.000000 COUNT : 3370324 SUM : 256229260 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 988996 SUM : 988996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3613091 SUM : 3728709912 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218000.000000 P95 : 437000.000000 P99 : 781700.000000 P100 : 824533.000000 COUNT : 54 SUM : 12871770 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 110 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0