[2024-12-14 12:02:42.500499] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-12-14 12:02:42.500646] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1219048 ] Set seed to 1734174162497054 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 12:02:42.586472] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 12:02:42.627911] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 12:02:42.627960] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1219048' to capture a snapshot of events at runtime. [2024-12-14 12:02:42.627971] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-14 12:02:42.627981] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-14 12:02:42.627989] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1219048 for offline analysis/debug. [2024-12-14 12:02:42.628080] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 12:02:46 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-12:02:50 ... thread 0: (1000000,1000000) ops and (245452.2,245452.2) ops/second in (4.074113,4.074113) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.46 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 101.0 257.9 5.62 4.45 15 0.374 575K 586 0.0 0.0 L2 1/0 34.55 MB 0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 892.74 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 161/0 9.61 GB 1.0 1.4 0.8 0.6 1.4 0.8 0.0 1.6 129.9 128.5 11.02 6.85 7 1.574 614K 0 0.0 0.0 L5 1124/0 92.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/14 105.31 GB 0.0 2.0 0.8 1.1 2.8 1.7 1.6 3.2 120.1 172.2 16.63 11.30 22 0.756 1189K 586 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.1 2.8 1.7 1.6 3.2 120.1 172.2 16.63 11.30 22 0.756 1189K 586 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.1 1.9 0.8 0.0 0.0 152.2 150.9 13.13 8.92 9 1.459 1189K 586 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 252.1 3.50 2.38 13 0.269 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.3 total, 4.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.80 GB write, 673.68 MB/s write, 1.95 GB read, 470.02 MB/s read, 16.6 seconds Interval compaction: 2.80 GB write, 702.82 MB/s write, 1.95 GB read, 490.35 MB/s read, 16.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 319512 Average: 8.4347 StdDev: 89.12 Min: 1 Median: 1.5782 Max: 8115 Percentiles: P50: 1.58 P75: 1.98 P99: 155.26 P99.9: 850.75 P99.99: 1595.08 ------------------------------------------------------ [ 0, 1 ] 45744 14.317% 14.317% ### ( 1, 2 ] 197192 61.717% 76.033% ############ ( 2, 3 ] 42871 13.418% 89.451% ### ( 3, 4 ] 13776 4.312% 93.763% # ( 4, 6 ] 10783 3.375% 97.138% # ( 6, 10 ] 3567 1.116% 98.254% ( 10, 15 ] 440 0.138% 98.392% ( 15, 22 ] 72 0.023% 98.414% ( 22, 34 ] 19 0.006% 98.420% ( 34, 51 ] 4 0.001% 98.421% ( 51, 76 ] 1 0.000% 98.422% ( 76, 110 ] 419 0.131% 98.553% ( 110, 170 ] 1897 0.594% 99.147% ( 170, 250 ] 1063 0.333% 99.479% ( 250, 380 ] 568 0.178% 99.657% ( 380, 580 ] 490 0.153% 99.810% ( 580, 870 ] 309 0.097% 99.907% ( 870, 1300 ] 210 0.066% 99.973% ( 1300, 1900 ] 116 0.036% 100.009% ( 1900, 2900 ] 74 0.023% 100.032% ( 2900, 4400 ] 41 0.013% 100.045% ( 4400, 6600 ] 18 0.006% 100.051% ( 6600, 9900 ] 4 0.001% 100.052% ** Level 2 read latency histogram (micros): Count: 12 Average: 291.0000 StdDev: 211.61 Min: 96 Median: 210.0000 Max: 695 Percentiles: P50: 210.00 P75: 380.00 P99: 695.00 P99.9: 695.00 P99.99: 695.00 ------------------------------------------------------ ( 76, 110 ] 2 16.667% 16.667% ### ( 110, 170 ] 2 16.667% 33.333% ### ( 170, 250 ] 4 33.333% 66.667% ####### ( 250, 380 ] 1 8.333% 75.000% ## ( 580, 870 ] 3 25.000% 100.000% ##### ** Level 3 read latency histogram (micros): Count: 73067 Average: 11.8154 StdDev: 139.86 Min: 1 Median: 1.9782 Max: 7083 Percentiles: P50: 1.98 P75: 3.00 P99: 14.35 P99.9: 1796.84 P99.99: 2840.95 ------------------------------------------------------ [ 0, 1 ] 2431 3.327% 3.327% # ( 1, 2 ] 34862 47.712% 51.039% ########## ( 2, 3 ] 17556 24.027% 75.067% ##### ( 3, 4 ] 7275 9.957% 85.023% ## ( 4, 6 ] 7413 10.145% 95.169% ## ( 6, 10 ] 2438 3.337% 98.505% # ( 10, 15 ] 415 0.568% 99.073% ( 15, 22 ] 67 0.092% 99.165% ( 22, 34 ] 17 0.023% 99.188% ( 34, 51 ] 6 0.008% 99.197% ( 51, 76 ] 7 0.010% 99.206% ( 76, 110 ] 15 0.021% 99.227% ( 110, 170 ] 71 0.097% 99.324% ( 170, 250 ] 44 0.060% 99.384% ( 250, 380 ] 53 0.073% 99.457% ( 380, 580 ] 76 0.104% 99.561% ( 580, 870 ] 99 0.135% 99.696% ( 870, 1300 ] 86 0.118% 99.814% ( 1300, 1900 ] 76 0.104% 99.918% ( 1900, 2900 ] 56 0.077% 99.995% ( 2900, 4400 ] 20 0.027% 100.022% ( 4400, 6600 ] 12 0.016% 100.038% ( 6600, 9900 ] 3 0.004% 100.042% ** Level 4 read latency histogram (micros): Count: 101694 Average: 26.8095 StdDev: 209.72 Min: 0 Median: 1.9453 Max: 8572 Percentiles: P50: 1.95 P75: 2.95 P99: 717.76 P99.9: 2517.40 P99.99: 3224.67 ------------------------------------------------------ [ 0, 1 ] 3695 3.633% 3.633% # ( 1, 2 ] 49880 49.049% 52.683% ########## ( 2, 3 ] 23958 23.559% 76.241% ##### ( 3, 4 ] 9136 8.984% 85.225% ## ( 4, 6 ] 8677 8.532% 93.758% ## ( 6, 10 ] 2760 2.714% 96.472% # ( 10, 15 ] 420 0.413% 96.885% ( 15, 22 ] 95 0.093% 96.978% ( 22, 34 ] 25 0.025% 97.003% ( 34, 51 ] 10 0.010% 97.013% ( 51, 76 ] 8 0.008% 97.020% ( 76, 110 ] 120 0.118% 97.138% ( 110, 170 ] 593 0.583% 97.722% ( 170, 250 ] 394 0.387% 98.109% ( 250, 380 ] 341 0.335% 98.444% ( 380, 580 ] 376 0.370% 98.814% ( 580, 870 ] 398 0.391% 99.205% ( 870, 1300 ] 324 0.319% 99.524% ( 1300, 1900 ] 265 0.261% 99.785% ( 1900, 2900 ] 190 0.187% 99.971% ( 2900, 4400 ] 87 0.086% 100.057% ( 4400, 6600 ] 34 0.033% 100.090% ( 6600, 9900 ] 4 0.004% 100.094% ** Level 5 read latency histogram (micros): Count: 17953 Average: 631.5075 StdDev: 960.39 Min: 76 Median: 239.7233 Max: 9910 Percentiles: P50: 239.72 P75: 596.58 P99: 4922.72 P99.9: 7398.20 P99.99: 9531.02 ------------------------------------------------------ ( 51, 76 ] 1 0.006% 0.006% ( 76, 110 ] 1284 7.152% 7.158% # ( 110, 170 ] 4920 27.405% 34.562% ##### ( 170, 250 ] 3180 17.713% 52.275% #### ( 250, 380 ] 2084 11.608% 63.883% ## ( 380, 580 ] 1920 10.695% 74.578% ## ( 580, 870 ] 1325 7.380% 81.958% # ( 870, 1300 ] 881 4.907% 86.866% # ( 1300, 1900 ] 714 3.977% 90.843% # ( 1900, 2900 ] 782 4.356% 95.199% # ( 2900, 4400 ] 634 3.531% 98.730% # ( 4400, 6600 ] 204 1.136% 99.866% ( 6600, 9900 ] 25 0.139% 100.006% ( 9900, 14000 ] 1 0.006% 100.011% ** DB Stats ** Uptime(secs): 4.3 total, 4.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 231.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.404 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 241.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 9.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-12:02:57 ... thread 0: (1000000,2000000) ops and (152494.2,188116.0) ops/second in (6.557625,10.631738) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.44 GB 56.6 1.8 0.0 1.8 3.6 1.8 0.0 2.0 135.8 276.2 13.45 11.78 36 0.374 1855K 1757 0.0 0.0 L2 1/0 34.55 MB 0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 892.74 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 161/0 9.61 GB 1.0 1.4 0.8 0.6 1.4 0.8 0.0 1.6 129.9 128.5 11.02 6.85 7 1.574 614K 0 0.0 0.0 L5 1124/0 92.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/16 106.29 GB 0.0 3.2 0.8 2.3 5.0 2.7 1.6 2.7 133.2 209.7 24.47 18.64 43 0.569 2469K 1757 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.8 2.3 5.0 2.7 1.6 2.7 133.2 209.7 24.47 18.64 43 0.569 2469K 1757 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.8 2.3 3.2 0.8 0.0 0.0 182.8 181.8 17.82 13.54 14 1.273 2469K 1757 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 284.4 6.64 5.10 29 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.8 total, 10.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.01 GB write, 474.69 MB/s write, 3.18 GB read, 301.45 MB/s read, 24.5 seconds Interval compaction: 5.01 GB write, 482.56 MB/s write, 3.18 GB read, 306.45 MB/s read, 24.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 4, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 846784 Average: 14.0990 StdDev: 74.14 Min: 0 Median: 1.4856 Max: 8115 Percentiles: P50: 1.49 P75: 1.93 P99: 237.43 P99.9: 579.57 P99.99: 835.93 ------------------------------------------------------ [ 0, 1 ] 190299 22.473% 22.473% #### ( 1, 2 ] 480010 56.686% 79.159% ########### ( 2, 3 ] 76693 9.057% 88.216% ## ( 3, 4 ] 25284 2.986% 91.202% # ( 4, 6 ] 17289 2.042% 93.244% ( 6, 10 ] 5027 0.594% 93.838% ( 10, 15 ] 754 0.089% 93.927% ( 15, 22 ] 107 0.013% 93.939% ( 22, 34 ] 28 0.003% 93.943% ( 34, 51 ] 7 0.001% 93.943% ( 51, 76 ] 13 0.002% 93.945% ( 76, 110 ] 8085 0.955% 94.900% ( 110, 170 ] 26434 3.122% 98.021% # ( 170, 250 ] 9832 1.161% 99.183% ( 250, 380 ] 3415 0.403% 99.586% ( 380, 580 ] 2667 0.315% 99.901% ( 580, 870 ] 857 0.101% 100.002% ( 870, 1300 ] 288 0.034% 100.036% ( 1300, 1900 ] 125 0.015% 100.051% ( 1900, 2900 ] 102 0.012% 100.063% ( 2900, 4400 ] 48 0.006% 100.068% ( 4400, 6600 ] 18 0.002% 100.071% ( 6600, 9900 ] 4 0.000% 100.071% ** Level 2 read latency histogram (micros): Count: 58 Average: 180.3448 StdDev: 122.58 Min: 87 Median: 148.0000 Max: 695 Percentiles: P50: 148.00 P75: 195.45 P99: 695.00 P99.9: 695.00 P99.99: 695.00 ------------------------------------------------------ ( 76, 110 ] 10 17.241% 17.241% ### ( 110, 170 ] 30 51.724% 68.966% ########## ( 170, 250 ] 11 18.966% 87.931% #### ( 250, 380 ] 3 5.172% 93.103% # ( 380, 580 ] 1 1.724% 94.828% ( 580, 870 ] 3 5.172% 100.000% # ** Level 3 read latency histogram (micros): Count: 74210 Average: 14.3802 StdDev: 141.18 Min: 1 Median: 1.9946 Max: 7083 Percentiles: P50: 1.99 P75: 3.11 P99: 203.69 P99.9: 1795.71 P99.99: 2839.98 ------------------------------------------------------ [ 0, 1 ] 2431 3.276% 3.276% # ( 1, 2 ] 34862 46.977% 50.253% ######### ( 2, 3 ] 17556 23.657% 73.911% ##### ( 3, 4 ] 7275 9.803% 83.714% ## ( 4, 6 ] 7413 9.989% 93.703% ## ( 6, 10 ] 2438 3.285% 96.988% # ( 10, 15 ] 415 0.559% 97.548% ( 15, 22 ] 67 0.090% 97.638% ( 22, 34 ] 17 0.023% 97.661% ( 34, 51 ] 6 0.008% 97.669% ( 51, 76 ] 7 0.009% 97.678% ( 76, 110 ] 221 0.298% 97.976% ( 110, 170 ] 650 0.876% 98.852% ( 170, 250 ] 261 0.352% 99.204% ( 250, 380 ] 126 0.170% 99.373% ( 380, 580 ] 126 0.170% 99.543% ( 580, 870 ] 113 0.152% 99.695% ( 870, 1300 ] 89 0.120% 99.815% ( 1300, 1900 ] 76 0.102% 99.918% ( 1900, 2900 ] 57 0.077% 99.995% ( 2900, 4400 ] 20 0.027% 100.022% ( 4400, 6600 ] 12 0.016% 100.038% ( 6600, 9900 ] 3 0.004% 100.042% ** Level 4 read latency histogram (micros): Count: 113676 Average: 41.2525 StdDev: 206.54 Min: 0 Median: 2.1297 Max: 8572 Percentiles: P50: 2.13 P75: 3.78 P99: 710.94 P99.9: 2463.53 P99.99: 3204.01 ------------------------------------------------------ [ 0, 1 ] 3695 3.250% 3.250% # ( 1, 2 ] 49997 43.982% 47.232% ######### ( 2, 3 ] 24253 21.335% 68.568% #### ( 3, 4 ] 9351 8.226% 76.794% ## ( 4, 6 ] 8962 7.884% 84.678% ## ( 6, 10 ] 2783 2.448% 87.126% ( 10, 15 ] 426 0.375% 87.500% ( 15, 22 ] 96 0.084% 87.585% ( 22, 34 ] 26 0.023% 87.608% ( 34, 51 ] 10 0.009% 87.617% ( 51, 76 ] 8 0.007% 87.624% ( 76, 110 ] 1871 1.646% 89.270% ( 110, 170 ] 6592 5.799% 95.068% # ( 170, 250 ] 2374 2.088% 97.157% ( 250, 380 ] 985 0.866% 98.023% ( 380, 580 ] 861 0.757% 98.781% ( 580, 870 ] 552 0.486% 99.266% ( 870, 1300 ] 345 0.303% 99.570% ( 1300, 1900 ] 266 0.234% 99.804% ( 1900, 2900 ] 194 0.171% 99.974% ( 2900, 4400 ] 87 0.077% 100.051% ( 4400, 6600 ] 34 0.030% 100.081% ( 6600, 9900 ] 4 0.004% 100.084% ** Level 5 read latency histogram (micros): Count: 113470 Average: 248.9317 StdDev: 429.59 Min: 72 Median: 152.6293 Max: 9910 Percentiles: P50: 152.63 P75: 216.86 P99: 2567.04 P99.9: 5624.34 P99.99: 8138.20 ------------------------------------------------------ ( 51, 76 ] 13 0.011% 0.011% ( 76, 110 ] 16357 14.415% 14.427% ### ( 110, 170 ] 56813 50.069% 64.495% ########## ( 170, 250 ] 20347 17.932% 82.427% #### ( 250, 380 ] 7695 6.782% 89.209% # ( 380, 580 ] 6329 5.578% 94.786% # ( 580, 870 ] 2480 2.186% 96.972% ( 870, 1300 ] 1028 0.906% 97.878% ( 1300, 1900 ] 735 0.648% 98.526% ( 1900, 2900 ] 807 0.711% 99.237% ( 2900, 4400 ] 639 0.563% 99.800% ( 4400, 6600 ] 204 0.180% 99.980% ( 6600, 9900 ] 25 0.022% 100.002% ( 9900, 14000 ] 1 0.001% 100.003% ** DB Stats ** Uptime(secs): 10.8 total, 6.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 182.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.336 H:M:S, 30.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 150.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.933 H:M:S, 44.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-12:03:04 ... thread 0: (1000000,3000000) ops and (142892.9,170164.6) ops/second in (6.998250,17.629988) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.36 GB 175.5 3.8 0.0 3.8 6.6 2.8 0.0 2.4 161.7 278.7 24.15 21.94 55 0.439 3964K 9700 0.0 0.0 L2 1/0 34.55 MB 0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 892.74 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 161/0 9.61 GB 1.0 1.4 0.8 0.6 1.4 0.8 0.0 1.6 129.9 128.5 11.02 6.85 7 1.574 614K 0 0.0 0.0 L5 1124/0 92.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1318/15 107.21 GB 0.0 5.2 0.8 4.4 8.0 3.6 1.6 2.9 151.7 231.6 35.17 28.80 62 0.567 4579K 9700 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 0.8 4.4 8.0 3.6 1.6 2.9 151.7 231.6 35.17 28.80 62 0.567 4579K 9700 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 0.8 4.4 5.2 0.8 0.0 0.0 208.3 207.4 25.61 21.21 18 1.423 4579K 9700 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 296.7 9.55 7.59 44 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.8 total, 17.6 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.96 GB write, 457.44 MB/s write, 5.21 GB read, 299.66 MB/s read, 35.2 seconds Interval compaction: 7.96 GB write, 462.02 MB/s write, 5.21 GB read, 302.66 MB/s read, 35.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 4, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1303259 Average: 16.4234 StdDev: 71.95 Min: 0 Median: 1.4593 Max: 8115 Percentiles: P50: 1.46 P75: 1.92 P99: 245.00 P99.9: 575.26 P99.99: 802.03 ------------------------------------------------------ [ 0, 1 ] 324309 24.884% 24.884% ##### ( 1, 2 ] 712609 54.679% 79.563% ########### ( 2, 3 ] 102171 7.840% 87.403% ## ( 3, 4 ] 33751 2.590% 89.993% # ( 4, 6 ] 22000 1.688% 91.681% ( 6, 10 ] 6138 0.471% 92.152% ( 10, 15 ] 1059 0.081% 92.233% ( 15, 22 ] 131 0.010% 92.243% ( 22, 34 ] 32 0.002% 92.246% ( 34, 51 ] 9 0.001% 92.246% ( 51, 76 ] 20 0.002% 92.248% ( 76, 110 ] 15827 1.214% 93.462% ( 110, 170 ] 54288 4.166% 97.628% # ( 170, 250 ] 19075 1.464% 99.092% ( 250, 380 ] 5999 0.460% 99.552% ( 380, 580 ] 4649 0.357% 99.909% ( 580, 870 ] 1388 0.107% 100.015% ( 870, 1300 ] 348 0.027% 100.042% ( 1300, 1900 ] 136 0.010% 100.052% ( 1900, 2900 ] 128 0.010% 100.062% ( 2900, 4400 ] 57 0.004% 100.066% ( 4400, 6600 ] 18 0.001% 100.068% ( 6600, 9900 ] 4 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 107 Average: 179.9533 StdDev: 124.95 Min: 84 Median: 146.5455 Max: 751 Percentiles: P50: 146.55 P75: 192.11 P99: 751.00 P99.9: 751.00 P99.99: 751.00 ------------------------------------------------------ ( 76, 110 ] 20 18.692% 18.692% #### ( 110, 170 ] 55 51.402% 70.093% ########## ( 170, 250 ] 19 17.757% 87.850% #### ( 250, 380 ] 6 5.607% 93.458% # ( 380, 580 ] 2 1.869% 95.327% ( 580, 870 ] 5 4.673% 100.000% # ** Level 3 read latency histogram (micros): Count: 75410 Average: 16.9826 StdDev: 142.47 Min: 1 Median: 2.0235 Max: 7083 Percentiles: P50: 2.02 P75: 3.23 P99: 245.08 P99.9: 1795.51 P99.99: 2838.95 ------------------------------------------------------ [ 0, 1 ] 2431 3.224% 3.224% # ( 1, 2 ] 34862 46.230% 49.454% ######### ( 2, 3 ] 17556 23.281% 72.734% ##### ( 3, 4 ] 7275 9.647% 82.382% ## ( 4, 6 ] 7413 9.830% 92.212% ## ( 6, 10 ] 2438 3.233% 95.445% # ( 10, 15 ] 415 0.550% 95.995% ( 15, 22 ] 67 0.089% 96.084% ( 22, 34 ] 17 0.023% 96.107% ( 34, 51 ] 6 0.008% 96.115% ( 51, 76 ] 7 0.009% 96.124% ( 76, 110 ] 426 0.565% 96.689% ( 110, 170 ] 1299 1.723% 98.411% ( 170, 250 ] 473 0.627% 99.039% ( 250, 380 ] 188 0.249% 99.288% ( 380, 580 ] 179 0.237% 99.525% ( 580, 870 ] 126 0.167% 99.692% ( 870, 1300 ] 93 0.123% 99.816% ( 1300, 1900 ] 77 0.102% 99.918% ( 1900, 2900 ] 58 0.077% 99.995% ( 2900, 4400 ] 20 0.027% 100.021% ( 4400, 6600 ] 12 0.016% 100.037% ( 6600, 9900 ] 3 0.004% 100.041% ** Level 4 read latency histogram (micros): Count: 126852 Average: 54.2543 StdDev: 202.33 Min: 0 Median: 2.3998 Max: 8572 Percentiles: P50: 2.40 P75: 5.71 P99: 690.54 P99.9: 2410.74 P99.99: 3181.29 ------------------------------------------------------ [ 0, 1 ] 3695 2.913% 2.913% # ( 1, 2 ] 50019 39.431% 42.344% ######## ( 2, 3 ] 24292 19.150% 61.494% #### ( 3, 4 ] 9400 7.410% 68.904% # ( 4, 6 ] 9036 7.123% 76.027% # ( 6, 10 ] 2788 2.198% 78.225% ( 10, 15 ] 433 0.341% 78.566% ( 15, 22 ] 97 0.076% 78.643% ( 22, 34 ] 26 0.020% 78.663% ( 34, 51 ] 10 0.008% 78.671% ( 51, 76 ] 9 0.007% 78.678% ( 76, 110 ] 4118 3.246% 81.925% # ( 110, 170 ] 13887 10.947% 92.872% ## ( 170, 250 ] 4583 3.613% 96.485% # ( 250, 380 ] 1593 1.256% 97.741% ( 380, 580 ] 1344 1.060% 98.800% ( 580, 870 ] 665 0.524% 99.324% ( 870, 1300 ] 359 0.283% 99.607% ( 1300, 1900 ] 269 0.212% 99.819% ( 1900, 2900 ] 200 0.158% 99.977% ( 2900, 4400 ] 87 0.069% 100.046% ( 4400, 6600 ] 34 0.027% 100.073% ( 6600, 9900 ] 4 0.003% 100.076% ** Level 5 read latency histogram (micros): Count: 217723 Average: 211.3480 StdDev: 321.42 Min: 72 Median: 148.8278 Max: 9910 Percentiles: P50: 148.83 P75: 199.23 P99: 1520.66 P99.9: 4446.12 P99.99: 6559.32 ------------------------------------------------------ ( 51, 76 ] 41 0.019% 0.019% ( 76, 110 ] 34398 15.799% 15.818% ### ( 110, 170 ] 115004 52.821% 68.639% ########### ( 170, 250 ] 37903 17.409% 86.048% ### ( 250, 380 ] 12820 5.888% 91.936% # ( 380, 580 ] 10412 4.782% 96.718% # ( 580, 870 ] 3525 1.619% 98.337% ( 870, 1300 ] 1164 0.535% 98.872% ( 1300, 1900 ] 758 0.348% 99.220% ( 1900, 2900 ] 835 0.384% 99.604% ( 2900, 4400 ] 641 0.294% 99.898% ( 4400, 6600 ] 204 0.094% 99.992% ( 6600, 9900 ] 25 0.011% 100.003% ( 9900, 14000 ] 1 0.000% 100.004% ** DB Stats ** Uptime(secs): 17.8 total, 7.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 165.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.673 H:M:S, 37.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.337 H:M:S, 47.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 208.435 micros/op 19180 ops/sec 60.113 seconds 1152996 operations; 18.6 MB/s (294999 of 294999 found) Microseconds per read: Count: 1152996 Average: 208.4365 StdDev: 421.94 Min: 2 Median: 168.5115 Max: 60158 Percentiles: P50: 168.51 P75: 228.08 P99: 718.44 P99.9: 4901.36 P99.99: 20562.39 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 48 0.004% 0.005% ( 3, 4 ] 55 0.005% 0.010% ( 4, 6 ] 94 0.008% 0.018% ( 6, 10 ] 483 0.042% 0.060% ( 10, 15 ] 6156 0.534% 0.594% ( 15, 22 ] 3993 0.346% 0.940% ( 22, 34 ] 11901 1.032% 1.972% ( 34, 51 ] 2084 0.181% 2.153% ( 51, 76 ] 212 0.018% 2.171% ( 76, 110 ] 27525 2.387% 4.559% ( 110, 170 ] 537265 46.597% 51.156% ######### ( 170, 250 ] 378666 32.842% 83.998% ####### ( 250, 380 ] 122630 10.636% 94.634% ## ( 380, 580 ] 44225 3.836% 98.469% # ( 580, 870 ] 12816 1.112% 99.581% ( 870, 1300 ] 2621 0.227% 99.808% ( 1300, 1900 ] 410 0.036% 99.844% ( 1900, 2900 ] 333 0.029% 99.873% ( 2900, 4400 ] 230 0.020% 99.893% ( 4400, 6600 ] 373 0.032% 99.925% ( 6600, 9900 ] 354 0.031% 99.956% ( 9900, 14000 ] 230 0.020% 99.976% ( 14000, 22000 ] 202 0.018% 99.993% ( 22000, 33000 ] 66 0.006% 99.999% ( 33000, 50000 ] 12 0.001% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18202701 rocksdb.bloom.filter.full.positive COUNT : 1328680 rocksdb.bloom.filter.full.true.positive COUNT : 1152559 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 437 rocksdb.memtable.miss COUNT : 1152559 rocksdb.l0.hit COUNT : 53898 rocksdb.l1.hit COUNT : 2654 rocksdb.l2andup.hit COUNT : 1096007 rocksdb.compaction.key.drop.new COUNT : 54402 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3941632 rocksdb.number.keys.read COUNT : 1152996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4067764224 rocksdb.bytes.read COUNT : 1152996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1428 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 45131531 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10946262933 rocksdb.compact.write.bytes COUNT : 10883835868 rocksdb.flush.write.bytes COUNT : 4029711998 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 51 rocksdb.number.superversion_acquires COUNT : 618 rocksdb.number.superversion_releases COUNT : 589 rocksdb.number.superversion_cleanups COUNT : 151 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 109 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3996988416 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1355776 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16339279907 rocksdb.non.last.level.read.count COUNT : 3801410 rocksdb.block.checksum.compute.count COUNT : 3989855 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 167.605441 P95 : 397.055388 P99 : 717.100926 P100 : 60157.000000 COUNT : 1152996 SUM : 239338342 rocksdb.db.write.micros P50 : 1.538591 P95 : 4.634750 P99 : 14.050666 P100 : 360628.000000 COUNT : 3941632 SUM : 54879386 rocksdb.compaction.times.micros P50 : 1120666.666667 P95 : 5950000.000000 P99 : 53204155.000000 P100 : 53204155.000000 COUNT : 25 SUM : 90203174 rocksdb.compaction.times.cpu_micros P50 : 1075333.333333 P95 : 5950000.000000 P99 : 15494067.000000 P100 : 15494067.000000 COUNT : 25 SUM : 47962090 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 773.333333 P95 : 1900.000000 P99 : 58589.000000 P100 : 58589.000000 COUNT : 60 SUM : 133978 rocksdb.compaction.outfile.sync.micros P50 : 2212.500000 P95 : 29241.666667 P99 : 39630.000000 P100 : 45164.000000 COUNT : 61 SUM : 451457 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 146.136364 P95 : 1221.166667 P99 : 3035.000000 P100 : 4052.000000 COUNT : 91 SUM : 28708 rocksdb.table.open.io.micros P50 : 6163.752665 P95 : 13617.055838 P99 : 20195.200000 P100 : 29210.000000 COUNT : 1428 SUM : 9693502 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.625935 P95 : 148.278692 P99 : 236.903880 P100 : 20053.000000 COUNT : 2649460 SUM : 59464575 rocksdb.read.block.get.micros P50 : 139.140010 P95 : 254.934655 P99 : 561.501195 P100 : 24523.000000 COUNT : 1338952 SUM : 204326844 rocksdb.write.raw.block.micros P50 : 0.547686 P95 : 1.564356 P99 : 3.754700 P100 : 8684.000000 COUNT : 3611849 SUM : 7959752 rocksdb.numfiles.in.singlecompaction P50 : 3.613636 P95 : 7.800000 P99 : 19.830000 P100 : 20.000000 COUNT : 31 SUM : 149 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570947 P95 : 1286.624282 P99 : 2690.045977 P100 : 360449.000000 COUNT : 246891 SUM : 45149202 rocksdb.sst.read.micros P50 : 2.325120 P95 : 204.466731 P99 : 429.472264 P100 : 9910.000000 COUNT : 3801469 SUM : 250443636 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1152996 SUM : 1152996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3941632 SUM : 4067764224 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212857.142857 P95 : 315000.000000 P99 : 597763.000000 P100 : 597763.000000 COUNT : 60 SUM : 12813157 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 109 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0