[2024-12-13 06:18:50.308593] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-13 06:18:50.308868] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid443317 ] Set seed to 1734067130301867 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 06:18:50.442313] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 06:18:50.465863] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 06:18:50.465907] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 443317' to capture a snapshot of events at runtime. [2024-12-13 06:18:50.465918] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-13 06:18:50.465928] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-13 06:18:50.465936] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid443317 for offline analysis/debug. [2024-12-13 06:18:50.466507] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 06:18:54 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/13-06:19:02 ... thread 0: (1000000,1000000) ops and (136353.8,136353.8) ops/second in (7.333861,7.333861) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 1.91 GB 50.3 0.4 0.0 0.4 1.3 0.9 0.0 1.5 46.1 138.2 9.57 4.44 11 0.870 447K 748 0.0 0.0 L1 6/6 603.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/5 1.57 GB 1.0 1.0 0.8 0.3 1.0 0.7 0.1 1.3 118.1 116.6 8.72 4.96 2 4.362 523K 0 0.0 0.0 L4 172/17 10.05 GB 1.0 4.2 3.1 1.1 4.1 3.0 0.0 1.3 98.6 97.6 43.51 21.09 30 1.450 884K 341 0.0 0.0 L5 1112/0 91.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/41 105.59 GB 0.0 5.6 3.8 1.8 6.4 4.6 3.5 7.5 93.2 106.5 61.80 30.49 43 1.437 1855K 1089 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 3.8 1.8 6.4 4.6 3.5 7.5 93.2 106.5 61.80 30.49 43 1.437 1855K 1089 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 3.8 1.8 5.6 3.8 0.0 0.0 104.9 103.8 54.95 27.94 33 1.665 1855K 1089 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 128.6 6.86 2.55 10 0.686 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.5 total, 7.3 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.43 GB write, 873.16 MB/s write, 5.63 GB read, 764.11 MB/s read, 61.8 seconds Interval compaction: 6.43 GB write, 897.55 MB/s write, 5.63 GB read, 785.46 MB/s read, 61.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 37, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 258155 Average: 24.1164 StdDev: 277.51 Min: 1 Median: 1.8791 Max: 43215 Percentiles: P50: 1.88 P75: 2.90 P99: 679.32 P99.9: 3311.48 P99.99: 4749.47 ------------------------------------------------------ [ 0, 1 ] 10853 4.204% 4.204% # ( 1, 2 ] 134484 52.094% 56.298% ########## ( 2, 3 ] 53846 20.858% 77.156% #### ( 3, 4 ] 24252 9.394% 86.551% ## ( 4, 6 ] 23794 9.217% 95.768% ## ( 6, 10 ] 5891 2.282% 98.050% ( 10, 15 ] 1085 0.420% 98.470% ( 15, 22 ] 158 0.061% 98.531% ( 22, 34 ] 14 0.005% 98.537% ( 34, 51 ] 4 0.002% 98.538% ( 51, 76 ] 7 0.003% 98.541% ( 76, 110 ] 10 0.004% 98.545% ( 110, 170 ] 42 0.016% 98.561% ( 170, 250 ] 110 0.043% 98.604% ( 250, 380 ] 250 0.097% 98.700% ( 380, 580 ] 508 0.197% 98.897% ( 580, 870 ] 778 0.301% 99.199% ( 870, 1300 ] 762 0.295% 99.494% ( 1300, 1900 ] 552 0.214% 99.708% ( 1900, 2900 ] 415 0.161% 99.868% ( 2900, 4400 ] 302 0.117% 99.985% ( 4400, 6600 ] 83 0.032% 100.017% ( 6600, 9900 ] 18 0.007% 100.024% ( 9900, 14000 ] 2 0.001% 100.025% ( 14000, 22000 ] 7 0.003% 100.028% ( 22000, 33000 ] 4 0.002% 100.029% ( 33000, 50000 ] 2 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 71 Average: 1334.4085 StdDev: 1536.94 Min: 93 Median: 733.0556 Max: 7413 Percentiles: P50: 733.06 P75: 1618.75 P99: 7413.00 P99.9: 7413.00 P99.99: 7413.00 ------------------------------------------------------ ( 76, 110 ] 1 1.408% 1.408% ( 110, 170 ] 1 1.408% 2.817% ( 170, 250 ] 5 7.042% 9.859% # ( 250, 380 ] 6 8.451% 18.310% ## ( 380, 580 ] 13 18.310% 36.620% #### ( 580, 870 ] 18 25.352% 61.972% ##### ( 870, 1300 ] 5 7.042% 69.014% # ( 1300, 1900 ] 8 11.268% 80.282% ## ( 1900, 2900 ] 4 5.634% 85.915% # ( 2900, 4400 ] 6 8.451% 94.366% ## ( 4400, 6600 ] 2 2.817% 97.183% # ( 6600, 9900 ] 2 2.817% 100.000% # ** Level 2 read latency histogram (micros): Count: 163473 Average: 15.4897 StdDev: 201.70 Min: 1 Median: 1.9084 Max: 22423 Percentiles: P50: 1.91 P75: 2.94 P99: 13.43 P99.9: 2820.04 P99.99: 4203.09 ------------------------------------------------------ [ 0, 1 ] 5992 3.665% 3.665% # ( 1, 2 ] 83383 51.007% 54.673% ########## ( 2, 3 ] 35471 21.698% 76.371% #### ( 3, 4 ] 16218 9.921% 86.292% ## ( 4, 6 ] 15522 9.495% 95.787% ## ( 6, 10 ] 4579 2.801% 98.588% # ( 10, 15 ] 981 0.600% 99.188% ( 15, 22 ] 152 0.093% 99.281% ( 22, 34 ] 12 0.007% 99.289% ( 34, 51 ] 7 0.004% 99.293% ( 51, 76 ] 7 0.004% 99.297% ( 76, 110 ] 5 0.003% 99.300% ( 110, 170 ] 13 0.008% 99.308% ( 170, 250 ] 31 0.019% 99.327% ( 250, 380 ] 54 0.033% 99.360% ( 380, 580 ] 118 0.072% 99.432% ( 580, 870 ] 177 0.108% 99.541% ( 870, 1300 ] 232 0.142% 99.683% ( 1300, 1900 ] 212 0.130% 99.812% ( 1900, 2900 ] 156 0.095% 99.908% ( 2900, 4400 ] 155 0.095% 100.002% ( 4400, 6600 ] 41 0.025% 100.028% ( 6600, 9900 ] 9 0.006% 100.033% ( 9900, 14000 ] 1 0.001% 100.034% ( 14000, 22000 ] 2 0.001% 100.035% ( 22000, 33000 ] 1 0.001% 100.035% ** Level 3 read latency histogram (micros): Count: 772037 Average: 14.0967 StdDev: 224.39 Min: 1 Median: 1.9381 Max: 45619 Percentiles: P50: 1.94 P75: 2.96 P99: 10.32 P99.9: 1258.10 P99.99: 1827.86 ------------------------------------------------------ [ 0, 1 ] 20435 2.647% 2.647% # ( 1, 2 ] 389707 50.478% 53.125% ########## ( 2, 3 ] 175365 22.715% 75.839% ##### ( 3, 4 ] 80974 10.488% 86.328% ## ( 4, 6 ] 76902 9.961% 96.289% ## ( 6, 10 ] 20678 2.678% 98.967% # ( 10, 15 ] 4042 0.524% 99.490% ( 15, 22 ] 586 0.076% 99.566% ( 22, 34 ] 67 0.009% 99.575% ( 34, 51 ] 39 0.005% 99.580% ( 51, 76 ] 45 0.006% 99.586% ( 76, 110 ] 17 0.002% 99.588% ( 110, 170 ] 57 0.007% 99.595% ( 170, 250 ] 122 0.016% 99.611% ( 250, 380 ] 238 0.031% 99.642% ( 380, 580 ] 477 0.062% 99.704% ( 580, 870 ] 717 0.093% 99.797% ( 870, 1300 ] 883 0.114% 99.911% ( 1300, 1900 ] 692 0.090% 100.001% ( 1900, 2900 ] 584 0.076% 100.076% ( 2900, 4400 ] 631 0.082% 100.158% ( 4400, 6600 ] 204 0.026% 100.185% ( 6600, 9900 ] 63 0.008% 100.193% ( 9900, 14000 ] 14 0.002% 100.195% ( 14000, 22000 ] 8 0.001% 100.196% ( 22000, 33000 ] 5 0.001% 100.196% ( 33000, 50000 ] 6 0.001% 100.197% ** Level 4 read latency histogram (micros): Count: 395522 Average: 24.3434 StdDev: 271.90 Min: 1 Median: 1.9211 Max: 39982 Percentiles: P50: 1.92 P75: 2.96 P99: 596.41 P99.9: 2710.48 P99.99: 3682.09 ------------------------------------------------------ [ 0, 1 ] 12192 3.083% 3.083% # ( 1, 2 ] 201472 50.938% 54.021% ########## ( 2, 3 ] 86672 21.913% 75.934% #### ( 3, 4 ] 40710 10.293% 86.227% ## ( 4, 6 ] 36353 9.191% 95.418% ## ( 6, 10 ] 10450 2.642% 98.060% # ( 10, 15 ] 1888 0.477% 98.537% ( 15, 22 ] 308 0.078% 98.615% ( 22, 34 ] 41 0.010% 98.626% ( 34, 51 ] 25 0.006% 98.632% ( 51, 76 ] 32 0.008% 98.640% ( 76, 110 ] 22 0.006% 98.646% ( 110, 170 ] 81 0.020% 98.666% ( 170, 250 ] 194 0.049% 98.715% ( 250, 380 ] 342 0.086% 98.802% ( 380, 580 ] 721 0.182% 98.984% ( 580, 870 ] 1127 0.285% 99.269% ( 870, 1300 ] 1194 0.302% 99.571% ( 1300, 1900 ] 817 0.207% 99.777% ( 1900, 2900 ] 599 0.151% 99.929% ( 2900, 4400 ] 465 0.118% 100.046% ( 4400, 6600 ] 168 0.042% 100.089% ( 6600, 9900 ] 39 0.010% 100.099% ( 9900, 14000 ] 11 0.003% 100.101% ( 14000, 22000 ] 3 0.001% 100.102% ( 22000, 33000 ] 5 0.001% 100.103% ( 33000, 50000 ] 3 0.001% 100.104% ** Level 5 read latency histogram (micros): Count: 11202 Average: 1825.0403 StdDev: 1968.74 Min: 93 Median: 1190.7341 Max: 50854 Percentiles: P50: 1190.73 P75: 2569.42 P99: 7870.50 P99.9: 17596.00 P99.99: 46826.10 ------------------------------------------------------ ( 76, 110 ] 9 0.080% 0.080% ( 110, 170 ] 91 0.812% 0.893% ( 170, 250 ] 238 2.125% 3.017% ( 250, 380 ] 619 5.526% 8.543% # ( 380, 580 ] 1294 11.552% 20.095% ## ( 580, 870 ] 1897 16.934% 37.029% ### ( 870, 1300 ] 1948 17.390% 54.419% ### ( 1300, 1900 ] 1454 12.980% 67.399% ### ( 1900, 2900 ] 1272 11.355% 78.754% ## ( 2900, 4400 ] 1484 13.248% 92.001% ### ( 4400, 6600 ] 727 6.490% 98.491% # ( 6600, 9900 ] 148 1.321% 99.813% ( 9900, 14000 ] 8 0.071% 99.884% ( 14000, 22000 ] 4 0.036% 99.920% ( 22000, 33000 ] 3 0.027% 99.946% ( 33000, 50000 ] 6 0.054% 100.000% ( 50000, 75000 ] 1 0.009% 100.009% ** DB Stats ** Uptime(secs): 7.5 total, 7.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 130.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.321 H:M:S, 44.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 134.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.321 H:M:S, 45.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/13-06:19:05 ... thread 0: (1000000,2000000) ops and (259466.9,178764.3) ops/second in (3.854056,11.187917) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 2.89 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 90.1 198.2 17.47 11.71 31 0.564 1599K 2074 0.0 0.0 L1 6/6 603.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 960.77 MB 1.0 1.0 0.8 0.3 1.0 0.7 0.1 1.3 118.1 116.6 8.72 4.96 2 4.362 523K 0 0.0 0.0 L4 168/0 9.68 GB 1.0 5.4 3.7 1.7 5.4 3.6 0.0 1.4 107.3 106.0 51.81 26.83 35 1.480 1190K 341 0.0 0.0 L5 1124/0 92.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/19 106.55 GB 0.0 8.0 4.5 3.5 9.7 6.2 4.4 5.3 104.6 127.8 78.01 43.51 68 1.147 3312K 2415 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 4.5 3.5 9.7 6.2 4.4 5.3 104.6 127.8 78.01 43.51 68 1.147 3312K 2415 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 4.5 3.5 7.9 4.4 0.0 0.0 120.6 119.5 67.66 37.96 42 1.611 3312K 2415 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 182.7 10.34 5.54 26 0.398 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.4 total, 11.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.74 GB write, 875.22 MB/s write, 7.97 GB read, 716.28 MB/s read, 78.0 seconds Interval compaction: 9.74 GB write, 891.25 MB/s write, 7.97 GB read, 729.40 MB/s read, 78.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 37, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 578793 Average: 20.1108 StdDev: 193.85 Min: 0 Median: 1.6330 Max: 43215 Percentiles: P50: 1.63 P75: 2.38 P99: 370.49 P99.9: 1893.92 P99.99: 3229.72 ------------------------------------------------------ [ 0, 1 ] 91033 15.728% 15.728% ### ( 1, 2 ] 313356 54.140% 69.868% ########### ( 2, 3 ] 77988 13.474% 83.342% ### ( 3, 4 ] 32928 5.689% 89.031% # ( 4, 6 ] 28956 5.003% 94.034% # ( 6, 10 ] 7257 1.254% 95.288% ( 10, 15 ] 1354 0.234% 95.522% ( 15, 22 ] 206 0.036% 95.557% ( 22, 34 ] 20 0.003% 95.561% ( 34, 51 ] 8 0.001% 95.562% ( 51, 76 ] 8 0.001% 95.563% ( 76, 110 ] 2151 0.372% 95.935% ( 110, 170 ] 10265 1.774% 97.709% ( 170, 250 ] 5285 0.913% 98.622% ( 250, 380 ] 2364 0.408% 99.030% ( 380, 580 ] 2214 0.383% 99.413% ( 580, 870 ] 1339 0.231% 99.644% ( 870, 1300 ] 917 0.158% 99.802% ( 1300, 1900 ] 572 0.099% 99.901% ( 1900, 2900 ] 445 0.077% 99.978% ( 2900, 4400 ] 319 0.055% 100.033% ( 4400, 6600 ] 84 0.015% 100.048% ( 6600, 9900 ] 19 0.003% 100.051% ( 9900, 14000 ] 2 0.000% 100.051% ( 14000, 22000 ] 7 0.001% 100.053% ( 22000, 33000 ] 4 0.001% 100.053% ( 33000, 50000 ] 2 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 439 Average: 379.6446 StdDev: 762.32 Min: 82 Median: 167.6562 Max: 7413 Percentiles: P50: 167.66 P75: 251.05 P99: 4302.50 P99.9: 7413.00 P99.99: 7413.00 ------------------------------------------------------ ( 76, 110 ] 35 7.973% 7.973% ## ( 110, 170 ] 192 43.736% 51.708% ######### ( 170, 250 ] 102 23.235% 74.943% ##### ( 250, 380 ] 31 7.062% 82.005% # ( 380, 580 ] 23 5.239% 87.244% # ( 580, 870 ] 27 6.150% 93.394% # ( 870, 1300 ] 5 1.139% 94.533% ( 1300, 1900 ] 9 2.050% 96.583% ( 1900, 2900 ] 5 1.139% 97.722% ( 2900, 4400 ] 6 1.367% 99.089% ( 4400, 6600 ] 2 0.456% 99.544% ( 6600, 9900 ] 2 0.456% 100.000% ** Level 2 read latency histogram (micros): Count: 163547 Average: 15.5695 StdDev: 201.70 Min: 1 Median: 1.9088 Max: 22423 Percentiles: P50: 1.91 P75: 2.94 P99: 13.80 P99.9: 2819.57 P99.99: 4203.02 ------------------------------------------------------ [ 0, 1 ] 5992 3.664% 3.664% # ( 1, 2 ] 83383 50.984% 54.648% ########## ( 2, 3 ] 35471 21.689% 76.336% #### ( 3, 4 ] 16218 9.916% 86.253% ## ( 4, 6 ] 15522 9.491% 95.744% ## ( 6, 10 ] 4579 2.800% 98.544% # ( 10, 15 ] 981 0.600% 99.143% ( 15, 22 ] 152 0.093% 99.236% ( 22, 34 ] 12 0.007% 99.244% ( 34, 51 ] 7 0.004% 99.248% ( 51, 76 ] 7 0.004% 99.252% ( 76, 110 ] 9 0.006% 99.258% ( 110, 170 ] 57 0.035% 99.293% ( 170, 250 ] 46 0.028% 99.321% ( 250, 380 ] 60 0.037% 99.357% ( 380, 580 ] 121 0.074% 99.431% ( 580, 870 ] 178 0.109% 99.540% ( 870, 1300 ] 233 0.142% 99.683% ( 1300, 1900 ] 212 0.130% 99.812% ( 1900, 2900 ] 156 0.095% 99.908% ( 2900, 4400 ] 155 0.095% 100.002% ( 4400, 6600 ] 41 0.025% 100.028% ( 6600, 9900 ] 9 0.006% 100.033% ( 9900, 14000 ] 1 0.001% 100.034% ( 14000, 22000 ] 2 0.001% 100.035% ( 22000, 33000 ] 1 0.001% 100.035% ** Level 3 read latency histogram (micros): Count: 787814 Average: 14.0392 StdDev: 222.30 Min: 1 Median: 1.9340 Max: 45619 Percentiles: P50: 1.93 P75: 2.96 P99: 10.86 P99.9: 1251.51 P99.99: 1826.60 ------------------------------------------------------ [ 0, 1 ] 20983 2.663% 2.663% # ( 1, 2 ] 399273 50.681% 53.345% ########## ( 2, 3 ] 178154 22.614% 75.958% ##### ( 3, 4 ] 82113 10.423% 86.381% ## ( 4, 6 ] 77745 9.868% 96.250% ## ( 6, 10 ] 20972 2.662% 98.912% # ( 10, 15 ] 4054 0.515% 99.426% ( 15, 22 ] 590 0.075% 99.501% ( 22, 34 ] 67 0.009% 99.510% ( 34, 51 ] 42 0.005% 99.515% ( 51, 76 ] 47 0.006% 99.521% ( 76, 110 ] 67 0.009% 99.529% ( 110, 170 ] 309 0.039% 99.569% ( 170, 250 ] 248 0.031% 99.600% ( 250, 380 ] 306 0.039% 99.639% ( 380, 580 ] 531 0.067% 99.706% ( 580, 870 ] 732 0.093% 99.799% ( 870, 1300 ] 894 0.113% 99.913% ( 1300, 1900 ] 693 0.088% 100.001% ( 1900, 2900 ] 584 0.074% 100.075% ( 2900, 4400 ] 632 0.080% 100.155% ( 4400, 6600 ] 204 0.026% 100.181% ( 6600, 9900 ] 63 0.008% 100.189% ( 9900, 14000 ] 14 0.002% 100.191% ( 14000, 22000 ] 8 0.001% 100.192% ( 22000, 33000 ] 5 0.001% 100.192% ( 33000, 50000 ] 6 0.001% 100.193% ** Level 4 read latency histogram (micros): Count: 446210 Average: 24.8244 StdDev: 257.93 Min: 1 Median: 1.9148 Max: 39982 Percentiles: P50: 1.91 P75: 2.97 P99: 533.93 P99.9: 2558.59 P99.99: 3526.21 ------------------------------------------------------ [ 0, 1 ] 13563 3.040% 3.040% # ( 1, 2 ] 229066 51.336% 54.376% ########## ( 2, 3 ] 95190 21.333% 75.709% #### ( 3, 4 ] 44126 9.889% 85.598% ## ( 4, 6 ] 39043 8.750% 94.348% ## ( 6, 10 ] 11344 2.542% 96.890% # ( 10, 15 ] 1936 0.434% 97.324% ( 15, 22 ] 318 0.071% 97.395% ( 22, 34 ] 44 0.010% 97.405% ( 34, 51 ] 28 0.006% 97.411% ( 51, 76 ] 33 0.007% 97.418% ( 76, 110 ] 628 0.141% 97.559% ( 110, 170 ] 2998 0.672% 98.231% ( 170, 250 ] 1586 0.355% 98.587% ( 250, 380 ] 949 0.213% 98.799% ( 380, 580 ] 1164 0.261% 99.060% ( 580, 870 ] 1280 0.287% 99.347% ( 870, 1300 ] 1246 0.279% 99.626% ( 1300, 1900 ] 824 0.185% 99.811% ( 1900, 2900 ] 604 0.135% 99.946% ( 2900, 4400 ] 468 0.105% 100.051% ( 4400, 6600 ] 168 0.038% 100.089% ( 6600, 9900 ] 39 0.009% 100.097% ( 9900, 14000 ] 11 0.002% 100.100% ( 14000, 22000 ] 3 0.001% 100.101% ( 22000, 33000 ] 5 0.001% 100.102% ( 33000, 50000 ] 3 0.001% 100.102% ** Level 5 read latency histogram (micros): Count: 54027 Average: 548.0449 StdDev: 1120.92 Min: 79 Median: 187.1040 Max: 50854 Percentiles: P50: 187.10 P75: 443.57 P99: 5479.57 P99.9: 9146.38 P99.99: 31523.43 ------------------------------------------------------ ( 76, 110 ] 4478 8.288% 8.288% ## ( 110, 170 ] 20458 37.866% 46.155% ######## ( 170, 250 ] 9717 17.985% 64.140% #### ( 250, 380 ] 4450 8.237% 72.377% ## ( 380, 580 ] 4459 8.253% 80.630% ## ( 580, 870 ] 3036 5.619% 86.249% # ( 870, 1300 ] 2210 4.091% 90.340% # ( 1300, 1900 ] 1503 2.782% 93.122% # ( 1900, 2900 ] 1324 2.451% 95.573% ( 2900, 4400 ] 1494 2.765% 98.338% # ( 4400, 6600 ] 729 1.349% 99.687% ( 6600, 9900 ] 149 0.276% 99.963% ( 9900, 14000 ] 8 0.015% 99.978% ( 14000, 22000 ] 4 0.007% 99.985% ( 22000, 33000 ] 3 0.006% 99.991% ( 33000, 50000 ] 6 0.011% 100.002% ( 50000, 75000 ] 1 0.002% 100.004% ** DB Stats ** Uptime(secs): 11.4 total, 3.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 172.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.656 H:M:S, 32.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 255.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.336 H:M:S, 8.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-06:19:16 ... thread 0: (1000000,3000000) ops and (93229.9,136898.2) ops/second in (10.726174,21.914091) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.80 GB 256.9 3.8 0.0 3.8 6.6 2.8 0.0 2.4 133.7 230.4 29.19 22.93 50 0.584 3964K 13K 0.0 0.0 L1 6/6 603.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 960.77 MB 1.0 1.0 0.8 0.3 1.0 0.7 0.1 1.3 118.1 116.6 8.72 4.96 2 4.362 523K 0 0.0 0.0 L4 168/0 9.68 GB 1.0 5.4 3.7 1.7 5.4 3.6 0.0 1.4 107.3 106.0 51.81 26.83 35 1.480 1190K 341 0.0 0.0 L5 1124/0 92.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/19 107.46 GB 0.0 10.2 4.5 5.8 12.9 7.1 4.4 4.7 116.9 147.5 89.73 54.73 87 1.031 5678K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 4.5 5.8 12.9 7.1 4.4 4.7 116.9 147.5 89.73 54.73 87 1.031 5678K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 4.5 5.8 10.2 4.4 0.0 0.0 137.3 136.2 76.39 46.57 46 1.661 5678K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 212.5 13.34 8.15 41 0.325 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.1 total, 21.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.93 GB write, 598.35 MB/s write, 10.25 GB read, 474.27 MB/s read, 89.7 seconds Interval compaction: 12.93 GB write, 603.94 MB/s write, 10.25 GB read, 478.71 MB/s read, 89.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 37, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1297624 Average: 19.9603 StdDev: 137.93 Min: 0 Median: 1.4941 Max: 43215 Percentiles: P50: 1.49 P75: 1.99 P99: 285.78 P99.9: 1076.01 P99.99: 2024.97 ------------------------------------------------------ [ 0, 1 ] 323068 24.897% 24.897% ##### ( 1, 2 ] 659283 50.807% 75.704% ########## ( 2, 3 ] 110961 8.551% 84.255% ## ( 3, 4 ] 50919 3.924% 88.179% # ( 4, 6 ] 39721 3.061% 91.240% # ( 6, 10 ] 9151 0.705% 91.945% ( 10, 15 ] 1796 0.138% 92.084% ( 15, 22 ] 281 0.022% 92.105% ( 22, 34 ] 32 0.002% 92.108% ( 34, 51 ] 15 0.001% 92.109% ( 51, 76 ] 21 0.002% 92.111% ( 76, 110 ] 13646 1.052% 93.162% ( 110, 170 ] 55592 4.284% 97.446% # ( 170, 250 ] 18575 1.431% 98.878% ( 250, 380 ] 5765 0.444% 99.322% ( 380, 580 ] 4950 0.381% 99.703% ( 580, 870 ] 2078 0.160% 99.864% ( 870, 1300 ] 986 0.076% 99.940% ( 1300, 1900 ] 595 0.046% 99.985% ( 1900, 2900 ] 474 0.037% 100.022% ( 2900, 4400 ] 330 0.025% 100.047% ( 4400, 6600 ] 85 0.007% 100.054% ( 6600, 9900 ] 19 0.001% 100.055% ( 9900, 14000 ] 2 0.000% 100.056% ( 14000, 22000 ] 7 0.001% 100.056% ( 22000, 33000 ] 4 0.000% 100.056% ( 33000, 50000 ] 2 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 1624 Average: 227.2525 StdDev: 418.94 Min: 82 Median: 149.8894 Max: 7413 Percentiles: P50: 149.89 P75: 198.61 P99: 1884.00 P99.9: 7220.40 P99.99: 7413.00 ------------------------------------------------------ ( 76, 110 ] 211 12.993% 12.993% ### ( 110, 170 ] 904 55.665% 68.658% ########### ( 170, 250 ] 288 17.734% 86.392% #### ( 250, 380 ] 81 4.988% 91.379% # ( 380, 580 ] 71 4.372% 95.751% # ( 580, 870 ] 37 2.278% 98.030% ( 870, 1300 ] 7 0.431% 98.461% ( 1300, 1900 ] 9 0.554% 99.015% ( 1900, 2900 ] 6 0.369% 99.384% ( 2900, 4400 ] 6 0.369% 99.754% ( 4400, 6600 ] 2 0.123% 99.877% ( 6600, 9900 ] 2 0.123% 100.000% ** Level 2 read latency histogram (micros): Count: 163822 Average: 15.8208 StdDev: 201.66 Min: 1 Median: 1.9105 Max: 22423 Percentiles: P50: 1.91 P75: 2.94 P99: 16.74 P99.9: 2817.81 P99.99: 4202.75 ------------------------------------------------------ [ 0, 1 ] 5992 3.658% 3.658% # ( 1, 2 ] 83383 50.899% 54.556% ########## ( 2, 3 ] 35471 21.652% 76.208% #### ( 3, 4 ] 16218 9.900% 86.108% ## ( 4, 6 ] 15522 9.475% 95.583% ## ( 6, 10 ] 4579 2.795% 98.378% # ( 10, 15 ] 981 0.599% 98.977% ( 15, 22 ] 152 0.093% 99.070% ( 22, 34 ] 12 0.007% 99.077% ( 34, 51 ] 7 0.004% 99.081% ( 51, 76 ] 7 0.004% 99.086% ( 76, 110 ] 45 0.027% 99.113% ( 110, 170 ] 226 0.138% 99.251% ( 170, 250 ] 92 0.056% 99.307% ( 250, 380 ] 72 0.044% 99.351% ( 380, 580 ] 130 0.079% 99.430% ( 580, 870 ] 181 0.110% 99.541% ( 870, 1300 ] 233 0.142% 99.683% ( 1300, 1900 ] 212 0.129% 99.813% ( 1900, 2900 ] 156 0.095% 99.908% ( 2900, 4400 ] 155 0.095% 100.002% ( 4400, 6600 ] 41 0.025% 100.027% ( 6600, 9900 ] 9 0.005% 100.033% ( 9900, 14000 ] 1 0.001% 100.034% ( 14000, 22000 ] 2 0.001% 100.035% ( 22000, 33000 ] 1 0.001% 100.035% ** Level 3 read latency histogram (micros): Count: 789689 Average: 14.3980 StdDev: 222.20 Min: 1 Median: 1.9364 Max: 45619 Percentiles: P50: 1.94 P75: 2.97 P99: 13.15 P99.9: 1250.77 P99.99: 1826.43 ------------------------------------------------------ [ 0, 1 ] 20983 2.657% 2.657% # ( 1, 2 ] 399273 50.561% 53.218% ########## ( 2, 3 ] 178154 22.560% 75.778% ##### ( 3, 4 ] 82113 10.398% 86.176% ## ( 4, 6 ] 77745 9.845% 96.021% ## ( 6, 10 ] 20972 2.656% 98.677% # ( 10, 15 ] 4054 0.513% 99.190% ( 15, 22 ] 590 0.075% 99.265% ( 22, 34 ] 67 0.008% 99.273% ( 34, 51 ] 42 0.005% 99.279% ( 51, 76 ] 47 0.006% 99.285% ( 76, 110 ] 356 0.045% 99.330% ( 110, 170 ] 1438 0.182% 99.512% ( 170, 250 ] 551 0.070% 99.582% ( 250, 380 ] 382 0.048% 99.630% ( 380, 580 ] 593 0.075% 99.705% ( 580, 870 ] 745 0.094% 99.799% ( 870, 1300 ] 897 0.114% 99.913% ( 1300, 1900 ] 693 0.088% 100.001% ( 1900, 2900 ] 584 0.074% 100.075% ( 2900, 4400 ] 632 0.080% 100.155% ( 4400, 6600 ] 204 0.026% 100.181% ( 6600, 9900 ] 63 0.008% 100.189% ( 9900, 14000 ] 14 0.002% 100.190% ( 14000, 22000 ] 8 0.001% 100.191% ( 22000, 33000 ] 5 0.001% 100.192% ( 33000, 50000 ] 6 0.001% 100.193% ** Level 4 read latency histogram (micros): Count: 471688 Average: 31.7770 StdDev: 253.69 Min: 1 Median: 1.9703 Max: 39982 Percentiles: P50: 1.97 P75: 3.35 P99: 551.81 P99.9: 2517.04 P99.99: 3518.05 ------------------------------------------------------ [ 0, 1 ] 13563 2.875% 2.875% # ( 1, 2 ] 229077 48.565% 51.441% ########## ( 2, 3 ] 95233 20.190% 71.631% #### ( 3, 4 ] 45076 9.556% 81.187% ## ( 4, 6 ] 40138 8.509% 89.696% ## ( 6, 10 ] 11460 2.430% 92.126% ( 10, 15 ] 1972 0.418% 92.544% ( 15, 22 ] 320 0.068% 92.612% ( 22, 34 ] 44 0.009% 92.621% ( 34, 51 ] 29 0.006% 92.627% ( 51, 76 ] 33 0.007% 92.634% ( 76, 110 ] 4147 0.879% 93.514% ( 110, 170 ] 16758 3.553% 97.066% # ( 170, 250 ] 5422 1.149% 98.216% ( 250, 380 ] 1975 0.419% 98.634% ( 380, 580 ] 2007 0.425% 99.060% ( 580, 870 ] 1485 0.315% 99.375% ( 870, 1300 ] 1279 0.271% 99.646% ( 1300, 1900 ] 825 0.175% 99.821% ( 1900, 2900 ] 605 0.128% 99.949% ( 2900, 4400 ] 468 0.099% 100.048% ( 4400, 6600 ] 168 0.036% 100.084% ( 6600, 9900 ] 39 0.008% 100.092% ( 9900, 14000 ] 11 0.002% 100.095% ( 14000, 22000 ] 3 0.001% 100.095% ( 22000, 33000 ] 5 0.001% 100.096% ( 33000, 50000 ] 3 0.001% 100.097% ** Level 5 read latency histogram (micros): Count: 203936 Average: 268.4508 StdDev: 607.06 Min: 79 Median: 150.8215 Max: 50854 Percentiles: P50: 150.82 P75: 207.45 P99: 3256.40 P99.9: 6485.52 P99.99: 9824.84 ------------------------------------------------------ ( 76, 110 ] 27796 13.630% 13.630% ### ( 110, 170 ] 109019 53.457% 67.087% ########### ( 170, 250 ] 34468 16.901% 83.989% ### ( 250, 380 ] 10909 5.349% 89.338% # ( 380, 580 ] 9770 4.791% 94.129% # ( 580, 870 ] 4361 2.138% 96.267% ( 870, 1300 ] 2340 1.147% 97.414% ( 1300, 1900 ] 1529 0.750% 98.164% ( 1900, 2900 ] 1348 0.661% 98.825% ( 2900, 4400 ] 1501 0.736% 99.561% ( 4400, 6600 ] 729 0.357% 99.919% ( 6600, 9900 ] 149 0.073% 99.992% ( 9900, 14000 ] 8 0.004% 99.996% ( 14000, 22000 ] 4 0.002% 99.998% ( 22000, 33000 ] 3 0.001% 99.999% ( 33000, 50000 ] 6 0.003% 100.002% ( 50000, 75000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 22.1 total, 10.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 133.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.515 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 91.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.859 H:M:S, 63.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-06:19:25 ... thread 0: (1000000,4000000) ops and (112029.2,129700.3) ops/second in (8.926248,30.840339) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 21/15 4.85 GB 256.9 5.0 0.0 5.0 8.8 3.8 0.0 2.3 137.6 241.2 37.54 30.70 72 0.521 5243K 14K 0.0 0.0 L1 6/6 603.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 960.77 MB 1.0 1.0 0.8 0.3 1.0 0.7 0.1 1.3 118.1 116.6 8.72 4.96 2 4.362 523K 0 0.0 0.0 L4 168/0 9.68 GB 1.0 5.4 3.7 1.7 5.4 3.6 0.0 1.4 107.3 106.0 51.81 26.83 35 1.480 1190K 341 0.0 0.0 L5 1124/0 92.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/21 108.51 GB 0.0 11.5 4.5 7.0 15.2 8.2 4.4 4.0 119.8 158.7 98.07 62.49 109 0.900 6957K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.5 7.0 15.2 8.2 4.4 4.0 119.8 158.7 98.07 62.49 109 0.900 6957K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.5 7.0 11.4 4.4 0.0 0.0 144.8 143.6 81.17 51.27 51 1.592 6957K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 231.2 16.90 11.22 58 0.291 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.0 total, 30.8 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.20 GB write, 501.35 MB/s write, 11.48 GB read, 378.49 MB/s read, 98.1 seconds Interval compaction: 15.20 GB write, 504.68 MB/s write, 11.48 GB read, 381.01 MB/s read, 98.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 26, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 26, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 37, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1912436 Average: 19.8645 StdDev: 119.52 Min: 0 Median: 1.4630 Max: 43215 Percentiles: P50: 1.46 P75: 1.96 P99: 270.22 P99.9: 829.06 P99.99: 1577.21 ------------------------------------------------------ [ 0, 1 ] 509752 26.655% 26.655% ##### ( 1, 2 ] 964365 50.426% 77.081% ########## ( 2, 3 ] 142617 7.457% 84.538% # ( 3, 4 ] 66675 3.486% 88.024% # ( 4, 6 ] 49477 2.587% 90.611% # ( 6, 10 ] 10659 0.557% 91.169% ( 10, 15 ] 2361 0.123% 91.292% ( 15, 22 ] 359 0.019% 91.311% ( 22, 34 ] 46 0.002% 91.313% ( 34, 51 ] 16 0.001% 91.314% ( 51, 76 ] 35 0.002% 91.316% ( 76, 110 ] 23292 1.218% 92.534% ( 110, 170 ] 92476 4.836% 97.370% # ( 170, 250 ] 29808 1.559% 98.928% ( 250, 380 ] 8849 0.463% 99.391% ( 380, 580 ] 7407 0.387% 99.778% ( 580, 870 ] 2716 0.142% 99.920% ( 870, 1300 ] 1055 0.055% 99.975% ( 1300, 1900 ] 612 0.032% 100.007% ( 1900, 2900 ] 506 0.026% 100.034% ( 2900, 4400 ] 343 0.018% 100.052% ( 4400, 6600 ] 86 0.004% 100.056% ( 6600, 9900 ] 19 0.001% 100.057% ( 9900, 14000 ] 2 0.000% 100.057% ( 14000, 22000 ] 7 0.000% 100.058% ( 22000, 33000 ] 4 0.000% 100.058% ( 33000, 50000 ] 2 0.000% 100.058% ** Level 1 read latency histogram (micros): Count: 2629 Average: 205.1057 StdDev: 337.82 Min: 82 Median: 147.9555 Max: 7413 Percentiles: P50: 147.96 P75: 189.69 P99: 1284.41 P99.9: 5908.10 P99.99: 7413.00 ------------------------------------------------------ ( 76, 110 ] 377 14.340% 14.340% ### ( 110, 170 ] 1482 56.371% 70.711% ########### ( 170, 250 ] 458 17.421% 88.132% ### ( 250, 380 ] 129 4.907% 93.039% # ( 380, 580 ] 104 3.956% 96.995% # ( 580, 870 ] 45 1.712% 98.707% ( 870, 1300 ] 8 0.304% 99.011% ( 1300, 1900 ] 9 0.342% 99.353% ( 1900, 2900 ] 7 0.266% 99.620% ( 2900, 4400 ] 6 0.228% 99.848% ( 4400, 6600 ] 2 0.076% 99.924% ( 6600, 9900 ] 2 0.076% 100.000% ** Level 2 read latency histogram (micros): Count: 164028 Average: 16.0389 StdDev: 201.81 Min: 1 Median: 1.9117 Max: 22423 Percentiles: P50: 1.91 P75: 2.95 P99: 103.08 P99.9: 2822.90 P99.99: 4203.82 ------------------------------------------------------ [ 0, 1 ] 5992 3.653% 3.653% # ( 1, 2 ] 83383 50.835% 54.488% ########## ( 2, 3 ] 35471 21.625% 76.113% #### ( 3, 4 ] 16218 9.887% 86.000% ## ( 4, 6 ] 15522 9.463% 95.463% ## ( 6, 10 ] 4579 2.792% 98.255% # ( 10, 15 ] 981 0.598% 98.853% ( 15, 22 ] 152 0.093% 98.945% ( 22, 34 ] 12 0.007% 98.953% ( 34, 51 ] 7 0.004% 98.957% ( 51, 76 ] 7 0.004% 98.961% ( 76, 110 ] 80 0.049% 99.010% ( 110, 170 ] 349 0.213% 99.223% ( 170, 250 ] 124 0.076% 99.298% ( 250, 380 ] 76 0.046% 99.345% ( 380, 580 ] 135 0.082% 99.427% ( 580, 870 ] 186 0.113% 99.540% ( 870, 1300 ] 233 0.142% 99.682% ( 1300, 1900 ] 213 0.130% 99.812% ( 1900, 2900 ] 156 0.095% 99.907% ( 2900, 4400 ] 156 0.095% 100.002% ( 4400, 6600 ] 41 0.025% 100.027% ( 6600, 9900 ] 9 0.005% 100.033% ( 9900, 14000 ] 1 0.001% 100.034% ( 14000, 22000 ] 2 0.001% 100.035% ( 22000, 33000 ] 1 0.001% 100.035% ** Level 3 read latency histogram (micros): Count: 791263 Average: 14.7079 StdDev: 222.14 Min: 1 Median: 1.9383 Max: 45619 Percentiles: P50: 1.94 P75: 2.97 P99: 15.67 P99.9: 1250.55 P99.99: 1826.40 ------------------------------------------------------ [ 0, 1 ] 20983 2.652% 2.652% # ( 1, 2 ] 399273 50.460% 53.112% ########## ( 2, 3 ] 178154 22.515% 75.627% ##### ( 3, 4 ] 82113 10.377% 86.005% ## ( 4, 6 ] 77745 9.825% 95.830% ## ( 6, 10 ] 20972 2.650% 98.481% # ( 10, 15 ] 4054 0.512% 98.993% ( 15, 22 ] 590 0.075% 99.067% ( 22, 34 ] 67 0.008% 99.076% ( 34, 51 ] 42 0.005% 99.081% ( 51, 76 ] 47 0.006% 99.087% ( 76, 110 ] 590 0.075% 99.162% ( 110, 170 ] 2368 0.299% 99.461% ( 170, 250 ] 812 0.103% 99.564% ( 250, 380 ] 458 0.058% 99.621% ( 380, 580 ] 648 0.082% 99.703% ( 580, 870 ] 761 0.096% 99.800% ( 870, 1300 ] 898 0.113% 99.913% ( 1300, 1900 ] 694 0.088% 100.001% ( 1900, 2900 ] 584 0.074% 100.075% ( 2900, 4400 ] 632 0.080% 100.154% ( 4400, 6600 ] 204 0.026% 100.180% ( 6600, 9900 ] 63 0.008% 100.188% ( 9900, 14000 ] 14 0.002% 100.190% ( 14000, 22000 ] 8 0.001% 100.191% ( 22000, 33000 ] 5 0.001% 100.192% ( 33000, 50000 ] 6 0.001% 100.192% ** Level 4 read latency histogram (micros): Count: 492052 Average: 37.4376 StdDev: 250.85 Min: 1 Median: 2.0355 Max: 39982 Percentiles: P50: 2.04 P75: 3.69 P99: 561.99 P99.9: 2489.41 P99.99: 3515.30 ------------------------------------------------------ [ 0, 1 ] 13563 2.756% 2.756% # ( 1, 2 ] 229080 46.556% 49.312% ######### ( 2, 3 ] 95245 19.357% 68.669% #### ( 3, 4 ] 45166 9.179% 77.848% ## ( 4, 6 ] 40243 8.179% 86.027% ## ( 6, 10 ] 11474 2.332% 88.359% ( 10, 15 ] 1974 0.401% 88.760% ( 15, 22 ] 320 0.065% 88.825% ( 22, 34 ] 44 0.009% 88.834% ( 34, 51 ] 29 0.006% 88.840% ( 51, 76 ] 34 0.007% 88.847% ( 76, 110 ] 7248 1.473% 90.320% ( 110, 170 ] 28415 5.775% 96.095% # ( 170, 250 ] 8875 1.804% 97.898% ( 250, 380 ] 2931 0.596% 98.494% ( 380, 580 ] 2737 0.556% 99.050% ( 580, 870 ] 1690 0.343% 99.394% ( 870, 1300 ] 1305 0.265% 99.659% ( 1300, 1900 ] 828 0.168% 99.827% ( 1900, 2900 ] 609 0.124% 99.951% ( 2900, 4400 ] 470 0.096% 100.046% ( 4400, 6600 ] 168 0.034% 100.080% ( 6600, 9900 ] 39 0.008% 100.088% ( 9900, 14000 ] 11 0.002% 100.091% ( 14000, 22000 ] 3 0.001% 100.091% ( 22000, 33000 ] 5 0.001% 100.092% ( 33000, 50000 ] 3 0.001% 100.093% ** Level 5 read latency histogram (micros): Count: 322372 Average: 232.7686 StdDev: 489.81 Min: 77 Median: 148.8845 Max: 50854 Percentiles: P50: 148.88 P75: 196.61 P99: 2306.29 P99.9: 6122.71 P99.99: 9518.23 ------------------------------------------------------ ( 76, 110 ] 45971 14.260% 14.260% ### ( 110, 170 ] 177781 55.148% 69.408% ########### ( 170, 250 ] 54202 16.813% 86.222% ### ( 250, 380 ] 16759 5.199% 91.420% # ( 380, 580 ] 14297 4.435% 95.855% # ( 580, 870 ] 5521 1.713% 97.568% ( 870, 1300 ] 2500 0.776% 98.343% ( 1300, 1900 ] 1559 0.484% 98.827% ( 1900, 2900 ] 1379 0.428% 99.255% ( 2900, 4400 ] 1511 0.469% 99.723% ( 4400, 6600 ] 730 0.226% 99.950% ( 6600, 9900 ] 149 0.046% 99.996% ( 9900, 14000 ] 8 0.002% 99.998% ( 14000, 22000 ] 4 0.001% 100.000% ( 22000, 33000 ] 3 0.001% 100.001% ( 33000, 50000 ] 6 0.002% 100.002% ( 50000, 75000 ] 1 0.000% 100.003% ** DB Stats ** Uptime(secs): 31.0 total, 8.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 126.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.657 H:M:S, 50.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.142 H:M:S, 57.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 236.813 micros/op 16870 ops/sec 60.164 seconds 1014996 operations; 16.3 MB/s (252999 of 252999 found) Microseconds per read: Count: 1014996 Average: 236.8156 StdDev: 720.57 Min: 3 Median: 185.7334 Max: 117481 Percentiles: P50: 185.73 P75: 234.89 P99: 833.71 P99.9: 11266.72 P99.99: 30795.06 ------------------------------------------------------ ( 2, 3 ] 1 0.000% 0.000% ( 3, 4 ] 4 0.000% 0.000% ( 4, 6 ] 32 0.003% 0.004% ( 6, 10 ] 242 0.024% 0.027% ( 10, 15 ] 134 0.013% 0.041% ( 15, 22 ] 399 0.039% 0.080% ( 22, 34 ] 17676 1.741% 1.821% ( 34, 51 ] 5057 0.498% 2.320% ( 51, 76 ] 648 0.064% 2.384% ( 76, 110 ] 381 0.038% 2.421% ( 110, 170 ] 401714 39.578% 41.999% ######## ( 170, 250 ] 412931 40.683% 82.682% ######## ( 250, 380 ] 107131 10.555% 93.237% ## ( 380, 580 ] 45270 4.460% 97.697% # ( 580, 870 ] 15118 1.489% 99.186% ( 870, 1300 ] 3995 0.394% 99.580% ( 1300, 1900 ] 1212 0.119% 99.699% ( 1900, 2900 ] 817 0.080% 99.780% ( 2900, 4400 ] 686 0.068% 99.847% ( 4400, 6600 ] 232 0.023% 99.870% ( 6600, 9900 ] 188 0.019% 99.889% ( 9900, 14000 ] 339 0.033% 99.922% ( 14000, 22000 ] 510 0.050% 99.973% ( 22000, 33000 ] 222 0.022% 99.994% ( 33000, 50000 ] 43 0.004% 99.999% ( 50000, 75000 ] 13 0.001% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14824008 rocksdb.bloom.filter.full.positive COUNT : 1158957 rocksdb.bloom.filter.full.true.positive COUNT : 1014601 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 395 rocksdb.memtable.miss COUNT : 1014601 rocksdb.l0.hit COUNT : 43208 rocksdb.l1.hit COUNT : 10301 rocksdb.l2andup.hit COUNT : 961092 rocksdb.compaction.key.drop.new COUNT : 127769 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4431752 rocksdb.number.keys.read COUNT : 1014996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4573568064 rocksdb.bytes.read COUNT : 1014996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1528 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42175451 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16777338022 rocksdb.compact.write.bytes COUNT : 16640016860 rocksdb.flush.write.bytes COUNT : 4558156928 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 826 rocksdb.number.superversion_releases COUNT : 787 rocksdb.number.superversion_cleanups COUNT : 203 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 197 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4521233408 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1606656 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21098920477 rocksdb.non.last.level.read.count COUNT : 4953018 rocksdb.block.checksum.compute.count COUNT : 5231548 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 184.044467 P95 : 457.140688 P99 : 832.871341 P100 : 117479.000000 COUNT : 1014996 SUM : 239157364 rocksdb.db.write.micros P50 : 1.565993 P95 : 5.334987 P99 : 14.116996 P100 : 837629.000000 COUNT : 4431752 SUM : 54071521 rocksdb.compaction.times.micros P50 : 1406818.181818 P95 : 5537500.000000 P99 : 40200000.000000 P100 : 41129750.000000 COUNT : 55 SUM : 129059104 rocksdb.compaction.times.cpu_micros P50 : 941851.851852 P95 : 4575000.000000 P99 : 14451206.000000 P100 : 14451206.000000 COUNT : 55 SUM : 72381292 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 750.375000 P95 : 30250.000000 P99 : 194791.000000 P100 : 194791.000000 COUNT : 65 SUM : 466666 rocksdb.compaction.outfile.sync.micros P50 : 22846.153846 P95 : 165500.000000 P99 : 419900.000000 P100 : 454467.000000 COUNT : 158 SUM : 7514409 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 166.428571 P95 : 3775.000000 P99 : 5610.000000 P100 : 6403.000000 COUNT : 135 SUM : 120035 rocksdb.table.open.io.micros P50 : 9900.000000 P95 : 20971.821306 P99 : 29674.117647 P100 : 89029.000000 COUNT : 1528 SUM : 15613166 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.804726 P95 : 112.902916 P99 : 229.038451 P100 : 45625.000000 COUNT : 4061839 SUM : 79051964 rocksdb.read.block.get.micros P50 : 142.487761 P95 : 321.586188 P99 : 758.466982 P100 : 50931.000000 COUNT : 1168207 SUM : 196591825 rocksdb.write.raw.block.micros P50 : 0.552009 P95 : 1.629259 P99 : 4.793510 P100 : 93856.000000 COUNT : 5134219 SUM : 14920668 rocksdb.numfiles.in.singlecompaction P50 : 3.161765 P95 : 5.725000 P99 : 17.030000 P100 : 21.000000 COUNT : 71 SUM : 272 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574727 P95 : 1204.520027 P99 : 2536.219684 P100 : 837456.000000 COUNT : 233892 SUM : 42204293 rocksdb.sst.read.micros P50 : 2.104364 P95 : 183.113489 P99 : 468.807169 P100 : 50854.000000 COUNT : 4953096 SUM : 258602670 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1014996 SUM : 1014995000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4431752 SUM : 4573568064 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 219056.603774 P95 : 923750.000000 P99 : 1079092.000000 P100 : 1079092.000000 COUNT : 65 SUM : 18365559 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 198 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0