[00:29:08] *** Joins: tomzawadzki (~tzawadzk@192.55.54.36) [01:22:30] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [02:13:10] *** Joins: consus (~Unknown@2001:0:53aa:64c:10e9:6aaf:aa8d:fad5) [02:13:14] Folks [02:13:16] Hi [02:14:31] Do I have an option to run nvmeof client/server via TCP/UDP without RDMA support? It would be easier to run functional tests without a need for a bunch of expensive RDMA cards. [03:40:42] *** Quits: tsuyoshi (b42b2067@gateway/web/freenode/ip.180.43.32.103) (Quit: Page closed) [04:35:51] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [04:42:56] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [05:47:26] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [05:56:25] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [07:11:17] *** Quits: tomzawadzki (~tzawadzk@192.55.54.36) (Ping timeout: 245 seconds) [07:13:19] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [08:19:34] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [08:42:42] consus: There is no defined support for pure TCP or UDP in the NVMe-oF specification, so no [08:42:47] but you do have a few potential options [08:43:08] there is soft RoCE v2 in recent Linux kernels [08:43:15] so you can use software to emulate RDMA [08:43:31] I don't know how solid that code is in the kernel - it is very new [08:43:40] Well [08:43:44] I've read the code [08:43:58] Implementing udp transport will be very trivial [08:44:15] The performance will suck of course [08:44:21] yes - we've implemented a TCP transport as a simple proof [08:44:25] but it isn't officially in the spec yet [08:44:38] it is something that the NVMe-oF spec committee is currently discussing [08:44:47] so there isn't any released code [08:45:01] AFAIR there is an option for tcp transport in linux kernel [08:45:18] I'm not aware of one - is that documented somewhere? [08:45:26] Let me check [08:45:27] I know someone submitted a patch to add it and it was rejected [08:45:34] (because it isn't in the spec yet) [08:46:06] Nah [08:46:12] rdma/loop/fc [08:46:18] Apparently I was wrong [08:46:54] I'm in the spec working group that will ultimately define the TCP transport [08:47:09] if the wider community agrees that there should b eone [08:47:23] so work is definitely ongoing, but nothing is committed yet [08:47:44] I agree with your assessment that it is very easy to implement in SPDK [08:48:05] Nah, I'm not implying that you guys should support it [08:48:16] I will write my own stuff if I'll need it [08:48:29] Maybe I'll post it if it's useful [08:48:32] the main problem it previously solved for us was to run without having RDMA hardware [08:48:45] so we wrote up a TCP transport just for testing in our early days [08:48:52] fortunately we now have plenty of RDMA NICs [08:48:58] so we just test on the real thing [08:49:11] But I'm considering writing my own protocol on pure verbs + udp so it's a vague option [08:49:26] but it's fairly clear that any other developer isn't going to have access to tons of RDMA NICs [08:49:39] keep us up to date if you do something in this area [08:49:45] Sure [08:53:12] *** Quits: consus (~Unknown@2001:0:53aa:64c:10e9:6aaf:aa8d:fad5) (Quit: Lost terminal) [09:12:52] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [09:36:57] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [09:57:16] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [09:58:51] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [10:13:57] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [12:13:23] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [12:41:34] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [12:51:10] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [13:26:33] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [13:42:37] *** Joins: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) [17:30:33] *** Quits: gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) (Quit: My Mac Pro has gone to sleep. ZZZzzz…) [23:35:16] *** Joins: tsuyoshi (b42b2067@gateway/web/freenode/ip.180.43.32.103)