allenbh / ntrdma-old Goto Github PK

Hello Allen,

I really appreciate your work on NTRDMA driver. I go through all the instruction at https://github.com/allenbh/ntrdma/wiki to setup NTRDMA software stack on my HW platform (a 2U-2N Intel-based server with NTB connection between two nodes). Following is some Platform information I got after all:

Processor: Intel(R) Xeon(R) CPU E5-2658 v4@ 2.30GHz
[root@localhost ~]# lspci -s 00:03.0
00:03.0 Bridge: Intel Corporation Device 6f0d (rev 01)
[root@localhost ~]# uname -a
Linux localhost.localdomain 4.3.0+ #1 SMP Tue Jul 19 04:34:29 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux
[root@localhost ~]# cat /sys/class/infiniband_verbs/uverbs0/device/vendor
0x8086
[root@localhost ~]# cat /sys/class/infiniband_verbs/uverbs0/device/device
0x6f0d
[root@localhost ~]# cat /sys/class/infiniband/ntrdma_0/device/vendor
0x8086
[root@localhost ~]# cat /sys/class/infiniband/ntrdma_0/device/device
0x6f0d
[root@localhost ~]# lsmod | grep ntb
ntc_ntb_msi 24576 0
ntc_phys 16384 1 ntc_ntb_msi
ntc 16384 2 ntc_ntb_msi,ntrdma
ntb_hw_intel 40960 0
ntb 16384 2 ntc_ntb_msi,ntb_hw_intel
[root@localhost ~]# lsmod | grep rdma
rpcrdma 81920 0
rdma_ucm 24576 0
rdma_cm 45056 4 rpcrdma,ib_iser,rdma_ucm,ib_isert
ib_cm 45056 5 rdma_cm,ib_srp,ib_ucm,ib_srpt,ib_ipoib
iw_cm 45056 1 rdma_cm
ib_sa 36864 5 rdma_cm,ib_cm,ib_srp,rdma_ucm,ib_ipoib
ib_uverbs 53248 2 ib_ucm,rdma_ucm
ntrdma 94208 0
ntc 16384 2 ntc_ntb_msi,ntrdma
ib_core 110592 16 rdma_cm,ib_cm,ib_sa,iw_cm,rpcrdma,ib_mad,ib_srp,ib_ucm,ntrdma,ntc_phys,ib_iser,ib_srpt,ib_umad,ib_uverbs,ib_ipoib,ib_isert
ib_addr 16384 3 rdma_cm,ib_core,rdma_ucm
sunrpc 327680 8 nfsd,auth_rpcgss,lockd,rpcrdma,nfs_acl

[root@localhost ~]# ibv_rc_pingpong
No IB devices found

As you can see, even though the IB Verb device was created successfully, it's unable to be found by "ibv_rc_pingpong". Do you have any idea?