NFS server on MooseFS client about moosefs

[xandrus]

Question is why you want to use NFS resharing?
And we are talking about NFS v3. Yes?

We have native MooseFS client for all available operating systems: Linux, FreeBSD, OSX. ...

We had a lot of problems with NFS, mainly because of FUSE and KERNEL.
Our recommendation is to not use NFS v3 + FUSE combination.

From the other hand we can try to use latest linux kernel and NFS v4 version.
I will return to this topic after few tests.

[oszafraniec]

FYI: We were exporting MFS volumes mounted on Ubuntu via NFSv3 to FreeBSD boxes because of problems with mfsmount @freebsd lately. It worked well without problems.

BTW> why NFS resharing? NFS has very good caching mechanisms on client side and can do async and for some cases it speeds up a lot file operations. It's not that bad solution sometimes.

[yinjiawind]

Hi, @xandrus

And we are talking about NFS v3. Yes?

No, My NFS version is v4.
Something like that

[root@YU-72 ~]# nfsstat
Server rpc stats:
calls      badcalls   badclnt    badauth    xdrcall
7719291    0          0          0          0       

Server nfs v4:
null         compound     
4         0% 7719298  99% 

Server nfs v4 operations:
op0-unused   op1-unused   op2-future   access       close        commit       
0         0% 0         0% 0         0% 1516658   6% 1485312   6% 212435    0% 
create       delegpurge   delegreturn  getattr      getfh        link         
371       0% 0         0% 11        0% 7489730  30% 1485726   6% 0         0% 
lock         lockt        locku        lookup       lookup_root  nverify      
0         0% 0         0% 0         0% 495       0% 0         0% 0         0% 
open         openattr     open_conf    open_dgrd    putfh        putpubfh     
1485622   6% 0         0% 5         0% 0         0% 7705031  31% 0         0% 
putrootfh    read         readdir      readlink     remove       rename       
4         0% 1117      0% 174       0% 0         0% 1110      0% 0         0% 
renew        restorefh    savefh       secinfo      setattr      setcltid     
13951     0% 0         0% 0         0% 0         0% 9         0% 4         0% 
setcltidconf verify       write        rellockowner bc_ctl       bind_conn    
4         0% 0         0% 2796802  11% 0         0% 0         0% 0         0% 
exchange_id  create_ses   destroy_ses  free_stateid getdirdeleg  getdevinfo   
0         0% 0         0% 0         0% 0         0% 0         0% 0         0% 
getdevlist   layoutcommit layoutget    layoutreturn secinfononam sequence     
0         0% 0         0% 0         0% 0         0% 0         0% 0         0% 
set_ssv      test_stateid want_deleg   destroy_clid reclaim_comp 
0         0% 0         0% 0         0% 0         0% 0         0% 

Client rpc stats:
calls      retrans    authrefrsh
32041      8          32041   

Client nfs v4:
null         read         write        commit       open         open_conf    
0         0% 3         0% 1         0% 0         0% 17        0% 2         0% 
open_noat    open_dgrd    close        setattr      fsinfo       renew        
0         0% 0         0% 8         0% 3         0% 22        0% 1471      4% 
setclntid    confirm      lock         lockt        locku        access       
3         0% 3         0% 0         0% 0         0% 0         0% 21        0% 
getattr      lookup       lookup_root  remove       rename       link         
1524      4% 41        0% 6         0% 0         0% 0         0% 0         0% 
symlink      create       pathconf     statfs       readlink     readdir      
0         0% 0         0% 16        0% 28846    90% 0         0% 8         0% 
server_caps  delegreturn  getacl       setacl       fs_locations rel_lkowner  
38        0% 3         0% 0         0% 0         0% 0         0% 0         0% 
secinfo      exchange_id  create_ses   destroy_ses  sequence     get_lease_t  
0         0% 0         0% 0         0% 0         0% 0         0% 0         0% 
reclaim_comp layoutget    getdevinfo   layoutcommit layoutreturn getdevlist   
0         0% 0         0% 0         0% 0         0% 0         0% 0         0% 
(null)       
0         0% 

[yinjiawind]

Hi， @xandrus
This problem does not happen in CentOS 7.
System Info:

[root@YU-74 /tmp]
>nfsstat -m
/tmp/test from 192.168.0.73:/mnt/mfs/nfs-share # "/mnt/mfs" is mountpoint
 Flags:	rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.0.73,mountvers=3,mountport=20048,mountproto=udp,local_lock=none,addr=192.168.0.73

[root@YU-74 /tmp]
>uname -a
Linux YU-74 3.10.0-327.el7.x86_64 #1 SMP Thu Nov 19 22:10:57 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

[root@YU-73 /]
>mfsmount -V
MFS version 3.0.86-1
FUSE library version: 2.9.2
fusermount version: 2.9.2

[xandrus]

Hi,
I would like to add that you should test ganesha nfs software.
This specific NFS server works on user-mode site, so it should cooperate with MooseFS without any problems.

[yinjiawind]

Thank you!

[xandrus]

No problem.
Thank you.