nfs/svn/apache strange interaction

[J. Bruce Fields]

On Tue, Apr 22, 2008 at 04:54:12PM +0200, Guillaume Rousse wrote:
> J. Bruce Fields a écrit :
> > On Mon, Apr 21, 2008 at 01:14:19PM -0400, J. Bruce Fields wrote:
> >> The value "3" is (1 & 2), so turns on two different types of debugging;
> >> the exact meaning of the flags depends on the syctl you set.  See the
> >> header files referred to on that wiki page for definitions.
> >>
> >> I think it'd be most interesting to look at the server, in particular
> >> at:
> >> 	NFSDDBG_FH | NFSDDBG_EXPORT | NFSDDBG_PROC | NFSDDBG_FILEOP
> >> 	== 0x02 & 0x04 & 0x10 & 0x20 == 54
> >>
> >> So:
> >>
> >> 	echo 54 >/proc/sys/sunrpc/nfsd_debug
> > 
> > By the way, rpcdebug seems to be installed on both Fedora and Debian,
> > and gives symbolic names to these flags, so may be a bit easier to deal
> > with; see:
> > 
> > 	rpcdebug -vh
> > 
> > for the choices.
> > 
> > Maybe we should document that on the wiki page instead of the sysctl's,
> > which nobody ever seems to understand....
> To be honest, I've understood the principle, but I thought they were
> nfs-utils headers, and I was too lazy to check. Indeed, rpcdebug (which
> is also included in nfs-utils package on mandriva) make it really easier.
> 
> Here is a syslog trace with suggested flags enabled on server side.
> There is a first http request for file index.txt, served correctly, at
> 15:40. The second http request, wich fails with a 404 error, happens at
> 15:41. Interestingly, the last reference to the requested file, which is
> a close operation, happens at 15:40:14.

There's also a putfh of that file at 41:19.  (Does that return the stale
error?  The fact that compound processing stops there suggest so.  We
should probably add a printk of the status at the end of the nfsd4
compound processing.... I haven't tried to use these dprintk's for
debugging recently!  A network trace might help confirm.)

> It means the http server doesn't request the file a second time, which
> seems to confirm apache behaviour of caching NFS inodes.

Looks like it tried to and failed.

So the file was almost certainly removed on the server.

Apache itself can't be caching the inode.  It could be holding it open,
but that seems unlikely.  (If so, it's a server bug, since the v4 open
should be holding the file open.)  So it's the client that got the stale
error.  Isn't it supposed to try revalidating the dentry in a case like
this before giving up?

--b.

> -- 
> Guillaume Rousse
> Moyens Informatiques - INRIA Futurs
> Tel: 01 69 35 69 62

> Apr 22 15:40:05 nation kernel: nfsd: fh_compose(exp 09:00/2 ///, ino=2)
> Apr 22 15:40:05 nation kernel: nfsv4 compound op #2: 10
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:07 nation kernel: nfsv4 compound op #2: 15
> Apr 22 15:40:07 nation kernel: nfsd: nfsd_lookup(fh 20: 00060001 f432cb1d db11a978 13002297 83025872 00000000, members)
> Apr 22 15:40:07 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:08 nation kernel: nfsd: fh_lock(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000) locked = 0
> Apr 22 15:40:08 nation kernel: nfsd: fh_compose(exp 09:00/2 //members, ino=7322625)
> Apr 22 15:40:08 nation kernel: nfsv4 compound op #3: 10
> Apr 22 15:40:08 nation kernel: nfsv4 compound op #4: 9
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:08 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:08 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:08 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:08 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:08 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #2: 9
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #2: 15
> Apr 22 15:40:09 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01, rousse)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01) locked = 0
> Apr 22 15:40:09 nation kernel: nfsd: fh_compose(exp 09:00/2 members/rousse, ino=5280780)
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #3: 10
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #4: 9
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:09 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:09 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #2: 15
> Apr 22 15:40:10 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c, public_html)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:10 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c) locked = 0
> Apr 22 15:40:10 nation kernel: nfsd: fh_compose(exp 09:00/2 rousse/public_html, ino=5281793)
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #3: 10
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #4: 9
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:10 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:10 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #2: 15
> Apr 22 15:40:11 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 00509801, index.txt)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:11 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801) locked = 0
> Apr 22 15:40:11 nation kernel: nfsd: fh_compose(exp 09:00/2 public_html/index.txt, ino=5281940)
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #3: 10
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #4: 9
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #1: 35
> Apr 22 15:40:11 nation kernel: NFSD: nfs4_make_rec_clidname for 193.55.250.161/193.55.250.6 AUTH_UNIX 0
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #1: 36
> Apr 22 15:40:11 nation kernel: NFSD: move_to_confirm nfs4_client f4c4f900
> Apr 22 15:40:11 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #2: 24
> Apr 22 15:40:11 nation kernel: nfsd: fh_compose(exp 09:00/2 ///, ino=2)
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #2: 32
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #3: 18
> Apr 22 15:40:11 nation kernel: NFSD: nfsd4_open filename .htaccess op_stateowner 00000000
> Apr 22 15:40:11 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:11 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 00509801, .htaccess)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:11 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801) locked = 0
> Apr 22 15:40:11 nation kernel: nfsd: fh_compose(exp 09:00/2 public_html/.htaccess, ino=5281826)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:11 nation kernel: nfs4_process_open2: stateid=(480dab6a/000000b0/00000090/00000000)
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #4: 10
> Apr 22 15:40:11 nation kernel: nfsv4 compound op #5: 9
> Apr 22 15:40:11 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #6: 31
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #7: 9
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #2: 20
> Apr 22 15:40:12 nation kernel: NFSD: nfsd4_open_confirm on file .htaccess
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:12 nation kernel: NFSD: preprocess_seqid_op: seqid=1 stateid = (480dab6a/000000b0/00000090/00000000)
> Apr 22 15:40:12 nation kernel: NFSD: find_stateid flags 0x7
> Apr 22 15:40:12 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:12 nation kernel: NFSD: nfsd4_open_confirm: success, seqid=1 stateid=(480dab6a/000000b0/00000090/00000001)
> Apr 22 15:40:12 nation kernel: NFSD: nfsd4_create_clid_dir for "ba733314a3d8014931a584abfcd20e3e"
> Apr 22 15:40:12 nation kernel: NFSD: nfsd4_create_clid_dir returns 0
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #2: 25
> Apr 22 15:40:12 nation kernel: NFSD: preprocess_stateid_op: stateid = (480dab6a/000000b0/00000090/00000001)
> Apr 22 15:40:12 nation kernel: NFSD: find_stateid flags 0x11
> Apr 22 15:40:12 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #2: 4
> Apr 22 15:40:12 nation kernel: NFSD: nfsd4_close on file .htaccess
> Apr 22 15:40:12 nation kernel: NFSD: preprocess_seqid_op: seqid=2 stateid = (480dab6a/000000b0/00000090/00000001)
> Apr 22 15:40:12 nation kernel: NFSD: find_stateid flags 0x45
> Apr 22 15:40:12 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:12 nation kernel: NFSD: move_to_close_lru nfs4_stateowner ed884000
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:12 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:12 nation kernel: nfsv4 compound op #2: 32
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #3: 18
> Apr 22 15:40:13 nation kernel: NFSD: nfsd4_open filename index.txt op_stateowner 00000000
> Apr 22 15:40:13 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:13 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 00509801, index.txt)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:13 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801) locked = 0
> Apr 22 15:40:13 nation kernel: nfsd: fh_compose(exp 09:00/2 public_html/index.txt, ino=5281940)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:13 nation kernel: nfs4_process_open2: stateid=(480dab6a/000000b1/00000091/00000000)
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #4: 10
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #5: 9
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #6: 31
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #7: 9
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #2: 20
> Apr 22 15:40:13 nation kernel: NFSD: nfsd4_open_confirm on file index.txt
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:13 nation kernel: NFSD: preprocess_seqid_op: seqid=1 stateid = (480dab6a/000000b1/00000091/00000000)
> Apr 22 15:40:13 nation kernel: NFSD: find_stateid flags 0x7
> Apr 22 15:40:13 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:13 nation kernel: NFSD: nfsd4_open_confirm: success, seqid=1 stateid=(480dab6a/000000b1/00000091/00000001)
> Apr 22 15:40:13 nation kernel: NFSD: nfsd4_create_clid_dir for "ba733314a3d8014931a584abfcd20e3e"
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:13 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:13 nation kernel: nfsv4 compound op #2: 25
> Apr 22 15:40:13 nation kernel: NFSD: preprocess_stateid_op: stateid = (480dab6a/000000b1/00000091/00000001)
> Apr 22 15:40:14 nation kernel: NFSD: find_stateid flags 0x11
> Apr 22 15:40:14 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:14 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:40:14 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:14 nation kernel: nfsv4 compound op #2: 4
> Apr 22 15:40:14 nation kernel: NFSD: nfsd4_close on file index.txt
> Apr 22 15:40:14 nation kernel: NFSD: preprocess_seqid_op: seqid=2 stateid = (480dab6a/000000b1/00000091/00000001)
> Apr 22 15:40:14 nation kernel: NFSD: find_stateid flags 0x45
> Apr 22 15:40:14 nation kernel: renewing client (clientid 480dab6a/00000045)
> Apr 22 15:40:14 nation kernel: NFSD: move_to_close_lru nfs4_stateowner f003d000
> Apr 22 15:40:14 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:40:14 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:40:14 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:40:36 nation kernel: NFSD: laundromat service - starting
> Apr 22 15:40:36 nation kernel: NFSD: laundromat_main - sleeping for 59 seconds
> Apr 22 15:40:50 nation kernel: nfs4_cb: server 193.55.250.161 not responding, timed out
> Apr 22 15:41:17 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:41:18 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:18 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 006fbc01)
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:18 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:18 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:18 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:18 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #2: 15
> Apr 22 15:41:19 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c, public_html)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c) locked = 0
> Apr 22 15:41:19 nation kernel: nfsd: fh_compose(exp 09:00/2 rousse/public_html, ino=5281793)
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #3: 10
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #4: 9
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509894)
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #2: 3
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 0050940c)
> Apr 22 15:41:19 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #1: 35
> Apr 22 15:41:19 nation kernel: NFSD: nfs4_make_rec_clidname for 193.55.250.161/193.55.250.6 AUTH_UNIX 0
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #1: 36
> Apr 22 15:41:19 nation kernel: NFSD: nfsd4_unlink_clid_dir. name ba733314a3d8014931a584abfcd20e3e
> Apr 22 15:41:19 nation kernel: NFSD: expire_client cl_count 1
> Apr 22 15:41:19 nation kernel: NFSD: move_to_confirm nfs4_client f4df2200
> Apr 22 15:41:19 nation kernel: renewing client (clientid 480dab6a/00000046)
> Apr 22 15:41:19 nation kernel: nfsv4 compound op #2: 24
> Apr 22 15:41:20 nation kernel: nfsd: fh_compose(exp 09:00/2 ///, ino=2)
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(20: 00060001 f432cb1d db11a978 13002297 83025872 00000000)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #2: 32
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #3: 18
> Apr 22 15:41:20 nation kernel: NFSD: nfsd4_open filename .htaccess op_stateowner 00000000
> Apr 22 15:41:20 nation kernel: renewing client (clientid 480dab6a/00000046)
> Apr 22 15:41:20 nation kernel: nfsd: nfsd_lookup(fh 28: 01060001 f432cb1d db11a978 13002297 83025872 00509801, .htaccess)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:20 nation kernel: nfsd: fh_lock(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801) locked = 0
> Apr 22 15:41:20 nation kernel: nfsd: fh_compose(exp 09:00/2 public_html/.htaccess, ino=5281826)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:20 nation kernel: nfs4_process_open2: stateid=(480dab6a/000000b2/00000092/00000000)
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #4: 10
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #5: 9
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #6: 31
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #7: 9
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509801)
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:20 nation kernel: nfsv4 compound op #2: 20
> Apr 22 15:41:20 nation kernel: NFSD: nfsd4_open_confirm on file .htaccess
> Apr 22 15:41:20 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:21 nation kernel: nfsd: fh_verify - just checking
> Apr 22 15:41:21 nation kernel: NFSD: preprocess_seqid_op: seqid=1 stateid = (480dab6a/000000b2/00000092/00000000)
> Apr 22 15:41:21 nation kernel: NFSD: find_stateid flags 0x7
> Apr 22 15:41:21 nation kernel: renewing client (clientid 480dab6a/00000046)
> Apr 22 15:41:21 nation kernel: NFSD: nfsd4_open_confirm: success, seqid=1 stateid=(480dab6a/000000b2/00000092/00000001)
> Apr 22 15:41:21 nation kernel: NFSD: nfsd4_create_clid_dir for "ba733314a3d8014931a584abfcd20e3e"
> Apr 22 15:41:21 nation kernel: NFSD: nfsd4_create_clid_dir returns 0
> Apr 22 15:41:21 nation kernel: nfsv4 compound op #1: 22
> Apr 22 15:41:21 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:21 nation kernel: nfsv4 compound op #2: 4
> Apr 22 15:41:21 nation kernel: NFSD: nfsd4_close on file .htaccess
> Apr 22 15:41:21 nation kernel: NFSD: preprocess_seqid_op: seqid=2 stateid = (480dab6a/000000b2/00000092/00000001)
> Apr 22 15:41:21 nation kernel: NFSD: find_stateid flags 0x45
> Apr 22 15:41:21 nation kernel: renewing client (clientid 480dab6a/00000046)
> Apr 22 15:41:21 nation kernel: NFSD: move_to_close_lru nfs4_stateowner f18e4ac0
> Apr 22 15:41:21 nation kernel: nfsv4 compound op #3: 9
> Apr 22 15:41:21 nation kernel: nfsd: fh_verify(28: 01060001 f432cb1d db11a978 13002297 83025872 00509822)
> Apr 22 15:41:21 nation kernel: nfsd: fh_verify - just checking