[9fans] replica

[9fans] replica

[Richard Bilson]

I attempted to update my system using replica tonight, using glenda's
pull script, but as bootes and from the file server console. What
seems to have happened is that replica believed that every file ought
to be deleted. I stopped it before it made it out of /sys/src, so my
system is still usable.

Questions:

- Why?

- What can I do to avoid this in future?

- Is there an easy way to get the files resynchronized with sources?
If I try "replica/pull -v /dist/replica/network", it tells me

sys/src/9/ip/devip.c: not replicated; will not update
sys/src/9/pc/etherigbe.c: not replicated; will not update
sys/src/9/pc/fns.h: not replicated; will not update

etc.

I just realized that I didn't have a writable /tmp, so the pull would
have failed anyway, but I usually expect an error message in this
case, not devastation.

- Richard

Re: [9fans] replica

[Lyndon Nerenberg]

> - What can I do to avoid this in future?

Don't Panic!

It's not just you -- I saw the same thing when I ran pull this afternoon. 
It kind of looks like Russ pushed some changes that had the side effect of 
touching a whole lot of stuff.  Or maybe was intentional -- I had to leave 
before it was done, but my that point it was already putting stuff back.

I'll try to drawterm into the server in a little while and see how it's 
doing.

Re: [9fans] replica

[geoff]

Our main file server, edith, developed bad spots in its /n/other
partition, so we took /n/other out of service until we sort it out.
Unfortunately, a lot of the machinery that maintains sources lives
there.  We'll be working on this problem on Friday.

Re: [9fans] replica

[Martin Neubauer]

* geoff@plan9.bell-labs.com (geoff@plan9.bell-labs.com) wrote:
> Our main file server, edith, developed bad spots in its /n/other
> partition, so we took /n/other out of service until we sort it out.
> Unfortunately, a lot of the machinery that maintains sources lives
> there.  We'll be working on this problem on Friday.

No sweat. I ran a pull last night, too, and all the current situation
means is that everything gets thrown away and pulled afresh afterwards.
Not for the faint of heart though.

Re: [9fans] replica

[geoff]

jmk recovered edith's /n/other onto a new disk on Friday.  The old
disk had developed bad spots and trying to read it wedged edith,
repeatedly and with no messages.

With some guidance from Russ, I've restored
/n/sourcesdump/2006/0824/plan9/dist/replica/plan9.^(db log) on
sources.  pull -n at collyer.net seems to be sane again, so I hope it
will be for everyone else.

Re: [9fans] replica

[Richard Bilson]

> With some guidance from Russ, I've restored
> /n/sourcesdump/2006/0824/plan9/dist/replica/plan9.^(db log) on
> sources.  pull -n at collyer.net seems to be sane again, so I hope it
> will be for everyone else.

Works for me too. Thanks very much for getting this working again.

- Richard

[9fans] Pegasus 2.2 is released

[arisawa]

Hello,

Pegasus 2.2 is released.
New supports are digest authentication, CGI/1.1, etc.
and some CGI tools are added.

Take a look at http://plan9.aichi-u.ac.jp/pegasus/eman-2.2/
The source files are http://plan9.aichi-u.ac.jp/netlib/pegasus-2.2.tgz

Bug report to me.
Please enjoy!

Kenji Arisawa
Email: arisawa@aichi-u.ac.jp

Re: [9fans] Pegasus 2.2 is released

[Skip Tavakkolian]

> Pegasus 2.2 is released.
> New supports are digest authentication, CGI/1.1, etc.
> and some CGI tools are added.

this is great.  rit is cool.  i'm wondering now that js is available
in plan9, if it could be integrated into a cgi environment? it seems
that rit could easily run different types of script handlers and invoke
them like <!--js ... --> or <!--rc --> since that's a natural
syntax for html.

would it be difficult to integrate this digest authentication into
standard httpd?

Re: [9fans] Pegasus 2.2 is released

[arisawa]

Hello,

> it seems
> that rit could easily run different types of script handlers and  
> invoke
> them like <!--js ... --> or <!--rc --> since that's a natural
> syntax for html.

I also considered that, and finally stopped to do so.
That makes things complicated and makes coding difficult.
If we want other scripting tool, we can do it as a command of "rc".
I love "rc". "rc" is best for me.

Of course js can be embedded in text part of rc as follows:
	some text <!--js ... -> other text
	${ # rc codes follow ..
	.....}
  	text continues

> would it be difficult to integrate this digest authentication into
> standard httpd?

Implementing digest authentication is not difficult.
However, if we want to change owner of running httpd by digest  
authentication,
then we should consider many many problems.

Thanks Skip for your comments.

Kenji Arisawa

Re: [9fans] Pegasus 2.2 is released

[Lyndon Nerenberg]

> Implementing digest authentication is not difficult.
> However, if we want to change owner of running httpd by digest 
> authentication,
> then we should consider many many problems.

Digest is a bit of a hybrid in that it does authentication, and also 
provides data integrity and protection.  It would be nice to implement the 
transport layer part in a manner analogous to TLS.  I'm currently hacking 
on Plan 9's IMAP support, and SASL DIGEST with encryption is high on the 
TODO list. (It's a toss-up as to whether DIGEST-MD5 or STARTTLS has the 
wider deployment, but software that supports one tends not to support the 
other, so it's useful to have both for interoperability's sake.)

--lyndon

Re: [9fans] Pegasus 2.2 is released

[Skip Tavakkolian]

> The source files are http://plan9.aichi-u.ac.jp/netlib/pegasus-2.2.tgz

is rit packaged separately?

Re: [9fans] Pegasus 2.2 is released

[arisawa]

> is rit packaged separately?
>

Yes, look http://plan9.aichi-u.ac.jp/netlib/

Kenji Arisawa

[9fans] Re: Pegasus 2.2 is released

[Dave Eckhardt]

My apologies for the broadcast, but my mail to Kenji Arisawa
timed out after failing for 3 days as follows:

   ----- Transcript of session follows -----
... while talking to ar.aichi-u.ac.jp.:
>>> DATA
<<< 450 deferred: smtp ping: smtp: dns: dns failure (/net/tcp!lunacy.ugrad.cs.cmu.edu)
<arisawa@ar.aichi-u.ac.jp>... Deferred: 450 deferred: smtp ping: smtp: dns: dns failure (/net/tcp!lunacy.ugrad.cs
.cmu.edu)

If it looks as if this is due to something on this end, please
let me know...

Dave Eckhardt

Re: [9fans] Re: Pegasus 2.2 is released

[arisawa]

Hello Dave,

It seems my machine "ar.aichi-u.ac.jp" dislikes your machine  
"lunacy.ugrad.cs.cmu.edu",
although your machine is observed by the command ndb/dnsdebug on my  
machine.
I don't know the reason. Sorry...

Please send your mail to my official mail address: arisawa@aichi-u.ac.jp

Kenji Arisawa

Re: [9fans] Re: Pegasus 2.2 is released

[erik quanstrom]

cmu.edu is returning bogus results.  dig from linux returns "connection reset" on tcp and a truncated
query on udp.  ndb/dnsquery has better results, but for returns only this for a "cmu.edu any" query

; ndb/dnsquery
> cmu.edu any
cmu.edu txt	[NRDR16452_IN_MX_10.CMU-MX1.ANDREW.CMU.EDU.wRx2sgedR34KMLeiHlkHpA]
> cmu.edu ip
cmu.edu ip	128.2.10.162
cmu.edu ip	128.2.10.163

- erik

[9fans] Re: Pegasus 2.2 is released

[Dave Eckhardt]

> cmu.edu is returning bogus results.  dig from linux returns "connection
> reset" on tcp and a truncated query on udp.

Weird--not for me (off campus and not particularly short-haul).

What I see with dig, straight at the 3 CMU.EDU servers, is a response
truncated due to "excessive" size (e.g., 779 bytes) and apparently-ok
responses via TCP.  That is:

	dig +tcp @t-ns2-sec.net.cmu.edu any cmu.edu
	dig +tcp @cabbage.srv.cs.cmu.edu any cmu.edu
	dig +tcp @t-ns1.net.cmu.edu any cmu.edu

If I ask my LinkSys, what I get back is 102 bytes--lots of stuff trimmed
out, apparently by speakeasy.net DNS servers.

Are the queries failing for you being made directly, or is there maybe
some issue involving an intermediate DNS server?

Thanks for letting me know something odd is going on...

Dave Eckhardt

Re: [9fans] Re: Pegasus 2.2 is released

[erik quanstrom]

i was using the Level3-provided dns servers (speakeasy dialup).
it all seems better today.

- erik

[9fans] i need someone to pinpoint a sample program for me : )

[bituman]

Ahoi all...
Ive been using my plan9 installation for a while. Now i feel comfortable 
enough to start some coding.
Im like lets starts something basic (basic might be a relative term), 
like a server that exports a ctl and a data file,
every line written to ctl can be read from data with the letters sorted.
Id like someone to pinpoint a sample program for me that exports files, 
the most basic such program will do the trick i guess.
Thanks in advance
bituman

Re: [9fans] i need someone to pinpoint a sample program for me : )

[Gabriel Diaz]

Hello

a great sample is /sys/src/lib9p/ramfs.c

gabi


On 8/31/06, bituman <bituman@enerla.net> wrote:
> Ahoi all...
> Ive been using my plan9 installation for a while. Now i feel comfortable
> enough to start some coding.
> Im like lets starts something basic (basic might be a relative term),
> like a server that exports a ctl and a data file,
> every line written to ctl can be read from data with the letters sorted.
> Id like someone to pinpoint a sample program for me that exports files,
> the most basic such program will do the trick i guess.
> Thanks in advance
> bituman
>

Re: [9fans] i need someone to pinpoint a sample program for me : )

[rog]

> a great sample is /sys/src/lib9p/ramfs.c

actually, i don't find this a particularly good example, because it implements
an arbitrarily structured namespace, whereas most simpler fileservers serve
a static or highly structured namespace.

9p(2) can remove some of the drudgework.

Re: [9fans] i need someone to pinpoint a sample program for me : )

[Gabriel Diaz]

Hello,

I put the sample thinking more on 9p than in ramfs particulary.

With that ramfs.c, 9p(2) and 9pfile(2) is "easy" to build what he
wants. At least i found it easier than reading nntpfs.c and the other
samples that do not use 9p and have a syntetic fs.

I think this has been discused in 9fans time ago, but didn't remember
what the conclusion was (producing more samples :-? )

nemo's book looks promising, i will read it to learn some things too.
I hope that the "magic" around the qids,fids and refs get explained.

gabi


On 8/31/06, rog@vitanuova.com <rog@vitanuova.com> wrote:
> > a great sample is /sys/src/lib9p/ramfs.c
>
> actually, i don't find this a particularly good example, because it implements
> an arbitrarily structured namespace, whereas most simpler fileservers serve
> a static or highly structured namespace.
>
> 9p(2) can remove some of the drudgework.
>

Re: [9fans] i need someone to pinpoint a sample program for me : )

[Russ Cox]

> nemo's book looks promising, i will read it to learn some things too.
> I hope that the "magic" around the qids,fids and refs get explained.

after reading intro(5) there should be no magic around qids and fids anymore.
and ref is just a reference count.

russ

Re: [9fans] i need someone to pinpoint a sample program for me : )

[rog]

> after reading intro(5) there should be no magic around qids and fids anymore.
> and ref is just a reference count.

i have thought in the past that the man pages could make it
clearer how ref counts interact with clunk - i.e. that a client will never
send a clunk while there are outstanding transactions on the fid.
this (i think) falls naturally from the way things are implemented
in plan 9, but might not be obvious to those writing servers (or
new clients).

Re: [9fans] i need someone to pinpoint a sample program for me : )

[Russ Cox]

> i have thought in the past that the man pages could make it
> clearer how ref counts interact with clunk - i.e. that a client will never
> send a clunk while there are outstanding transactions on the fid.
> this (i think) falls naturally from the way things are implemented
> in plan 9, but might not be obvious to those writing servers (or
> new clients).

i don't actually know how ref counts interact with clunk.
certainly the plan 9 kernels don't send clunks of fids with
transactions outstanding, but there is nothing in section 5
that says this is a requirement, and even if there were,
robust servers would do well to detect that case anyway.

much of the ref counting in lib9p exists for exactly this purpose,
to do something sensible even when the client doesn't.

russ

Re: [9fans] i need someone to pinpoint a sample program for me : )

[rog]

> I put the sample thinking more on 9p than in ramfs particulary.

... and i'm sorry because i didn't read the source path name properly. i'd forgotten
there was a ramfs example in lib9p, and was thinking you'd pointed to /sys/src/cmd/ramfs.c
which is a different beast entirely (and has been recommended as an example in the past).
i'd agree that /sys/src/lib9p/ramfs.c is a useful example.

Re: Re: [9fans] i need someone to pinpoint a sample program for me : )

[David Leimbach]

On 8/31/06, Gabriel Diaz <gabidiaz@gmail.com> wrote:
> Hello
>
> a great sample is /sys/src/lib9p/ramfs.c
>
I disagree, I tried to learn from that and the code seems to make some
shortcuts around certain issues.  It also seems to label itself as a
"toy" in the comments.

It works well enough for how I'm using it though :-)

> gabi
>
>
> On 8/31/06, bituman <bituman@enerla.net> wrote:
> > Ahoi all...
> > Ive been using my plan9 installation for a while. Now i feel comfortable
> > enough to start some coding.
> > Im like lets starts something basic (basic might be a relative term),
> > like a server that exports a ctl and a data file,
> > every line written to ctl can be read from data with the letters sorted.
> > Id like someone to pinpoint a sample program for me that exports files,
> > the most basic such program will do the trick i guess.
> > Thanks in advance
> > bituman
> >
>

Re: Re: Re: [9fans] i need someone to pinpoint a sample program for me : )

[David Leimbach]

On 8/31/06, David Leimbach <leimy2k@gmail.com> wrote:
> On 8/31/06, Gabriel Diaz <gabidiaz@gmail.com> wrote:
> > Hello
> >
> > a great sample is /sys/src/lib9p/ramfs.c
> >
> I disagree, I tried to learn from that and the code seems to make some
> shortcuts around certain issues.  It also seems to label itself as a
> "toy" in the comments.
>
> It works well enough for how I'm using it though :-)

Heh, looks like I made the same mistake as rog.... D'oh!
>
> > gabi
> >
> >
> > On 8/31/06, bituman <bituman@enerla.net> wrote:
> > > Ahoi all...
> > > Ive been using my plan9 installation for a while. Now i feel comfortable
> > > enough to start some coding.
> > > Im like lets starts something basic (basic might be a relative term),
> > > like a server that exports a ctl and a data file,
> > > every line written to ctl can be read from data with the letters sorted.
> > > Id like someone to pinpoint a sample program for me that exports files,
> > > the most basic such program will do the trick i guess.
> > > Thanks in advance
> > > bituman
> > >
> >
>

Re: [9fans] i need someone to pinpoint a sample program for me : )

[Sergey Zhilkin]

[-- Attachment #1: Type: text/plain, Size: 661 bytes --]

Hi !!!
Here is a sample - http://rs-rlab.narod.ru/dev9b.html
Documentation in russian (sorry)
Have a nice day ! :)


2006/8/31, bituman <bituman@enerla.net>:
>
> Ahoi all...
> Ive been using my plan9 installation for a while. Now i feel comfortable
> enough to start some coding.
> Im like lets starts something basic (basic might be a relative term),
> like a server that exports a ctl and a data file,
> every line written to ctl can be read from data with the letters sorted.
> Id like someone to pinpoint a sample program for me that exports files,
> the most basic such program will do the trick i guess.
> Thanks in advance
> bituman
>

[-- Attachment #2: Type: text/html, Size: 968 bytes --]

Re: [9fans] i need someone to pinpoint a sample program for me : )

[Sascha Retzki]

> Ahoi all...
> Im like lets starts something basic (basic might be a relative term), 
> like a server that exports a ctl and a data file,
> every line written to ctl can be read from data with the letters sorted.


I did something like this some long time ago, I was told that using 9p(2)/9pfile(2) for such tiny things, which file structure does not change much is not suggested - I actually did not get that.

Anyway, this may not even compile, I copied out of a source-tree. You want to read it and understand every line, anyway, do you? ;)

#include <u.h>
#include <libc.h>
#include <fcall.h>
#include <thread.h>
#include <9p.h>

Srv *daefs;

/*
our file layout. Note that the enum Qstatus is
used in daefsfiles_create() to determine the size
of the array. Either fix the function or add files 
(in any) before Qstatus.
*/
enum {
	Qctl,
	Qout,
	Qstatus,
};
struct {
	char name[20]; /* name of the file */
	ulong mode;	/* permission mode */
	File *file;		/* File-struct used by createfile() */
	char *data;	/* The data this file contains */
} daefsfiles[] = {
	"ctl",		0666, nil, nil,
	"output",	0444, nil, nil,
	"status",	0444, nil, nil,
};



void daefs_write(Req *r) {
	int i, myQid = (int)r->fid->file->qid.path;

	if(myQid > Qstatus)
			sysfatal("unknown Qid %d in write-call\n",myQid);

	for(i=0;i+r->ifcall.offset < FILESIZE && i < r->ifcall.count;i++) {
		daefsfiles[myQid].data[i+r->ifcall.offset] = r->ifcall.data[i];
		r->ofcall.count++;
	}
	daefsfiles[myQid].file->length = r->ifcall.offset + r->ifcall.count;

	
	if(myQid == Qctl) {
		char *msg = daefsfiles[Qctl].data;
		// Do your processing...

		// Copy the string
		strcpy(daefsfiles[Qstatus].data,msg);
		// Do not forget to set the new length of the file, for stat(5) etc.
		daefsfiles[Qstatus].file->length =  strlen(msg);
	}

	respond(r,nil);
}

void daefs_read(Req *r) {
	readstr(r,daefsfiles[(int)r->fid->file->qid.path].data);
	respond(r,nil);	
}


void daefsfiles_create(void) {
	int i;

	if((daefs->tree = alloctree("daefs","daefs",DMDIR|0777,nil)) == nil)
		sysfatal("daefs: daefsfiles_create(): alloctree() == nil");

	for(i=0;i<=Qstatus;i++) {

		daefsfiles[i].data = emalloc9p(FILESIZE);

		if((daefsfiles[i].file = createfile(daefs->tree->root, daefsfiles[i].name,"daefs", daefsfiles[i].mode,(void *)daefsfiles[i].data)) == nil)
			sysfatal("daefs: daefsfiles_create() for file \"%s\": createfile() == nil\n",daefsfiles[i].name);

	}

	daefs_status("ready\n");
}

void main(int argc, char **argv) {
	char *mtpt = "/n/daefs/";
	daefs = emalloc9p(sizeof(Srv));
	daefs->write = daefs_write;
	daefs->read = daefs_read;
	daefsfiles_create();
	threadpostmountsrv(daefs,"daefs",mtpt,0);
}