[9front] str2json and jsonfmt

[9front] str2json and jsonfmt

[Xiao-Yong Jin]

I wrote the following two json programs and found them helpful and
wanted to share with you.  Feel free to add it to the 9front
distribution if more people find them useful.

/* str2json.c */
#include <u.h>
#include <libc.h>
#include <json.h>

void
main(void)
{
	char *buf;
	long n;
	ulong m;
	struct JSON json;

	JSONfmtinstall();

	buf = nil;
	m = 0;
	for(;;){
		m += IOUNIT;
		buf = realloc(buf, m);
		if(!buf)
			sysfatal("realloc");
		n = readn(0, buf+m-IOUNIT, IOUNIT);
		if(n < IOUNIT){
			buf[m-IOUNIT+n] = '\0';
			break;
		}
	}

	json.t = JSONString;
	json.s = buf;

	print("%J", &json);

	free(buf);
	exits(nil);
}

/* jsonfmt.c */
#include <u.h>
#include <libc.h>
#include <json.h>

JSON*
jsonindex(JSON *j, vlong i)
{
	JSONEl *e;

	if(j->t != JSONArray){
		werrstr("not an array");
		return nil;
	}
	if(i < 0){
		werrstr("negative index");
		return nil;
	}
	for(e=j->first; e!=nil; e=e->next, --i)
		if(i==0)
			return e->val;
	werrstr("index out of bounds");
	return nil;
}

void
printjson(JSON *j, int raw)
{
	JSONEl *e;

	if(j->t == JSONString && raw)
		print("%s", j->s);
	else if(j->t == JSONArray && raw)
		for(e=j->first; e!=nil; e=e->next)
			print("%J\n", e->val);
	else
		print("%J\n", j);
}

void
usage(void)
{
	fprint(2, "usage: jsonfmt [-r] [names/indices...]\n");
	exits("usage");
}

void
main(int argc, char *argv[])
{
	char *buf;
	long n;
	ulong m;
	JSON *json, *obj;
	int i;
	int raw;

	JSONfmtinstall();

	buf = nil;
	m = 0;
	for(;;){
		m += IOUNIT;
		buf = realloc(buf, m);
		if(!buf)
			sysfatal("realloc");
		n = readn(0, buf+m-IOUNIT, IOUNIT);
		if(n < IOUNIT){
			buf[m-IOUNIT+n] = '\0';
			break;
		}
	}

	json = jsonparse(buf);
	if(!json)
		sysfatal("jsonfmt: %r");

	raw = 0;
	ARGBEGIN{
	case 'r':
		raw = 1;
		break;
	default:
		usage();
	}ARGEND

	if(argc == 0)
		printjson(json, raw);
	else for(i=0; i<argc; ++i){
		obj = nil;
		if(json->t==JSONObject)
			obj = jsonbyname(json, argv[i]);
		else if(json->t==JSONArray)
			obj = jsonindex(json, atoll(argv[i]));
		else
			werrstr("not a JSON array or object");
		if(obj)
			printjson(obj, raw);
		else
			sysfatal("jsonfmt: %r");
	}

	jsonfree(json);
	free(buf);
	exits(nil);
}

Re: [9front] str2json and jsonfmt

[cinap_lenrek]

nice!

thanks for sharing.

this might indeed become usefull for a mangadex fetcher.

--
cinap

Re: [9front] str2json and jsonfmt

[phil9]

I also wrote some json tool
(http://shithub.us/phil9/gj/HEAD/info.html) inspired by gron to make
json greppable.
umbraticus has a better version but I can never remember their site :)

Maybe we could have all these tools in a json subdir of /bin like
json/fmt, json/parse, json/grep

On Thu, Jan 25, 2024 at 9:08 AM <cinap_lenrek@felloff.net> wrote:
>
> nice!
>
> thanks for sharing.
>
> this might indeed become usefull for a mangadex fetcher.
>
> --
> cinap

Re: [9front] str2json and jsonfmt

[chris]

> umbraticus has a better version but I can never remember their site :)

Perhaps this one http://runjimmyrunrunyoufuckerrun.com/src/jb.c

Re: [9front] str2json and jsonfmt

[Dave MacFarlane]

I wrote something similar to OP's str2json which I call jsonfmt which
I use all the time, so I'm definitely in favour of including it.

If there's going to be a /bin/json/* hierarchy another candidate would
be a json/fs.  I have one that I wrote for myself here:
https://github.com/driusan/fedi9/blob/front/jsonfs.c to make it easier
to deal with json in shell scripts but I don't think it's very good or
up to 9front standards (it's not well documented and it can get
crash-y when you try and re-use same /mnt/json/ctl with different
json).  There may be other json/fs implementations out there in the
world.

Quoth phil9 <telephil9@gmail.com>:
> I also wrote some json tool
> (http://shithub.us/phil9/gj/HEAD/info.html) inspired by gron to make
> json greppable.
> umbraticus has a better version but I can never remember their site :)
> 
> Maybe we could have all these tools in a json subdir of /bin like
> json/fmt, json/parse, json/grep
> 
> On Thu, Jan 25, 2024 at 9:08 AM <cinap_lenrek@felloff.net> wrote:
> >
> > nice!
> >
> > thanks for sharing.
> >
> > this might indeed become usefull for a mangadex fetcher.
> >
> > --
> > cinap
> 

Re: [9front] str2json and jsonfmt

[Alex Musolino]

Quoth chris@chrisfroeschl.de:
> > umbraticus has a better version but I can never remember their site :)
> 
> Perhaps this one http://runjimmyrunrunyoufuckerrun.com/src/jb.c

How can you not remember that?! :)

Re: [9front] str2json and jsonfmt

[hiro]

> Maybe we could have all these tools in a json subdir of /bin like
> json/fmt, json/parse, json/grep

it seems extremely trivial. but with the right convention this seems
surprisingly powerful.

super obvious in hindsight now that you thought it out loud. and
that's probably why i like it so much.

Re: [9front] str2json and jsonfmt

[cinap_lenrek]

very interesting.

i tried jg but the problem with mangadex json was that
they had newlines in the values, which where not escaped
so the grep approach doesnt work so well.

a file-system to parse it might do the trick.

--
cinap

Re: [9front] str2json and jsonfmt

[Dave MacFarlane]

Quoth cinap_lenrek@felloff.net:
> very interesting.
> 
> i tried jg but the problem with mangadex json was that
> they had newlines in the values, which where not escaped
> so the grep approach doesnt work so well.
> 
> a file-system to parse it might do the trick.
> 
> --
> cinap
> 

*Not* escaped newlines? You mean their json looks something like:

"{
	"foo": "bar
baz"
}"?

That isn't valid JSON and even with a filesystem would (should) fail
when jsonparse() is called on it.  (The above example fails with
JSON.parse in both Firefox and Chrome, so if that is what you mean I'm
not sure how they do anything with it..)

Re: [9front] str2json and jsonfmt

[Steve simon]

Hi,

I wrote something similar a long time ago

https://9p.io/sources/contrib/steve/libjson.tbz       - json library for plan9
https://9p.io/sources/contrib/steve/json.tbz          - tools, only a json beautifier

there are similar ones for xml in a similar place.
The parsers are well tested (the XML one in particular) and pretty robust.

If they are of any use to anyone, feel free to take the code.

-Steve

Re: [9front] str2json and jsonfmt

[umbraticus]

> there are similar ones for xml in a similar place.

Yes, always meant to thank you for that & the docx/xlsx stuff.

Thanks!

Possibly distasteful to suggest adding these to 9front, and they
need a little love, but they are of more use than the doc2txt(1)
stuff that already is shipped.

umbraticus

Re: [9front] str2json and jsonfmt

[ori]

Quoth phil9 <telephil9@gmail.com>:
> 
> Maybe we could have all these tools in a json subdir of /bin like
> json/fmt, json/parse, json/grep

Yes, I like this idea -- I think this would make sense.

Re: [9front] str2json and jsonfmt

[Steve Simon]

makes sense to me too.

> On 26 Jan 2024, at 2:55 pm, ori@eigenstate.org wrote:
> 
> Quoth phil9 <telephil9@gmail.com>:
>> 
>> Maybe we could have all these tools in a json subdir of /bin like
>> json/fmt, json/parse, json/grep
> 
> Yes, I like this idea -- I think this would make sense.
>