Thoughts on
https://github.com/jedisct1/libsodium
? I haven't dug too much into the code.